Ceph bench 16.2.5
Backend info: 3 backend hosts, 40gbps NIC, 24 NVME, ceph 16.2.5 from eucephcom
Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom
Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off
Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images.
Images are fully pre-written.
Each fio test is executed for 15 mins. Each suite conist 25 fio runs.
Each suite is repeated 3 times, thus 3 results.
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}
1649463163-16.2.5-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
8 021 |
63 895 |
286 284 |
623 344 |
| 4k 4 randrw W |
74 650 |
72 733 |
63 897 |
31 765 |
0 |
| 4k 32 randrw R |
0 |
9 486 |
76 229 |
304 056 |
606 506 |
| 4k 32 randrw W |
88 198 |
85 873 |
76 227 |
33 718 |
0 |
| 4k 64 randrw R |
0 |
9 654 |
78 271 |
304 224 |
626 799 |
| 4k 64 randrw W |
89 377 |
87 444 |
78 267 |
33 749 |
0 |
| 64k 4 rw R |
0 |
5 249 |
55 815 |
160 189 |
198 460 |
| 64k 4 rw W |
55 433 |
47 762 |
55 811 |
17 745 |
0 |
| 64k 64 rw R |
0 |
7 431 |
64 559 |
162 227 |
197 707 |
| 64k 64 rw W |
66 839 |
67 379 |
64 564 |
17 964 |
0 |
1649486028-16.2.5-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
1 550 |
13 416 |
101 785 |
597 881 |
| 4k 4 randrw W |
16 316 |
14 458 |
13 423 |
11 251 |
0 |
| 4k 32 randrw R |
0 |
4 008 |
33 888 |
141 055 |
597 632 |
| 4k 32 randrw W |
34 965 |
36 527 |
33 885 |
15 627 |
0 |
| 4k 64 randrw R |
0 |
7 937 |
67 813 |
217 083 |
604 882 |
| 4k 64 randrw W |
61 488 |
71 954 |
67 801 |
24 066 |
0 |
| 64k 4 rw R |
0 |
2 089 |
18 016 |
108 265 |
198 321 |
| 64k 4 rw W |
20 840 |
19 302 |
18 023 |
11 970 |
0 |
| 64k 64 rw R |
0 |
7 233 |
64 298 |
162 347 |
197 425 |
| 64k 64 rw W |
62 449 |
65 553 |
64 316 |
17 987 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-80.67 |
-79.00 |
-64.45 |
-4.08 |
| 4k 4qd randrw W |
-78.14 |
-80.12 |
-78.99 |
-64.58 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-57.75 |
-55.54 |
-53.61 |
-1.46 |
| 4k 32qd randrw W |
-60.36 |
-57.46 |
-55.55 |
-53.65 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-17.79 |
-13.36 |
-28.64 |
-3.50 |
| 4k 64qd randrw W |
-31.20 |
-17.71 |
-13.37 |
-28.69 |
0.00 |
| 64k 4qd rw R |
0.00 |
-60.20 |
-67.72 |
-32.41 |
-0.07 |
| 64k 4qd rw W |
-62.40 |
-59.59 |
-67.71 |
-32.54 |
0.00 |
| 64k 64qd rw R |
0.00 |
-2.66 |
-0.41 |
0.07 |
-0.14 |
| 64k 64qd rw W |
-6.57 |
-2.71 |
-0.38 |
0.13 |
0.00 |
1649508905-16.2.5-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
2 524 |
19 487 |
118 271 |
599 296 |
| 4k 4 randrw W |
27 208 |
23 236 |
19 485 |
13 084 |
0 |
| 4k 32 randrw R |
0 |
5 152 |
36 000 |
137 143 |
593 651 |
| 4k 32 randrw W |
50 018 |
46 824 |
35 995 |
15 180 |
0 |
| 4k 64 randrw R |
0 |
5 921 |
49 677 |
163 985 |
596 432 |
| 4k 64 randrw W |
52 799 |
53 804 |
49 690 |
18 162 |
0 |
| 64k 4 rw R |
0 |
3 219 |
30 005 |
143 792 |
198 813 |
| 64k 4 rw W |
27 977 |
29 445 |
30 016 |
15 921 |
0 |
| 64k 64 rw R |
0 |
7 514 |
65 323 |
162 400 |
197 630 |
| 64k 64 rw W |
67 212 |
68 087 |
65 309 |
17 991 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-68.53 |
-69.50 |
-58.69 |
-3.86 |
| 4k 4qd randrw W |
-63.55 |
-68.05 |
-69.50 |
-58.81 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-45.69 |
-52.77 |
-54.90 |
-2.12 |
| 4k 32qd randrw W |
-43.29 |
-45.47 |
-52.78 |
-54.98 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-38.67 |
-36.53 |
-46.10 |
-4.84 |
| 4k 64qd randrw W |
-40.93 |
-38.47 |
-36.51 |
-46.19 |
0.00 |
| 64k 4qd rw R |
0.00 |
-38.67 |
-46.24 |
-10.24 |
0.18 |
| 64k 4qd rw W |
-49.53 |
-38.35 |
-46.22 |
-10.27 |
0.00 |
| 64k 64qd rw R |
0.00 |
1.11 |
1.18 |
0.11 |
-0.04 |
| 64k 64qd rw W |
0.56 |
1.05 |
1.15 |
0.15 |
0.00 |