Ceph bench 16.2.7 -znver2o2
Backend info: 3 backend hosts, 40gbps NIC, 24 NVME, ceph 16.2.7 -znver2o2 custom build
Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom
Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off
Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images.
Images are fully pre-written.
Each fio test is executed for 15 mins. Each suite conist 25 fio runs.
Each suite is repeated 3 times, thus 3 results.
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}
1648770148-16.2.7-znver2o2
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
9 564 |
74 210 |
318 073 |
597 406 |
| 4k 4 randrw W |
89 386 |
86 573 |
74 224 |
35 294 |
0 |
| 4k 32 randrw R |
0 |
13 557 |
102 505 |
343 350 |
610 675 |
| 4k 32 randrw W |
126 602 |
122 554 |
102 542 |
38 098 |
0 |
| 4k 64 randrw R |
0 |
15 059 |
111 375 |
346 384 |
631 160 |
| 4k 64 randrw W |
140 364 |
136 024 |
111 385 |
38 438 |
0 |
| 64k 4 rw R |
0 |
7 132 |
61 128 |
165 869 |
199 070 |
| 64k 4 rw W |
64 405 |
64 696 |
61 120 |
18 377 |
0 |
| 64k 64 rw R |
0 |
7 576 |
66 134 |
163 380 |
197 990 |
| 64k 64 rw W |
68 537 |
68 715 |
66 130 |
18 101 |
0 |
1648792995-16.2.7-znver2o2
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
7 285 |
23 665 |
240 909 |
591 493 |
| 4k 4 randrw W |
87 290 |
66 034 |
23 670 |
26 715 |
0 |
| 4k 32 randrw R |
0 |
2 588 |
24 012 |
239 561 |
611 831 |
| 4k 32 randrw W |
20 167 |
23 785 |
24 014 |
26 560 |
0 |
| 4k 64 randrw R |
0 |
2 794 |
8 964 |
53 928 |
626 392 |
| 4k 64 randrw W |
25 900 |
25 549 |
9 053 |
6 135 |
0 |
| 64k 4 rw R |
0 |
3 417 |
35 410 |
149 015 |
198 946 |
| 64k 4 rw W |
33 570 |
31 269 |
35 419 |
16 504 |
0 |
| 64k 64 rw R |
0 |
7 381 |
65 200 |
162 858 |
198 145 |
| 64k 64 rw W |
66 166 |
66 900 |
65 184 |
18 045 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-23.82 |
-68.11 |
-24.26 |
-0.99 |
| 4k 4qd randrw W |
-2.34 |
-23.72 |
-68.11 |
-24.31 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-80.90 |
-76.57 |
-30.23 |
0.19 |
| 4k 32qd randrw W |
-84.07 |
-80.59 |
-76.58 |
-30.29 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-81.44 |
-91.95 |
-84.43 |
-0.76 |
| 4k 64qd randrw W |
-81.55 |
-81.22 |
-91.87 |
-84.04 |
0.00 |
| 64k 4qd rw R |
0.00 |
-52.09 |
-42.07 |
-10.16 |
-0.06 |
| 64k 4qd rw W |
-47.88 |
-51.67 |
-42.05 |
-10.19 |
0.00 |
| 64k 64qd rw R |
0.00 |
-2.58 |
-1.41 |
-0.32 |
0.08 |
| 64k 64qd rw W |
-3.46 |
-2.64 |
-1.43 |
-0.31 |
0.00 |
1648816163-16.2.7-znver2o2
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
1 754 |
15 772 |
112 529 |
593 203 |
| 4k 4 randrw W |
19 082 |
16 293 |
15 766 |
12 447 |
0 |
| 4k 32 randrw R |
0 |
2 276 |
21 296 |
130 470 |
608 023 |
| 4k 32 randrw W |
21 482 |
20 994 |
21 298 |
14 488 |
0 |
| 4k 64 randrw R |
0 |
2 511 |
21 372 |
115 764 |
626 976 |
| 4k 64 randrw W |
24 766 |
23 100 |
21 363 |
12 928 |
0 |
| 64k 4 rw R |
0 |
3 265 |
31 274 |
154 335 |
198 912 |
| 64k 4 rw W |
28 990 |
29 875 |
31 268 |
17 093 |
0 |
| 64k 64 rw R |
0 |
7 529 |
65 705 |
163 060 |
198 265 |
| 64k 64 rw W |
67 180 |
68 291 |
65 709 |
18 062 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-81.66 |
-78.75 |
-64.62 |
-0.70 |
| 4k 4qd randrw W |
-78.65 |
-81.18 |
-78.76 |
-64.73 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-83.21 |
-79.22 |
-62.00 |
-0.43 |
| 4k 32qd randrw W |
-83.03 |
-82.87 |
-79.23 |
-61.97 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-83.32 |
-80.81 |
-66.58 |
-0.66 |
| 4k 64qd randrw W |
-82.36 |
-83.02 |
-80.82 |
-66.37 |
0.00 |
| 64k 4qd rw R |
0.00 |
-54.22 |
-48.84 |
-6.95 |
-0.08 |
| 64k 4qd rw W |
-54.99 |
-53.82 |
-48.84 |
-6.99 |
0.00 |
| 64k 64qd rw R |
0.00 |
-0.62 |
-0.65 |
-0.20 |
0.14 |
| 64k 64qd rw W |
-1.98 |
-0.62 |
-0.64 |
-0.21 |
0.00 |