Ceph bench 14.2.22
Backend info: 3 backend hosts, 40gbps NIC, 24 NVME, ceph 14.2.22 from eucephcom
Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom
Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off
Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images.
Images are fully pre-written.
Each fio test is executed for 15 mins. Each suite conist 25 fio runs.
Each suite is repeated 3 times, thus 3 results.
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}
1648492407-14.2.22
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
9 436 |
74 217 |
351 023 |
666 279 |
| 4k 4 randrw W |
79 872 |
85 442 |
74 237 |
38 962 |
0 |
| 4k 32 randrw R |
0 |
14 215 |
107 435 |
415 210 |
765 772 |
| 4k 32 randrw W |
126 904 |
128 443 |
107 447 |
46 073 |
0 |
| 4k 64 randrw R |
0 |
15 319 |
116 686 |
429 779 |
770 712 |
| 4k 64 randrw W |
141 007 |
138 333 |
116 699 |
47 709 |
0 |
| 64k 4 rw R |
0 |
7 216 |
62 585 |
151 831 |
164 772 |
| 64k 4 rw W |
65 273 |
65 446 |
62 577 |
16 818 |
0 |
| 64k 64 rw R |
0 |
7 557 |
66 111 |
163 518 |
195 327 |
| 64k 64 rw W |
68 473 |
68 517 |
66 110 |
18 121 |
0 |
1648515259-14.2.22
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
10 050 |
77 376 |
344 477 |
651 235 |
| 4k 4 randrw W |
92 248 |
90 915 |
77 368 |
38 224 |
0 |
| 4k 32 randrw R |
0 |
14 376 |
108 939 |
411 505 |
752 720 |
| 4k 32 randrw W |
132 111 |
129 915 |
108 933 |
45 670 |
0 |
| 4k 64 randrw R |
0 |
15 604 |
116 842 |
422 086 |
762 489 |
| 4k 64 randrw W |
144 145 |
140 889 |
116 836 |
46 848 |
0 |
| 64k 4 rw R |
0 |
7 061 |
62 374 |
131 139 |
141 543 |
| 64k 4 rw W |
60 561 |
63 998 |
62 383 |
14 510 |
0 |
| 64k 64 rw R |
0 |
7 547 |
66 172 |
166 505 |
197 648 |
| 64k 64 rw W |
68 947 |
68 386 |
66 172 |
18 446 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
6.50 |
4.26 |
-1.86 |
-2.26 |
| 4k 4qd randrw W |
15.50 |
6.41 |
4.22 |
-1.90 |
0.00 |
| 4k 32qd randrw R |
0.00 |
1.13 |
1.40 |
-0.89 |
-1.70 |
| 4k 32qd randrw W |
4.10 |
1.15 |
1.38 |
-0.87 |
0.00 |
| 4k 64qd randrw R |
0.00 |
1.86 |
0.13 |
-1.79 |
-1.07 |
| 4k 64qd randrw W |
2.23 |
1.85 |
0.12 |
-1.81 |
0.00 |
| 64k 4qd rw R |
0.00 |
-2.16 |
-0.34 |
-13.63 |
-14.10 |
| 64k 4qd rw W |
-7.22 |
-2.21 |
-0.31 |
-13.72 |
0.00 |
| 64k 64qd rw R |
0.00 |
-0.13 |
0.09 |
1.83 |
1.19 |
| 64k 64qd rw W |
0.69 |
-0.19 |
0.09 |
1.79 |
0.00 |
1648538112-14.2.22
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
9 876 |
76 125 |
342 787 |
643 344 |
| 4k 4 randrw W |
88 702 |
89 377 |
76 136 |
38 044 |
0 |
| 4k 32 randrw R |
0 |
14 325 |
107 889 |
407 720 |
748 463 |
| 4k 32 randrw W |
130 580 |
129 384 |
107 889 |
45 246 |
0 |
| 4k 64 randrw R |
0 |
15 436 |
117 173 |
417 992 |
761 071 |
| 4k 64 randrw W |
143 058 |
139 412 |
117 184 |
46 386 |
0 |
| 64k 4 rw R |
0 |
6 865 |
61 132 |
122 414 |
131 598 |
| 64k 4 rw W |
54 782 |
62 289 |
61 123 |
13 549 |
0 |
| 64k 64 rw R |
0 |
7 060 |
64 525 |
163 092 |
182 456 |
| 64k 64 rw W |
63 460 |
63 996 |
64 521 |
18 070 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
4.66 |
2.57 |
-2.35 |
-3.44 |
| 4k 4qd randrw W |
11.06 |
4.61 |
2.56 |
-2.36 |
0.00 |
| 4k 32qd randrw R |
0.00 |
0.77 |
0.42 |
-1.80 |
-2.26 |
| 4k 32qd randrw W |
2.90 |
0.73 |
0.41 |
-1.79 |
0.00 |
| 4k 64qd randrw R |
0.00 |
0.76 |
0.42 |
-2.74 |
-1.25 |
| 4k 64qd randrw W |
1.45 |
0.78 |
0.42 |
-2.77 |
0.00 |
| 64k 4qd rw R |
0.00 |
-4.87 |
-2.32 |
-19.37 |
-20.13 |
| 64k 4qd rw W |
-16.07 |
-4.82 |
-2.32 |
-19.43 |
0.00 |
| 64k 64qd rw R |
0.00 |
-6.57 |
-2.40 |
-0.26 |
-6.59 |
| 64k 64qd rw W |
-7.32 |
-6.60 |
-2.40 |
-0.28 |
0.00 |