Ceph bench 14.2.16
Backend info: 3 backend hosts, 40gbps NIC, 24 NVME, ceph 14.2.16 from eucephcom
Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom
Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off
Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images.
Images are fully pre-written.
Each fio test is executed for 15 mins. Each suite conist 25 fio runs.
Each suite is repeated 3 times, thus 3 results.
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}
1648391070-14.2.16
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
7 941 |
64 466 |
332 243 |
708 565 |
| 4k 4 randrw W |
70 128 |
71 914 |
64 476 |
36 848 |
0 |
| 4k 32 randrw R |
0 |
12 237 |
95 792 |
420 571 |
822 982 |
| 4k 32 randrw W |
112 049 |
110 625 |
95 762 |
46 670 |
0 |
| 4k 64 randrw R |
0 |
13 773 |
106 670 |
440 825 |
829 995 |
| 4k 64 randrw W |
127 320 |
124 504 |
106 668 |
48 918 |
0 |
| 64k 4 rw R |
0 |
7 164 |
62 445 |
154 695 |
169 491 |
| 64k 4 rw W |
64 964 |
64 929 |
62 460 |
17 133 |
0 |
| 64k 64 rw R |
0 |
7 512 |
66 144 |
163 254 |
196 321 |
| 64k 64 rw W |
68 830 |
68 079 |
66 146 |
18 081 |
0 |
1648413916-14.2.16
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
6 706 |
53 943 |
286 587 |
689 904 |
| 4k 4 randrw W |
62 481 |
60 845 |
53 952 |
31 787 |
0 |
| 4k 32 randrw R |
0 |
11 773 |
90 718 |
409 824 |
805 981 |
| 4k 32 randrw W |
108 123 |
106 439 |
90 688 |
45 468 |
0 |
| 4k 64 randrw R |
0 |
13 246 |
103 460 |
426 877 |
823 703 |
| 4k 64 randrw W |
123 465 |
119 636 |
103 455 |
47 373 |
0 |
| 64k 4 rw R |
0 |
7 000 |
62 168 |
134 886 |
146 307 |
| 64k 4 rw W |
61 027 |
63 551 |
62 172 |
14 940 |
0 |
| 64k 64 rw R |
0 |
7 587 |
66 101 |
165 855 |
197 498 |
| 64k 64 rw W |
68 815 |
68 851 |
66 112 |
18 367 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-15.55 |
-16.32 |
-13.74 |
-2.63 |
| 4k 4qd randrw W |
-10.90 |
-15.39 |
-16.32 |
-13.74 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-3.79 |
-5.30 |
-2.56 |
-2.07 |
| 4k 32qd randrw W |
-3.50 |
-3.78 |
-5.30 |
-2.58 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-3.82 |
-3.01 |
-3.16 |
-0.76 |
| 4k 64qd randrw W |
-3.03 |
-3.91 |
-3.01 |
-3.16 |
0.00 |
| 64k 4qd rw R |
0.00 |
-2.28 |
-0.44 |
-12.81 |
-13.68 |
| 64k 4qd rw W |
-6.06 |
-2.12 |
-0.46 |
-12.80 |
0.00 |
| 64k 64qd rw R |
0.00 |
1.00 |
-0.06 |
1.59 |
0.60 |
| 64k 64qd rw W |
-0.02 |
1.13 |
-0.05 |
1.58 |
0.00 |
1648436765-14.2.16
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
6 972 |
55 519 |
294 638 |
676 912 |
| 4k 4 randrw W |
65 063 |
63 275 |
55 521 |
32 679 |
0 |
| 4k 32 randrw R |
0 |
11 815 |
91 979 |
406 858 |
799 123 |
| 4k 32 randrw W |
109 678 |
106 834 |
91 986 |
45 148 |
0 |
| 4k 64 randrw R |
0 |
13 394 |
103 523 |
425 460 |
810 390 |
| 4k 64 randrw W |
122 980 |
121 005 |
103 546 |
47 219 |
0 |
| 64k 4 rw R |
0 |
7 174 |
62 252 |
126 351 |
136 344 |
| 64k 4 rw W |
59 410 |
65 068 |
62 249 |
13 986 |
0 |
| 64k 64 rw R |
0 |
7 565 |
66 065 |
166 415 |
197 007 |
| 64k 64 rw W |
68 949 |
68 576 |
66 056 |
18 435 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-12.20 |
-13.88 |
-11.32 |
-4.47 |
| 4k 4qd randrw W |
-7.22 |
-12.01 |
-13.89 |
-11.31 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-3.45 |
-3.98 |
-3.26 |
-2.90 |
| 4k 32qd randrw W |
-2.12 |
-3.43 |
-3.94 |
-3.26 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-2.75 |
-2.95 |
-3.49 |
-2.36 |
| 4k 64qd randrw W |
-3.41 |
-2.81 |
-2.93 |
-3.47 |
0.00 |
| 64k 4qd rw R |
0.00 |
0.15 |
-0.31 |
-18.32 |
-19.56 |
| 64k 4qd rw W |
-8.55 |
0.21 |
-0.34 |
-18.36 |
0.00 |
| 64k 64qd rw R |
0.00 |
0.71 |
-0.12 |
1.94 |
0.35 |
| 64k 64qd rw W |
0.17 |
0.73 |
-0.14 |
1.96 |
0.00 |