Ceph bench 15.2.14
Backend info: 3 backend hosts, 40gbps NIC, 24 NVME, ceph 15.2.14 from eucephcom
Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom
Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off
Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images.
Images are fully pre-written.
Each fio test is executed for 15 mins. Each suite conist 25 fio runs.
Each suite is repeated 3 times, thus 3 results.
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}
1649087078-15.2.14-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
8 074 |
64 563 |
296 605 |
638 711 |
| 4k 4 randrw W |
75 031 |
73 190 |
64 558 |
32 894 |
0 |
| 4k 32 randrw R |
0 |
9 911 |
80 252 |
328 918 |
631 273 |
| 4k 32 randrw W |
91 823 |
89 660 |
80 264 |
36 490 |
0 |
| 4k 64 randrw R |
0 |
10 126 |
82 906 |
332 073 |
650 855 |
| 4k 64 randrw W |
94 229 |
91 632 |
82 933 |
36 845 |
0 |
| 64k 4 rw R |
0 |
7 132 |
61 631 |
166 662 |
199 047 |
| 64k 4 rw W |
63 217 |
64 661 |
61 629 |
18 467 |
0 |
| 64k 64 rw R |
0 |
7 434 |
66 063 |
164 334 |
198 960 |
| 64k 64 rw W |
67 137 |
67 412 |
66 052 |
18 195 |
0 |
1649109941-15.2.14-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
7 924 |
63 213 |
292 087 |
641 899 |
| 4k 4 randrw W |
74 047 |
71 853 |
63 225 |
32 402 |
0 |
| 4k 32 randrw R |
0 |
9 685 |
78 756 |
324 210 |
623 817 |
| 4k 32 randrw W |
90 479 |
87 650 |
78 738 |
35 976 |
0 |
| 4k 64 randrw R |
0 |
10 008 |
81 755 |
329 750 |
639 120 |
| 4k 64 randrw W |
92 665 |
90 604 |
81 733 |
36 589 |
0 |
| 64k 4 rw R |
0 |
6 538 |
61 451 |
166 756 |
199 534 |
| 64k 4 rw W |
59 240 |
59 315 |
61 444 |
18 479 |
0 |
| 64k 64 rw R |
0 |
7 555 |
65 850 |
164 570 |
199 457 |
| 64k 64 rw W |
67 812 |
68 515 |
65 844 |
18 237 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-1.86 |
-2.09 |
-1.52 |
0.50 |
| 4k 4qd randrw W |
-1.31 |
-1.83 |
-2.07 |
-1.50 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-2.27 |
-1.86 |
-1.43 |
-1.18 |
| 4k 32qd randrw W |
-1.46 |
-2.24 |
-1.90 |
-1.41 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-1.16 |
-1.39 |
-0.70 |
-1.80 |
| 4k 64qd randrw W |
-1.66 |
-1.12 |
-1.45 |
-0.69 |
0.00 |
| 64k 4qd rw R |
0.00 |
-8.32 |
-0.29 |
0.06 |
0.24 |
| 64k 4qd rw W |
-6.29 |
-8.27 |
-0.30 |
0.06 |
0.00 |
| 64k 64qd rw R |
0.00 |
1.64 |
-0.32 |
0.14 |
0.25 |
| 64k 64qd rw W |
1.01 |
1.64 |
-0.32 |
0.23 |
0.00 |
1649156817-15.2.14-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
7 768 |
62 389 |
287 235 |
611 042 |
| 4k 4 randrw W |
72 560 |
70 392 |
62 389 |
31 862 |
0 |
| 4k 32 randrw R |
0 |
9 550 |
78 344 |
319 786 |
612 296 |
| 4k 32 randrw W |
88 331 |
86 452 |
78 330 |
35 470 |
0 |
| 4k 64 randrw R |
0 |
9 866 |
80 250 |
329 347 |
636 750 |
| 4k 64 randrw W |
91 172 |
89 273 |
80 231 |
36 539 |
0 |
| 64k 4 rw R |
0 |
6 869 |
60 472 |
166 610 |
199 882 |
| 64k 4 rw W |
53 126 |
62 316 |
60 468 |
18 461 |
0 |
| 64k 64 rw R |
0 |
7 422 |
65 553 |
164 787 |
199 778 |
| 64k 64 rw W |
67 012 |
67 284 |
65 536 |
18 259 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-3.79 |
-3.37 |
-3.16 |
-4.33 |
| 4k 4qd randrw W |
-3.29 |
-3.82 |
-3.36 |
-3.14 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-3.64 |
-2.38 |
-2.78 |
-3.01 |
| 4k 32qd randrw W |
-3.80 |
-3.58 |
-2.41 |
-2.80 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-2.57 |
-3.20 |
-0.82 |
-2.17 |
| 4k 64qd randrw W |
-3.24 |
-2.57 |
-3.26 |
-0.83 |
0.00 |
| 64k 4qd rw R |
0.00 |
-3.68 |
-1.88 |
-0.03 |
0.42 |
| 64k 4qd rw W |
-15.96 |
-3.63 |
-1.88 |
-0.04 |
0.00 |
| 64k 64qd rw R |
0.00 |
-0.15 |
-0.77 |
0.28 |
0.41 |
| 64k 64qd rw W |
-0.19 |
-0.19 |
-0.78 |
0.35 |
0.00 |