Ceph bench 15.2.16
Backend info: 3 backend hosts, 40gbps NIC, 24 NVME, ceph 15.2.16 from eucephcom
Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom
Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off
Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images.
Images are fully pre-written.
Each fio test is executed for 15 mins. Each suite conist 25 fio runs.
Each suite is repeated 3 times, thus 3 results.
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}
1648593414-15.2.16-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
8 146 |
64 935 |
299 273 |
655 803 |
| 4k 4 randrw W |
75 673 |
73 780 |
64 939 |
33 186 |
0 |
| 4k 32 randrw R |
0 |
9 979 |
81 799 |
330 847 |
642 836 |
| 4k 32 randrw W |
93 731 |
90 339 |
81 809 |
36 704 |
0 |
| 4k 64 randrw R |
0 |
10 422 |
85 107 |
338 107 |
654 227 |
| 4k 64 randrw W |
96 685 |
94 274 |
85 104 |
37 499 |
0 |
| 64k 4 rw R |
0 |
6 338 |
56 715 |
166 919 |
199 139 |
| 64k 4 rw W |
63 844 |
57 530 |
56 719 |
18 487 |
0 |
| 64k 64 rw R |
0 |
7 552 |
66 368 |
164 698 |
198 788 |
| 64k 64 rw W |
68 545 |
68 475 |
66 354 |
18 242 |
0 |
1648616267-15.2.16-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
7 995 |
63 702 |
294 478 |
657 728 |
| 4k 4 randrw W |
74 935 |
72 491 |
63 709 |
32 659 |
0 |
| 4k 32 randrw R |
0 |
9 905 |
80 661 |
327 014 |
638 094 |
| 4k 32 randrw W |
92 797 |
89 610 |
80 672 |
36 284 |
0 |
| 4k 64 randrw R |
0 |
10 275 |
83 498 |
334 832 |
644 877 |
| 4k 64 randrw W |
94 896 |
92 980 |
83 496 |
37 154 |
0 |
| 64k 4 rw R |
0 |
7 107 |
60 164 |
166 623 |
199 756 |
| 64k 4 rw W |
58 405 |
64 455 |
60 159 |
18 454 |
0 |
| 64k 64 rw R |
0 |
7 596 |
66 504 |
165 214 |
198 705 |
| 64k 64 rw W |
68 720 |
68 852 |
66 521 |
18 296 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-1.86 |
-1.90 |
-1.60 |
0.29 |
| 4k 4qd randrw W |
-0.98 |
-1.75 |
-1.89 |
-1.59 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-0.74 |
-1.39 |
-1.16 |
-0.74 |
| 4k 32qd randrw W |
-1.00 |
-0.81 |
-1.39 |
-1.14 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-1.41 |
-1.89 |
-0.97 |
-1.43 |
| 4k 64qd randrw W |
-1.85 |
-1.37 |
-1.89 |
-0.92 |
0.00 |
| 64k 4qd rw R |
0.00 |
12.13 |
6.08 |
-0.18 |
0.31 |
| 64k 4qd rw W |
-8.52 |
12.04 |
6.07 |
-0.18 |
0.00 |
| 64k 64qd rw R |
0.00 |
0.59 |
0.21 |
0.31 |
-0.04 |
| 64k 64qd rw W |
0.26 |
0.55 |
0.25 |
0.29 |
0.00 |
1648639114-15.2.16-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
7 878 |
63 695 |
293 060 |
641 125 |
| 4k 4 randrw W |
74 201 |
71 413 |
63 722 |
32 501 |
0 |
| 4k 32 randrw R |
0 |
9 791 |
79 713 |
326 380 |
635 233 |
| 4k 32 randrw W |
90 952 |
88 616 |
79 717 |
36 198 |
0 |
| 4k 64 randrw R |
0 |
10 146 |
83 179 |
334 247 |
640 901 |
| 4k 64 randrw W |
94 312 |
91 802 |
83 197 |
37 081 |
0 |
| 64k 4 rw R |
0 |
6 250 |
55 128 |
166 905 |
199 698 |
| 64k 4 rw W |
54 795 |
56 751 |
55 123 |
18 497 |
0 |
| 64k 64 rw R |
0 |
7 593 |
66 470 |
165 201 |
199 692 |
| 64k 64 rw W |
68 778 |
68 785 |
66 460 |
18 300 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-3.29 |
-1.91 |
-2.08 |
-2.24 |
| 4k 4qd randrw W |
-1.95 |
-3.21 |
-1.87 |
-2.07 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-1.88 |
-2.55 |
-1.35 |
-1.18 |
| 4k 32qd randrw W |
-2.97 |
-1.91 |
-2.56 |
-1.38 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-2.65 |
-2.27 |
-1.14 |
-2.04 |
| 4k 64qd randrw W |
-2.45 |
-2.62 |
-2.24 |
-1.11 |
0.00 |
| 64k 4qd rw R |
0.00 |
-1.39 |
-2.80 |
-0.01 |
0.28 |
| 64k 4qd rw W |
-14.17 |
-1.35 |
-2.81 |
0.05 |
0.00 |
| 64k 64qd rw R |
0.00 |
0.54 |
0.15 |
0.31 |
0.45 |
| 64k 64qd rw W |
0.34 |
0.45 |
0.16 |
0.31 |
0.00 |