Ceph bench 16.2.7
Backend info: 3 backend hosts, 40gbps NIC, 24 NVME, ceph 16.2.7 from eucephcom
Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom
Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off
Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images.
Images are fully pre-written.
Each fio test is executed for 15 mins. Each suite conist 25 fio runs.
Each suite is repeated 3 times, thus 3 results.
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}
1648684409-16.2.7-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
8 125 |
64 557 |
296 165 |
628 927 |
| 4k 4 randrw W |
75 666 |
73 583 |
64 557 |
32 857 |
0 |
| 4k 32 randrw R |
0 |
9 727 |
78 824 |
326 393 |
620 177 |
| 4k 32 randrw W |
90 311 |
88 048 |
78 827 |
36 210 |
0 |
| 4k 64 randrw R |
0 |
10 047 |
81 244 |
334 182 |
630 369 |
| 4k 64 randrw W |
93 320 |
90 899 |
81 266 |
37 076 |
0 |
| 64k 4 rw R |
0 |
6 086 |
51 010 |
162 184 |
198 881 |
| 64k 4 rw W |
57 045 |
55 298 |
51 009 |
17 966 |
0 |
| 64k 64 rw R |
0 |
7 398 |
64 693 |
161 915 |
196 849 |
| 64k 64 rw W |
67 548 |
67 062 |
64 675 |
17 929 |
0 |
1648707255-16.2.7-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
1 632 |
13 650 |
102 507 |
635 857 |
| 4k 4 randrw W |
15 848 |
15 178 |
13 651 |
11 331 |
0 |
| 4k 32 randrw R |
0 |
4 320 |
37 932 |
155 911 |
623 199 |
| 4k 32 randrw W |
36 765 |
39 350 |
37 929 |
17 264 |
0 |
| 4k 64 randrw R |
0 |
9 525 |
80 466 |
330 989 |
625 427 |
| 4k 64 randrw W |
74 209 |
86 207 |
80 479 |
36 713 |
0 |
| 64k 4 rw R |
0 |
2 179 |
19 137 |
117 106 |
198 775 |
| 64k 4 rw W |
21 596 |
20 124 |
19 127 |
12 955 |
0 |
| 64k 64 rw R |
0 |
7 314 |
65 383 |
162 353 |
197 015 |
| 64k 64 rw W |
63 107 |
66 322 |
65 399 |
17 981 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-79.91 |
-78.86 |
-65.39 |
1.10 |
| 4k 4qd randrw W |
-79.05 |
-79.37 |
-78.85 |
-65.51 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-55.59 |
-51.88 |
-52.23 |
0.49 |
| 4k 32qd randrw W |
-59.29 |
-55.31 |
-51.88 |
-52.32 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-5.19 |
-0.96 |
-0.96 |
-0.78 |
| 4k 64qd randrw W |
-20.48 |
-5.16 |
-0.97 |
-0.98 |
0.00 |
| 64k 4qd rw R |
0.00 |
-64.19 |
-62.48 |
-27.79 |
-0.05 |
| 64k 4qd rw W |
-62.14 |
-63.61 |
-62.50 |
-27.89 |
0.00 |
| 64k 64qd rw R |
0.00 |
-1.13 |
1.07 |
0.27 |
0.08 |
| 64k 64qd rw W |
-6.57 |
-1.10 |
1.12 |
0.29 |
0.00 |
1648731837-16.2.7-eucephcom
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
2 913 |
20 240 |
135 648 |
611 136 |
| 4k 4 randrw W |
36 526 |
26 706 |
20 244 |
15 021 |
0 |
| 4k 32 randrw R |
0 |
5 984 |
47 338 |
176 378 |
613 054 |
| 4k 32 randrw W |
57 541 |
54 357 |
47 329 |
19 536 |
0 |
| 4k 64 randrw R |
0 |
9 052 |
74 878 |
247 197 |
610 959 |
| 4k 64 randrw W |
77 483 |
81 963 |
74 874 |
27 416 |
0 |
| 64k 4 rw R |
0 |
3 091 |
31 273 |
153 447 |
199 042 |
| 64k 4 rw W |
24 980 |
28 291 |
31 266 |
16 986 |
0 |
| 64k 64 rw R |
0 |
7 475 |
65 340 |
162 161 |
197 762 |
| 64k 64 rw W |
66 088 |
67 765 |
65 344 |
17 969 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-64.15 |
-68.65 |
-54.20 |
-2.83 |
| 4k 4qd randrw W |
-51.73 |
-63.71 |
-68.64 |
-54.28 |
0.00 |
| 4k 32qd randrw R |
0.00 |
-38.48 |
-39.94 |
-45.96 |
-1.15 |
| 4k 32qd randrw W |
-36.29 |
-38.26 |
-39.96 |
-46.05 |
0.00 |
| 4k 64qd randrw R |
0.00 |
-9.90 |
-7.84 |
-26.03 |
-3.08 |
| 4k 64qd randrw W |
-16.97 |
-9.83 |
-7.87 |
-26.05 |
0.00 |
| 64k 4qd rw R |
0.00 |
-49.20 |
-38.69 |
-5.39 |
0.08 |
| 64k 4qd rw W |
-56.21 |
-48.84 |
-38.71 |
-5.45 |
0.00 |
| 64k 64qd rw R |
0.00 |
1.05 |
1.00 |
0.15 |
0.46 |
| 64k 64qd rw W |
-2.16 |
1.05 |
1.03 |
0.22 |
0.00 |