Ceph bench 15.2.14-0ubuntu0.20.04.2
Backend info: 3 backend hosts, 40gbps NIC, 24 NVME, ceph 15.2.14-0ubuntu0.20.04.2 ubuntu
Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom
Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off
Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images.
Images are fully pre-written.
Each fio test is executed for 15 mins. Each suite conist 25 fio runs.
Each suite is repeated 3 times, thus 3 results.
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}
1649338810-15.2.14-ubuntu
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
11 324 |
87 132 |
374 505 |
745 488 |
| 4k 4 randrw W |
104 681 |
102 409 |
87 122 |
41 553 |
0 |
| 4k 32 randrw R |
0 |
16 081 |
120 579 |
397 180 |
744 180 |
| 4k 32 randrw W |
148 495 |
145 214 |
120 582 |
44 076 |
0 |
| 4k 64 randrw R |
0 |
17 956 |
129 240 |
398 656 |
744 581 |
| 4k 64 randrw W |
166 020 |
162 109 |
129 246 |
44 231 |
0 |
| 64k 4 rw R |
0 |
7 225 |
62 860 |
166 800 |
198 934 |
| 64k 4 rw W |
65 320 |
65 541 |
62 841 |
18 483 |
0 |
| 64k 64 rw R |
0 |
7 636 |
66 569 |
163 958 |
198 717 |
| 64k 64 rw W |
69 341 |
69 276 |
66 556 |
18 158 |
0 |
1649361658-15.2.14-ubuntu
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
11 260 |
86 406 |
368 599 |
729 365 |
| 4k 4 randrw W |
104 220 |
101 828 |
86 406 |
40 896 |
0 |
| 4k 32 randrw R |
0 |
16 164 |
121 851 |
390 125 |
729 123 |
| 4k 32 randrw W |
150 224 |
146 024 |
121 860 |
43 285 |
0 |
| 4k 64 randrw R |
0 |
18 256 |
127 874 |
394 425 |
735 664 |
| 4k 64 randrw W |
165 837 |
164 766 |
127 876 |
43 763 |
0 |
| 64k 4 rw R |
0 |
7 077 |
62 645 |
166 532 |
199 570 |
| 64k 4 rw W |
62 901 |
64 152 |
62 666 |
18 441 |
0 |
| 64k 64 rw R |
0 |
7 617 |
66 637 |
164 047 |
198 282 |
| 64k 64 rw W |
69 160 |
69 092 |
66 620 |
18 170 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-0.56 |
-0.83 |
-1.58 |
-2.16 |
| 4k 4qd randrw W |
-0.44 |
-0.57 |
-0.82 |
-1.58 |
0.00 |
| 4k 32qd randrw R |
0.00 |
0.51 |
1.06 |
-1.78 |
-2.02 |
| 4k 32qd randrw W |
1.16 |
0.56 |
1.06 |
-1.79 |
0.00 |
| 4k 64qd randrw R |
0.00 |
1.67 |
-1.06 |
-1.06 |
-1.20 |
| 4k 64qd randrw W |
-0.11 |
1.64 |
-1.06 |
-1.06 |
0.00 |
| 64k 4qd rw R |
0.00 |
-2.05 |
-0.34 |
-0.16 |
0.32 |
| 64k 4qd rw W |
-3.70 |
-2.12 |
-0.28 |
-0.23 |
0.00 |
| 64k 64qd rw R |
0.00 |
-0.26 |
0.10 |
0.05 |
-0.22 |
| 64k 64qd rw W |
-0.26 |
-0.27 |
0.10 |
0.07 |
0.00 |
1649384510-15.2.14-ubuntu
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4 randrw R |
0 |
11 164 |
86 233 |
366 117 |
721 852 |
| 4k 4 randrw W |
103 184 |
101 015 |
86 242 |
40 612 |
0 |
| 4k 32 randrw R |
0 |
16 131 |
120 327 |
386 168 |
721 641 |
| 4k 32 randrw W |
148 034 |
145 694 |
120 340 |
42 855 |
0 |
| 4k 64 randrw R |
0 |
18 053 |
127 117 |
392 942 |
730 562 |
| 4k 64 randrw W |
166 252 |
162 899 |
127 126 |
43 599 |
0 |
| 64k 4 rw R |
0 |
7 219 |
62 631 |
166 878 |
199 940 |
| 64k 4 rw W |
64 157 |
65 504 |
62 638 |
18 483 |
0 |
| 64k 64 rw R |
0 |
7 626 |
66 520 |
163 982 |
198 688 |
| 64k 64 rw W |
69 170 |
69 062 |
66 502 |
18 170 |
0 |
Relative performance (compared to 1st result)
|
0%R |
10%R |
50%R |
90%R |
100%R |
| 4k 4qd randrw R |
0.00 |
-1.41 |
-1.03 |
-2.24 |
-3.17 |
| 4k 4qd randrw W |
-1.43 |
-1.36 |
-1.01 |
-2.26 |
0.00 |
| 4k 32qd randrw R |
0.00 |
0.31 |
-0.21 |
-2.77 |
-3.03 |
| 4k 32qd randrw W |
-0.31 |
0.33 |
-0.20 |
-2.77 |
0.00 |
| 4k 64qd randrw R |
0.00 |
0.54 |
-1.64 |
-1.43 |
-1.88 |
| 4k 64qd randrw W |
0.14 |
0.49 |
-1.64 |
-1.43 |
0.00 |
| 64k 4qd rw R |
0.00 |
-0.08 |
-0.36 |
0.05 |
0.51 |
| 64k 4qd rw W |
-1.78 |
-0.06 |
-0.32 |
0.00 |
0.00 |
| 64k 64qd rw R |
0.00 |
-0.13 |
-0.07 |
0.01 |
-0.01 |
| 64k 64qd rw W |
-0.25 |
-0.31 |
-0.08 |
0.07 |
0.00 |