Ceph bench 15.2.14 eucephcom vs znver2o2 vs ubuntu

Backend info:

Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom

Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off

Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images. Images are fully pre-written. Each fio test is executed for 15 mins. Each suite conist 25 fio runs. 

- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}

1649087078-15.2.14-eucephcom

0%R 10%R 50%R 90%R 100%R
4k 4 randrw R 0 8 074 64 563 296 605 638 711
4k 4 randrw W 75 031 73 190 64 558 32 894 0
4k 32 randrw R 0 9 911 80 252 328 918 631 273
4k 32 randrw W 91 823 89 660 80 264 36 490 0
4k 64 randrw R 0 10 126 82 906 332 073 650 855
4k 64 randrw W 94 229 91 632 82 933 36 845 0
64k 4 rw R 0 7 132 61 631 166 662 199 047
64k 4 rw W 63 217 64 661 61 629 18 467 0
64k 64 rw R 0 7 434 66 063 164 334 198 960
64k 64 rw W 67 137 67 412 66 052 18 195 0

1649240890-15.2.14-znver2o2

0%R 10%R 50%R 90%R 100%R
4k 4 randrw R 0 11 237 87 034 374 551 739 034
4k 4 randrw W 103 279 101 625 87 048 41 557 0
4k 32 randrw R 0 15 862 121 417 396 216 733 090
4k 32 randrw W 147 770 143 225 121 423 43 965 0
4k 64 randrw R 0 17 996 127 470 403 773 736 132
4k 64 randrw W 164 869 162 505 127 470 44 807 0
64k 4 rw R 0 7 212 62 490 166 771 199 158
64k 4 rw W 65 267 65 398 62 496 18 468 0
64k 64 rw R 0 7 569 66 376 164 400 198 841
64k 64 rw W 68 366 68 624 66 372 18 213 0

Relative performance (compared to 1st result)

0%R 10%R 50%R 90%R 100%R
4k 4qd randrw R 0.00 39.17 34.80 26.28 15.71
4k 4qd randrw W 37.65 38.85 34.84 26.34 0.00
4k 32qd randrw R 0.00 60.05 51.29 20.46 16.13
4k 32qd randrw W 60.93 59.74 51.28 20.49 0.00
4k 64qd randrw R 0.00 77.71 53.75 21.59 13.10
4k 64qd randrw W 74.97 77.34 53.70 21.61 0.00
64k 4qd rw R 0.00 1.13 1.39 0.07 0.06
64k 4qd rw W 3.24 1.14 1.41 0.01 0.00
64k 64qd rw R 0.00 1.82 0.47 0.04 -0.06
64k 64qd rw W 1.83 1.80 0.48 0.10 0.00

1649338810-15.2.14-ubuntu

0%R 10%R 50%R 90%R 100%R
4k 4 randrw R 0 11 324 87 132 374 505 745 488
4k 4 randrw W 104 681 102 409 87 122 41 553 0
4k 32 randrw R 0 16 081 120 579 397 180 744 180
4k 32 randrw W 148 495 145 214 120 582 44 076 0
4k 64 randrw R 0 17 956 129 240 398 656 744 581
4k 64 randrw W 166 020 162 109 129 246 44 231 0
64k 4 rw R 0 7 225 62 860 166 800 198 934
64k 4 rw W 65 320 65 541 62 841 18 483 0
64k 64 rw R 0 7 636 66 569 163 958 198 717
64k 64 rw W 69 341 69 276 66 556 18 158 0

Relative performance (compared to 1st result)

0%R 10%R 50%R 90%R 100%R
4k 4qd randrw R 0.00 40.25 34.96 26.26 16.72
4k 4qd randrw W 39.52 39.92 34.95 26.32 0.00
4k 32qd randrw R 0.00 62.26 50.25 20.75 17.89
4k 32qd randrw W 61.72 61.96 50.23 20.79 0.00
4k 64qd randrw R 0.00 77.32 55.89 20.05 14.40
4k 64qd randrw W 76.19 76.91 55.84 20.05 0.00
64k 4qd rw R 0.00 1.31 1.99 0.08 -0.06
64k 4qd rw W 3.33 1.36 1.97 0.08 0.00
64k 64qd rw R 0.00 2.73 0.77 -0.23 -0.12
64k 64qd rw W 3.28 2.77 0.76 -0.20 0.00