Skip to the content.

Ceph bench 16.2.7 -znver2o2minconf

Backend info: 3 backend hosts, 40gbps NIC, 24 NVME, ceph 16.2.7 -znver2o2minconf custom build (-march=znver2 -O2), minimal config

Client info: 4 client hosts, 40gbps NIC, ceph 16.2.7 from eucephcom

Config info: noscrub, nodeep-scrub, 1024PG, balancer off, pg autoscaler off

Test info: 128 RBD images each 128GB, each client runs fio tests against 32 RBD images. Images are fully pre-written. Each fio test is executed for 15 mins. Each suite conist 25 fio runs. Each suite is repeated 3 times, thus 3 results.

- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 4, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 32, rw: randrw, rwmixread: 100}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 0}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 10}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 50}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 90}
- {blocksize: 4k, iodepth: 64, rw: randrw, rwmixread: 100}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 4, rw: rw, rwmixread: 100}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 0}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 10}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 50}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 90}
- {blocksize: 64k, iodepth: 64, rw: rw, rwmixread: 100}

1649868770-16.2.7-znver2o2minconf

0%R 10%R 50%R 90%R 100%R
4k 4 randrw R 0 9 465 73 445 314 778 595 120
4k 4 randrw W 88 628 85 708 73 446 34 916 0
4k 32 randrw R 0 13 475 101 529 342 259 610 912
4k 32 randrw W 125 386 121 759 101 534 37 974 0
4k 64 randrw R 0 14 990 106 577 354 317 621 741
4k 64 randrw W 139 726 135 393 106 562 39 308 0
64k 4 rw R 0 7 093 61 107 165 460 198 970
64k 4 rw W 64 462 64 366 61 098 18 333 0
64k 64 rw R 0 7 525 65 977 162 981 198 387
64k 64 rw W 68 019 68 211 65 986 18 052 0

1649891632-16.2.7-znver2o2minconf

0%R 10%R 50%R 90%R 100%R
4k 4 randrw R 0 9 243 72 186 309 617 591 026
4k 4 randrw W 85 786 83 740 72 189 34 348 0
4k 32 randrw R 0 12 952 65 522 10 281 600 354
4k 32 randrw W 120 481 117 096 65 772 1 116 0
4k 64 randrw R 0 1 422 9 337 43 570 617 065
4k 64 randrw W 10 582 12 903 9 399 4 962 0
64k 4 rw R 0 3 596 33 934 155 527 198 983
64k 4 rw W 37 416 32 830 33 955 17 222 0
64k 64 rw R 0 7 416 64 748 163 002 197 841
64k 64 rw W 67 172 67 149 64 760 18 057 0

Relative performance (compared to 1st result)

0%R 10%R 50%R 90%R 100%R
4k 4qd randrw R 0.00 -2.34 -1.71 -1.64 -0.69
4k 4qd randrw W -3.21 -2.30 -1.71 -1.63 0.00
4k 32qd randrw R 0.00 -3.88 -35.47 -97.00 -1.73
4k 32qd randrw W -3.91 -3.83 -35.22 -97.06 0.00
4k 64qd randrw R 0.00 -90.51 -91.24 -87.70 -0.75
4k 64qd randrw W -92.43 -90.47 -91.18 -87.38 0.00
64k 4qd rw R 0.00 -49.31 -44.47 -6.00 0.01
64k 4qd rw W -41.96 -48.99 -44.43 -6.06 0.00
64k 64qd rw R 0.00 -1.45 -1.86 0.01 -0.28
64k 64qd rw W -1.24 -1.56 -1.86 0.03 0.00

1649915669-16.2.7-znver2o2minconf

0%R 10%R 50%R 90%R 100%R
4k 4 randrw R 0 1 852 16 290 117 103 597 800
4k 4 randrw W 18 358 17 178 16 283 12 959 0
4k 32 randrw R 0 2 580 20 756 163 578 609 234
4k 32 randrw W 23 904 23 700 20 757 18 134 0
4k 64 randrw R 0 2 274 21 789 109 776 613 903
4k 64 randrw W 24 261 20 973 21 788 12 190 0
64k 4 rw R 0 3 168 27 957 141 195 198 997
64k 4 rw W 29 154 29 020 27 956 15 629 0
64k 64 rw R 0 7 474 64 969 162 978 197 709
64k 64 rw W 65 720 67 786 64 988 18 052 0

Relative performance (compared to 1st result)

0%R 10%R 50%R 90%R 100%R
4k 4qd randrw R 0.00 -80.43 -77.82 -62.80 0.45
4k 4qd randrw W -79.29 -79.96 -77.83 -62.88 0.00
4k 32qd randrw R 0.00 -80.85 -79.56 -52.21 -0.27
4k 32qd randrw W -80.94 -80.54 -79.56 -52.24 0.00
4k 64qd randrw R 0.00 -84.83 -79.56 -69.02 -1.26
4k 64qd randrw W -82.64 -84.51 -79.55 -68.99 0.00
64k 4qd rw R 0.00 -55.33 -54.25 -14.67 0.01
64k 4qd rw W -54.77 -54.91 -54.24 -14.75 0.00
64k 64qd rw R 0.00 -0.68 -1.53 -0.00 -0.34
64k 64qd rw W -3.38 -0.62 -1.51 0.00 0.00