Тестирование виртуальных серверов от DigitalOcean, Vultr, Linode и Hetzner. Человеческие жертвы: 0.0 / Хабр

Тестирование виртуальных серверов от DigitalOcean, Vultr, Linode и Hetzner. Человеческие жертвы: 0.0 / Хабр Хостинг

Случайное чтение

$ fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=randread
Vscale

test: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=64
fio-2.1.3
Starting 1 process
test: (groupid=0, jobs=1): err= 0: pid=3196:
read: io=4096.0MB, bw=431690KB/s, iops=107922, runt= 9716msec
cpu: usr=23.12%, sys=44.50%, ctx=15090, majf=0, minf=88
IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued: total=r=1048576/w=0/d=0, short=r=0/w=0/d=0

Digital Ocean

test: (groupid=0, jobs=1): err= 0: pid=1517:

read: io=4096.0MB, bw=409400KB/s,

iops=102350

, runt= 10245msec

cpu: usr=16.84%, sys=72.93%, ctx=8625, majf=0, minf=88

IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%

submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%

issued: total=r=1048576/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=4096.0MB, aggrb=409400KB/s, minb=409400KB/s, maxb=409400KB/s, mint=10245msec, maxt=10245msec

Disk stats (read/write):
vda: ios=1043338/2, merge=0/1, ticks=250480/144, in_queue=250380, util=97.64%

Simple Cloud

test: (groupid=0, jobs=1): err= 0: pid=30397:

read: io=4096.0MB, bw=20009KB/s,

iops=5002

, runt=209620msec

cpu: usr=2.19%, sys=8.57%, ctx=1018919, majf=0, minf=70

IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%

submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%

issued: total=r=1048576/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=4096.0MB, aggrb=20009KB/s, minb=20009KB/s, maxb=20009KB/s, mint=209620msec, maxt=209620msec

Disk stats (read/write):
sda: ios=1048416/32, merge=0/18, ticks=13391324/0, in_queue=13391244, util=100.00%

Flops

Ttest: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=64

fio-2.1.3

Starting 1 process

Jobs: 1 (f=1): [r] [100.0% done] [2261KB/0KB/0KB /s] [565/0/0 iops] [eta 00m:00s]

test: (groupid=0, jobs=1): err= 0: pid=1486:

read: io=4096.0MB, bw=2259.9KB/s,

iops=564

, runt=1856032msec

cpu: usr=0.51%, sys=1.75%, ctx=1036500, majf=0, minf=70

IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%

submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%

issued: total=r=1048576/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=4096.0MB, aggrb=2259KB/s, minb=2259KB/s, maxb=2259KB/s, mint=1856032msec, maxt=1856032msec

Disk stats (read/write):
vda: ios=1048488/40, merge=0/2, ticks=118733168/20, in_queue=118736612, util=100.00%

Vdsina

test: (groupid=0, jobs=1): err= 0: pid=28962:

read: io=4096.0MB, bw=392394KB/s,

iops=98098

, runt= 10689msec

cpu: usr=10.59%, sys=27.46%, ctx=16742, majf=0, minf=88

IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%

submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%

issued: total=r=1048576/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=4096.0MB, aggrb=392394KB/s, minb=392394KB/s, maxb=392394KB/s, mint=10689msec, maxt=10689msec

Disk stats (read/write):
vda: ios=1046002/2, merge=0/3, ticks=521024/0, in_queue=520932, util=90.98%

Случайное чтение/запись

$ fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=4G --readwrite=randrw --rwmixread=75
Vscale

test: (groupid=0, jobs=1): err= 0: pid=27836:

read: io=3071.7MB, bw=212584KB/s,

iops=53145

, runt= 14796msec

write: io=1024.4MB, bw=70892KB/s,

iops=17722

, runt= 14796msec

cpu: usr=16.93%, sys=32.63%, ctx=18011, majf=0, minf=22

IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%

submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%

issued: total=r=786347/w=262229/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=3071.7MB, aggrb=212583KB/s, minb=212583KB/s, maxb=212583KB/s, mint=14796msec, maxt=14796msec
WRITE: io=1024.4MB, aggrb=70891KB/s, minb=70891KB/s, maxb=70891KB/s, mint=14796msec, maxt=14796msec

Disk stats (read/write):
vda: ios=774997/258507, merge=0/3, ticks=720836/243716, in_queue=675204, util=96.32%

Digital Ocean

test: (groupid=0, jobs=1): err= 0: pid=1502:

read: io=3071.7MB, bw=212684KB/s,

iops=53171

, runt= 14789msec

write: io=1024.4MB, bw=70925KB/s,

iops=17731

, runt= 14789msec

cpu: usr=15.70%, sys=62.97%, ctx=37546, majf=0, minf=22

IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%

submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%

issued: total=r=786347/w=262229/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=3071.7MB, aggrb=212684KB/s, minb=212684KB/s, maxb=212684KB/s, mint=14789msec, maxt=14789msec
WRITE: io=1024.4MB, aggrb=70925KB/s, minb=70925KB/s, maxb=70925KB/s, mint=14789msec, maxt=14789msec

Disk stats (read/write):
vda: ios=783813/261330, merge=0/3, ticks=155432/539592, in_queue=694836, util=99.45%

Simple Cloud

test: (groupid=0, jobs=1): err= 0: pid=30299:

read: io=3071.7MB, bw=15004KB/s,

iops=3751

, runt=209632msec

write: io=1024.4MB, bw=5003.7KB/s,

iops=1250

, runt=209632msec

cpu: usr=1.50%, sys=6.29%, ctx=436095, majf=0, minf=7

IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%

submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%

issued: total=r=786347/w=262229/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=3071.7MB, aggrb=15004KB/s, minb=15004KB/s, maxb=15004KB/s, mint=209632msec, maxt=209632msec
WRITE: io=1024.4MB, aggrb=5003KB/s, minb=5003KB/s, maxb=5003KB/s, mint=209632msec, maxt=209632msec

Disk stats (read/write):
sda: ios=786305/262316, merge=0/49, ticks=12138328/1234504, in_

Flops

Test: Laying out IO file(s) (1 file(s) / 4096MB)

Jobs: 1 (f=1): [m] [100.0% done] [2261KB/675KB/0KB /s] [565/168/0 iops] [eta 00m:00s]

test: (groupid=0, jobs=1): err= 0: pid=1366:

read: io=3071.7MB, bw=2226.5KB/s,

iops=556

, runt=1412766msec

write: io=1024.4MB, bw=760274B/s,

iops=185

, runt=1412766msec

cpu: usr=0.58%, sys=2.30%, ctx=1003423, majf=0, minf=6

IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%

submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%

issued: total=r=786347/w=262229/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=3071.7MB, aggrb=2226KB/s, minb=2226KB/s, maxb=2226KB/s, mint=1412766msec, maxt=1412766msec
WRITE: io=1024.4MB, aggrb=742KB/s, minb=742KB/s, maxb=742KB/s, mint=1412766msec, maxt=1412766msec

Vdsina

test: (groupid=0, jobs=1): err= 0: pid=28951:

read: io=3071.7MB, bw=193837KB/s,

iops=48459

, runt= 16227msec

write: io=1024.4MB, bw=64640KB/s,

iops=16160

, runt= 16227msec

cpu: usr=10.31%, sys=31.69%, ctx=148968, majf=0, minf=22

IO depths: 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%

submit: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

complete: 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%

issued: total=r=786347/w=262229/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
READ: io=3071.7MB, aggrb=193836KB/s, minb=193836KB/s, maxb=193836KB/s, mint=16227msec, maxt=16227msec
WRITE: io=1024.4MB, aggrb=64640KB/s, minb=64640KB/s, maxb=64640KB/s, mint=16227msec, maxt=16227msec

Disk stats (read/write):
vda: ios=770125/256758, merge=0/7, ticks=58980/918912, in_queue=978268, util=99.42%

Итоговая сравнительная таблица:

Тесты:

Unixbench (Австралия, Сидней)
   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   02:46:36 up 2 min,  1 user,  load average: 0.58, 0.19, 0.06; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Mon Dec 16 2022 02:46:36 - 03:14:41
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       25102626.8 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4295.6 MWIPS (9.8 s, 7 samples)
Execl Throughput                               4230.2 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        604499.7 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          169295.0 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1277011.0 KBps  (30.0 s, 2 samples)
Pipe Throughput                              959022.0 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 140482.6 lps   (10.0 s, 7 samples)
Process Creation                               9784.3 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7107.8 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    906.8 lpm   (60.0 s, 2 samples)
System Call Overhead                         673720.5 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   25102626.8   2151.0
Double-Precision Whetstone                       55.0       4295.6    781.0
Execl Throughput                                 43.0       4230.2    983.8
File Copy 1024 bufsize 2000 maxblocks          3960.0     604499.7   1526.5
File Copy 256 bufsize 500 maxblocks            1655.0     169295.0   1022.9
File Copy 4096 bufsize 8000 maxblocks          5800.0    1277011.0   2201.7
Pipe Throughput                               12440.0     959022.0    770.9
Pipe-based Context Switching                   4000.0     140482.6    351.2
Process Creation                                126.0       9784.3    776.5
Shell Scripts (1 concurrent)                     42.4       7107.8   1676.4
Shell Scripts (8 concurrent)                      6.0        906.8   1511.4
System Call Overhead                          15000.0     673720.5    449.1
                                                                   ========
System Benchmarks Index Score                                        1025.9

Unixbench (Канада, Торонто)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 82d9ed4018dd (5187.8 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   02:42:53 up 2 min,  1 user,  load average: 0.64, 0.17, 0.06; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Mon Dec 16 2022 02:42:53 - 03:11:00
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       38699273.9 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4619.5 MWIPS (10.2 s, 7 samples)
Execl Throughput                               6768.4 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        705978.4 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          192749.4 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1751883.6 KBps  (30.0 s, 2 samples)
Pipe Throughput                             1012385.6 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 179610.0 lps   (10.0 s, 7 samples)
Process Creation                              15081.7 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                  10739.0 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   1378.7 lpm   (60.0 s, 2 samples)
System Call Overhead                         570458.3 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   38699273.9   3316.1
Double-Precision Whetstone                       55.0       4619.5    839.9
Execl Throughput                                 43.0       6768.4   1574.0
File Copy 1024 bufsize 2000 maxblocks          3960.0     705978.4   1782.8
File Copy 256 bufsize 500 maxblocks            1655.0     192749.4   1164.6
File Copy 4096 bufsize 8000 maxblocks          5800.0    1751883.6   3020.5
Pipe Throughput                               12440.0    1012385.6    813.8
Pipe-based Context Switching                   4000.0     179610.0    449.0
Process Creation                                126.0      15081.7   1197.0
Shell Scripts (1 concurrent)                     42.4      10739.0   2532.8
Shell Scripts (8 concurrent)                      6.0       1378.7   2297.8
System Call Overhead                          15000.0     570458.3    380.3
                                                                   ========
System Benchmarks Index Score                                        1314.5

Unixbench (Германия, Франкфурт)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 714389bda930 (4800.0 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   23:41:12 up 3 min,  1 user,  load average: 0.49, 0.17, 0.06; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Fri Dec 13 2022 23:41:12 - 00:09:21
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       26077546.4 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     3561.5 MWIPS (9.9 s, 7 samples)
Execl Throughput                               4233.5 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        495359.7 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          130299.0 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1347940.9 KBps  (30.0 s, 2 samples)
Pipe Throughput                              657753.9 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 117057.6 lps   (10.0 s, 7 samples)
Process Creation                               9390.0 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   6618.6 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    870.7 lpm   (60.1 s, 2 samples)
System Call Overhead                         359105.0 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   26077546.4   2234.6
Double-Precision Whetstone                       55.0       3561.5    647.5
Execl Throughput                                 43.0       4233.5    984.5
File Copy 1024 bufsize 2000 maxblocks          3960.0     495359.7   1250.9
File Copy 256 bufsize 500 maxblocks            1655.0     130299.0    787.3
File Copy 4096 bufsize 8000 maxblocks          5800.0    1347940.9   2324.0
Pipe Throughput                               12440.0     657753.9    528.7
Pipe-based Context Switching                   4000.0     117057.6    292.6
Process Creation                                126.0       9390.0    745.2
Shell Scripts (1 concurrent)                     42.4       6618.6   1561.0
Shell Scripts (8 concurrent)                      6.0        870.7   1451.2
System Call Overhead                          15000.0     359105.0    239.4
                                                                   ========
System Benchmarks Index Score                                         875.9

Unixbench (Франция, Париж)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   12:37:38 up 5 min,  1 user,  load average: 0.85, 0.48, 0.21; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Thu Dec 12 2022 12:37:38 - 13:05:33
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables        8896034.1 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     1762.9 MWIPS (9.5 s, 7 samples)
Execl Throughput                               1488.3 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        170322.0 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks           46997.0 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks        499490.5 KBps  (30.0 s, 2 samples)
Pipe Throughput                              253632.7 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                  47089.9 lps   (10.0 s, 7 samples)
Process Creation                               3571.1 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   2557.8 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    339.8 lpm   (60.1 s, 2 samples)
System Call Overhead                         149530.8 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0    8896034.1    762.3
Double-Precision Whetstone                       55.0       1762.9    320.5
Execl Throughput                                 43.0       1488.3    346.1
File Copy 1024 bufsize 2000 maxblocks          3960.0     170322.0    430.1
File Copy 256 bufsize 500 maxblocks            1655.0      46997.0    284.0
File Copy 4096 bufsize 8000 maxblocks          5800.0     499490.5    861.2
Pipe Throughput                               12440.0     253632.7    203.9
Pipe-based Context Switching                   4000.0      47089.9    117.7
Process Creation                                126.0       3571.1    283.4
Shell Scripts (1 concurrent)                     42.4       2557.8    603.3
Shell Scripts (8 concurrent)                      6.0        339.8    566.3
System Call Overhead                          15000.0     149530.8     99.7
                                                                   ========
System Benchmarks Index Score                                         335.9

Unixbench (Япония, Токио)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   07:37:39 up 3 min,  1 user,  load average: 0.65, 0.31, 0.12; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Thu Dec 05 2022 07:37:39 - 08:05:44
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       26212655.7 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4429.9 MWIPS (10.0 s, 7 samples)
Execl Throughput                               4627.0 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        676411.8 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          181937.6 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1590192.7 KBps  (30.0 s, 2 samples)
Pipe Throughput                             1008509.9 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 147408.3 lps   (10.0 s, 7 samples)
Process Creation                              10743.2 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7856.9 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   1025.9 lpm   (60.0 s, 2 samples)
System Call Overhead                         689942.2 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   26212655.7   2246.2
Double-Precision Whetstone                       55.0       4429.9    805.4
Execl Throughput                                 43.0       4627.0   1076.0
File Copy 1024 bufsize 2000 maxblocks          3960.0     676411.8   1708.1
File Copy 256 bufsize 500 maxblocks            1655.0     181937.6   1099.3
File Copy 4096 bufsize 8000 maxblocks          5800.0    1590192.7   2741.7
Pipe Throughput                               12440.0    1008509.9    810.7
Pipe-based Context Switching                   4000.0     147408.3    368.5
Process Creation                                126.0      10743.2    852.6
Shell Scripts (1 concurrent)                     42.4       7856.9   1853.0
Shell Scripts (8 concurrent)                      6.0       1025.9   1709.8
System Call Overhead                          15000.0     689942.2    460.0
                                                                   ========
System Benchmarks Index Score                                        1115.7

Unixbench (Нидерланды, Амстердам)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   18:14:32 up 4 min,  1 user,  load average: 0.54, 0.21, 0.07; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Wed Dec 11 2022 18:14:32 - 18:42:36
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       24400966.1 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4307.7 MWIPS (10.0 s, 7 samples)
Execl Throughput                               4137.2 lps   (29.7 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        563366.3 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          166725.8 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1351284.6 KBps  (30.0 s, 2 samples)
Pipe Throughput                              947831.0 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 127169.9 lps   (10.0 s, 7 samples)
Process Creation                               9682.9 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   6961.7 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    917.2 lpm   (60.0 s, 2 samples)
System Call Overhead                         660482.8 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   24400966.1   2090.9
Double-Precision Whetstone                       55.0       4307.7    783.2
Execl Throughput                                 43.0       4137.2    962.1
File Copy 1024 bufsize 2000 maxblocks          3960.0     563366.3   1422.6
File Copy 256 bufsize 500 maxblocks            1655.0     166725.8   1007.4
File Copy 4096 bufsize 8000 maxblocks          5800.0    1351284.6   2329.8
Pipe Throughput                               12440.0     947831.0    761.9
Pipe-based Context Switching                   4000.0     127169.9    317.9
Process Creation                                126.0       9682.9    768.5
Shell Scripts (1 concurrent)                     42.4       6961.7   1641.9
Shell Scripts (8 concurrent)                      6.0        917.2   1528.7
System Call Overhead                          15000.0     660482.8    440.3
                                                                   ========
System Benchmarks Index Score                                        1006.6

Unixbench (Сингапур)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   14:17:01 up 4 min,  1 user,  load average: 0.68, 0.23, 0.08; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Wed Dec 11 2022 14:17:01 - 14:45:06
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       25144861.2 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4260.9 MWIPS (9.9 s, 7 samples)
Execl Throughput                               4040.1 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        427185.8 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          116507.8 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1148414.3 KBps  (30.0 s, 2 samples)
Pipe Throughput                              626572.7 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 115253.6 lps   (10.0 s, 7 samples)
Process Creation                               9620.9 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   6846.7 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    881.5 lpm   (60.0 s, 2 samples)
System Call Overhead                         344955.6 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   25144861.2   2154.7
Double-Precision Whetstone                       55.0       4260.9    774.7
Execl Throughput                                 43.0       4040.1    939.5
File Copy 1024 bufsize 2000 maxblocks          3960.0     427185.8   1078.8
File Copy 256 bufsize 500 maxblocks            1655.0     116507.8    704.0
File Copy 4096 bufsize 8000 maxblocks          5800.0    1148414.3   1980.0
Pipe Throughput                               12440.0     626572.7    503.7
Pipe-based Context Switching                   4000.0     115253.6    288.1
Process Creation                                126.0       9620.9    763.6
Shell Scripts (1 concurrent)                     42.4       6846.7   1614.8
Shell Scripts (8 concurrent)                      6.0        881.5   1469.2
System Call Overhead                          15000.0     344955.6    230.0
                                                                   ========
System Benchmarks Index Score                                         850.2

Unixbench (Великобритания, Лондон)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Intel Core Processor (Haswell, no TSX, IBRS) (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   15:54:53 up 2 min,  1 user,  load average: 0.62, 0.21, 0.07; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Sun Dec 15 2022 15:54:53 - 16:22:57
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       26199695.8 lps   (10.1 s, 7 samples)
Double-Precision Whetstone                     4515.1 MWIPS (9.9 s, 7 samples)
Execl Throughput                               4408.5 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        595220.1 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          166098.6 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1395372.9 KBps  (30.0 s, 2 samples)
Pipe Throughput                              993618.1 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 141759.0 lps   (10.0 s, 7 samples)
Process Creation                              10582.5 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7349.8 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    939.8 lpm   (60.1 s, 2 samples)
System Call Overhead                         689617.2 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   26199695.8   2245.0
Double-Precision Whetstone                       55.0       4515.1    820.9
Execl Throughput                                 43.0       4408.5   1025.2
File Copy 1024 bufsize 2000 maxblocks          3960.0     595220.1   1503.1
File Copy 256 bufsize 500 maxblocks            1655.0     166098.6   1003.6
File Copy 4096 bufsize 8000 maxblocks          5800.0    1395372.9   2405.8
Pipe Throughput                               12440.0     993618.1    798.7
Pipe-based Context Switching                   4000.0     141759.0    354.4
Process Creation                                126.0      10582.5    839.9
Shell Scripts (1 concurrent)                     42.4       7349.8   1733.4
Shell Scripts (8 concurrent)                      6.0        939.8   1566.4
System Call Overhead                          15000.0     689617.2    459.7
                                                                   ========
System Benchmarks Index Score                                        1061.0

Unixbench (США, Атланта)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   18:59:49 up 2 min,  1 user,  load average: 0.65, 0.22, 0.08; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Sun Dec 15 2022 18:59:49 - 19:27:54
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       25425673.3 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4296.1 MWIPS (9.9 s, 7 samples)
Execl Throughput                               4230.5 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        463467.3 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          126388.6 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1186982.0 KBps  (30.0 s, 2 samples)
Pipe Throughput                              646774.2 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 122358.8 lps   (10.0 s, 7 samples)
Process Creation                               9800.5 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7261.6 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    938.8 lpm   (60.0 s, 2 samples)
System Call Overhead                         357385.0 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   25425673.3   2178.7
Double-Precision Whetstone                       55.0       4296.1    781.1
Execl Throughput                                 43.0       4230.5    983.8
File Copy 1024 bufsize 2000 maxblocks          3960.0     463467.3   1170.4
File Copy 256 bufsize 500 maxblocks            1655.0     126388.6    763.7
File Copy 4096 bufsize 8000 maxblocks          5800.0    1186982.0   2046.5
Pipe Throughput                               12440.0     646774.2    519.9
Pipe-based Context Switching                   4000.0     122358.8    305.9
Process Creation                                126.0       9800.5    777.8
Shell Scripts (1 concurrent)                     42.4       7261.6   1712.6
Shell Scripts (8 concurrent)                      6.0        938.8   1564.6
System Call Overhead                          15000.0     357385.0    238.3
                                                                   ========
System Benchmarks Index Score                                         888.4

Unixbench (США, Чикаго)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   01:04:10 up 2 min,  1 user,  load average: 0.60, 0.20, 0.07; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Mon Dec 16 2022 01:04:10 - 01:32:14
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       25523985.5 lps   (10.1 s, 7 samples)
Double-Precision Whetstone                     4315.5 MWIPS (9.9 s, 7 samples)
Execl Throughput                               4148.4 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        452161.7 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          123919.4 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1196969.9 KBps  (30.0 s, 2 samples)
Pipe Throughput                              642700.8 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 124108.9 lps   (10.0 s, 7 samples)
Process Creation                               9849.9 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7299.6 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    941.0 lpm   (60.0 s, 2 samples)
System Call Overhead                         355273.2 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   25523985.5   2187.1
Double-Precision Whetstone                       55.0       4315.5    784.6
Execl Throughput                                 43.0       4148.4    964.8
File Copy 1024 bufsize 2000 maxblocks          3960.0     452161.7   1141.8
File Copy 256 bufsize 500 maxblocks            1655.0     123919.4    748.8
File Copy 4096 bufsize 8000 maxblocks          5800.0    1196969.9   2063.7
Pipe Throughput                               12440.0     642700.8    516.6
Pipe-based Context Switching                   4000.0     124108.9    310.3
Process Creation                                126.0       9849.9    781.7
Shell Scripts (1 concurrent)                     42.4       7299.6   1721.6
Shell Scripts (8 concurrent)                      6.0        941.0   1568.4
System Call Overhead                          15000.0     355273.2    236.8
                                                                   ========
System Benchmarks Index Score                                         886.0

Unixbench (США, Даллас)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4800.0 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   01:07:22 up 2 min,  1 user,  load average: 0.62, 0.19, 0.07; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Mon Dec 16 2022 01:07:22 - 01:35:27
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       26030426.9 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4443.2 MWIPS (10.0 s, 7 samples)
Execl Throughput                               4537.8 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        634719.5 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          176552.9 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1486392.3 KBps  (30.0 s, 2 samples)
Pipe Throughput                              990514.7 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 144687.4 lps   (10.0 s, 7 samples)
Process Creation                              10880.8 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7575.3 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    992.9 lpm   (60.0 s, 2 samples)
System Call Overhead                         688433.6 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   26030426.9   2230.5
Double-Precision Whetstone                       55.0       4443.2    807.9
Execl Throughput                                 43.0       4537.8   1055.3
File Copy 1024 bufsize 2000 maxblocks          3960.0     634719.5   1602.8
File Copy 256 bufsize 500 maxblocks            1655.0     176552.9   1066.8
File Copy 4096 bufsize 8000 maxblocks          5800.0    1486392.3   2562.7
Pipe Throughput                               12440.0     990514.7    796.2
Pipe-based Context Switching                   4000.0     144687.4    361.7
Process Creation                                126.0      10880.8    863.6
Shell Scripts (1 concurrent)                     42.4       7575.3   1786.6
Shell Scripts (8 concurrent)                      6.0        992.9   1654.8
System Call Overhead                          15000.0     688433.6    459.0
                                                                   ========
System Benchmarks Index Score                                        1090.0

Unixbench (США, Лос-Анджелес)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   01:11:21 up 3 min,  1 user,  load average: 0.71, 0.29, 0.11; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Mon Dec 16 2022 01:11:21 - 01:39:26
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       25267089.5 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     4246.4 MWIPS (9.9 s, 7 samples)
Execl Throughput                               4112.8 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        456196.7 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          122812.5 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1192809.7 KBps  (30.0 s, 2 samples)
Pipe Throughput                              636446.5 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 116546.4 lps   (10.0 s, 7 samples)
Process Creation                               9696.7 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7097.2 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    919.9 lpm   (60.0 s, 2 samples)
System Call Overhead                         352701.1 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   25267089.5   2165.1
Double-Precision Whetstone                       55.0       4246.4    772.1
Execl Throughput                                 43.0       4112.8    956.5
File Copy 1024 bufsize 2000 maxblocks          3960.0     456196.7   1152.0
File Copy 256 bufsize 500 maxblocks            1655.0     122812.5    742.1
File Copy 4096 bufsize 8000 maxblocks          5800.0    1192809.7   2056.6
Pipe Throughput                               12440.0     636446.5    511.6
Pipe-based Context Switching                   4000.0     116546.4    291.4
Process Creation                                126.0       9696.7    769.6
Shell Scripts (1 concurrent)                     42.4       7097.2   1673.9
Shell Scripts (8 concurrent)                      6.0        919.9   1533.2
System Call Overhead                          15000.0     352701.1    235.1
                                                                   ========
System Benchmarks Index Score                                         872.5

Unixbench (США, Майами)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   01:15:03 up 2 min,  1 user,  load average: 0.60, 0.21, 0.07; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Mon Dec 16 2022 01:15:03 - 01:43:08
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       26582764.1 lps   (10.1 s, 7 samples)
Double-Precision Whetstone                     4412.8 MWIPS (10.0 s, 7 samples)
Execl Throughput                               4634.7 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        669481.5 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          179719.1 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1533680.6 KBps  (30.0 s, 2 samples)
Pipe Throughput                              997113.7 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 145060.8 lps   (10.0 s, 7 samples)
Process Creation                              11030.6 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7915.2 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   1025.9 lpm   (60.0 s, 2 samples)
System Call Overhead                         686188.0 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   26582764.1   2277.9
Double-Precision Whetstone                       55.0       4412.8    802.3
Execl Throughput                                 43.0       4634.7   1077.8
File Copy 1024 bufsize 2000 maxblocks          3960.0     669481.5   1690.6
File Copy 256 bufsize 500 maxblocks            1655.0     179719.1   1085.9
File Copy 4096 bufsize 8000 maxblocks          5800.0    1533680.6   2644.3
Pipe Throughput                               12440.0     997113.7    801.5
Pipe-based Context Switching                   4000.0     145060.8    362.7
Process Creation                                126.0      11030.6    875.4
Shell Scripts (1 concurrent)                     42.4       7915.2   1866.8
Shell Scripts (8 concurrent)                      6.0       1025.9   1709.8
System Call Overhead                          15000.0     686188.0    457.5
                                                                   ========
System Benchmarks Index Score                                        1111.4

Unixbench (США, Нью-Йорк)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 714389bda930 (4800.0 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   00:55:26 up 2 min,  1 user,  load average: 0.56, 0.23, 0.09; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Mon Dec 16 2022 00:55:26 - 01:23:34
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       25633639.9 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     3533.8 MWIPS (9.9 s, 7 samples)
Execl Throughput                               4070.4 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        474437.0 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          126743.5 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1199905.9 KBps  (30.0 s, 2 samples)
Pipe Throughput                              647341.0 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                  88978.2 lps   (10.0 s, 7 samples)
Process Creation                               7295.0 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   6352.0 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    826.7 lpm   (60.0 s, 2 samples)
System Call Overhead                         353376.1 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   25633639.9   2196.5
Double-Precision Whetstone                       55.0       3533.8    642.5
Execl Throughput                                 43.0       4070.4    946.6
File Copy 1024 bufsize 2000 maxblocks          3960.0     474437.0   1198.1
File Copy 256 bufsize 500 maxblocks            1655.0     126743.5    765.8
File Copy 4096 bufsize 8000 maxblocks          5800.0    1199905.9   2068.8
Pipe Throughput                               12440.0     647341.0    520.4
Pipe-based Context Switching                   4000.0      88978.2    222.4
Process Creation                                126.0       7295.0    579.0
Shell Scripts (1 concurrent)                     42.4       6352.0   1498.1
Shell Scripts (8 concurrent)                      6.0        826.7   1377.9
System Call Overhead                          15000.0     353376.1    235.6
                                                                   ========
System Benchmarks Index Score                                         812.4

Unixbench (США, Сиэтл)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 714389bda930 (4800.0 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   01:18:39 up 2 min,  1 user,  load average: 0.73, 0.25, 0.09; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Mon Dec 16 2022 01:18:39 - 01:46:47
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       26700878.9 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     3622.7 MWIPS (9.9 s, 7 samples)
Execl Throughput                               3907.5 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        486945.0 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          130046.2 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1283902.3 KBps  (30.0 s, 2 samples)
Pipe Throughput                              662209.3 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 113981.0 lps   (10.0 s, 7 samples)
Process Creation                               8765.1 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7075.8 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    905.1 lpm   (60.1 s, 2 samples)
System Call Overhead                         364946.5 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   26700878.9   2288.0
Double-Precision Whetstone                       55.0       3622.7    658.7
Execl Throughput                                 43.0       3907.5    908.7
File Copy 1024 bufsize 2000 maxblocks          3960.0     486945.0   1229.7
File Copy 256 bufsize 500 maxblocks            1655.0     130046.2    785.8
File Copy 4096 bufsize 8000 maxblocks          5800.0    1283902.3   2213.6
Pipe Throughput                               12440.0     662209.3    532.3
Pipe-based Context Switching                   4000.0     113981.0    285.0
Process Creation                                126.0       8765.1    695.6
Shell Scripts (1 concurrent)                     42.4       7075.8   1668.8
Shell Scripts (8 concurrent)                      6.0        905.1   1508.5
System Call Overhead                          15000.0     364946.5    243.3
                                                                   ========
System Benchmarks Index Score                                         870.5

Unixbench (США, Сан-Хосе)

   BYTE UNIX Benchmarks (Version 5.1.3)

   System: vultr.guest: GNU/Linux
   OS: GNU/Linux -- 4.9.0-11-amd64 -- #1 SMP Debian 4.9.189-3 deb9u1 (2022-09-20)
   Machine: x86_64 (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: Virtual CPU 523cbcdd6ca4 (4788.9 bogomips)
          x86-64, MMX, Physical Address Ext, SYSENTER/SYSEXIT, SYSCALL/SYSRET
   02:40:36 up 3 min,  1 user,  load average: 0.62, 0.21, 0.07; runlevel 5

------------------------------------------------------------------------
Benchmark Run: Mon Dec 16 2022 02:40:36 - 03:08:40
1 CPU in system; running 1 parallel copy of tests

Dhrystone 2 using register variables       26677842.8 lps   (10.1 s, 7 samples)
Double-Precision Whetstone                     4517.5 MWIPS (10.0 s, 7 samples)
Execl Throughput                               4679.7 lps   (30.0 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        658109.9 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks          179078.5 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks       1513335.5 KBps  (30.0 s, 2 samples)
Pipe Throughput                             1011954.1 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 147993.7 lps   (10.0 s, 7 samples)
Process Creation                              11034.6 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   7761.3 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                   1007.2 lpm   (60.0 s, 2 samples)
System Call Overhead                         686496.1 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   26677842.8   2286.0
Double-Precision Whetstone                       55.0       4517.5    821.4
Execl Throughput                                 43.0       4679.7   1088.3
File Copy 1024 bufsize 2000 maxblocks          3960.0     658109.9   1661.9
File Copy 256 bufsize 500 maxblocks            1655.0     179078.5   1082.0
File Copy 4096 bufsize 8000 maxblocks          5800.0    1513335.5   2609.2
Pipe Throughput                               12440.0    1011954.1    813.5
Pipe-based Context Switching                   4000.0     147993.7    370.0
Process Creation                                126.0      11034.6    875.8
Shell Scripts (1 concurrent)                     42.4       7761.3   1830.5
Shell Scripts (8 concurrent)                      6.0       1007.2   1678.6
System Call Overhead                          15000.0     686496.1    457.7
                                                                   ========
System Benchmarks Index Score                                        1111.5

fio (Австралия, Сидней)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=28589: Mon Dec 16 03:16:07 2022
  read : io=7674.1MB, bw=130983KB/s, iops=32745, runt= 60001msec
    clat (usec): min=1, max=13364, avg=240.17, stdev=183.78
     lat (usec): min=2, max=13365, avg=240.76, stdev=183.79
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[  171], 20.00th=[  193],
     | 30.00th=[  207], 40.00th=[  221], 50.00th=[  233], 60.00th=[  247],
     | 70.00th=[  266], 80.00th=[  290], 90.00th=[  334], 95.00th=[  374],
     | 99.00th=[  470], 99.50th=[  540], 99.90th=[ 2864], 99.95th=[ 3408],
     | 99.99th=[ 7008]
    bw (KB  /s): min=10904, max=23080, per=12.50%, avg=16375.51, stdev=1940.14
    lat (usec) : 2=0.02%, 4=5.24%, 10=1.36%, 20=0.94%, 50=0.29%
    lat (usec) : 100=0.02%, 250=53.43%, 500=37.99%, 750=0.42%, 1000=0.04%
    lat (msec) : 2=0.05%, 4=0.18%, 10=0.03%, 20=0.01%
  cpu          : usr=1.87%, sys=5.83%, ctx=1816331, majf=2, minf=94
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1964785/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7674.1MB, aggrb=130983KB/s, minb=130983KB/s, maxb=130983KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1809446/9, merge=0/4, ticks=391072/0, in_queue=391128, util=98.07%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=28618: Mon Dec 16 03:18:14 2022
  write: io=31535MB, bw=537932KB/s, iops=134482, runt= 60029msec
    clat (usec): min=1, max=512047, avg=44.70, stdev=1034.85
     lat (usec): min=1, max=512048, avg=47.33, stdev=1074.92
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    2], 20.00th=[    3],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    4], 90.00th=[    4], 95.00th=[    6],
     | 99.00th=[   18], 99.50th=[   28], 99.90th=[15296], 99.95th=[19840],
     | 99.99th=[30848]
    bw (KB  /s): min=    1, max=85640, per=12.68%, avg=68203.30, stdev=11017.32
    lat (usec) : 2=0.12%, 4=77.58%, 10=19.53%, 20=2.07%, 50=0.27%
    lat (usec) : 100=0.04%, 250=0.02%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.03%, 10=0.10%, 20=0.13%, 50=0.05%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  cpu          : usr=2.64%, sys=7.81%, ctx=76430, majf=0, minf=83
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=8072876/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=31535MB, aggrb=537931KB/s, minb=537931KB/s, maxb=537931KB/s, mint=60029msec, maxt=60029msec

Disk stats (read/write):
  vda: ios=169/782742, merge=0/8447, ticks=1264/6814944, in_queue=6818788, util=98.98%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=28602: Mon Dec 16 03:17:14 2022
  read : io=7471.5MB, bw=127506KB/s, iops=31876, runt= 60003msec
    clat (usec): min=132, max=10029, avg=246.78, stdev=107.92
     lat (usec): min=133, max=10030, avg=247.38, stdev=107.95
    clat percentiles (usec):
     |  1.00th=[  159],  5.00th=[  173], 10.00th=[  183], 20.00th=[  197],
     | 30.00th=[  209], 40.00th=[  219], 50.00th=[  231], 60.00th=[  245],
     | 70.00th=[  262], 80.00th=[  286], 90.00th=[  326], 95.00th=[  362],
     | 99.00th=[  446], 99.50th=[  494], 99.90th=[  884], 99.95th=[ 1752],
     | 99.99th=[ 4960]
    bw (KB  /s): min=13352, max=17536, per=12.50%, avg=15943.78, stdev=782.58
    lat (usec) : 250=63.11%, 500=36.43%, 750=0.33%, 1000=0.04%
    lat (msec) : 2=0.04%, 4=0.02%, 10=0.03%, 20=0.01%
  cpu          : usr=1.84%, sys=4.97%, ctx=1916371, majf=0, minf=80
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1912681/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7471.5MB, aggrb=127505KB/s, minb=127505KB/s, maxb=127505KB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  vda: ios=1911024/10, merge=0/14, ticks=387936/0, in_queue=387700, util=99.79%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=28631: Mon Dec 16 03:19:15 2022
  write: io=2116.3MB, bw=36114KB/s, iops=9028, runt= 60005msec
    clat (usec): min=60, max=52275, avg=881.45, stdev=5188.98
     lat (usec): min=60, max=52275, avg=882.13, stdev=5189.03
    clat percentiles (usec):
     |  1.00th=[   67],  5.00th=[   71], 10.00th=[   74], 20.00th=[   80],
     | 30.00th=[   85], 40.00th=[   90], 50.00th=[   95], 60.00th=[  101],
     | 70.00th=[  109], 80.00th=[  121], 90.00th=[  161], 95.00th=[  215],
     | 99.00th=[36096], 99.50th=[38144], 99.90th=[41216], 99.95th=[42240],
     | 99.99th=[44800]
    bw (KB  /s): min= 3169, max= 5891, per=12.51%, avg=4516.12, stdev=452.68
    lat (usec) : 100=57.43%, 250=39.03%, 500=1.24%, 750=0.04%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.02%, 20=0.01%, 50=2.21%
    lat (msec) : 100=0.01%
  cpu          : usr=0.61%, sys=2.76%, ctx=1095749, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=541749/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2116.3MB, aggrb=36113KB/s, minb=36113KB/s, maxb=36113KB/s, mint=60005msec, maxt=60005msec

Disk stats (read/write):
  vda: ios=182/541139, merge=0/1556, ticks=100/47652, in_queue=47640, util=79.23%

fio (Канада, Торонто)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=4579: Mon Dec 16 03:12:15 2022
  read : io=12498MB, bw=213300KB/s, iops=53324, runt= 60001msec
    clat (usec): min=1, max=12335, avg=146.68, stdev=110.17
     lat (usec): min=1, max=12335, avg=147.24, stdev=110.17
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    4], 20.00th=[  135],
     | 30.00th=[  141], 40.00th=[  147], 50.00th=[  151], 60.00th=[  155],
     | 70.00th=[  161], 80.00th=[  169], 90.00th=[  183], 95.00th=[  201],
     | 99.00th=[  318], 99.50th=[  422], 99.90th=[ 1832], 99.95th=[ 2024],
     | 99.99th=[ 2672]
    bw (KB  /s): min=17680, max=35552, per=12.47%, avg=26605.05, stdev=3053.39
    lat (usec) : 2=0.92%, 4=8.94%, 10=0.77%, 20=0.02%, 50=0.01%
    lat (usec) : 100=0.13%, 250=87.61%, 500=1.28%, 750=0.05%, 1000=0.02%
    lat (msec) : 2=0.21%, 4=0.05%, 10=0.01%, 20=0.01%
  cpu          : usr=2.33%, sys=5.24%, ctx=2863832, majf=2, minf=87
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=3199546/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=12498MB, aggrb=213299KB/s, minb=213299KB/s, maxb=213299KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=2853531/9, merge=0/4, ticks=413816/0, in_queue=413848, util=97.93%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=4606: Mon Dec 16 03:14:20 2022
  write: io=40568MB, bw=692123KB/s, iops=173030, runt= 60020msec
    clat (usec): min=1, max=168030, avg=30.86, stdev=724.13
     lat (usec): min=1, max=168030, avg=33.62, stdev=769.11
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    2], 40.00th=[    2], 50.00th=[    2], 60.00th=[    2],
     | 70.00th=[    3], 80.00th=[    3], 90.00th=[    3], 95.00th=[    3],
     | 99.00th=[    4], 99.50th=[    8], 99.90th=[11712], 99.95th=[16192],
     | 99.99th=[27776]
    bw (KB  /s): min=    1, max=102488, per=12.60%, avg=87188.15, stdev=9025.40
    lat (usec) : 2=0.15%, 4=98.40%, 10=1.00%, 20=0.07%, 50=0.06%
    lat (usec) : 100=0.02%, 250=0.01%, 500=0.02%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.03%, 10=0.09%, 20=0.09%, 50=0.03%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=4.36%, sys=6.42%, ctx=83149, majf=0, minf=75
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=10385305/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=40568MB, aggrb=692122KB/s, minb=692122KB/s, maxb=692122KB/s, mint=60020msec, maxt=60020msec

Disk stats (read/write):
  vda: ios=625/1328807, merge=0/8697, ticks=3072/7005192, in_queue=7008748, util=99.27%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=4593: Mon Dec 16 03:13:20 2022
  read : io=11311MB, bw=193037KB/s, iops=48259, runt= 60001msec
    clat (usec): min=75, max=8391, avg=162.37, stdev=140.17
     lat (usec): min=76, max=8391, avg=162.94, stdev=140.17
    clat percentiles (usec):
     |  1.00th=[  123],  5.00th=[  131], 10.00th=[  135], 20.00th=[  141],
     | 30.00th=[  145], 40.00th=[  149], 50.00th=[  151], 60.00th=[  157],
     | 70.00th=[  161], 80.00th=[  169], 90.00th=[  183], 95.00th=[  199],
     | 99.00th=[  290], 99.50th=[  406], 99.90th=[ 2192], 99.95th=[ 3120],
     | 99.99th=[ 6432]
    bw (KB  /s): min=17560, max=26000, per=12.50%, avg=24134.45, stdev=1483.61
    lat (usec) : 100=0.12%, 250=98.48%, 500=1.10%, 750=0.05%, 1000=0.02%
    lat (msec) : 2=0.11%, 4=0.08%, 10=0.04%
  cpu          : usr=2.16%, sys=4.65%, ctx=2903321, majf=0, minf=73
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2895610/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=11311MB, aggrb=193037KB/s, minb=193037KB/s, maxb=193037KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=2892534/8, merge=0/5, ticks=434584/0, in_queue=434828, util=99.87%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=4621: Mon Dec 16 03:15:21 2022
  write: io=2264.6MB, bw=38648KB/s, iops=9661, runt= 60002msec
    clat (usec): min=51, max=256774, avg=824.62, stdev=6716.44
     lat (usec): min=51, max=256775, avg=825.21, stdev=6716.44
    clat percentiles (usec):
     |  1.00th=[   56],  5.00th=[   57], 10.00th=[   58], 20.00th=[   60],
     | 30.00th=[   61], 40.00th=[   63], 50.00th=[   65], 60.00th=[   67],
     | 70.00th=[   71], 80.00th=[   89], 90.00th=[  139], 95.00th=[  203],
     | 99.00th=[43264], 99.50th=[55552], 99.90th=[81408], 99.95th=[96768],
     | 99.99th=[134144]
    bw (KB  /s): min= 1323, max= 8856, per=12.51%, avg=4835.55, stdev=1290.36
    lat (usec) : 100=81.77%, 250=14.40%, 500=1.52%, 750=0.17%, 1000=0.17%
    lat (msec) : 2=0.37%, 4=0.21%, 10=0.09%, 20=0.01%, 50=0.58%
    lat (msec) : 100=0.66%, 250=0.04%, 500=0.01%
  cpu          : usr=0.45%, sys=1.61%, ctx=1167262, majf=0, minf=82
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=579733/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2264.6MB, aggrb=38647KB/s, minb=38647KB/s, maxb=38647KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  vda: ios=173/578889, merge=0/1547, ticks=252/52532, in_queue=52724, util=87.45%

fio (Германия, Франкфурт)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=21959: Sat Dec 14 00:10:37 2022
  read : io=7915.7MB, bw=135091KB/s, iops=33772, runt= 60001msec
    clat (usec): min=1, max=15947, avg=231.15, stdev=202.63
     lat (usec): min=2, max=15947, avg=232.04, stdev=202.68
    clat percentiles (usec):
     |  1.00th=[    3],  5.00th=[    9], 10.00th=[  153], 20.00th=[  175],
     | 30.00th=[  189], 40.00th=[  201], 50.00th=[  215], 60.00th=[  229],
     | 70.00th=[  249], 80.00th=[  278], 90.00th=[  330], 95.00th=[  386],
     | 99.00th=[  588], 99.50th=[  940], 99.90th=[ 2704], 99.95th=[ 3152],
     | 99.99th=[ 8256]
    bw (KB  /s): min=13072, max=22224, per=12.50%, avg=16885.51, stdev=1416.82
    lat (usec) : 2=0.01%, 4=2.12%, 10=3.30%, 20=1.99%, 50=0.58%
    lat (usec) : 100=0.02%, 250=62.14%, 500=28.13%, 750=1.10%, 1000=0.15%
    lat (msec) : 2=0.21%, 4=0.23%, 10=0.02%, 20=0.01%
  cpu          : usr=2.90%, sys=7.72%, ctx=1870975, majf=2, minf=94
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2026398/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7915.7MB, aggrb=135090KB/s, minb=135090KB/s, maxb=135090KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1861991/9, merge=0/4, ticks=329328/0, in_queue=328932, util=98.13%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=21985: Sat Dec 14 00:12:43 2022
  write: io=26172MB, bw=446593KB/s, iops=111648, runt= 60009msec
    clat (usec): min=1, max=104202, avg=46.04, stdev=817.78
     lat (usec): min=2, max=104203, avg=50.84, stdev=880.51
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    3], 20.00th=[    3],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    4], 90.00th=[    5], 95.00th=[    7],
     | 99.00th=[   18], 99.50th=[   95], 99.90th=[14272], 99.95th=[18816],
     | 99.99th=[28032]
    bw (KB  /s): min=    1, max=66344, per=12.64%, avg=56439.90, stdev=6246.70
    lat (usec) : 2=0.01%, 4=74.88%, 10=21.89%, 20=2.34%, 50=0.31%
    lat (usec) : 100=0.08%, 250=0.03%, 500=0.02%, 750=0.02%, 1000=0.01%
    lat (msec) : 2=0.03%, 4=0.05%, 10=0.15%, 20=0.14%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=4.84%, sys=5.78%, ctx=92604, majf=0, minf=74
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=6699905/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=26172MB, aggrb=446593KB/s, minb=446593KB/s, maxb=446593KB/s, mint=60009msec, maxt=60009msec

Disk stats (read/write):
  vda: ios=169/1517807, merge=0/10554, ticks=652/6860812, in_queue=6861820, util=98.12%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=21972: Sat Dec 14 00:11:43 2022
  read : io=8536.2MB, bw=145672KB/s, iops=36417, runt= 60004msec
    clat (usec): min=118, max=11287, avg=214.02, stdev=81.60
     lat (usec): min=118, max=11288, avg=214.87, stdev=81.67
    clat percentiles (usec):
     |  1.00th=[  143],  5.00th=[  155], 10.00th=[  163], 20.00th=[  173],
     | 30.00th=[  183], 40.00th=[  191], 50.00th=[  201], 60.00th=[  213],
     | 70.00th=[  227], 80.00th=[  247], 90.00th=[  278], 95.00th=[  310],
     | 99.00th=[  398], 99.50th=[  442], 99.90th=[  628], 99.95th=[  804],
     | 99.99th=[ 3664]
    bw (KB  /s): min=14304, max=19464, per=12.50%, avg=18209.07, stdev=907.94
    lat (usec) : 250=81.57%, 500=18.17%, 750=0.20%, 1000=0.03%
    lat (msec) : 2=0.02%, 4=0.01%, 10=0.01%, 20=0.01%
  cpu          : usr=3.16%, sys=6.72%, ctx=2190379, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2185219/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8536.2MB, aggrb=145671KB/s, minb=145671KB/s, maxb=145671KB/s, mint=60004msec, maxt=60004msec

Disk stats (read/write):
  vda: ios=2182468/8, merge=0/5, ticks=399108/0, in_queue=398872, util=99.82%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=21998: Sat Dec 14 00:13:43 2022
  write: io=2255.2MB, bw=38485KB/s, iops=9621, runt= 60005msec
    clat (usec): min=65, max=42951, avg=825.62, stdev=4606.39
     lat (usec): min=65, max=42951, avg=826.56, stdev=4606.42
    clat percentiles (usec):
     |  1.00th=[   71],  5.00th=[   74], 10.00th=[   75], 20.00th=[   79],
     | 30.00th=[   83], 40.00th=[   88], 50.00th=[   93], 60.00th=[   98],
     | 70.00th=[  105], 80.00th=[  114], 90.00th=[  133], 95.00th=[  161],
     | 99.00th=[30336], 99.50th=[31616], 99.90th=[34048], 99.95th=[35072],
     | 99.99th=[38144]
    bw (KB  /s): min= 3420, max= 6336, per=12.51%, avg=4815.62, stdev=460.55
    lat (usec) : 100=62.03%, 250=35.23%, 500=0.26%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=2.45%
  cpu          : usr=1.02%, sys=3.03%, ctx=1169418, majf=0, minf=67
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=577318/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2255.2MB, aggrb=38484KB/s, minb=38484KB/s, maxb=38484KB/s, mint=60005msec, maxt=60005msec

Disk stats (read/write):
  vda: ios=177/576692, merge=0/1614, ticks=108/44140, in_queue=44096, util=73.32%

fio (Франция, Париж)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=21844: Thu Dec 12 13:06:55 2022
  read : io=3057.1MB, bw=52185KB/s, iops=13046, runt= 60004msec
    clat (usec): min=4, max=52368, avg=596.01, stdev=581.93
     lat (usec): min=5, max=52370, avg=598.59, stdev=582.58
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[  251], 10.00th=[  306], 20.00th=[  354],
     | 30.00th=[  398], 40.00th=[  446], 50.00th=[  510], 60.00th=[  572],
     | 70.00th=[  652], 80.00th=[  756], 90.00th=[  940], 95.00th=[ 1176],
     | 99.00th=[ 1992], 99.50th=[ 2928], 99.90th=[ 8032], 99.95th=[ 9536],
     | 99.99th=[18048]
    bw (KB  /s): min= 2432, max=10000, per=12.51%, avg=6526.19, stdev=974.23
    lat (usec) : 10=3.48%, 20=0.46%, 50=0.34%, 100=0.03%, 250=0.64%
    lat (usec) : 500=43.85%, 750=30.97%, 1000=12.02%
    lat (msec) : 2=7.22%, 4=0.67%, 10=0.28%, 20=0.03%, 50=0.01%
    lat (msec) : 100=0.01%
  cpu          : usr=3.03%, sys=6.50%, ctx=754863, majf=0, minf=82
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=782820/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=3057.1MB, aggrb=52184KB/s, minb=52184KB/s, maxb=52184KB/s, mint=60004msec, maxt=60004msec

Disk stats (read/write):
  vda: ios=748009/9, merge=0/4, ticks=297144/0, in_queue=296676, util=97.38%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=21880: Thu Dec 12 13:09:04 2022
  write: io=9695.7MB, bw=165439KB/s, iops=41359, runt= 60012msec
    clat (usec): min=4, max=272163, avg=120.45, stdev=1565.02
     lat (usec): min=5, max=272194, avg=133.49, stdev=1688.89
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    6], 20.00th=[    6],
     | 30.00th=[    7], 40.00th=[    8], 50.00th=[    8], 60.00th=[    8],
     | 70.00th=[    8], 80.00th=[    9], 90.00th=[   11], 95.00th=[   15],
     | 99.00th=[  129], 99.50th=[ 8768], 99.90th=[24192], 99.95th=[30336],
     | 99.99th=[41728]
    bw (KB  /s): min=    0, max=28015, per=12.73%, avg=21062.09, stdev=3164.09
    lat (usec) : 10=85.36%, 20=11.94%, 50=1.55%, 100=0.11%, 250=0.12%
    lat (usec) : 500=0.04%, 750=0.02%, 1000=0.02%
    lat (msec) : 2=0.06%, 4=0.09%, 10=0.23%, 20=0.30%, 50=0.17%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
  cpu          : usr=4.62%, sys=5.28%, ctx=55211, majf=0, minf=91
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=2482084/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=9695.7MB, aggrb=165439KB/s, minb=165439KB/s, maxb=165439KB/s, mint=60012msec, maxt=60012msec

Disk stats (read/write):
  vda: ios=570/734015, merge=0/6974, ticks=960/4050752, in_queue=4051320, util=67.62%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=21859: Thu Dec 12 13:08:04 2022
  read : io=3183.3MB, bw=54325KB/s, iops=13581, runt= 60003msec
    clat (usec): min=177, max=31523, avg=571.81, stdev=426.10
     lat (usec): min=178, max=31525, avg=574.34, stdev=426.65
    clat percentiles (usec):
     |  1.00th=[  251],  5.00th=[  290], 10.00th=[  318], 20.00th=[  354],
     | 30.00th=[  394], 40.00th=[  438], 50.00th=[  494], 60.00th=[  556],
     | 70.00th=[  620], 80.00th=[  708], 90.00th=[  860], 95.00th=[ 1032],
     | 99.00th=[ 1704], 99.50th=[ 2192], 99.90th=[ 7456], 99.95th=[ 8768],
     | 99.99th=[10944]
    bw (KB  /s): min= 2080, max= 8136, per=12.52%, avg=6803.39, stdev=713.56
    lat (usec) : 250=0.91%, 500=49.97%, 750=32.72%, 1000=10.66%
    lat (msec) : 2=5.10%, 4=0.44%, 10=0.18%, 20=0.01%, 50=0.01%
  cpu          : usr=3.21%, sys=6.17%, ctx=821085, majf=0, minf=74
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=814921/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=3183.3MB, aggrb=54325KB/s, minb=54325KB/s, maxb=54325KB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  vda: ios=814160/25, merge=0/21, ticks=309004/0, in_queue=308492, util=98.07%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=21905: Thu Dec 12 13:10:05 2022
  write: io=513932KB, bw=8564.1KB/s, iops=2141, runt= 60004msec
    clat (usec): min=124, max=75798, avg=3712.21, stdev=9522.14
     lat (usec): min=125, max=75801, avg=3715.65, stdev=9522.72
    clat percentiles (usec):
     |  1.00th=[  201],  5.00th=[  237], 10.00th=[  262], 20.00th=[  298],
     | 30.00th=[  330], 40.00th=[  366], 50.00th=[  418], 60.00th=[  482],
     | 70.00th=[  556], 80.00th=[  668], 90.00th=[25728], 95.00th=[30592],
     | 99.00th=[36096], 99.50th=[39168], 99.90th=[44800], 99.95th=[48896],
     | 99.99th=[62720]
    bw (KB  /s): min=  361, max= 1687, per=12.50%, avg=1070.72, stdev=161.85
    lat (usec) : 250=7.32%, 500=55.42%, 750=20.91%, 1000=3.87%
    lat (msec) : 2=1.37%, 4=0.23%, 10=0.16%, 20=0.05%, 50=10.64%
    lat (msec) : 100=0.04%
  cpu          : usr=0.84%, sys=3.45%, ctx=269617, majf=0, minf=64
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=128483/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=513932KB, aggrb=8564KB/s, minb=8564KB/s, maxb=8564KB/s, mint=60004msec, maxt=60004msec

Disk stats (read/write):
  vda: ios=563/128541, merge=0/2127, ticks=392/44204, in_queue=44448, util=73.41%

fio (Япония, Токио)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=27596: Thu Dec  5 08:07:04 2022
  read : io=8536.6MB, bw=145688KB/s, iops=36421, runt= 60001msec
    clat (usec): min=1, max=8864, avg=215.91, stdev=140.30
     lat (usec): min=1, max=8865, avg=216.46, stdev=140.31
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[  159], 20.00th=[  185],
     | 30.00th=[  197], 40.00th=[  209], 50.00th=[  217], 60.00th=[  229],
     | 70.00th=[  241], 80.00th=[  258], 90.00th=[  286], 95.00th=[  314],
     | 99.00th=[  398], 99.50th=[  540], 99.90th=[ 2224], 99.95th=[ 2736],
     | 99.99th=[ 3632]
    bw (KB  /s): min=14880, max=25576, per=12.49%, avg=18199.00, stdev=2075.46
    lat (usec) : 2=0.29%, 4=7.93%, 10=0.72%, 20=0.12%, 50=0.01%
    lat (usec) : 100=0.01%, 250=66.79%, 500=23.59%, 750=0.13%, 1000=0.06%
    lat (msec) : 2=0.19%, 4=0.15%, 10=0.01%
  cpu          : usr=1.91%, sys=5.45%, ctx=1991593, majf=2, minf=94
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2185355/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8536.6MB, aggrb=145687KB/s, minb=145687KB/s, maxb=145687KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1983091/10, merge=0/3, ticks=408440/0, in_queue=408168, util=98.38%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=27622: Thu Dec  5 08:09:12 2022
  write: io=35740MB, bw=609892KB/s, iops=152473, runt= 60007msec
    clat (usec): min=1, max=206966, avg=37.85, stdev=961.08
     lat (usec): min=1, max=206981, avg=40.42, stdev=1001.48
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    2], 40.00th=[    2], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    3], 90.00th=[    3], 95.00th=[    4],
     | 99.00th=[    9], 99.50th=[   14], 99.90th=[13248], 99.95th=[19584],
     | 99.99th=[33536]
    bw (KB  /s): min=    1, max=99528, per=12.64%, avg=77112.48, stdev=10362.96
    lat (usec) : 2=0.26%, 4=90.58%, 10=8.18%, 20=0.62%, 50=0.06%
    lat (usec) : 100=0.02%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.02%, 10=0.08%, 20=0.10%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=2.89%, sys=7.40%, ctx=68728, majf=0, minf=83
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=9149450/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=35740MB, aggrb=609892KB/s, minb=609892KB/s, maxb=609892KB/s, mint=60007msec, maxt=60007msec

Disk stats (read/write):
  vda: ios=180/643486, merge=0/8512, ticks=1204/6913368, in_queue=6916056, util=99.07%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=27609: Thu Dec  5 08:08:11 2022
  read : io=7775.5MB, bw=132697KB/s, iops=33174, runt= 60002msec
    clat (usec): min=132, max=4782, avg=237.29, stdev=83.99
     lat (usec): min=133, max=4783, avg=237.83, stdev=84.00
    clat percentiles (usec):
     |  1.00th=[  161],  5.00th=[  175], 10.00th=[  185], 20.00th=[  197],
     | 30.00th=[  209], 40.00th=[  219], 50.00th=[  227], 60.00th=[  239],
     | 70.00th=[  251], 80.00th=[  266], 90.00th=[  294], 95.00th=[  318],
     | 99.00th=[  390], 99.50th=[  450], 99.90th=[ 1400], 99.95th=[ 1784],
     | 99.99th=[ 3184]
    bw (KB  /s): min=14368, max=18584, per=12.50%, avg=16593.13, stdev=701.89
    lat (usec) : 250=69.35%, 500=30.27%, 750=0.13%, 1000=0.07%
    lat (msec) : 2=0.15%, 4=0.03%, 10=0.01%
  cpu          : usr=1.77%, sys=4.65%, ctx=1994084, majf=0, minf=57
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1990521/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7775.5MB, aggrb=132696KB/s, minb=132696KB/s, maxb=132696KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  vda: ios=1983437/8, merge=0/5, ticks=409560/0, in_queue=409268, util=99.87%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=27635: Thu Dec  5 08:10:12 2022
  write: io=2355.4MB, bw=40196KB/s, iops=10048, runt= 60003msec
    clat (usec): min=59, max=50972, avg=792.04, stdev=4971.28
     lat (usec): min=60, max=50973, avg=792.63, stdev=4971.29
    clat percentiles (usec):
     |  1.00th=[   66],  5.00th=[   69], 10.00th=[   73], 20.00th=[   78],
     | 30.00th=[   83], 40.00th=[   87], 50.00th=[   92], 60.00th=[   96],
     | 70.00th=[  101], 80.00th=[  108], 90.00th=[  124], 95.00th=[  149],
     | 99.00th=[36096], 99.50th=[38144], 99.90th=[41216], 99.95th=[42240],
     | 99.99th=[44288]
    bw (KB  /s): min= 3600, max= 6696, per=12.51%, avg=5026.41, stdev=488.82
    lat (usec) : 100=67.89%, 250=29.95%, 500=0.18%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=1.94%
    lat (msec) : 100=0.01%
  cpu          : usr=0.59%, sys=2.72%, ctx=1218150, majf=0, minf=74
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=602963/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2355.4MB, aggrb=40195KB/s, minb=40195KB/s, maxb=40195KB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  vda: ios=169/602207, merge=0/1593, ticks=12/48036, in_queue=47908, util=79.85%

fio (Нидерланды, Амстердам)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=15909: Wed Dec 11 18:43:57 2022
  read : io=7981.3MB, bw=136211KB/s, iops=34052, runt= 60001msec
    clat (usec): min=1, max=5923, avg=230.65, stdev=151.37
     lat (usec): min=1, max=5924, avg=231.24, stdev=151.40
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[  171], 20.00th=[  195],
     | 30.00th=[  209], 40.00th=[  219], 50.00th=[  229], 60.00th=[  241],
     | 70.00th=[  258], 80.00th=[  274], 90.00th=[  306], 95.00th=[  338],
     | 99.00th=[  434], 99.50th=[  524], 99.90th=[ 2672], 99.95th=[ 3312],
     | 99.99th=[ 4320]
    bw (KB  /s): min=13288, max=23776, per=12.50%, avg=17025.53, stdev=1846.05
    lat (usec) : 2=0.08%, 4=7.03%, 10=0.82%, 20=0.18%, 50=0.03%
    lat (usec) : 100=0.01%, 250=57.74%, 500=33.54%, 750=0.26%, 1000=0.06%
    lat (msec) : 2=0.07%, 4=0.17%, 10=0.02%
  cpu          : usr=1.94%, sys=6.08%, ctx=1883534, majf=2, minf=94
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2043203/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7981.3MB, aggrb=136211KB/s, minb=136211KB/s, maxb=136211KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1873042/9, merge=0/4, ticks=388148/0, in_queue=387944, util=98.33%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=15935: Wed Dec 11 18:46:05 2022
  write: io=32167MB, bw=548938KB/s, iops=137234, runt= 60005msec
    clat (usec): min=1, max=179157, avg=40.91, stdev=950.87
     lat (usec): min=1, max=179157, avg=43.74, stdev=995.56
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    3], 90.00th=[    4], 95.00th=[    5],
     | 99.00th=[    8], 99.50th=[   16], 99.90th=[14400], 99.95th=[20096],
     | 99.99th=[32384]
    bw (KB  /s): min=    0, max=94521, per=12.76%, avg=70066.25, stdev=10498.62
    lat (usec) : 2=0.09%, 4=80.81%, 10=18.19%, 20=0.47%, 50=0.08%
    lat (usec) : 100=0.03%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.03%, 10=0.09%, 20=0.11%, 50=0.05%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=3.05%, sys=7.35%, ctx=68257, majf=0, minf=83
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=8234759/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=32167MB, aggrb=548938KB/s, minb=548938KB/s, maxb=548938KB/s, mint=60005msec, maxt=60005msec

Disk stats (read/write):
  vda: ios=180/704167, merge=0/7607, ticks=1196/6839992, in_queue=6841764, util=98.87%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=15922: Wed Dec 11 18:45:04 2022
  read : io=7375.3MB, bw=125867KB/s, iops=31466, runt= 60002msec
    clat (usec): min=136, max=10916, avg=250.04, stdev=101.92
     lat (usec): min=136, max=10916, avg=250.63, stdev=101.96
    clat percentiles (usec):
     |  1.00th=[  165],  5.00th=[  179], 10.00th=[  189], 20.00th=[  203],
     | 30.00th=[  215], 40.00th=[  225], 50.00th=[  235], 60.00th=[  247],
     | 70.00th=[  262], 80.00th=[  278], 90.00th=[  314], 95.00th=[  354],
     | 99.00th=[  564], 99.50th=[  676], 99.90th=[ 1032], 99.95th=[ 1512],
     | 99.99th=[ 3920]
    bw (KB  /s): min= 8752, max=18208, per=12.51%, avg=15747.04, stdev=1769.43
    lat (usec) : 250=62.53%, 500=35.96%, 750=1.19%, 1000=0.21%
    lat (msec) : 2=0.08%, 4=0.03%, 10=0.01%, 20=0.01%
  cpu          : usr=1.77%, sys=5.13%, ctx=1891322, majf=0, minf=88
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1888072/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7375.3MB, aggrb=125867KB/s, minb=125867KB/s, maxb=125867KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  vda: ios=1886265/8, merge=0/5, ticks=420800/0, in_queue=420836, util=99.87%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=15948: Wed Dec 11 18:47:05 2022
  write: io=1885.3MB, bw=32172KB/s, iops=8043, runt= 60004msec
    clat (usec): min=63, max=64992, avg=989.65, stdev=5493.21
     lat (usec): min=64, max=64993, avg=990.38, stdev=5493.23
    clat percentiles (usec):
     |  1.00th=[   73],  5.00th=[   81], 10.00th=[   86], 20.00th=[   92],
     | 30.00th=[   97], 40.00th=[  102], 50.00th=[  107], 60.00th=[  114],
     | 70.00th=[  123], 80.00th=[  139], 90.00th=[  171], 95.00th=[  221],
     | 99.00th=[35584], 99.50th=[37632], 99.90th=[42752], 99.95th=[44800],
     | 99.99th=[55552]
    bw (KB  /s): min= 2203, max= 5426, per=12.52%, avg=4027.61, stdev=480.41
    lat (usec) : 100=34.99%, 250=61.01%, 500=1.28%, 750=0.09%, 1000=0.05%
    lat (msec) : 2=0.06%, 4=0.03%, 10=0.01%, 20=0.01%, 50=2.46%
    lat (msec) : 100=0.02%
  cpu          : usr=0.60%, sys=2.78%, ctx=977664, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=482614/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=1885.3MB, aggrb=32172KB/s, minb=32172KB/s, maxb=32172KB/s, mint=60004msec, maxt=60004msec

Disk stats (read/write):
  vda: ios=170/482245, merge=0/1678, ticks=132/47556, in_queue=47540, util=79.02%

fio (Сингапур)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30926: Wed Dec 11 14:46:27 2022
  read : io=7697.7MB, bw=131370KB/s, iops=32842, runt= 60001msec
    clat (usec): min=1, max=34126, avg=238.32, stdev=232.97
     lat (usec): min=2, max=34127, avg=239.17, stdev=232.98
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[  165], 20.00th=[  189],
     | 30.00th=[  201], 40.00th=[  213], 50.00th=[  227], 60.00th=[  241],
     | 70.00th=[  262], 80.00th=[  290], 90.00th=[  334], 95.00th=[  378],
     | 99.00th=[  540], 99.50th=[  844], 99.90th=[ 2512], 99.95th=[ 3056],
     | 99.99th=[ 4640]
    bw (KB  /s): min=11272, max=22698, per=12.50%, avg=16416.34, stdev=1953.87
    lat (usec) : 2=0.01%, 4=6.34%, 10=1.30%, 20=0.20%, 50=0.02%
    lat (usec) : 100=0.01%, 250=56.94%, 500=33.94%, 750=0.68%, 1000=0.16%
    lat (msec) : 2=0.20%, 4=0.19%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=2.34%, sys=5.49%, ctx=1820233, majf=2, minf=95
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1970586/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7697.7MB, aggrb=131370KB/s, minb=131370KB/s, maxb=131370KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1811866/16, merge=0/8, ticks=385580/0, in_queue=385364, util=98.23%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30954: Wed Dec 11 14:48:35 2022
  write: io=26015MB, bw=443885KB/s, iops=110971, runt= 60015msec
    clat (usec): min=1, max=192632, avg=45.41, stdev=880.56
     lat (usec): min=2, max=192634, avg=50.34, stdev=950.31
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[    3], 20.00th=[    3],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    4], 80.00th=[    4], 90.00th=[    4], 95.00th=[    5],
     | 99.00th=[   18], 99.50th=[   35], 99.90th=[14656], 99.95th=[20096],
     | 99.99th=[32128]
    bw (KB  /s): min=    1, max=66360, per=12.66%, avg=56217.23, stdev=5810.74
    lat (usec) : 2=0.01%, 4=66.86%, 10=30.89%, 20=1.55%, 50=0.21%
    lat (usec) : 100=0.05%, 250=0.03%, 500=0.01%, 750=0.02%, 1000=0.01%
    lat (msec) : 2=0.03%, 4=0.04%, 10=0.12%, 20=0.13%, 50=0.05%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=4.75%, sys=5.94%, ctx=77362, majf=0, minf=83
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=6659941/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=26015MB, aggrb=443885KB/s, minb=443885KB/s, maxb=443885KB/s, mint=60015msec, maxt=60015msec

Disk stats (read/write):
  vda: ios=171/1050982, merge=0/9077, ticks=640/6829808, in_queue=6830932, util=98.80%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30940: Wed Dec 11 14:47:34 2022
  read : io=7409.7MB, bw=126453KB/s, iops=31613, runt= 60002msec
    clat (usec): min=130, max=24402, avg=247.64, stdev=134.86
     lat (usec): min=131, max=24403, avg=248.50, stdev=134.89
    clat percentiles (usec):
     |  1.00th=[  157],  5.00th=[  171], 10.00th=[  181], 20.00th=[  193],
     | 30.00th=[  205], 40.00th=[  215], 50.00th=[  225], 60.00th=[  239],
     | 70.00th=[  258], 80.00th=[  282], 90.00th=[  326], 95.00th=[  370],
     | 99.00th=[  556], 99.50th=[  804], 99.90th=[ 1720], 99.95th=[ 2480],
     | 99.99th=[ 3952]
    bw (KB  /s): min= 4128, max=17392, per=12.50%, avg=15809.98, stdev=1368.84
    lat (usec) : 250=66.66%, 500=32.07%, 750=0.69%, 1000=0.28%
    lat (msec) : 2=0.23%, 4=0.06%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=2.51%, sys=4.77%, ctx=1900108, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1896859/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7409.7MB, aggrb=126453KB/s, minb=126453KB/s, maxb=126453KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  vda: ios=1893026/8, merge=0/5, ticks=404240/0, in_queue=404112, util=99.88%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30967: Wed Dec 11 14:49:35 2022
  write: io=2091.3MB, bw=35686KB/s, iops=8921, runt= 60002msec
    clat (usec): min=60, max=76654, avg=890.95, stdev=5124.75
     lat (usec): min=61, max=76655, avg=891.89, stdev=5124.77
    clat percentiles (usec):
     |  1.00th=[   66],  5.00th=[   69], 10.00th=[   72], 20.00th=[   79],
     | 30.00th=[   84], 40.00th=[   89], 50.00th=[   95], 60.00th=[  100],
     | 70.00th=[  108], 80.00th=[  121], 90.00th=[  167], 95.00th=[  233],
     | 99.00th=[34560], 99.50th=[36608], 99.90th=[39680], 99.95th=[42240],
     | 99.99th=[56576]
    bw (KB  /s): min= 2831, max= 5484, per=12.50%, avg=4461.68, stdev=440.44
    lat (usec) : 100=58.61%, 250=37.16%, 500=1.74%, 750=0.08%, 1000=0.02%
    lat (msec) : 2=0.03%, 4=0.02%, 10=0.01%, 20=0.01%, 50=2.31%
    lat (msec) : 100=0.02%
  cpu          : usr=0.66%, sys=2.82%, ctx=1083156, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=535303/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2091.3MB, aggrb=35685KB/s, minb=35685KB/s, maxb=35685KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  vda: ios=170/534669, merge=0/1610, ticks=132/49496, in_queue=49572, util=82.41%

fio (Великобритания, Лондон)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=20488: Sun Dec 15 16:24:24 2022
  read : io=743988KB, bw=12399KB/s, iops=3099, runt= 60004msec
    clat (usec): min=142, max=15787, avg=2574.70, stdev=1413.98
     lat (usec): min=143, max=15788, avg=2575.38, stdev=1414.09
    clat percentiles (usec):
     |  1.00th=[  185],  5.00th=[  221], 10.00th=[  266], 20.00th=[ 1256],
     | 30.00th=[ 2128], 40.00th=[ 2480], 50.00th=[ 2768], 60.00th=[ 3024],
     | 70.00th=[ 3280], 80.00th=[ 3600], 90.00th=[ 4128], 95.00th=[ 4640],
     | 99.00th=[ 6176], 99.50th=[ 6880], 99.90th=[ 8256], 99.95th=[ 8896],
     | 99.99th=[10304]
    bw (KB  /s): min= 1136, max= 4691, per=12.52%, avg=1551.89, stdev=544.41
    lat (usec) : 250=8.44%, 500=8.36%, 750=1.31%, 1000=0.96%
    lat (msec) : 2=8.13%, 4=61.25%, 10=11.53%, 20=0.01%
  cpu          : usr=0.30%, sys=0.92%, ctx=186568, majf=0, minf=80
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=185997/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=743988KB, aggrb=12398KB/s, minb=12398KB/s, maxb=12398KB/s, mint=60004msec, maxt=60004msec

Disk stats (read/write):
  vda: ios=186162/8, merge=0/4, ticks=470968/44, in_queue=470988, util=99.87%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=20514: Sun Dec 15 16:26:34 2022
  write: io=3170.2MB, bw=54082KB/s, iops=13520, runt= 60040msec
    clat (usec): min=1, max=2811.6K, avg=487.71, stdev=17323.71
     lat (usec): min=1, max=2811.6K, avg=489.04, stdev=17329.86
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    4], 90.00th=[    4], 95.00th=[    6],
     | 99.00th=[   14], 99.50th=[   31], 99.90th=[126464], 99.95th=[189440],
     | 99.99th=[757760]
    bw (KB  /s): min=    0, max=40279, per=18.07%, avg=9773.52, stdev=7070.57
    lat (usec) : 2=0.05%, 4=78.16%, 10=19.65%, 20=1.52%, 50=0.15%
    lat (usec) : 100=0.05%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.02%, 10=0.03%, 20=0.04%, 50=0.09%
    lat (msec) : 100=0.07%, 250=0.11%, 500=0.02%, 750=0.01%, 1000=0.01%
    lat (msec) : 2000=0.01%, >=2000=0.01%
  cpu          : usr=0.28%, sys=0.87%, ctx=15613, majf=0, minf=85
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=811771/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=3170.2MB, aggrb=54082KB/s, minb=54082KB/s, maxb=54082KB/s, mint=60040msec, maxt=60040msec

Disk stats (read/write):
  vda: ios=170/84307, merge=0/6212, ticks=592/2584112, in_queue=2586072, util=99.40%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=20501: Sun Dec 15 16:25:34 2022
  read : io=1298.7MB, bw=22162KB/s, iops=5540, runt= 60004msec
    clat (usec): min=136, max=16560, avg=1438.74, stdev=1490.59
     lat (usec): min=137, max=16560, avg=1439.37, stdev=1490.64
    clat percentiles (usec):
     |  1.00th=[  171],  5.00th=[  189], 10.00th=[  203], 20.00th=[  225],
     | 30.00th=[  249], 40.00th=[  286], 50.00th=[  402], 60.00th=[ 1496],
     | 70.00th=[ 2448], 80.00th=[ 2992], 90.00th=[ 3568], 95.00th=[ 4048],
     | 99.00th=[ 5344], 99.50th=[ 6112], 99.90th=[ 7776], 99.95th=[ 8640],
     | 99.99th=[10176]
    bw (KB  /s): min= 1117, max= 8504, per=12.52%, avg=2775.28, stdev=1765.96
    lat (usec) : 250=30.63%, 500=21.52%, 750=3.15%, 1000=1.92%
    lat (msec) : 2=6.75%, 4=30.70%, 10=5.32%, 20=0.01%
  cpu          : usr=0.46%, sys=1.15%, ctx=333216, majf=0, minf=80
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=332448/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=1298.7MB, aggrb=22161KB/s, minb=22161KB/s, maxb=22161KB/s, mint=60004msec, maxt=60004msec

Disk stats (read/write):
  vda: ios=332167/8, merge=0/5, ticks=464228/760, in_queue=464876, util=99.86%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=20527: Sun Dec 15 16:27:36 2022
  write: io=339804KB, bw=5661.7KB/s, iops=1415, runt= 60019msec
    clat (usec): min=66, max=1766.6K, avg=5646.40, stdev=40055.68
     lat (usec): min=66, max=1766.6K, avg=5647.17, stdev=40055.71
    clat percentiles (usec):
     |  1.00th=[   73],  5.00th=[   81], 10.00th=[   86], 20.00th=[   94],
     | 30.00th=[  101], 40.00th=[  107], 50.00th=[  115], 60.00th=[  125],
     | 70.00th=[  143], 80.00th=[  179], 90.00th=[ 1012], 95.00th=[ 6496],
     | 99.00th=[177152], 99.50th=[242688], 99.90th=[528384], 99.95th=[724992],
     | 99.99th=[1105920]
    bw (KB  /s): min=    2, max= 2640, per=13.35%, avg=755.86, stdev=514.57
    lat (usec) : 100=28.39%, 250=57.85%, 500=2.51%, 750=0.63%, 1000=0.59%
    lat (msec) : 2=1.96%, 4=2.08%, 10=1.67%, 20=0.56%, 50=1.20%
    lat (msec) : 100=0.65%, 250=1.47%, 500=0.33%, 750=0.07%, 1000=0.02%
    lat (msec) : 2000=0.02%
  cpu          : usr=0.13%, sys=0.62%, ctx=172753, majf=0, minf=83
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=84951/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=339804KB, aggrb=5661KB/s, minb=5661KB/s, maxb=5661KB/s, mint=60019msec, maxt=60019msec

Disk stats (read/write):
  vda: ios=172/84970, merge=0/2006, ticks=544/57484, in_queue=58024, util=94.67%

fio (США, Атланта)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=15476: Sun Dec 15 19:29:14 2022
  read : io=7837.8MB, bw=133749KB/s, iops=33437, runt= 60001msec
    clat (usec): min=1, max=7324, avg=234.11, stdev=141.99
     lat (usec): min=2, max=7325, avg=234.93, stdev=142.02
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[  167], 20.00th=[  193],
     | 30.00th=[  207], 40.00th=[  219], 50.00th=[  231], 60.00th=[  245],
     | 70.00th=[  262], 80.00th=[  286], 90.00th=[  322], 95.00th=[  358],
     | 99.00th=[  458], 99.50th=[  556], 99.90th=[ 2352], 99.95th=[ 2864],
     | 99.99th=[ 3888]
    bw (KB  /s): min=11944, max=23232, per=12.49%, avg=16709.43, stdev=1866.94
    lat (usec) : 2=0.01%, 4=6.74%, 10=1.06%, 20=0.17%, 50=0.03%
    lat (usec) : 100=0.01%, 250=55.01%, 500=36.31%, 750=0.36%, 1000=0.09%
    lat (msec) : 2=0.06%, 4=0.16%, 10=0.01%
  cpu          : usr=2.32%, sys=5.36%, ctx=1851110, majf=2, minf=94
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2006274/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7837.8MB, aggrb=133749KB/s, minb=133749KB/s, maxb=133749KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1845303/14, merge=0/7, ticks=397380/0, in_queue=397304, util=98.34%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=15511: Sun Dec 15 19:31:22 2022
  write: io=26235MB, bw=447631KB/s, iops=111907, runt= 60014msec
    clat (usec): min=1, max=117339, avg=44.70, stdev=861.50
     lat (usec): min=2, max=136215, avg=49.63, stdev=930.64
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[    3], 20.00th=[    3],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    4], 80.00th=[    4], 90.00th=[    4], 95.00th=[    5],
     | 99.00th=[   19], 99.50th=[   40], 99.90th=[14272], 99.95th=[19328],
     | 99.99th=[31104]
    bw (KB  /s): min=    1, max=65736, per=12.63%, avg=56547.13, stdev=5586.94
    lat (usec) : 2=0.01%, 4=68.30%, 10=29.61%, 20=1.32%, 50=0.29%
    lat (usec) : 100=0.05%, 250=0.02%, 500=0.01%, 750=0.02%, 1000=0.01%
    lat (msec) : 2=0.03%, 4=0.04%, 10=0.12%, 20=0.13%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=4.95%, sys=5.87%, ctx=77785, majf=0, minf=75
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=6716037/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=26235MB, aggrb=447631KB/s, minb=447631KB/s, maxb=447631KB/s, mint=60014msec, maxt=60014msec

Disk stats (read/write):
  vda: ios=192/1075724, merge=0/8974, ticks=768/6927672, in_queue=6933620, util=98.80%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=15496: Sun Dec 15 19:30:21 2022
  read : io=7593.5MB, bw=129593KB/s, iops=32398, runt= 60001msec
    clat (usec): min=135, max=6091, avg=241.58, stdev=71.45
     lat (usec): min=135, max=6091, avg=242.43, stdev=71.49
    clat percentiles (usec):
     |  1.00th=[  161],  5.00th=[  175], 10.00th=[  185], 20.00th=[  199],
     | 30.00th=[  209], 40.00th=[  219], 50.00th=[  231], 60.00th=[  243],
     | 70.00th=[  258], 80.00th=[  278], 90.00th=[  310], 95.00th=[  342],
     | 99.00th=[  422], 99.50th=[  462], 99.90th=[  708], 99.95th=[  980],
     | 99.99th=[ 2448]
    bw (KB  /s): min=13104, max=17648, per=12.50%, avg=16200.46, stdev=780.38
    lat (usec) : 250=65.19%, 500=34.51%, 750=0.22%, 1000=0.04%
    lat (msec) : 2=0.03%, 4=0.01%, 10=0.01%
  cpu          : usr=2.51%, sys=4.83%, ctx=1947114, majf=0, minf=73
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1943932/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7593.5MB, aggrb=129593KB/s, minb=129593KB/s, maxb=129593KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1937903/10, merge=0/7, ticks=409816/0, in_queue=409684, util=99.82%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=15524: Sun Dec 15 19:32:22 2022
  write: io=2278.9MB, bw=38891KB/s, iops=9722, runt= 60003msec
    clat (usec): min=60, max=51553, avg=817.32, stdev=4886.56
     lat (usec): min=60, max=51554, avg=818.22, stdev=4886.59
    clat percentiles (usec):
     |  1.00th=[   66],  5.00th=[   68], 10.00th=[   70], 20.00th=[   76],
     | 30.00th=[   81], 40.00th=[   85], 50.00th=[   91], 60.00th=[   96],
     | 70.00th=[  102], 80.00th=[  112], 90.00th=[  139], 95.00th=[  181],
     | 99.00th=[34048], 99.50th=[36096], 99.90th=[38656], 99.95th=[39680],
     | 99.99th=[41728]
    bw (KB  /s): min= 3460, max= 5968, per=12.51%, avg=4863.46, stdev=404.00
    lat (usec) : 100=65.85%, 250=31.55%, 500=0.42%, 750=0.02%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=2.14%
    lat (msec) : 100=0.01%
  cpu          : usr=0.78%, sys=2.71%, ctx=1179671, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=583392/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2278.9MB, aggrb=38890KB/s, minb=38890KB/s, maxb=38890KB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  vda: ios=612/582769, merge=0/1520, ticks=392/47444, in_queue=47752, util=78.96%

fio (США, Чикаго)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=14831: Mon Dec 16 01:33:33 2022
  read : io=8035.5MB, bw=137136KB/s, iops=34284, runt= 60001msec
    clat (usec): min=1, max=4262, avg=227.92, stdev=133.01
     lat (usec): min=2, max=4267, avg=228.79, stdev=133.05
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[  165], 20.00th=[  189],
     | 30.00th=[  201], 40.00th=[  213], 50.00th=[  225], 60.00th=[  239],
     | 70.00th=[  255], 80.00th=[  278], 90.00th=[  314], 95.00th=[  350],
     | 99.00th=[  458], 99.50th=[  548], 99.90th=[ 2256], 99.95th=[ 2768],
     | 99.99th=[ 3408]
    bw (KB  /s): min=13152, max=23400, per=12.49%, avg=17131.96, stdev=2002.66
    lat (usec) : 2=0.01%, 4=6.94%, 10=0.98%, 20=0.21%, 50=0.05%
    lat (usec) : 100=0.01%, 250=58.57%, 500=32.57%, 750=0.41%, 1000=0.06%
    lat (msec) : 2=0.05%, 4=0.15%, 10=0.01%
  cpu          : usr=2.58%, sys=5.57%, ctx=1895150, majf=2, minf=94
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2057075/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8035.5MB, aggrb=137136KB/s, minb=137136KB/s, maxb=137136KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1884570/9, merge=0/4, ticks=377920/0, in_queue=377704, util=98.11%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=14858: Mon Dec 16 01:35:41 2022
  write: io=26627MB, bw=454312KB/s, iops=113578, runt= 60016msec
    clat (usec): min=1, max=140433, avg=44.25, stdev=841.09
     lat (usec): min=2, max=153527, avg=48.93, stdev=907.33
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[    3], 20.00th=[    3],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    4], 90.00th=[    4], 95.00th=[    5],
     | 99.00th=[   19], 99.50th=[   38], 99.90th=[14144], 99.95th=[19584],
     | 99.99th=[30592]
    bw (KB  /s): min=    1, max=67693, per=12.64%, avg=57424.28, stdev=5407.98
    lat (usec) : 2=0.01%, 4=70.71%, 10=26.77%, 20=1.74%, 50=0.30%
    lat (usec) : 100=0.04%, 250=0.02%, 500=0.02%, 750=0.02%, 1000=0.01%
    lat (msec) : 2=0.03%, 4=0.04%, 10=0.12%, 20=0.13%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=4.94%, sys=5.93%, ctx=79995, majf=0, minf=74
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=6816502/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=26627MB, aggrb=454312KB/s, minb=454312KB/s, maxb=454312KB/s, mint=60016msec, maxt=60016msec

Disk stats (read/write):
  vda: ios=499/1074165, merge=0/9300, ticks=2744/6945264, in_queue=6948456, util=98.75%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=14845: Mon Dec 16 01:34:41 2022
  read : io=7746.9MB, bw=132208KB/s, iops=33052, runt= 60002msec
    clat (usec): min=132, max=31092, avg=236.79, stdev=90.81
     lat (usec): min=132, max=31092, avg=237.63, stdev=90.84
    clat percentiles (usec):
     |  1.00th=[  157],  5.00th=[  171], 10.00th=[  181], 20.00th=[  193],
     | 30.00th=[  205], 40.00th=[  215], 50.00th=[  225], 60.00th=[  237],
     | 70.00th=[  253], 80.00th=[  274], 90.00th=[  306], 95.00th=[  338],
     | 99.00th=[  414], 99.50th=[  462], 99.90th=[  708], 99.95th=[  924],
     | 99.99th=[ 3376]
    bw (KB  /s): min=13992, max=17600, per=12.50%, avg=16531.33, stdev=620.44
    lat (usec) : 250=68.62%, 500=31.05%, 750=0.25%, 1000=0.04%
    lat (msec) : 2=0.03%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=2.35%, sys=4.85%, ctx=1987876, majf=0, minf=73
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1983189/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7746.9MB, aggrb=132208KB/s, minb=132208KB/s, maxb=132208KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  vda: ios=1977990/8, merge=0/5, ticks=408236/0, in_queue=407928, util=99.82%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=14873: Mon Dec 16 01:36:42 2022
  write: io=2261.6MB, bw=38594KB/s, iops=9648, runt= 60004msec
    clat (usec): min=61, max=44709, avg=823.69, stdev=4921.76
     lat (usec): min=61, max=44709, avg=824.57, stdev=4921.78
    clat percentiles (usec):
     |  1.00th=[   67],  5.00th=[   69], 10.00th=[   72], 20.00th=[   77],
     | 30.00th=[   82], 40.00th=[   86], 50.00th=[   91], 60.00th=[   96],
     | 70.00th=[  102], 80.00th=[  112], 90.00th=[  141], 95.00th=[  185],
     | 99.00th=[34560], 99.50th=[36096], 99.90th=[38144], 99.95th=[39168],
     | 99.99th=[40704]
    bw (KB  /s): min= 3547, max= 5952, per=12.50%, avg=4824.65, stdev=445.14
    lat (usec) : 100=65.60%, 250=31.76%, 500=0.46%, 750=0.03%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=2.14%
  cpu          : usr=0.85%, sys=2.61%, ctx=1170628, majf=0, minf=73
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=578946/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2261.6MB, aggrb=38593KB/s, minb=38593KB/s, maxb=38593KB/s, mint=60004msec, maxt=60004msec

Disk stats (read/write):
  vda: ios=169/578268, merge=0/1640, ticks=164/47368, in_queue=47436, util=78.80%

fio (США, Даллас)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30640: Mon Dec 16 01:36:46 2022
  read : io=8101.4MB, bw=138255KB/s, iops=34563, runt= 60001msec
    clat (usec): min=1, max=6512, avg=227.73, stdev=127.95
     lat (usec): min=1, max=6513, avg=228.26, stdev=127.96
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[  171], 20.00th=[  197],
     | 30.00th=[  209], 40.00th=[  221], 50.00th=[  231], 60.00th=[  243],
     | 70.00th=[  258], 80.00th=[  274], 90.00th=[  298], 95.00th=[  326],
     | 99.00th=[  402], 99.50th=[  478], 99.90th=[ 2160], 99.95th=[ 2576],
     | 99.99th=[ 3280]
    bw (KB  /s): min=13720, max=24296, per=12.49%, avg=17270.28, stdev=1840.54
    lat (usec) : 2=0.19%, 4=7.28%, 10=0.68%, 20=0.10%, 50=0.01%
    lat (usec) : 100=0.01%, 250=57.33%, 500=33.96%, 750=0.17%, 1000=0.03%
    lat (msec) : 2=0.10%, 4=0.14%, 10=0.01%
  cpu          : usr=1.64%, sys=5.37%, ctx=1906830, majf=3, minf=93
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2073857/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8101.4MB, aggrb=138254KB/s, minb=138254KB/s, maxb=138254KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1898815/11, merge=0/3, ticks=429144/0, in_queue=428844, util=98.21%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30667: Mon Dec 16 01:38:53 2022
  write: io=37120MB, bw=633470KB/s, iops=158367, runt= 60005msec
    clat (usec): min=1, max=268949, avg=35.49, stdev=825.71
     lat (usec): min=1, max=268950, avg=38.11, stdev=871.35
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    2], 40.00th=[    2], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    3], 90.00th=[    3], 95.00th=[    4],
     | 99.00th=[    7], 99.50th=[   14], 99.90th=[12992], 99.95th=[18304],
     | 99.99th=[30080]
    bw (KB  /s): min=    0, max=113093, per=12.76%, avg=80836.06, stdev=9692.35
    lat (usec) : 2=0.17%, 4=90.19%, 10=8.87%, 20=0.40%, 50=0.04%
    lat (usec) : 100=0.03%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.02%, 10=0.08%, 20=0.10%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%
  cpu          : usr=2.99%, sys=7.69%, ctx=71565, majf=0, minf=82
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=9502839/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=37120MB, aggrb=633469KB/s, minb=633469KB/s, maxb=633469KB/s, mint=60005msec, maxt=60005msec

Disk stats (read/write):
  vda: ios=178/767585, merge=0/7960, ticks=1388/6914052, in_queue=6915356, util=98.99%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30654: Mon Dec 16 01:37:53 2022
  read : io=7669.1MB, bw=130896KB/s, iops=32724, runt= 60002msec
    clat (usec): min=138, max=4498, avg=240.61, stdev=71.44
     lat (usec): min=139, max=4499, avg=241.16, stdev=71.45
    clat percentiles (usec):
     |  1.00th=[  165],  5.00th=[  179], 10.00th=[  189], 20.00th=[  203],
     | 30.00th=[  213], 40.00th=[  223], 50.00th=[  233], 60.00th=[  243],
     | 70.00th=[  258], 80.00th=[  274], 90.00th=[  298], 95.00th=[  322],
     | 99.00th=[  386], 99.50th=[  422], 99.90th=[  668], 99.95th=[ 1240],
     | 99.99th=[ 3408]
    bw (KB  /s): min=14360, max=17592, per=12.51%, avg=16370.02, stdev=521.56
    lat (usec) : 250=65.23%, 500=34.55%, 750=0.13%, 1000=0.02%
    lat (msec) : 2=0.04%, 4=0.02%, 10=0.01%
  cpu          : usr=1.77%, sys=4.75%, ctx=1966567, majf=0, minf=72
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1963511/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7669.1MB, aggrb=130896KB/s, minb=130896KB/s, maxb=130896KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  vda: ios=1959684/10, merge=0/4, ticks=400752/0, in_queue=400488, util=99.80%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30680: Mon Dec 16 01:39:54 2022
  write: io=2169.8MB, bw=37028KB/s, iops=9256, runt= 60005msec
    clat (usec): min=64, max=65768, avg=859.93, stdev=5258.49
     lat (usec): min=64, max=65768, avg=860.55, stdev=5258.50
    clat percentiles (usec):
     |  1.00th=[   70],  5.00th=[   74], 10.00th=[   78], 20.00th=[   84],
     | 30.00th=[   89], 40.00th=[   94], 50.00th=[   99], 60.00th=[  104],
     | 70.00th=[  110], 80.00th=[  119], 90.00th=[  139], 95.00th=[  165],
     | 99.00th=[37632], 99.50th=[39680], 99.90th=[42240], 99.95th=[42752],
     | 99.99th=[44288]
    bw (KB  /s): min= 2715, max= 6448, per=12.51%, avg=4630.24, stdev=529.55
    lat (usec) : 100=51.63%, 250=45.89%, 500=0.36%, 750=0.03%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.01%, 10=0.01%, 20=0.01%, 50=2.04%
    lat (msec) : 100=0.01%
  cpu          : usr=0.56%, sys=2.64%, ctx=1122771, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=555463/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2169.8MB, aggrb=37027KB/s, minb=37027KB/s, maxb=37027KB/s, mint=60005msec, maxt=60005msec

Disk stats (read/write):
  vda: ios=170/554923, merge=0/1544, ticks=80/48648, in_queue=48628, util=80.92%

fio (США, Лос-Анджелес)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30302: Mon Dec 16 01:40:53 2022
  read : io=4527.3MB, bw=77216KB/s, iops=19304, runt= 60038msec
    clat (usec): min=2, max=1002.6K, avg=409.03, stdev=3749.04
     lat (usec): min=2, max=1002.6K, avg=409.87, stdev=3749.05
    clat percentiles (usec):
     |  1.00th=[    3],  5.00th=[    7], 10.00th=[  177], 20.00th=[  195],
     | 30.00th=[  209], 40.00th=[  219], 50.00th=[  233], 60.00th=[  247],
     | 70.00th=[  266], 80.00th=[  298], 90.00th=[  354], 95.00th=[  426],
     | 99.00th=[ 1736], 99.50th=[ 6176], 99.90th=[41728], 99.95th=[44288],
     | 99.99th=[55040]
    bw (KB  /s): min=    4, max=21176, per=12.78%, avg=9869.13, stdev=6950.72
    lat (usec) : 4=3.86%, 10=1.28%, 20=0.21%, 50=0.02%, 100=0.01%
    lat (usec) : 250=56.16%, 500=34.99%, 750=1.52%, 1000=0.64%
    lat (msec) : 2=0.37%, 4=0.23%, 10=0.38%, 20=0.04%, 50=0.27%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2000=0.01%
  cpu          : usr=1.49%, sys=3.24%, ctx=1100743, majf=0, minf=84
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1158981/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=4527.3MB, aggrb=77216KB/s, minb=77216KB/s, maxb=77216KB/s, mint=60038msec, maxt=60038msec

Disk stats (read/write):
  vda: ios=1096289/9, merge=0/4, ticks=432752/56, in_queue=432560, util=99.17%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30328: Mon Dec 16 01:43:06 2022
  write: io=27193MB, bw=464019KB/s, iops=116004, runt= 60009msec
    clat (usec): min=1, max=176038, avg=43.66, stdev=914.60
     lat (usec): min=2, max=200012, avg=48.16, stdev=982.18
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    3], 20.00th=[    3],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    4], 90.00th=[    4], 95.00th=[    5],
     | 99.00th=[   15], 99.50th=[   23], 99.90th=[14912], 99.95th=[20096],
     | 99.99th=[32128]
    bw (KB  /s): min=    1, max=72232, per=12.65%, avg=58689.60, stdev=6954.65
    lat (usec) : 2=0.01%, 4=71.10%, 10=27.12%, 20=1.20%, 50=0.15%
    lat (usec) : 100=0.04%, 250=0.02%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.03%, 10=0.10%, 20=0.12%, 50=0.05%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=4.91%, sys=5.92%, ctx=71147, majf=0, minf=60
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=6961325/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=27193MB, aggrb=464018KB/s, minb=464018KB/s, maxb=464018KB/s, mint=60009msec, maxt=60009msec

Disk stats (read/write):
  vda: ios=174/804965, merge=0/9109, ticks=844/6904508, in_queue=6906288, util=98.78%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30315: Mon Dec 16 01:42:06 2022
  read : io=4759.4MB, bw=81225KB/s, iops=20306, runt= 60001msec
    clat (usec): min=134, max=83824, avg=388.59, stdev=2280.97
     lat (usec): min=134, max=83825, avg=389.43, stdev=2280.98
    clat percentiles (usec):
     |  1.00th=[  161],  5.00th=[  175], 10.00th=[  185], 20.00th=[  199],
     | 30.00th=[  211], 40.00th=[  221], 50.00th=[  233], 60.00th=[  247],
     | 70.00th=[  266], 80.00th=[  294], 90.00th=[  342], 95.00th=[  394],
     | 99.00th=[  708], 99.50th=[ 3728], 99.90th=[43776], 99.95th=[46848],
     | 99.99th=[55552]
    bw (KB  /s): min=   77, max=16936, per=12.65%, avg=10274.83, stdev=6866.05
    lat (usec) : 250=61.27%, 500=36.86%, 750=0.93%, 1000=0.16%
    lat (msec) : 2=0.20%, 4=0.10%, 10=0.17%, 20=0.03%, 50=0.27%
    lat (msec) : 100=0.02%
  cpu          : usr=1.63%, sys=3.04%, ctx=1220916, majf=0, minf=75
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1218402/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=4759.4MB, aggrb=81225KB/s, minb=81225KB/s, maxb=81225KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1216358/8, merge=0/5, ticks=429456/96, in_queue=429404, util=99.85%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30341: Mon Dec 16 01:44:07 2022
  write: io=1957.9MB, bw=33412KB/s, iops=8352, runt= 60003msec
    clat (usec): min=60, max=282347, avg=952.06, stdev=5702.32
     lat (usec): min=61, max=282348, avg=952.98, stdev=5702.34
    clat percentiles (usec):
     |  1.00th=[   68],  5.00th=[   72], 10.00th=[   76], 20.00th=[   83],
     | 30.00th=[   88], 40.00th=[   93], 50.00th=[   98], 60.00th=[  104],
     | 70.00th=[  111], 80.00th=[  125], 90.00th=[  177], 95.00th=[  243],
     | 99.00th=[36096], 99.50th=[38144], 99.90th=[43264], 99.95th=[46848],
     | 99.99th=[112128]
    bw (KB  /s): min= 1125, max= 5928, per=12.51%, avg=4180.03, stdev=644.04
    lat (usec) : 100=52.16%, 250=43.18%, 500=2.04%, 750=0.12%, 1000=0.05%
    lat (msec) : 2=0.07%, 4=0.04%, 10=0.02%, 20=0.01%, 50=2.29%
    lat (msec) : 100=0.03%, 250=0.01%, 500=0.01%
  cpu          : usr=0.74%, sys=2.51%, ctx=1014281, majf=0, minf=68
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=501203/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=1957.9MB, aggrb=33411KB/s, minb=33411KB/s, maxb=33411KB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  vda: ios=173/500597, merge=0/1694, ticks=236/48308, in_queue=48456, util=80.38%

fio (США, Майами)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=29120: Mon Dec 16 01:44:27 2022
  read : io=9084.3MB, bw=155035KB/s, iops=38758, runt= 60001msec
    clat (usec): min=1, max=4963, avg=202.89, stdev=119.18
     lat (usec): min=1, max=4964, avg=203.40, stdev=119.20
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[  153], 20.00th=[  177],
     | 30.00th=[  189], 40.00th=[  199], 50.00th=[  209], 60.00th=[  217],
     | 70.00th=[  229], 80.00th=[  243], 90.00th=[  266], 95.00th=[  290],
     | 99.00th=[  350], 99.50th=[  394], 99.90th=[ 2064], 99.95th=[ 2416],
     | 99.99th=[ 3216]
    bw (KB  /s): min=15200, max=26664, per=12.50%, avg=19375.82, stdev=2121.46
    lat (usec) : 2=0.37%, 4=8.07%, 10=0.62%, 20=0.14%, 50=0.03%
    lat (usec) : 100=0.01%, 250=74.10%, 500=16.39%, 750=0.05%, 1000=0.02%
    lat (msec) : 2=0.10%, 4=0.12%, 10=0.01%
  cpu          : usr=1.75%, sys=5.59%, ctx=2120348, majf=2, minf=85
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2325570/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=9084.3MB, aggrb=155035KB/s, minb=155035KB/s, maxb=155035KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=2106654/9, merge=0/4, ticks=407152/0, in_queue=406904, util=98.14%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=29147: Mon Dec 16 01:46:35 2022
  write: io=36107MB, bw=616162KB/s, iops=154040, runt= 60007msec
    clat (usec): min=1, max=249081, avg=36.39, stdev=848.32
     lat (usec): min=1, max=249082, avg=39.14, stdev=895.29
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    2], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    3], 90.00th=[    3], 95.00th=[    4],
     | 99.00th=[   17], 99.50th=[   19], 99.90th=[13248], 99.95th=[19072],
     | 99.99th=[31872]
    bw (KB  /s): min=    1, max=116880, per=12.62%, avg=77787.91, stdev=9285.64
    lat (usec) : 2=0.15%, 4=92.02%, 10=6.23%, 20=1.17%, 50=0.11%
    lat (usec) : 100=0.02%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.02%, 10=0.08%, 20=0.10%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=3.13%, sys=7.64%, ctx=72362, majf=0, minf=83
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=9243503/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=36107MB, aggrb=616161KB/s, minb=616161KB/s, maxb=616161KB/s, mint=60007msec, maxt=60007msec

Disk stats (read/write):
  vda: ios=175/658814, merge=0/8609, ticks=1444/6946772, in_queue=6949828, util=99.24%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=29134: Mon Dec 16 01:45:35 2022
  read : io=8421.3MB, bw=143720KB/s, iops=35929, runt= 60001msec
    clat (usec): min=131, max=5964, avg=218.95, stdev=56.93
     lat (usec): min=132, max=5964, avg=219.50, stdev=56.95
    clat percentiles (usec):
     |  1.00th=[  155],  5.00th=[  165], 10.00th=[  173], 20.00th=[  185],
     | 30.00th=[  195], 40.00th=[  203], 50.00th=[  211], 60.00th=[  221],
     | 70.00th=[  233], 80.00th=[  247], 90.00th=[  270], 95.00th=[  294],
     | 99.00th=[  350], 99.50th=[  378], 99.90th=[  596], 99.95th=[  948],
     | 99.99th=[ 2128]
    bw (KB  /s): min=14576, max=19592, per=12.50%, avg=17966.93, stdev=957.49
    lat (usec) : 250=81.46%, 500=18.40%, 750=0.07%, 1000=0.02%
    lat (msec) : 2=0.03%, 4=0.01%, 10=0.01%
  cpu          : usr=1.80%, sys=5.00%, ctx=2158860, majf=0, minf=80
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2155832/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8421.3MB, aggrb=143719KB/s, minb=143719KB/s, maxb=143719KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=2154518/8, merge=0/5, ticks=426160/0, in_queue=425888, util=99.86%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=29160: Mon Dec 16 01:47:35 2022
  write: io=2524.6MB, bw=43084KB/s, iops=10770, runt= 60003msec
    clat (usec): min=59, max=66717, avg=738.95, stdev=4867.38
     lat (usec): min=59, max=66717, avg=739.53, stdev=4867.39
    clat percentiles (usec):
     |  1.00th=[   65],  5.00th=[   67], 10.00th=[   69], 20.00th=[   72],
     | 30.00th=[   76], 40.00th=[   80], 50.00th=[   84], 60.00th=[   89],
     | 70.00th=[   94], 80.00th=[  102], 90.00th=[  117], 95.00th=[  137],
     | 99.00th=[37120], 99.50th=[39168], 99.90th=[41728], 99.95th=[42752],
     | 99.99th=[44288]
    bw (KB  /s): min= 3867, max= 6800, per=12.50%, avg=5386.89, stdev=586.21
    lat (usec) : 100=77.20%, 250=20.84%, 500=0.17%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=1.77%
    lat (msec) : 100=0.01%
  cpu          : usr=0.60%, sys=2.64%, ctx=1304520, majf=0, minf=58
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=646286/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2524.6MB, aggrb=43083KB/s, minb=43083KB/s, maxb=43083KB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  vda: ios=169/645485, merge=0/1412, ticks=124/48104, in_queue=48064, util=79.91%

fio (США, Нью-Йорк)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=31460: Mon Dec 16 01:24:50 2022
  read : io=7908.6MB, bw=134971KB/s, iops=33742, runt= 60001msec
    clat (usec): min=2, max=12146, avg=231.04, stdev=161.17
     lat (usec): min=2, max=12147, avg=231.97, stdev=161.24
    clat percentiles (usec):
     |  1.00th=[    3],  5.00th=[    8], 10.00th=[  157], 20.00th=[  179],
     | 30.00th=[  193], 40.00th=[  207], 50.00th=[  221], 60.00th=[  237],
     | 70.00th=[  258], 80.00th=[  286], 90.00th=[  334], 95.00th=[  382],
     | 99.00th=[  524], 99.50th=[  620], 99.90th=[ 2384], 99.95th=[ 2960],
     | 99.99th=[ 4448]
    bw (KB  /s): min=13384, max=22712, per=12.51%, avg=16881.32, stdev=1712.99
    lat (usec) : 4=3.51%, 10=2.33%, 20=1.79%, 50=0.38%, 100=0.01%
    lat (usec) : 250=58.30%, 500=32.43%, 750=0.94%, 1000=0.08%
    lat (msec) : 2=0.05%, 4=0.16%, 10=0.01%, 20=0.01%
  cpu          : usr=2.97%, sys=7.95%, ctx=1868322, majf=2, minf=102
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2024594/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=7908.6MB, aggrb=134970KB/s, minb=134970KB/s, maxb=134970KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1855108/9, merge=0/4, ticks=324384/0, in_queue=323904, util=98.33%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=31487: Mon Dec 16 01:26:56 2022
  write: io=23284MB, bw=397335KB/s, iops=99333, runt= 60007msec
    clat (usec): min=1, max=128077, avg=54.48, stdev=877.46
     lat (usec): min=2, max=128078, avg=59.22, stdev=936.71
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    3], 10.00th=[    3], 20.00th=[    3],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    4], 80.00th=[    4], 90.00th=[    7], 95.00th=[   10],
     | 99.00th=[   25], 99.50th=[  716], 99.90th=[15680], 99.95th=[19840],
     | 99.99th=[28288]
    bw (KB  /s): min=    1, max=63112, per=12.66%, avg=50293.42, stdev=7068.36
    lat (usec) : 2=0.01%, 4=61.17%, 10=33.34%, 20=4.16%, 50=0.63%
    lat (usec) : 100=0.10%, 250=0.04%, 500=0.03%, 750=0.03%, 1000=0.01%
    lat (msec) : 2=0.04%, 4=0.06%, 10=0.17%, 20=0.16%, 50=0.05%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=4.45%, sys=6.10%, ctx=95599, majf=0, minf=74
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=5960722/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=23284MB, aggrb=397335KB/s, minb=397335KB/s, maxb=397335KB/s, mint=60007msec, maxt=60007msec

Disk stats (read/write):
  vda: ios=174/1557066, merge=0/10682, ticks=160/6476912, in_queue=6477100, util=94.01%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=31474: Mon Dec 16 01:25:56 2022
  read : io=8180.5MB, bw=139606KB/s, iops=34901, runt= 60003msec
    clat (usec): min=118, max=10289, avg=223.40, stdev=102.27
     lat (usec): min=119, max=10289, avg=224.29, stdev=102.35
    clat percentiles (usec):
     |  1.00th=[  145],  5.00th=[  157], 10.00th=[  165], 20.00th=[  177],
     | 30.00th=[  187], 40.00th=[  197], 50.00th=[  209], 60.00th=[  221],
     | 70.00th=[  237], 80.00th=[  258], 90.00th=[  294], 95.00th=[  330],
     | 99.00th=[  422], 99.50th=[  478], 99.90th=[  748], 99.95th=[ 1176],
     | 99.99th=[ 5344]
    bw (KB  /s): min=14192, max=19104, per=12.50%, avg=17452.85, stdev=775.78
    lat (usec) : 250=76.22%, 500=23.39%, 750=0.30%, 1000=0.04%
    lat (msec) : 2=0.03%, 4=0.01%, 10=0.02%, 20=0.01%
  cpu          : usr=3.12%, sys=6.80%, ctx=2099536, majf=0, minf=65
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2094191/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8180.5MB, aggrb=139605KB/s, minb=139605KB/s, maxb=139605KB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  vda: ios=2090729/8, merge=0/5, ticks=366884/0, in_queue=366540, util=99.80%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=31500: Mon Dec 16 01:27:57 2022
  write: io=2163.8MB, bw=36926KB/s, iops=9231, runt= 60004msec
    clat (usec): min=66, max=48157, avg=860.52, stdev=4642.86
     lat (usec): min=66, max=48158, avg=861.51, stdev=4642.89
    clat percentiles (usec):
     |  1.00th=[   72],  5.00th=[   75], 10.00th=[   77], 20.00th=[   82],
     | 30.00th=[   87], 40.00th=[   92], 50.00th=[   97], 60.00th=[  103],
     | 70.00th=[  110], 80.00th=[  119], 90.00th=[  141], 95.00th=[  173],
     | 99.00th=[30080], 99.50th=[31104], 99.90th=[33024], 99.95th=[34048],
     | 99.99th=[37120]
    bw (KB  /s): min= 3373, max= 5824, per=12.51%, avg=4618.34, stdev=393.71
    lat (usec) : 100=53.98%, 250=43.09%, 500=0.28%, 750=0.02%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=2.61%
  cpu          : usr=0.93%, sys=3.20%, ctx=1122973, majf=0, minf=73
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=553923/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2163.8MB, aggrb=36925KB/s, minb=36925KB/s, maxb=36925KB/s, mint=60004msec, maxt=60004msec

Disk stats (read/write):
  vda: ios=171/553407, merge=0/1598, ticks=188/44808, in_queue=44824, util=74.39%

fio (США, Сиэтл)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30897: Mon Dec 16 01:48:04 2022
  read : io=8540.3MB, bw=145752KB/s, iops=36437, runt= 60001msec
    clat (usec): min=1, max=15745, avg=214.05, stdev=185.39
     lat (usec): min=2, max=15745, avg=214.92, stdev=185.76
    clat percentiles (usec):
     |  1.00th=[    3],  5.00th=[    8], 10.00th=[  153], 20.00th=[  175],
     | 30.00th=[  187], 40.00th=[  195], 50.00th=[  205], 60.00th=[  217],
     | 70.00th=[  231], 80.00th=[  249], 90.00th=[  286], 95.00th=[  334],
     | 99.00th=[  510], 99.50th=[ 1004], 99.90th=[ 2544], 99.95th=[ 2832],
     | 99.99th=[ 4256]
    bw (KB  /s): min=13048, max=24792, per=12.49%, avg=18199.83, stdev=1860.18
    lat (usec) : 2=0.01%, 4=2.96%, 10=3.83%, 20=2.03%, 50=0.28%
    lat (usec) : 100=0.01%, 250=71.01%, 500=18.85%, 750=0.43%, 1000=0.11%
    lat (msec) : 2=0.23%, 4=0.26%, 10=0.01%, 20=0.01%
  cpu          : usr=3.03%, sys=7.68%, ctx=1995422, majf=2, minf=87
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2186315/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8540.3MB, aggrb=145751KB/s, minb=145751KB/s, maxb=145751KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1985256/10, merge=0/3, ticks=350132/0, in_queue=350100, util=98.15%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30924: Mon Dec 16 01:50:10 2022
  write: io=25968MB, bw=443099KB/s, iops=110774, runt= 60012msec
    clat (usec): min=1, max=99789, avg=47.62, stdev=816.45
     lat (usec): min=2, max=108292, avg=52.13, stdev=875.35
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    3], 20.00th=[    3],
     | 30.00th=[    3], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    4], 90.00th=[    5], 95.00th=[    7],
     | 99.00th=[   16], 99.50th=[  159], 99.90th=[14528], 99.95th=[18816],
     | 99.99th=[27520]
    bw (KB  /s): min=    1, max=66464, per=12.65%, avg=56037.47, stdev=5979.41
    lat (usec) : 2=0.01%, 4=71.13%, 10=25.78%, 20=2.32%, 50=0.18%
    lat (usec) : 100=0.07%, 250=0.03%, 500=0.02%, 750=0.03%, 1000=0.01%
    lat (msec) : 2=0.03%, 4=0.06%, 10=0.15%, 20=0.15%, 50=0.04%
    lat (msec) : 100=0.01%
  cpu          : usr=4.66%, sys=5.89%, ctx=94569, majf=0, minf=82
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=6647820/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=25968MB, aggrb=443099KB/s, minb=443099KB/s, maxb=443099KB/s, mint=60012msec, maxt=60012msec

Disk stats (read/write):
  vda: ios=169/1692956, merge=0/10324, ticks=260/6620580, in_queue=6621932, util=96.39%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30911: Mon Dec 16 01:49:09 2022
  read : io=8739.6MB, bw=149150KB/s, iops=37287, runt= 60002msec
    clat (usec): min=121, max=13671, avg=209.06, stdev=70.91
     lat (usec): min=122, max=13672, avg=209.89, stdev=70.97
    clat percentiles (usec):
     |  1.00th=[  147],  5.00th=[  159], 10.00th=[  167], 20.00th=[  177],
     | 30.00th=[  185], 40.00th=[  191], 50.00th=[  199], 60.00th=[  209],
     | 70.00th=[  219], 80.00th=[  235], 90.00th=[  262], 95.00th=[  290],
     | 99.00th=[  362], 99.50th=[  398], 99.90th=[  524], 99.95th=[  700],
     | 99.99th=[ 2192]
    bw (KB  /s): min=16304, max=19560, per=12.50%, avg=18649.24, stdev=461.35
    lat (usec) : 250=86.74%, 500=13.13%, 750=0.08%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.01%, 10=0.01%, 20=0.01%
  cpu          : usr=3.19%, sys=6.68%, ctx=2243199, majf=0, minf=80
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2237318/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8739.6MB, aggrb=149149KB/s, minb=149149KB/s, maxb=149149KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  vda: ios=2229705/8, merge=0/5, ticks=387068/0, in_queue=387048, util=99.89%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=30937: Mon Dec 16 01:51:10 2022
  write: io=2329.5MB, bw=39753KB/s, iops=9938, runt= 60006msec
    clat (usec): min=67, max=47499, avg=799.36, stdev=4594.63
     lat (usec): min=68, max=47500, avg=800.27, stdev=4594.65
    clat percentiles (usec):
     |  1.00th=[   74],  5.00th=[   76], 10.00th=[   77], 20.00th=[   80],
     | 30.00th=[   84], 40.00th=[   88], 50.00th=[   92], 60.00th=[   96],
     | 70.00th=[  101], 80.00th=[  109], 90.00th=[  121], 95.00th=[  137],
     | 99.00th=[31360], 99.50th=[32640], 99.90th=[34560], 99.95th=[35584],
     | 99.99th=[38144]
    bw (KB  /s): min= 3671, max= 5968, per=12.51%, avg=4972.47, stdev=355.85
    lat (usec) : 100=66.85%, 250=30.72%, 500=0.10%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=2.31%
  cpu          : usr=1.01%, sys=2.93%, ctx=1207149, majf=0, minf=73
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=596349/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2329.5MB, aggrb=39752KB/s, minb=39752KB/s, maxb=39752KB/s, mint=60006msec, maxt=60006msec

Disk stats (read/write):
  vda: ios=173/595676, merge=0/1579, ticks=128/45208, in_queue=45220, util=75.16%

fio (США, Сан-Хосе)

Read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=22097: Mon Dec 16 03:10:03 2022
  read : io=8602.3MB, bw=146810KB/s, iops=36702, runt= 60001msec
    clat (usec): min=1, max=37853, avg=214.28, stdev=166.22
     lat (usec): min=1, max=37853, avg=214.82, stdev=166.22
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[  157], 20.00th=[  181],
     | 30.00th=[  193], 40.00th=[  203], 50.00th=[  213], 60.00th=[  223],
     | 70.00th=[  237], 80.00th=[  255], 90.00th=[  286], 95.00th=[  318],
     | 99.00th=[  442], 99.50th=[  676], 99.90th=[ 2352], 99.95th=[ 2768],
     | 99.99th=[ 4048]
    bw (KB  /s): min=12072, max=25480, per=12.50%, avg=18347.99, stdev=2080.92
    lat (usec) : 2=0.21%, 4=7.02%, 10=1.23%, 20=0.58%, 50=0.04%
    lat (usec) : 100=0.01%, 250=68.73%, 500=21.43%, 750=0.29%, 1000=0.11%
    lat (msec) : 2=0.17%, 4=0.17%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.79%, sys=5.69%, ctx=2009851, majf=2, minf=95
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2202186/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8602.3MB, aggrb=146809KB/s, minb=146809KB/s, maxb=146809KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):
  vda: ios=1997992/9, merge=0/4, ticks=411600/0, in_queue=411320, util=98.32%

Write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=22123: Mon Dec 16 03:12:12 2022
  write: io=35829MB, bw=610865KB/s, iops=152716, runt= 60061msec
    clat (usec): min=1, max=192241, avg=38.25, stdev=985.47
     lat (usec): min=1, max=270211, avg=40.80, stdev=1029.68
    clat percentiles (usec):
     |  1.00th=[    2],  5.00th=[    2], 10.00th=[    2], 20.00th=[    2],
     | 30.00th=[    2], 40.00th=[    3], 50.00th=[    3], 60.00th=[    3],
     | 70.00th=[    3], 80.00th=[    3], 90.00th=[    3], 95.00th=[    4],
     | 99.00th=[   10], 99.50th=[   18], 99.90th=[13376], 99.95th=[19584],
     | 99.99th=[35584]
    bw (KB  /s): min=    1, max=97767, per=12.65%, avg=77295.31, stdev=10675.70
    lat (usec) : 2=0.22%, 4=92.18%, 10=6.54%, 20=0.68%, 50=0.08%
    lat (usec) : 100=0.02%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.02%, 4=0.02%, 10=0.07%, 20=0.10%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.01%
  cpu          : usr=2.80%, sys=7.39%, ctx=68251, majf=0, minf=83
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=9172295/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=35829MB, aggrb=610865KB/s, minb=610865KB/s, maxb=610865KB/s, mint=60061msec, maxt=60061msec

Disk stats (read/write):
  vda: ios=172/642212, merge=0/8314, ticks=1048/6914268, in_queue=6915840, util=99.12%

Direct read

benchmark: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=22110: Mon Dec 16 03:11:12 2022
  read : io=8145.5MB, bw=139011KB/s, iops=34752, runt= 60002msec
    clat (usec): min=131, max=6165, avg=226.49, stdev=78.22
     lat (usec): min=132, max=6166, avg=227.00, stdev=78.23
    clat percentiles (usec):
     |  1.00th=[  155],  5.00th=[  167], 10.00th=[  177], 20.00th=[  189],
     | 30.00th=[  197], 40.00th=[  207], 50.00th=[  215], 60.00th=[  227],
     | 70.00th=[  239], 80.00th=[  255], 90.00th=[  282], 95.00th=[  310],
     | 99.00th=[  394], 99.50th=[  454], 99.90th=[ 1160], 99.95th=[ 1624],
     | 99.99th=[ 3152]
    bw (KB  /s): min=14064, max=18608, per=12.50%, avg=17378.33, stdev=844.92
    lat (usec) : 250=77.18%, 500=22.45%, 750=0.20%, 1000=0.05%
    lat (msec) : 2=0.10%, 4=0.02%, 10=0.01%
  cpu          : usr=1.73%, sys=4.97%, ctx=2088154, majf=0, minf=72
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=2085239/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=8145.5MB, aggrb=139011KB/s, minb=139011KB/s, maxb=139011KB/s, mint=60002msec, maxt=60002msec

Disk stats (read/write):
  vda: ios=2080813/8, merge=0/5, ticks=428548/0, in_queue=428396, util=99.87%

Direct write

benchmark: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=32
...
fio-2.8
Starting 8 processes
benchmark: Laying out IO file(s) (1 file(s) / 256MB)

benchmark: (groupid=0, jobs=8): err= 0: pid=22136: Mon Dec 16 03:13:12 2022
  write: io=2439.5MB, bw=41632KB/s, iops=10407, runt= 60003msec
    clat (usec): min=60, max=52245, avg=764.84, stdev=4993.14
     lat (usec): min=61, max=52245, avg=765.41, stdev=4993.15
    clat percentiles (usec):
     |  1.00th=[   66],  5.00th=[   68], 10.00th=[   70], 20.00th=[   74],
     | 30.00th=[   78], 40.00th=[   82], 50.00th=[   87], 60.00th=[   91],
     | 70.00th=[   97], 80.00th=[  105], 90.00th=[  123], 95.00th=[  149],
     | 99.00th=[37632], 99.50th=[40192], 99.90th=[42752], 99.95th=[43264],
     | 99.99th=[45312]
    bw (KB  /s): min= 3512, max= 6645, per=12.50%, avg=5204.98, stdev=587.61
    lat (usec) : 100=74.30%, 250=23.54%, 500=0.30%, 750=0.02%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=1.80%
    lat (msec) : 100=0.01%
  cpu          : usr=0.57%, sys=2.59%, ctx=1260736, majf=0, minf=81
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=624507/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=2439.5MB, aggrb=41631KB/s, minb=41631KB/s, maxb=41631KB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  vda: ios=174/623749, merge=0/1473, ticks=232/48604, in_queue=48728, util=80.83%

Оцените статью
Хостинги