randReadWrite: (g=0): rw=randrw, bs=(R) 8192B-8192B, (W) 8192B-8192B, (T) 8192B-8192B, ioengine=libaio, iodepth=1
randReadWrite/sync: (g=1): rw=randrw, bs=(R) 8192B-8192B, (W) 8192B-8192B, (T) 8192B-8192B, ioengine=libaio, iodepth=1
fio-3.12
Starting 2 processes

randReadWrite: (groupid=0, jobs=1): err= 0: pid=16410: Sun Oct 11 20:09:58 2020
  read: IOPS=5165, BW=40.4MiB/s (42.3MB/s)(4843MiB/120001msec)
    slat (usec): min=105, max=2922, avg=181.95, stdev=87.59
    clat (nsec): min=751, max=47285, avg=1529.94, stdev=247.63
     lat (usec): min=106, max=2924, avg=183.99, stdev=87.60
    clat percentiles (nsec):
     |  1.00th=[  900],  5.00th=[ 1432], 10.00th=[ 1464], 20.00th=[ 1480],
     | 30.00th=[ 1496], 40.00th=[ 1512], 50.00th=[ 1528], 60.00th=[ 1544],
     | 70.00th=[ 1560], 80.00th=[ 1576], 90.00th=[ 1608], 95.00th=[ 1640],
     | 99.00th=[ 1704], 99.50th=[ 1768], 99.90th=[ 4384], 99.95th=[ 4704],
     | 99.99th=[10816]
   bw (  KiB/s): min=13744, max=41777, per=77.88%, avg=32181.93, stdev=4945.13, samples=239
   iops        : min= 1718, max= 5222, avg=4022.29, stdev=618.15, samples=239
  write: IOPS=2218, BW=17.3MiB/s (18.2MB/s)(2079MiB/120001msec); 0 zone resets
    slat (usec): min=3, max=145, avg=10.24, stdev= 2.39
    clat (nsec): min=404, max=22961, avg=882.21, stdev=299.31
     lat (usec): min=4, max=148, avg=11.35, stdev= 2.48
    clat percentiles (nsec):
     |  1.00th=[  446],  5.00th=[  502], 10.00th=[  820], 20.00th=[  844],
     | 30.00th=[  868], 40.00th=[  884], 50.00th=[  892], 60.00th=[  900],
     | 70.00th=[  916], 80.00th=[  924], 90.00th=[  940], 95.00th=[  964],
     | 99.00th=[ 1048], 99.50th=[ 3760], 99.90th=[ 3984], 99.95th=[ 4048],
     | 99.99th=[10432]
   bw (  KiB/s): min= 6077, max=18716, per=77.89%, avg=13820.08, stdev=2178.54, samples=239
   iops        : min=  759, max= 2339, avg=1727.10, stdev=272.28, samples=239
  lat (nsec)   : 500=1.48%, 750=0.71%, 1000=28.66%
  lat (usec)   : 2=68.83%, 4=0.20%, 10=0.10%, 20=0.02%, 50=0.01%
  cpu          : usr=4.27%, sys=13.32%, ctx=619941, majf=7, minf=105
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=619864,266169,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
randReadWrite/sync: (groupid=1, jobs=1): err= 0: pid=19236: Sun Oct 11 20:09:58 2020
  read: IOPS=3474, BW=27.1MiB/s (28.5MB/s)(3258MiB/120001msec)
    slat (usec): min=107, max=3093, avg=188.10, stdev=101.75
    clat (nsec): min=758, max=36355, avg=1673.90, stdev=241.78
     lat (usec): min=108, max=3095, avg=190.32, stdev=101.75
    clat percentiles (nsec):
     |  1.00th=[  980],  5.00th=[ 1576], 10.00th=[ 1608], 20.00th=[ 1624],
     | 30.00th=[ 1656], 40.00th=[ 1672], 50.00th=[ 1688], 60.00th=[ 1688],
     | 70.00th=[ 1720], 80.00th=[ 1736], 90.00th=[ 1752], 95.00th=[ 1784],
     | 99.00th=[ 1848], 99.50th=[ 1896], 99.90th=[ 4320], 99.95th=[ 4832],
     | 99.99th=[10560]
   bw (  KiB/s): min=26224, max=29312, per=100.00%, avg=27797.09, stdev=465.57, samples=239
   iops        : min= 3278, max= 3664, avg=3474.63, stdev=58.18, samples=239
  write: IOPS=1498, BW=11.7MiB/s (12.3MB/s)(1405MiB/120001msec); 0 zone resets
    slat (usec): min=6, max=245, avg=13.70, stdev= 2.44
    clat (nsec): min=652, max=18943, avg=1144.04, stdev=693.00
     lat (usec): min=7, max=254, avg=15.20, stdev= 2.36
    clat percentiles (nsec):
     |  1.00th=[  740],  5.00th=[  772], 10.00th=[  780], 20.00th=[  796],
     | 30.00th=[  812], 40.00th=[  828], 50.00th=[  844], 60.00th=[  892],
     | 70.00th=[ 1368], 80.00th=[ 1416], 90.00th=[ 1464], 95.00th=[ 1512],
     | 99.00th=[ 4256], 99.50th=[ 4384], 99.90th=[ 4448], 99.95th=[ 4576],
     | 99.99th=[10432]
   bw (  KiB/s): min=10880, max=13424, per=99.98%, avg=11984.64, stdev=444.20, samples=239
   iops        : min= 1360, max= 1678, avg=1498.06, stdev=55.51, samples=239
  lat (nsec)   : 750=0.55%, 1000=19.57%
  lat (usec)   : 2=78.49%, 4=0.16%, 10=1.22%, 20=0.02%, 50=0.01%
  fsync/fdatasync/sync_file_range:
    sync (nsec): min=113, max=42621, avg=287.15, stdev=134.75
    sync percentiles (nsec):
     |  1.00th=[  161],  5.00th=[  215], 10.00th=[  249], 20.00th=[  262],
     | 30.00th=[  266], 40.00th=[  274], 50.00th=[  278], 60.00th=[  286],
     | 70.00th=[  298], 80.00th=[  322], 90.00th=[  342], 95.00th=[  354],
     | 99.00th=[  370], 99.50th=[  374], 99.90th=[  732], 99.95th=[ 3472],
     | 99.99th=[ 3568]
  cpu          : usr=5.00%, sys=18.37%, ctx=1790262, majf=0, minf=108
  IO depths    : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=416985,179815,0,596798 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
   READ: bw=40.4MiB/s (42.3MB/s), 40.4MiB/s-40.4MiB/s (42.3MB/s-42.3MB/s), io=4843MiB (5078MB), run=120001-120001msec
  WRITE: bw=17.3MiB/s (18.2MB/s), 17.3MiB/s-17.3MiB/s (18.2MB/s-18.2MB/s), io=2079MiB (2180MB), run=120001-120001msec

Run status group 1 (all jobs):
   READ: bw=27.1MiB/s (28.5MB/s), 27.1MiB/s-27.1MiB/s (28.5MB/s-28.5MB/s), io=3258MiB (3416MB), run=120001-120001msec
  WRITE: bw=11.7MiB/s (12.3MB/s), 11.7MiB/s-11.7MiB/s (12.3MB/s-12.3MB/s), io=1405MiB (1473MB), run=120001-120001msec

Disk stats (read/write):
  sdak: ios=1036817/1036924, merge=0/456733, ticks=174829/85505, in_queue=0, util=99.53%