User Tools

Site Tools


os:esxi:home_lab:tests:vm_storage_iops

ESXi - Home Lab - VM Storage IOPS

The following tests were done in my Home Lab Environment.

VM used:

  • OS: Windows Server 2012 R2
  • RAM: 3GB
  • CPU: 2
  • Partitions
    • C:\ (128GB, OS)
    • E:\ (10GB, local HDD)
    • F:\ (10GB, NFS on NAS)
    • G:\ (10GB, local SSD)

All partitions are thick disks (eager zeroed).

DiskSpd was used to do the tests. https://github.com/Microsoft/diskspd

Tests inspired by this article: DiskSpd, PowerShell and storage performance: measuring IOPs, throughput and latency for both local disks and SMB file shares

DiskSpd Parameters

  • file size: 8GB
  • duration: 60s
  • random
  • threads: 8

non-optimal parameters, could be optimized

Summary - IOPS

Storage Type Write 8K Read 8K Write 512K Read 512K
HDD 244.46 569.04 129.46 145.12
NFS 736.07 3449.77 40.72 68.01
SSD 5251.16 5261.11 516.56 1078.73

Test Results

Write 8K

HDD

C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L E:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L E:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'E:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   0.81%|   0.26%|    0.55%|  99.20%
   1|   1.20%|   0.16%|    1.04%|  98.81%
-------------------------------------------
avg.|   1.00%|   0.21%|    0.79%|  99.00%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        14966784 |         1827 |       0.24 |      30.44 |  263.003 |    92.655 | E:\testfile.dat (8192MB)
     1 |        14802944 |         1807 |       0.24 |      30.11 |  266.036 |    92.861 | E:\testfile.dat (8192MB)
     2 |        14991360 |         1830 |       0.24 |      30.49 |  262.751 |    89.634 | E:\testfile.dat (8192MB)
     3 |        15015936 |         1833 |       0.24 |      30.54 |  262.388 |    89.976 | E:\testfile.dat (8192MB)
     4 |        15155200 |         1850 |       0.24 |      30.83 |  259.575 |    90.207 | E:\testfile.dat (8192MB)
     5 |        15065088 |         1839 |       0.24 |      30.64 |  261.914 |    89.528 | E:\testfile.dat (8192MB)
     6 |        15171584 |         1852 |       0.24 |      30.86 |  259.259 |    88.642 | E:\testfile.dat (8192MB)
     7 |        15015936 |         1833 |       0.24 |      30.54 |  262.251 |    91.226 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         120184832 |        14671 |       1.91 |     244.46 |  262.133 |    90.616

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        14966784 |         1827 |       0.24 |      30.44 |  263.003 |    92.655 | E:\testfile.dat (8192MB)
     1 |        14802944 |         1807 |       0.24 |      30.11 |  266.036 |    92.861 | E:\testfile.dat (8192MB)
     2 |        14991360 |         1830 |       0.24 |      30.49 |  262.751 |    89.634 | E:\testfile.dat (8192MB)
     3 |        15015936 |         1833 |       0.24 |      30.54 |  262.388 |    89.976 | E:\testfile.dat (8192MB)
     4 |        15155200 |         1850 |       0.24 |      30.83 |  259.575 |    90.207 | E:\testfile.dat (8192MB)
     5 |        15065088 |         1839 |       0.24 |      30.64 |  261.914 |    89.528 | E:\testfile.dat (8192MB)
     6 |        15171584 |         1852 |       0.24 |      30.86 |  259.259 |    88.642 | E:\testfile.dat (8192MB)
     7 |        15015936 |         1833 |       0.24 |      30.54 |  262.251 |    91.226 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         120184832 |        14671 |       1.91 |     244.46 |  262.133 |    90.616


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |      5.062 |      5.062
   25th |        N/A |    199.542 |    199.542
   50th |        N/A |    251.012 |    251.012
   75th |        N/A |    313.644 |    313.644
   90th |        N/A |    384.289 |    384.289
   95th |        N/A |    424.078 |    424.078
   99th |        N/A |    511.867 |    511.867
3-nines |        N/A |    693.836 |    693.836
4-nines |        N/A |    823.742 |    823.742
5-nines |        N/A |    827.650 |    827.650
6-nines |        N/A |    827.650 |    827.650
7-nines |        N/A |    827.650 |    827.650
8-nines |        N/A |    827.650 |    827.650
    max |        N/A |    827.650 |    827.650

NFS

C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L F:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L F:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'F:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   1.02%|   0.18%|    0.83%|  98.98%
   1|   1.17%|   0.16%|    1.02%|  98.85%
-------------------------------------------
avg.|   1.09%|   0.17%|    0.92%|  98.92%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        45252608 |         5524 |       0.72 |      92.07 |   87.280 |    98.874 | F:\testfile.dat (8192MB)
     1 |        45178880 |         5515 |       0.72 |      91.92 |   87.421 |    99.095 | F:\testfile.dat (8192MB)
     2 |        45211648 |         5519 |       0.72 |      91.98 |   87.358 |    98.211 | F:\testfile.dat (8192MB)
     3 |        45252608 |         5524 |       0.72 |      92.07 |   87.278 |    99.075 | F:\testfile.dat (8192MB)
     4 |        45260800 |         5525 |       0.72 |      92.08 |   87.265 |    99.036 | F:\testfile.dat (8192MB)
     5 |        45219840 |         5520 |       0.72 |      92.00 |   87.343 |    98.244 | F:\testfile.dat (8192MB)
     6 |        45252608 |         5524 |       0.72 |      92.07 |   87.277 |    98.664 | F:\testfile.dat (8192MB)
     7 |        45170688 |         5514 |       0.72 |      91.90 |   87.439 |    97.592 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         361799680 |        44165 |       5.75 |     736.07 |   87.333 |    98.600

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        45252608 |         5524 |       0.72 |      92.07 |   87.280 |    98.874 | F:\testfile.dat (8192MB)
     1 |        45178880 |         5515 |       0.72 |      91.92 |   87.421 |    99.095 | F:\testfile.dat (8192MB)
     2 |        45211648 |         5519 |       0.72 |      91.98 |   87.358 |    98.211 | F:\testfile.dat (8192MB)
     3 |        45252608 |         5524 |       0.72 |      92.07 |   87.278 |    99.075 | F:\testfile.dat (8192MB)
     4 |        45260800 |         5525 |       0.72 |      92.08 |   87.265 |    99.036 | F:\testfile.dat (8192MB)
     5 |        45219840 |         5520 |       0.72 |      92.00 |   87.343 |    98.244 | F:\testfile.dat (8192MB)
     6 |        45252608 |         5524 |       0.72 |      92.07 |   87.277 |    98.664 | F:\testfile.dat (8192MB)
     7 |        45170688 |         5514 |       0.72 |      91.90 |   87.439 |    97.592 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         361799680 |        44165 |       5.75 |     736.07 |   87.333 |    98.600


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |      1.214 |      1.214
   25th |        N/A |      5.322 |      5.322
   50th |        N/A |     70.497 |     70.497
   75th |        N/A |    141.700 |    141.700
   90th |        N/A |    204.554 |    204.554
   95th |        N/A |    206.099 |    206.099
   99th |        N/A |    404.667 |    404.667
3-nines |        N/A |    818.114 |    818.114
4-nines |        N/A |    818.939 |    818.939
5-nines |        N/A |    819.543 |    819.543
6-nines |        N/A |    819.543 |    819.543
7-nines |        N/A |    819.543 |    819.543
8-nines |        N/A |    819.543 |    819.543
    max |        N/A |    819.543 |    819.543

SSD

C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L G:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L G:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'G:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   4.74%|   0.55%|    4.19%|  95.26%
   1|   4.84%|   0.60%|    4.24%|  95.15%
-------------------------------------------
avg.|   4.79%|   0.57%|    4.22%|  95.21%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       322609152 |        39381 |       5.13 |     656.34 |   12.187 |     1.844 | G:\testfile.dat (8192MB)
     1 |       322363392 |        39351 |       5.12 |     655.84 |   12.197 |     1.833 | G:\testfile.dat (8192MB)
     2 |       322813952 |        39406 |       5.13 |     656.75 |   12.180 |     1.823 | G:\testfile.dat (8192MB)
     3 |       322543616 |        39373 |       5.13 |     656.20 |   12.191 |     1.845 | G:\testfile.dat (8192MB)
     4 |       322797568 |        39404 |       5.13 |     656.72 |   12.180 |     1.839 | G:\testfile.dat (8192MB)
     5 |       322617344 |        39382 |       5.13 |     656.35 |   12.187 |     1.836 | G:\testfile.dat (8192MB)
     6 |       322830336 |        39408 |       5.13 |     656.79 |   12.179 |     1.829 | G:\testfile.dat (8192MB)
     7 |       322519040 |        39370 |       5.13 |     656.15 |   12.191 |     1.840 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2581094400 |       315075 |      41.02 |    5251.16 |   12.187 |     1.836

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       322609152 |        39381 |       5.13 |     656.34 |   12.187 |     1.844 | G:\testfile.dat (8192MB)
     1 |       322363392 |        39351 |       5.12 |     655.84 |   12.197 |     1.833 | G:\testfile.dat (8192MB)
     2 |       322813952 |        39406 |       5.13 |     656.75 |   12.180 |     1.823 | G:\testfile.dat (8192MB)
     3 |       322543616 |        39373 |       5.13 |     656.20 |   12.191 |     1.845 | G:\testfile.dat (8192MB)
     4 |       322797568 |        39404 |       5.13 |     656.72 |   12.180 |     1.839 | G:\testfile.dat (8192MB)
     5 |       322617344 |        39382 |       5.13 |     656.35 |   12.187 |     1.836 | G:\testfile.dat (8192MB)
     6 |       322830336 |        39408 |       5.13 |     656.79 |   12.179 |     1.829 | G:\testfile.dat (8192MB)
     7 |       322519040 |        39370 |       5.13 |     656.15 |   12.191 |     1.840 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2581094400 |       315075 |      41.02 |    5251.16 |   12.187 |     1.836


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |      1.885 |      1.885
   25th |        N/A |     11.873 |     11.873
   50th |        N/A |     12.098 |     12.098
   75th |        N/A |     12.282 |     12.282
   90th |        N/A |     12.398 |     12.398
   95th |        N/A |     12.533 |     12.533
   99th |        N/A |     22.468 |     22.468
3-nines |        N/A |     24.253 |     24.253
4-nines |        N/A |     33.970 |     33.970
5-nines |        N/A |     35.659 |     35.659
6-nines |        N/A |     35.892 |     35.892
7-nines |        N/A |     35.892 |     35.892
8-nines |        N/A |     35.892 |     35.892
    max |        N/A |     35.892 |     35.892

Read 8K

HDD

# diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L E:\testfile.dat

C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L E:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L E:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'E:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   1.54%|   0.23%|    1.30%|  98.46%
   1|   2.27%|   0.31%|    1.95%|  97.73%
-------------------------------------------
avg.|   1.90%|   0.27%|    1.63%|  98.09%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        34684928 |         4234 |       0.55 |      70.56 |  113.435 |   128.592 | E:\testfile.dat (8192MB)
     1 |        34709504 |         4237 |       0.55 |      70.61 |  113.155 |   128.764 | E:\testfile.dat (8192MB)
     2 |        35528704 |         4337 |       0.56 |      72.28 |  110.743 |   124.341 | E:\testfile.dat (8192MB)
     3 |        34996224 |         4272 |       0.56 |      71.20 |  112.274 |   124.561 | E:\testfile.dat (8192MB)
     4 |        35168256 |         4293 |       0.56 |      71.55 |  111.759 |   131.915 | E:\testfile.dat (8192MB)
     5 |        34512896 |         4213 |       0.55 |      70.21 |  113.757 |   128.762 | E:\testfile.dat (8192MB)
     6 |        34881536 |         4258 |       0.55 |      70.96 |  112.707 |   123.748 | E:\testfile.dat (8192MB)
     7 |        35225600 |         4300 |       0.56 |      71.66 |  111.092 |   125.022 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         279707648 |        34144 |       4.45 |     569.04 |  112.356 |   126.988

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        34684928 |         4234 |       0.55 |      70.56 |  113.435 |   128.592 | E:\testfile.dat (8192MB)
     1 |        34709504 |         4237 |       0.55 |      70.61 |  113.155 |   128.764 | E:\testfile.dat (8192MB)
     2 |        35528704 |         4337 |       0.56 |      72.28 |  110.743 |   124.341 | E:\testfile.dat (8192MB)
     3 |        34996224 |         4272 |       0.56 |      71.20 |  112.274 |   124.561 | E:\testfile.dat (8192MB)
     4 |        35168256 |         4293 |       0.56 |      71.55 |  111.759 |   131.915 | E:\testfile.dat (8192MB)
     5 |        34512896 |         4213 |       0.55 |      70.21 |  113.757 |   128.762 | E:\testfile.dat (8192MB)
     6 |        34881536 |         4258 |       0.55 |      70.96 |  112.707 |   123.748 | E:\testfile.dat (8192MB)
     7 |        35225600 |         4300 |       0.56 |      71.66 |  111.092 |   125.022 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         279707648 |        34144 |       4.45 |     569.04 |  112.356 |   126.988

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |      2.631 |        N/A |      2.631
   25th |     36.030 |        N/A |     36.030
   50th |     74.554 |        N/A |     74.554
   75th |    139.413 |        N/A |    139.413
   90th |    243.379 |        N/A |    243.379
   95th |    336.761 |        N/A |    336.761
   99th |    642.568 |        N/A |    642.568
3-nines |   1191.057 |        N/A |   1191.057
4-nines |   1753.558 |        N/A |   1753.558
5-nines |   2034.270 |        N/A |   2034.270
6-nines |   2034.270 |        N/A |   2034.270
7-nines |   2034.270 |        N/A |   2034.270
8-nines |   2034.270 |        N/A |   2034.270
    max |   2034.270 |        N/A |   2034.270

NFS

C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L F:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L F:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'F:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   2.40%|   0.23%|    2.16%|  97.58%
   1|   3.18%|   0.49%|    2.68%|  96.80%
-------------------------------------------
avg.|   2.79%|   0.36%|    2.42%|  97.19%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       214147072 |        26141 |       3.40 |     435.60 |   18.364 |    23.401 | F:\testfile.dat (8192MB)
     1 |       212246528 |        25909 |       3.37 |     431.73 |   18.527 |    24.628 | F:\testfile.dat (8192MB)
     2 |       210927616 |        25748 |       3.35 |     429.05 |   18.644 |    25.510 | F:\testfile.dat (8192MB)
     3 |       212099072 |        25891 |       3.37 |     431.43 |   18.542 |    23.859 | F:\testfile.dat (8192MB)
     4 |       211320832 |        25796 |       3.36 |     429.85 |   18.610 |    23.947 | F:\testfile.dat (8192MB)
     5 |       211124224 |        25772 |       3.36 |     429.45 |   18.624 |    25.017 | F:\testfile.dat (8192MB)
     6 |       211083264 |        25767 |       3.35 |     429.36 |   18.631 |    24.475 | F:\testfile.dat (8192MB)
     7 |       213024768 |        26004 |       3.39 |     433.31 |   18.457 |    23.861 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        1695973376 |       207028 |      26.95 |    3449.77 |   18.549 |    24.344

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       214147072 |        26141 |       3.40 |     435.60 |   18.364 |    23.401 | F:\testfile.dat (8192MB)
     1 |       212246528 |        25909 |       3.37 |     431.73 |   18.527 |    24.628 | F:\testfile.dat (8192MB)
     2 |       210927616 |        25748 |       3.35 |     429.05 |   18.644 |    25.510 | F:\testfile.dat (8192MB)
     3 |       212099072 |        25891 |       3.37 |     431.43 |   18.542 |    23.859 | F:\testfile.dat (8192MB)
     4 |       211320832 |        25796 |       3.36 |     429.85 |   18.610 |    23.947 | F:\testfile.dat (8192MB)
     5 |       211124224 |        25772 |       3.36 |     429.45 |   18.624 |    25.017 | F:\testfile.dat (8192MB)
     6 |       211083264 |        25767 |       3.35 |     429.36 |   18.631 |    24.475 | F:\testfile.dat (8192MB)
     7 |       213024768 |        26004 |       3.39 |     433.31 |   18.457 |    23.861 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        1695973376 |       207028 |      26.95 |    3449.77 |   18.549 |    24.344

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |      2.665 |        N/A |      2.665
   25th |      4.659 |        N/A |      4.659
   50th |     11.208 |        N/A |     11.208
   75th |     24.630 |        N/A |     24.630
   90th |     40.427 |        N/A |     40.427
   95th |     53.052 |        N/A |     53.052
   99th |     96.056 |        N/A |     96.056
3-nines |    297.746 |        N/A |    297.746
4-nines |    571.361 |        N/A |    571.361
5-nines |    828.978 |        N/A |    828.978
6-nines |   1418.762 |        N/A |   1418.762
7-nines |   1418.762 |        N/A |   1418.762
8-nines |   1418.762 |        N/A |   1418.762
    max |   1418.762 |        N/A |   1418.762

SSD

C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L G:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L G:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'G:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   4.45%|   0.52%|    3.93%|  95.55%
   1|   4.35%|   0.73%|    3.62%|  95.68%
-------------------------------------------
avg.|   4.40%|   0.62%|    3.78%|  95.61%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       322977792 |        39426 |       5.13 |     656.94 |   12.176 |     2.002 | G:\testfile.dat (8192MB)
     1 |       323084288 |        39439 |       5.13 |     657.15 |   12.172 |     1.989 | G:\testfile.dat (8192MB)
     2 |       324059136 |        39558 |       5.15 |     659.14 |   12.136 |     1.881 | G:\testfile.dat (8192MB)
     3 |       323395584 |        39477 |       5.14 |     657.79 |   12.161 |     1.966 | G:\testfile.dat (8192MB)
     4 |       322920448 |        39419 |       5.13 |     656.82 |   12.179 |     1.998 | G:\testfile.dat (8192MB)
     5 |       322772992 |        39401 |       5.13 |     656.52 |   12.184 |     2.025 | G:\testfile.dat (8192MB)
     6 |       323190784 |        39452 |       5.14 |     657.37 |   12.169 |     1.988 | G:\testfile.dat (8192MB)
     7 |       324182016 |        39573 |       5.15 |     659.39 |   12.131 |     1.876 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2586583040 |       315745 |      41.10 |    5261.11 |   12.163 |     1.966

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       322977792 |        39426 |       5.13 |     656.94 |   12.176 |     2.002 | G:\testfile.dat (8192MB)
     1 |       323084288 |        39439 |       5.13 |     657.15 |   12.172 |     1.989 | G:\testfile.dat (8192MB)
     2 |       324059136 |        39558 |       5.15 |     659.14 |   12.136 |     1.881 | G:\testfile.dat (8192MB)
     3 |       323395584 |        39477 |       5.14 |     657.79 |   12.161 |     1.966 | G:\testfile.dat (8192MB)
     4 |       322920448 |        39419 |       5.13 |     656.82 |   12.179 |     1.998 | G:\testfile.dat (8192MB)
     5 |       322772992 |        39401 |       5.13 |     656.52 |   12.184 |     2.025 | G:\testfile.dat (8192MB)
     6 |       323190784 |        39452 |       5.14 |     657.37 |   12.169 |     1.988 | G:\testfile.dat (8192MB)
     7 |       324182016 |        39573 |       5.15 |     659.39 |   12.131 |     1.876 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2586583040 |       315745 |      41.10 |    5261.11 |   12.163 |     1.966

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |      0.824 |        N/A |      0.824
   25th |     11.810 |        N/A |     11.810
   50th |     12.063 |        N/A |     12.063
   75th |     12.216 |        N/A |     12.216
   90th |     12.363 |        N/A |     12.363
   95th |     12.550 |        N/A |     12.550
   99th |     23.506 |        N/A |     23.506
3-nines |     24.415 |        N/A |     24.415
4-nines |     35.527 |        N/A |     35.527
5-nines |     36.228 |        N/A |     36.228
6-nines |     37.992 |        N/A |     37.992
7-nines |     37.992 |        N/A |     37.992
8-nines |     37.992 |        N/A |     37.992
    max |     37.992 |        N/A |     37.992

Write 512K

HDD

C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L E:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L E:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'E:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   1.02%|   0.26%|    0.76%|  99.01%
   1|   1.43%|   0.21%|    1.22%|  98.59%
-------------------------------------------
avg.|   1.22%|   0.23%|    0.99%|  98.80%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       506986496 |          967 |       8.06 |      16.12 |  494.441 |    54.611 | E:\testfile.dat (8192MB)
     1 |       509083648 |          971 |       8.09 |      16.18 |  493.640 |    54.625 | E:\testfile.dat (8192MB)
     2 |       508559360 |          970 |       8.08 |      16.17 |  494.926 |    55.924 | E:\testfile.dat (8192MB)
     3 |       509607936 |          972 |       8.10 |      16.20 |  492.664 |    53.485 | E:\testfile.dat (8192MB)
     4 |       510132224 |          973 |       8.11 |      16.22 |  492.701 |    54.730 | E:\testfile.dat (8192MB)
     5 |       509083648 |          971 |       8.09 |      16.18 |  493.307 |    56.621 | E:\testfile.dat (8192MB)
     6 |       509607936 |          972 |       8.10 |      16.20 |  493.745 |    55.556 | E:\testfile.dat (8192MB)
     7 |       509607936 |          972 |       8.10 |      16.20 |  493.109 |    55.962 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        4072669184 |         7768 |      64.73 |     129.46 |  493.566 |    55.202

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       506986496 |          967 |       8.06 |      16.12 |  494.441 |    54.611 | E:\testfile.dat (8192MB)
     1 |       509083648 |          971 |       8.09 |      16.18 |  493.640 |    54.625 | E:\testfile.dat (8192MB)
     2 |       508559360 |          970 |       8.08 |      16.17 |  494.926 |    55.924 | E:\testfile.dat (8192MB)
     3 |       509607936 |          972 |       8.10 |      16.20 |  492.664 |    53.485 | E:\testfile.dat (8192MB)
     4 |       510132224 |          973 |       8.11 |      16.22 |  492.701 |    54.730 | E:\testfile.dat (8192MB)
     5 |       509083648 |          971 |       8.09 |      16.18 |  493.307 |    56.621 | E:\testfile.dat (8192MB)
     6 |       509607936 |          972 |       8.10 |      16.20 |  493.745 |    55.556 | E:\testfile.dat (8192MB)
     7 |       509607936 |          972 |       8.10 |      16.20 |  493.109 |    55.962 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        4072669184 |         7768 |      64.73 |     129.46 |  493.566 |    55.202


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |    331.312 |    331.312
   25th |        N/A |    455.160 |    455.160
   50th |        N/A |    491.612 |    491.612
   75th |        N/A |    529.735 |    529.735
   90th |        N/A |    565.762 |    565.762
   95th |        N/A |    585.555 |    585.555
   99th |        N/A |    626.465 |    626.465
3-nines |        N/A |    705.344 |    705.344
4-nines |        N/A |    957.882 |    957.882
5-nines |        N/A |    957.882 |    957.882
6-nines |        N/A |    957.882 |    957.882
7-nines |        N/A |    957.882 |    957.882
8-nines |        N/A |    957.882 |    957.882
    max |        N/A |    957.882 |    957.882

NFS

C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L F:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L F:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'F:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   0.83%|   0.18%|    0.65%|  99.17%
   1|   0.52%|   0.26%|    0.26%|  99.48%
-------------------------------------------
avg.|   0.68%|   0.22%|    0.46%|  99.32%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       156237824 |          298 |       2.48 |       4.97 | 1649.946 |  1221.495 | F:\testfile.dat (8192MB)
     1 |       162004992 |          309 |       2.57 |       5.15 | 1578.751 |   884.018 | F:\testfile.dat (8192MB)
     2 |       160432128 |          306 |       2.55 |       5.10 | 1571.906 |   963.079 | F:\testfile.dat (8192MB)
     3 |       162529280 |          310 |       2.58 |       5.17 | 1540.152 |   810.981 | F:\testfile.dat (8192MB)
     4 |       155713536 |          297 |       2.47 |       4.95 | 1642.193 |  1229.414 | F:\testfile.dat (8192MB)
     5 |       162529280 |          310 |       2.58 |       5.17 | 1548.634 |   833.139 | F:\testfile.dat (8192MB)
     6 |       159383552 |          304 |       2.53 |       5.07 | 1599.569 |  1085.135 | F:\testfile.dat (8192MB)
     7 |       162004992 |          309 |       2.57 |       5.15 | 1538.734 |   804.873 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        1280835584 |         2443 |      20.36 |      40.72 | 1583.100 |   991.177

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       156237824 |          298 |       2.48 |       4.97 | 1649.946 |  1221.495 | F:\testfile.dat (8192MB)
     1 |       162004992 |          309 |       2.57 |       5.15 | 1578.751 |   884.018 | F:\testfile.dat (8192MB)
     2 |       160432128 |          306 |       2.55 |       5.10 | 1571.906 |   963.079 | F:\testfile.dat (8192MB)
     3 |       162529280 |          310 |       2.58 |       5.17 | 1540.152 |   810.981 | F:\testfile.dat (8192MB)
     4 |       155713536 |          297 |       2.47 |       4.95 | 1642.193 |  1229.414 | F:\testfile.dat (8192MB)
     5 |       162529280 |          310 |       2.58 |       5.17 | 1548.634 |   833.139 | F:\testfile.dat (8192MB)
     6 |       159383552 |          304 |       2.53 |       5.07 | 1599.569 |  1085.135 | F:\testfile.dat (8192MB)
     7 |       162004992 |          309 |       2.57 |       5.15 | 1538.734 |   804.873 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        1280835584 |         2443 |      20.36 |      40.72 | 1583.100 |   991.177


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |    488.675 |    488.675
   25th |        N/A |    987.196 |    987.196
   50th |        N/A |   1338.976 |   1338.976
   75th |        N/A |   1917.853 |   1917.853
   90th |        N/A |   2303.580 |   2303.580
   95th |        N/A |   3159.909 |   3159.909
   99th |        N/A |   5151.770 |   5151.770
3-nines |        N/A |  10736.144 |  10736.144
4-nines |        N/A |  11156.307 |  11156.307
5-nines |        N/A |  11156.307 |  11156.307
6-nines |        N/A |  11156.307 |  11156.307
7-nines |        N/A |  11156.307 |  11156.307
8-nines |        N/A |  11156.307 |  11156.307
    max |        N/A |  11156.307 |  11156.307

SSD

C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L G:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L G:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'G:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   1.67%|   0.10%|    1.56%|  98.34%
   1|   1.74%|   0.08%|    1.67%|  98.26%
-------------------------------------------
avg.|   1.71%|   0.09%|    1.61%|  98.30%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |      2032140288 |         3876 |      32.29 |      64.59 |  123.860 |     3.092 | G:\testfile.dat (8192MB)
     1 |      2032140288 |         3876 |      32.29 |      64.59 |  123.837 |     2.970 | G:\testfile.dat (8192MB)
     2 |      2032664576 |         3877 |      32.30 |      64.60 |  123.885 |     3.750 | G:\testfile.dat (8192MB)
     3 |      2029518848 |         3871 |      32.25 |      64.50 |  124.010 |     4.757 | G:\testfile.dat (8192MB)
     4 |      2031616000 |         3875 |      32.28 |      64.57 |  123.919 |     4.005 | G:\testfile.dat (8192MB)
     5 |      2033188864 |         3878 |      32.31 |      64.62 |  123.797 |     2.028 | G:\testfile.dat (8192MB)
     6 |      2031091712 |         3874 |      32.28 |      64.55 |  123.913 |     3.660 | G:\testfile.dat (8192MB)
     7 |      2030567424 |         3873 |      32.27 |      64.54 |  123.958 |     3.963 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:       16252928000 |        31000 |     258.28 |     516.56 |  123.897 |     3.611

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |      2032140288 |         3876 |      32.29 |      64.59 |  123.860 |     3.092 | G:\testfile.dat (8192MB)
     1 |      2032140288 |         3876 |      32.29 |      64.59 |  123.837 |     2.970 | G:\testfile.dat (8192MB)
     2 |      2032664576 |         3877 |      32.30 |      64.60 |  123.885 |     3.750 | G:\testfile.dat (8192MB)
     3 |      2029518848 |         3871 |      32.25 |      64.50 |  124.010 |     4.757 | G:\testfile.dat (8192MB)
     4 |      2031616000 |         3875 |      32.28 |      64.57 |  123.919 |     4.005 | G:\testfile.dat (8192MB)
     5 |      2033188864 |         3878 |      32.31 |      64.62 |  123.797 |     2.028 | G:\testfile.dat (8192MB)
     6 |      2031091712 |         3874 |      32.28 |      64.55 |  123.913 |     3.660 | G:\testfile.dat (8192MB)
     7 |      2030567424 |         3873 |      32.27 |      64.54 |  123.958 |     3.963 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:       16252928000 |        31000 |     258.28 |     516.56 |  123.897 |     3.611


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |    117.965 |    117.965
   25th |        N/A |    123.850 |    123.850
   50th |        N/A |    123.899 |    123.899
   75th |        N/A |    123.941 |    123.941
   90th |        N/A |    123.978 |    123.978
   95th |        N/A |    124.012 |    124.012
   99th |        N/A |    124.891 |    124.891
3-nines |        N/A |    199.822 |    199.822
4-nines |        N/A |    231.365 |    231.365
5-nines |        N/A |    238.747 |    238.747
6-nines |        N/A |    238.747 |    238.747
7-nines |        N/A |    238.747 |    238.747
8-nines |        N/A |    238.747 |    238.747
    max |        N/A |    238.747 |    238.747

Read 512K

HDD

C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L E:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L E:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'E:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   0.83%|   0.29%|    0.55%|  99.16%
   1|   1.07%|   0.23%|    0.83%|  98.93%
-------------------------------------------
avg.|   0.95%|   0.26%|    0.69%|  99.04%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       587202560 |         1120 |       9.33 |      18.67 |  427.771 |   347.990 | E:\testfile.dat (8192MB)
     1 |       586153984 |         1118 |       9.32 |      18.63 |  429.810 |   349.144 | E:\testfile.dat (8192MB)
     2 |       589299712 |         1124 |       9.37 |      18.73 |  424.982 |   340.093 | E:\testfile.dat (8192MB)
     3 |       555745280 |         1060 |       8.83 |      17.67 |  455.375 |   411.710 | E:\testfile.dat (8192MB)
     4 |       575668224 |         1098 |       9.15 |      18.30 |  433.092 |   352.360 | E:\testfile.dat (8192MB)
     5 |       557318144 |         1063 |       8.86 |      17.72 |  449.838 |   399.745 | E:\testfile.dat (8192MB)
     6 |       576716800 |         1100 |       9.17 |      18.33 |  435.077 |   362.675 | E:\testfile.dat (8192MB)
     7 |       537395200 |         1025 |       8.54 |      17.08 |  465.737 |   427.123 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        4565499904 |         8708 |      72.56 |     145.12 |  439.789 |   374.471

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       587202560 |         1120 |       9.33 |      18.67 |  427.771 |   347.990 | E:\testfile.dat (8192MB)
     1 |       586153984 |         1118 |       9.32 |      18.63 |  429.810 |   349.144 | E:\testfile.dat (8192MB)
     2 |       589299712 |         1124 |       9.37 |      18.73 |  424.982 |   340.093 | E:\testfile.dat (8192MB)
     3 |       555745280 |         1060 |       8.83 |      17.67 |  455.375 |   411.710 | E:\testfile.dat (8192MB)
     4 |       575668224 |         1098 |       9.15 |      18.30 |  433.092 |   352.360 | E:\testfile.dat (8192MB)
     5 |       557318144 |         1063 |       8.86 |      17.72 |  449.838 |   399.745 | E:\testfile.dat (8192MB)
     6 |       576716800 |         1100 |       9.17 |      18.33 |  435.077 |   362.675 | E:\testfile.dat (8192MB)
     7 |       537395200 |         1025 |       8.54 |      17.08 |  465.737 |   427.123 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        4565499904 |         8708 |      72.56 |     145.12 |  439.789 |   374.471

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |    134.665 |        N/A |    134.665
   25th |    308.128 |        N/A |    308.128
   50th |    367.192 |        N/A |    367.192
   75th |    431.843 |        N/A |    431.843
   90th |    495.140 |        N/A |    495.140
   95th |    562.580 |        N/A |    562.580
   99th |   2358.475 |        N/A |   2358.475
3-nines |   2484.729 |        N/A |   2484.729
4-nines |   2564.951 |        N/A |   2564.951
5-nines |   2564.951 |        N/A |   2564.951
6-nines |   2564.951 |        N/A |   2564.951
7-nines |   2564.951 |        N/A |   2564.951
8-nines |   2564.951 |        N/A |   2564.951
    max |   2564.951 |        N/A |   2564.951

NFS

C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L F:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L F:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'F:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   0.29%|   0.00%|    0.29%|  99.70%
   1|   0.47%|   0.05%|    0.42%|  99.51%
-------------------------------------------
avg.|   0.38%|   0.03%|    0.35%|  99.61%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       268959744 |          513 |       4.27 |       8.55 |  939.445 |   294.138 | F:\testfile.dat (8192MB)
     1 |       268435456 |          512 |       4.27 |       8.53 |  934.389 |   224.634 | F:\testfile.dat (8192MB)
     2 |       265289728 |          506 |       4.22 |       8.43 |  980.260 |   484.648 | F:\testfile.dat (8192MB)
     3 |       268959744 |          513 |       4.27 |       8.55 |  957.880 |   385.836 | F:\testfile.dat (8192MB)
     4 |       263192576 |          502 |       4.18 |       8.37 |  989.031 |   557.801 | F:\testfile.dat (8192MB)
     5 |       267911168 |          511 |       4.26 |       8.52 |  934.999 |   222.781 | F:\testfile.dat (8192MB)
     6 |       267386880 |          510 |       4.25 |       8.50 |  946.895 |   365.036 | F:\testfile.dat (8192MB)
     7 |       269484032 |          514 |       4.28 |       8.57 |  929.988 |   220.322 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2139619328 |         4081 |      34.00 |      68.01 |  951.471 |   364.318

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       268959744 |          513 |       4.27 |       8.55 |  939.445 |   294.138 | F:\testfile.dat (8192MB)
     1 |       268435456 |          512 |       4.27 |       8.53 |  934.389 |   224.634 | F:\testfile.dat (8192MB)
     2 |       265289728 |          506 |       4.22 |       8.43 |  980.260 |   484.648 | F:\testfile.dat (8192MB)
     3 |       268959744 |          513 |       4.27 |       8.55 |  957.880 |   385.836 | F:\testfile.dat (8192MB)
     4 |       263192576 |          502 |       4.18 |       8.37 |  989.031 |   557.801 | F:\testfile.dat (8192MB)
     5 |       267911168 |          511 |       4.26 |       8.52 |  934.999 |   222.781 | F:\testfile.dat (8192MB)
     6 |       267386880 |          510 |       4.25 |       8.50 |  946.895 |   365.036 | F:\testfile.dat (8192MB)
     7 |       269484032 |          514 |       4.28 |       8.57 |  929.988 |   220.322 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2139619328 |         4081 |      34.00 |      68.01 |  951.471 |   364.318

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |    343.730 |        N/A |    343.730
   25th |    775.531 |        N/A |    775.531
   50th |    922.393 |        N/A |    922.393
   75th |   1088.764 |        N/A |   1088.764
   90th |   1241.313 |        N/A |   1241.313
   95th |   1336.883 |        N/A |   1336.883
   99th |   1475.941 |        N/A |   1475.941
3-nines |   6404.973 |        N/A |   6404.973
4-nines |   7456.621 |        N/A |   7456.621
5-nines |   7456.621 |        N/A |   7456.621
6-nines |   7456.621 |        N/A |   7456.621
7-nines |   7456.621 |        N/A |   7456.621
8-nines |   7456.621 |        N/A |   7456.621
    max |   7456.621 |        N/A |   7456.621

SSD

C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L G:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L G:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'G:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   3.23%|   0.13%|    3.10%|  96.77%
   1|   4.27%|   0.26%|    4.01%|  95.73%
-------------------------------------------
avg.|   3.75%|   0.20%|    3.55%|  96.25%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |      4242538496 |         8092 |      67.43 |     134.86 |   59.329 |     0.560 | G:\testfile.dat (8192MB)
     1 |      4242014208 |         8091 |      67.42 |     134.85 |   59.329 |     0.540 | G:\testfile.dat (8192MB)
     2 |      4240441344 |         8088 |      67.40 |     134.80 |   59.329 |     0.586 | G:\testfile.dat (8192MB)
     3 |      4240965632 |         8089 |      67.41 |     134.81 |   59.328 |     0.552 | G:\testfile.dat (8192MB)
     4 |      4241489920 |         8090 |      67.42 |     134.83 |   59.325 |     0.547 | G:\testfile.dat (8192MB)
     5 |      4242014208 |         8091 |      67.42 |     134.85 |   59.326 |     0.546 | G:\testfile.dat (8192MB)
     6 |      4242014208 |         8091 |      67.42 |     134.85 |   59.327 |     0.539 | G:\testfile.dat (8192MB)
     7 |      4243062784 |         8093 |      67.44 |     134.88 |   59.326 |     0.543 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:       33934540800 |        64725 |     539.37 |    1078.73 |   59.327 |     0.552

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |      4242538496 |         8092 |      67.43 |     134.86 |   59.329 |     0.560 | G:\testfile.dat (8192MB)
     1 |      4242014208 |         8091 |      67.42 |     134.85 |   59.329 |     0.540 | G:\testfile.dat (8192MB)
     2 |      4240441344 |         8088 |      67.40 |     134.80 |   59.329 |     0.586 | G:\testfile.dat (8192MB)
     3 |      4240965632 |         8089 |      67.41 |     134.81 |   59.328 |     0.552 | G:\testfile.dat (8192MB)
     4 |      4241489920 |         8090 |      67.42 |     134.83 |   59.325 |     0.547 | G:\testfile.dat (8192MB)
     5 |      4242014208 |         8091 |      67.42 |     134.85 |   59.326 |     0.546 | G:\testfile.dat (8192MB)
     6 |      4242014208 |         8091 |      67.42 |     134.85 |   59.327 |     0.539 | G:\testfile.dat (8192MB)
     7 |      4243062784 |         8093 |      67.44 |     134.88 |   59.326 |     0.543 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:       33934540800 |        64725 |     539.37 |    1078.73 |   59.327 |     0.552

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |     53.509 |        N/A |     53.509
   25th |     59.263 |        N/A |     59.263
   50th |     59.300 |        N/A |     59.300
   75th |     59.339 |        N/A |     59.339
   90th |     59.398 |        N/A |     59.398
   95th |     59.458 |        N/A |     59.458
   99th |     59.632 |        N/A |     59.632
3-nines |     72.851 |        N/A |     72.851
4-nines |     72.918 |        N/A |     72.918
5-nines |     75.488 |        N/A |     75.488
6-nines |     75.488 |        N/A |     75.488
7-nines |     75.488 |        N/A |     75.488
8-nines |     75.488 |        N/A |     75.488
    max |     75.488 |        N/A |     75.488
os/esxi/home_lab/tests/vm_storage_iops.txt · Last modified: 2016-11-19 16:13 by root