defect.ch - Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== ESXi - Home Lab - VM Storage IOPS ======

The following tests were done in my [[os:esxi:home_lab#environment|Home Lab Environment]].

VM used:
  * OS: Windows Server 2012 R2
  * RAM: 3GB
  * CPU: 2
  * Partitions
    * C:\ (128GB, OS)
    * E:\ (10GB, local HDD)
    * F:\ (10GB, NFS on NAS)
    * G:\ (10GB, local SSD)

All partitions are thick disks (eager zeroed).

DiskSpd was used to do the tests. [[https://github.com/Microsoft/diskspd]]

Tests inspired by this article: [[http://blogs.technet.com/b/josebda/archive/2014/10/13/diskspd-powershell-and-storage-performance-measuring-iops-throughput-and-latency-for-both-local-disks-and-smb-file-shares.aspx|DiskSpd, PowerShell and storage performance: measuring IOPs, throughput and latency for both local disks and SMB file shares]]

===== DiskSpd Parameters =====

  * file size: 8GB
  * duration: 60s
  * random
  * threads: 8

//non-optimal parameters, could be optimized//

===== Summary - IOPS =====

^ Storage Type ^ Write 8K ^ Read 8K ^ Write 512K ^ Read 512K ^
| HDD          | 244.46   | 569.04  | 129.46     | 145.12    |
| NFS          | 736.07   | 3449.77 | 40.72      | 68.01     |
| SSD          | 5251.16  | 5261.11 | 516.56     | 1078.73   |

===== Test Results =====

==== Write 8K ====

=== HDD ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L E:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L E:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'E:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   0.81%|   0.26%|    0.55%|  99.20%
   1|   1.20%|   0.16%|    1.04%|  98.81%
-------------------------------------------
avg.|   1.00%|   0.21%|    0.79%|  99.00%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        14966784 |         1827 |       0.24 |      30.44 |  263.003 |    92.655 | E:\testfile.dat (8192MB)
     1 |        14802944 |         1807 |       0.24 |      30.11 |  266.036 |    92.861 | E:\testfile.dat (8192MB)
     2 |        14991360 |         1830 |       0.24 |      30.49 |  262.751 |    89.634 | E:\testfile.dat (8192MB)
     3 |        15015936 |         1833 |       0.24 |      30.54 |  262.388 |    89.976 | E:\testfile.dat (8192MB)
     4 |        15155200 |         1850 |       0.24 |      30.83 |  259.575 |    90.207 | E:\testfile.dat (8192MB)
     5 |        15065088 |         1839 |       0.24 |      30.64 |  261.914 |    89.528 | E:\testfile.dat (8192MB)
     6 |        15171584 |         1852 |       0.24 |      30.86 |  259.259 |    88.642 | E:\testfile.dat (8192MB)
     7 |        15015936 |         1833 |       0.24 |      30.54 |  262.251 |    91.226 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         120184832 |        14671 |       1.91 |     244.46 |  262.133 |    90.616

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        14966784 |         1827 |       0.24 |      30.44 |  263.003 |    92.655 | E:\testfile.dat (8192MB)
     1 |        14802944 |         1807 |       0.24 |      30.11 |  266.036 |    92.861 | E:\testfile.dat (8192MB)
     2 |        14991360 |         1830 |       0.24 |      30.49 |  262.751 |    89.634 | E:\testfile.dat (8192MB)
     3 |        15015936 |         1833 |       0.24 |      30.54 |  262.388 |    89.976 | E:\testfile.dat (8192MB)
     4 |        15155200 |         1850 |       0.24 |      30.83 |  259.575 |    90.207 | E:\testfile.dat (8192MB)
     5 |        15065088 |         1839 |       0.24 |      30.64 |  261.914 |    89.528 | E:\testfile.dat (8192MB)
     6 |        15171584 |         1852 |       0.24 |      30.86 |  259.259 |    88.642 | E:\testfile.dat (8192MB)
     7 |        15015936 |         1833 |       0.24 |      30.54 |  262.251 |    91.226 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         120184832 |        14671 |       1.91 |     244.46 |  262.133 |    90.616


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |      5.062 |      5.062
   25th |        N/A |    199.542 |    199.542
   50th |        N/A |    251.012 |    251.012
   75th |        N/A |    313.644 |    313.644
   90th |        N/A |    384.289 |    384.289
   95th |        N/A |    424.078 |    424.078
   99th |        N/A |    511.867 |    511.867
3-nines |        N/A |    693.836 |    693.836
4-nines |        N/A |    823.742 |    823.742
5-nines |        N/A |    827.650 |    827.650
6-nines |        N/A |    827.650 |    827.650
7-nines |        N/A |    827.650 |    827.650
8-nines |        N/A |    827.650 |    827.650
    max |        N/A |    827.650 |    827.650
</code>

=== NFS ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L F:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L F:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'F:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   1.02%|   0.18%|    0.83%|  98.98%
   1|   1.17%|   0.16%|    1.02%|  98.85%
-------------------------------------------
avg.|   1.09%|   0.17%|    0.92%|  98.92%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        45252608 |         5524 |       0.72 |      92.07 |   87.280 |    98.874 | F:\testfile.dat (8192MB)
     1 |        45178880 |         5515 |       0.72 |      91.92 |   87.421 |    99.095 | F:\testfile.dat (8192MB)
     2 |        45211648 |         5519 |       0.72 |      91.98 |   87.358 |    98.211 | F:\testfile.dat (8192MB)
     3 |        45252608 |         5524 |       0.72 |      92.07 |   87.278 |    99.075 | F:\testfile.dat (8192MB)
     4 |        45260800 |         5525 |       0.72 |      92.08 |   87.265 |    99.036 | F:\testfile.dat (8192MB)
     5 |        45219840 |         5520 |       0.72 |      92.00 |   87.343 |    98.244 | F:\testfile.dat (8192MB)
     6 |        45252608 |         5524 |       0.72 |      92.07 |   87.277 |    98.664 | F:\testfile.dat (8192MB)
     7 |        45170688 |         5514 |       0.72 |      91.90 |   87.439 |    97.592 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         361799680 |        44165 |       5.75 |     736.07 |   87.333 |    98.600

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        45252608 |         5524 |       0.72 |      92.07 |   87.280 |    98.874 | F:\testfile.dat (8192MB)
     1 |        45178880 |         5515 |       0.72 |      91.92 |   87.421 |    99.095 | F:\testfile.dat (8192MB)
     2 |        45211648 |         5519 |       0.72 |      91.98 |   87.358 |    98.211 | F:\testfile.dat (8192MB)
     3 |        45252608 |         5524 |       0.72 |      92.07 |   87.278 |    99.075 | F:\testfile.dat (8192MB)
     4 |        45260800 |         5525 |       0.72 |      92.08 |   87.265 |    99.036 | F:\testfile.dat (8192MB)
     5 |        45219840 |         5520 |       0.72 |      92.00 |   87.343 |    98.244 | F:\testfile.dat (8192MB)
     6 |        45252608 |         5524 |       0.72 |      92.07 |   87.277 |    98.664 | F:\testfile.dat (8192MB)
     7 |        45170688 |         5514 |       0.72 |      91.90 |   87.439 |    97.592 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         361799680 |        44165 |       5.75 |     736.07 |   87.333 |    98.600


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |      1.214 |      1.214
   25th |        N/A |      5.322 |      5.322
   50th |        N/A |     70.497 |     70.497
   75th |        N/A |    141.700 |    141.700
   90th |        N/A |    204.554 |    204.554
   95th |        N/A |    206.099 |    206.099
   99th |        N/A |    404.667 |    404.667
3-nines |        N/A |    818.114 |    818.114
4-nines |        N/A |    818.939 |    818.939
5-nines |        N/A |    819.543 |    819.543
6-nines |        N/A |    819.543 |    819.543
7-nines |        N/A |    819.543 |    819.543
8-nines |        N/A |    819.543 |    819.543
    max |        N/A |    819.543 |    819.543
</code>

=== SSD ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L G:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L G:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'G:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   4.74%|   0.55%|    4.19%|  95.26%
   1|   4.84%|   0.60%|    4.24%|  95.15%
-------------------------------------------
avg.|   4.79%|   0.57%|    4.22%|  95.21%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       322609152 |        39381 |       5.13 |     656.34 |   12.187 |     1.844 | G:\testfile.dat (8192MB)
     1 |       322363392 |        39351 |       5.12 |     655.84 |   12.197 |     1.833 | G:\testfile.dat (8192MB)
     2 |       322813952 |        39406 |       5.13 |     656.75 |   12.180 |     1.823 | G:\testfile.dat (8192MB)
     3 |       322543616 |        39373 |       5.13 |     656.20 |   12.191 |     1.845 | G:\testfile.dat (8192MB)
     4 |       322797568 |        39404 |       5.13 |     656.72 |   12.180 |     1.839 | G:\testfile.dat (8192MB)
     5 |       322617344 |        39382 |       5.13 |     656.35 |   12.187 |     1.836 | G:\testfile.dat (8192MB)
     6 |       322830336 |        39408 |       5.13 |     656.79 |   12.179 |     1.829 | G:\testfile.dat (8192MB)
     7 |       322519040 |        39370 |       5.13 |     656.15 |   12.191 |     1.840 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2581094400 |       315075 |      41.02 |    5251.16 |   12.187 |     1.836

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       322609152 |        39381 |       5.13 |     656.34 |   12.187 |     1.844 | G:\testfile.dat (8192MB)
     1 |       322363392 |        39351 |       5.12 |     655.84 |   12.197 |     1.833 | G:\testfile.dat (8192MB)
     2 |       322813952 |        39406 |       5.13 |     656.75 |   12.180 |     1.823 | G:\testfile.dat (8192MB)
     3 |       322543616 |        39373 |       5.13 |     656.20 |   12.191 |     1.845 | G:\testfile.dat (8192MB)
     4 |       322797568 |        39404 |       5.13 |     656.72 |   12.180 |     1.839 | G:\testfile.dat (8192MB)
     5 |       322617344 |        39382 |       5.13 |     656.35 |   12.187 |     1.836 | G:\testfile.dat (8192MB)
     6 |       322830336 |        39408 |       5.13 |     656.79 |   12.179 |     1.829 | G:\testfile.dat (8192MB)
     7 |       322519040 |        39370 |       5.13 |     656.15 |   12.191 |     1.840 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2581094400 |       315075 |      41.02 |    5251.16 |   12.187 |     1.836


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |      1.885 |      1.885
   25th |        N/A |     11.873 |     11.873
   50th |        N/A |     12.098 |     12.098
   75th |        N/A |     12.282 |     12.282
   90th |        N/A |     12.398 |     12.398
   95th |        N/A |     12.533 |     12.533
   99th |        N/A |     22.468 |     22.468
3-nines |        N/A |     24.253 |     24.253
4-nines |        N/A |     33.970 |     33.970
5-nines |        N/A |     35.659 |     35.659
6-nines |        N/A |     35.892 |     35.892
7-nines |        N/A |     35.892 |     35.892
8-nines |        N/A |     35.892 |     35.892
    max |        N/A |     35.892 |     35.892
</code>

==== Read 8K ====

=== HDD ===


<code>
# diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L E:\testfile.dat

C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L E:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L E:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'E:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   1.54%|   0.23%|    1.30%|  98.46%
   1|   2.27%|   0.31%|    1.95%|  97.73%
-------------------------------------------
avg.|   1.90%|   0.27%|    1.63%|  98.09%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        34684928 |         4234 |       0.55 |      70.56 |  113.435 |   128.592 | E:\testfile.dat (8192MB)
     1 |        34709504 |         4237 |       0.55 |      70.61 |  113.155 |   128.764 | E:\testfile.dat (8192MB)
     2 |        35528704 |         4337 |       0.56 |      72.28 |  110.743 |   124.341 | E:\testfile.dat (8192MB)
     3 |        34996224 |         4272 |       0.56 |      71.20 |  112.274 |   124.561 | E:\testfile.dat (8192MB)
     4 |        35168256 |         4293 |       0.56 |      71.55 |  111.759 |   131.915 | E:\testfile.dat (8192MB)
     5 |        34512896 |         4213 |       0.55 |      70.21 |  113.757 |   128.762 | E:\testfile.dat (8192MB)
     6 |        34881536 |         4258 |       0.55 |      70.96 |  112.707 |   123.748 | E:\testfile.dat (8192MB)
     7 |        35225600 |         4300 |       0.56 |      71.66 |  111.092 |   125.022 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         279707648 |        34144 |       4.45 |     569.04 |  112.356 |   126.988

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |        34684928 |         4234 |       0.55 |      70.56 |  113.435 |   128.592 | E:\testfile.dat (8192MB)
     1 |        34709504 |         4237 |       0.55 |      70.61 |  113.155 |   128.764 | E:\testfile.dat (8192MB)
     2 |        35528704 |         4337 |       0.56 |      72.28 |  110.743 |   124.341 | E:\testfile.dat (8192MB)
     3 |        34996224 |         4272 |       0.56 |      71.20 |  112.274 |   124.561 | E:\testfile.dat (8192MB)
     4 |        35168256 |         4293 |       0.56 |      71.55 |  111.759 |   131.915 | E:\testfile.dat (8192MB)
     5 |        34512896 |         4213 |       0.55 |      70.21 |  113.757 |   128.762 | E:\testfile.dat (8192MB)
     6 |        34881536 |         4258 |       0.55 |      70.96 |  112.707 |   123.748 | E:\testfile.dat (8192MB)
     7 |        35225600 |         4300 |       0.56 |      71.66 |  111.092 |   125.022 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:         279707648 |        34144 |       4.45 |     569.04 |  112.356 |   126.988

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |      2.631 |        N/A |      2.631
   25th |     36.030 |        N/A |     36.030
   50th |     74.554 |        N/A |     74.554
   75th |    139.413 |        N/A |    139.413
   90th |    243.379 |        N/A |    243.379
   95th |    336.761 |        N/A |    336.761
   99th |    642.568 |        N/A |    642.568
3-nines |   1191.057 |        N/A |   1191.057
4-nines |   1753.558 |        N/A |   1753.558
5-nines |   2034.270 |        N/A |   2034.270
6-nines |   2034.270 |        N/A |   2034.270
7-nines |   2034.270 |        N/A |   2034.270
8-nines |   2034.270 |        N/A |   2034.270
    max |   2034.270 |        N/A |   2034.270
</code>

=== NFS ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L F:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L F:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'F:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   2.40%|   0.23%|    2.16%|  97.58%
   1|   3.18%|   0.49%|    2.68%|  96.80%
-------------------------------------------
avg.|   2.79%|   0.36%|    2.42%|  97.19%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       214147072 |        26141 |       3.40 |     435.60 |   18.364 |    23.401 | F:\testfile.dat (8192MB)
     1 |       212246528 |        25909 |       3.37 |     431.73 |   18.527 |    24.628 | F:\testfile.dat (8192MB)
     2 |       210927616 |        25748 |       3.35 |     429.05 |   18.644 |    25.510 | F:\testfile.dat (8192MB)
     3 |       212099072 |        25891 |       3.37 |     431.43 |   18.542 |    23.859 | F:\testfile.dat (8192MB)
     4 |       211320832 |        25796 |       3.36 |     429.85 |   18.610 |    23.947 | F:\testfile.dat (8192MB)
     5 |       211124224 |        25772 |       3.36 |     429.45 |   18.624 |    25.017 | F:\testfile.dat (8192MB)
     6 |       211083264 |        25767 |       3.35 |     429.36 |   18.631 |    24.475 | F:\testfile.dat (8192MB)
     7 |       213024768 |        26004 |       3.39 |     433.31 |   18.457 |    23.861 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        1695973376 |       207028 |      26.95 |    3449.77 |   18.549 |    24.344

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       214147072 |        26141 |       3.40 |     435.60 |   18.364 |    23.401 | F:\testfile.dat (8192MB)
     1 |       212246528 |        25909 |       3.37 |     431.73 |   18.527 |    24.628 | F:\testfile.dat (8192MB)
     2 |       210927616 |        25748 |       3.35 |     429.05 |   18.644 |    25.510 | F:\testfile.dat (8192MB)
     3 |       212099072 |        25891 |       3.37 |     431.43 |   18.542 |    23.859 | F:\testfile.dat (8192MB)
     4 |       211320832 |        25796 |       3.36 |     429.85 |   18.610 |    23.947 | F:\testfile.dat (8192MB)
     5 |       211124224 |        25772 |       3.36 |     429.45 |   18.624 |    25.017 | F:\testfile.dat (8192MB)
     6 |       211083264 |        25767 |       3.35 |     429.36 |   18.631 |    24.475 | F:\testfile.dat (8192MB)
     7 |       213024768 |        26004 |       3.39 |     433.31 |   18.457 |    23.861 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        1695973376 |       207028 |      26.95 |    3449.77 |   18.549 |    24.344

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |      2.665 |        N/A |      2.665
   25th |      4.659 |        N/A |      4.659
   50th |     11.208 |        N/A |     11.208
   75th |     24.630 |        N/A |     24.630
   90th |     40.427 |        N/A |     40.427
   95th |     53.052 |        N/A |     53.052
   99th |     96.056 |        N/A |     96.056
3-nines |    297.746 |        N/A |    297.746
4-nines |    571.361 |        N/A |    571.361
5-nines |    828.978 |        N/A |    828.978
6-nines |   1418.762 |        N/A |   1418.762
7-nines |   1418.762 |        N/A |   1418.762
8-nines |   1418.762 |        N/A |   1418.762
    max |   1418.762 |        N/A |   1418.762
</code>

=== SSD ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L G:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L G:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'G:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 8192
                using random I/O (alignment: 8192)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   4.45%|   0.52%|    3.93%|  95.55%
   1|   4.35%|   0.73%|    3.62%|  95.68%
-------------------------------------------
avg.|   4.40%|   0.62%|    3.78%|  95.61%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       322977792 |        39426 |       5.13 |     656.94 |   12.176 |     2.002 | G:\testfile.dat (8192MB)
     1 |       323084288 |        39439 |       5.13 |     657.15 |   12.172 |     1.989 | G:\testfile.dat (8192MB)
     2 |       324059136 |        39558 |       5.15 |     659.14 |   12.136 |     1.881 | G:\testfile.dat (8192MB)
     3 |       323395584 |        39477 |       5.14 |     657.79 |   12.161 |     1.966 | G:\testfile.dat (8192MB)
     4 |       322920448 |        39419 |       5.13 |     656.82 |   12.179 |     1.998 | G:\testfile.dat (8192MB)
     5 |       322772992 |        39401 |       5.13 |     656.52 |   12.184 |     2.025 | G:\testfile.dat (8192MB)
     6 |       323190784 |        39452 |       5.14 |     657.37 |   12.169 |     1.988 | G:\testfile.dat (8192MB)
     7 |       324182016 |        39573 |       5.15 |     659.39 |   12.131 |     1.876 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2586583040 |       315745 |      41.10 |    5261.11 |   12.163 |     1.966

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       322977792 |        39426 |       5.13 |     656.94 |   12.176 |     2.002 | G:\testfile.dat (8192MB)
     1 |       323084288 |        39439 |       5.13 |     657.15 |   12.172 |     1.989 | G:\testfile.dat (8192MB)
     2 |       324059136 |        39558 |       5.15 |     659.14 |   12.136 |     1.881 | G:\testfile.dat (8192MB)
     3 |       323395584 |        39477 |       5.14 |     657.79 |   12.161 |     1.966 | G:\testfile.dat (8192MB)
     4 |       322920448 |        39419 |       5.13 |     656.82 |   12.179 |     1.998 | G:\testfile.dat (8192MB)
     5 |       322772992 |        39401 |       5.13 |     656.52 |   12.184 |     2.025 | G:\testfile.dat (8192MB)
     6 |       323190784 |        39452 |       5.14 |     657.37 |   12.169 |     1.988 | G:\testfile.dat (8192MB)
     7 |       324182016 |        39573 |       5.15 |     659.39 |   12.131 |     1.876 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2586583040 |       315745 |      41.10 |    5261.11 |   12.163 |     1.966

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |      0.824 |        N/A |      0.824
   25th |     11.810 |        N/A |     11.810
   50th |     12.063 |        N/A |     12.063
   75th |     12.216 |        N/A |     12.216
   90th |     12.363 |        N/A |     12.363
   95th |     12.550 |        N/A |     12.550
   99th |     23.506 |        N/A |     23.506
3-nines |     24.415 |        N/A |     24.415
4-nines |     35.527 |        N/A |     35.527
5-nines |     36.228 |        N/A |     36.228
6-nines |     37.992 |        N/A |     37.992
7-nines |     37.992 |        N/A |     37.992
8-nines |     37.992 |        N/A |     37.992
    max |     37.992 |        N/A |     37.992
</code>

==== Write 512K ====

=== HDD ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L E:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L E:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'E:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   1.02%|   0.26%|    0.76%|  99.01%
   1|   1.43%|   0.21%|    1.22%|  98.59%
-------------------------------------------
avg.|   1.22%|   0.23%|    0.99%|  98.80%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       506986496 |          967 |       8.06 |      16.12 |  494.441 |    54.611 | E:\testfile.dat (8192MB)
     1 |       509083648 |          971 |       8.09 |      16.18 |  493.640 |    54.625 | E:\testfile.dat (8192MB)
     2 |       508559360 |          970 |       8.08 |      16.17 |  494.926 |    55.924 | E:\testfile.dat (8192MB)
     3 |       509607936 |          972 |       8.10 |      16.20 |  492.664 |    53.485 | E:\testfile.dat (8192MB)
     4 |       510132224 |          973 |       8.11 |      16.22 |  492.701 |    54.730 | E:\testfile.dat (8192MB)
     5 |       509083648 |          971 |       8.09 |      16.18 |  493.307 |    56.621 | E:\testfile.dat (8192MB)
     6 |       509607936 |          972 |       8.10 |      16.20 |  493.745 |    55.556 | E:\testfile.dat (8192MB)
     7 |       509607936 |          972 |       8.10 |      16.20 |  493.109 |    55.962 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        4072669184 |         7768 |      64.73 |     129.46 |  493.566 |    55.202

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       506986496 |          967 |       8.06 |      16.12 |  494.441 |    54.611 | E:\testfile.dat (8192MB)
     1 |       509083648 |          971 |       8.09 |      16.18 |  493.640 |    54.625 | E:\testfile.dat (8192MB)
     2 |       508559360 |          970 |       8.08 |      16.17 |  494.926 |    55.924 | E:\testfile.dat (8192MB)
     3 |       509607936 |          972 |       8.10 |      16.20 |  492.664 |    53.485 | E:\testfile.dat (8192MB)
     4 |       510132224 |          973 |       8.11 |      16.22 |  492.701 |    54.730 | E:\testfile.dat (8192MB)
     5 |       509083648 |          971 |       8.09 |      16.18 |  493.307 |    56.621 | E:\testfile.dat (8192MB)
     6 |       509607936 |          972 |       8.10 |      16.20 |  493.745 |    55.556 | E:\testfile.dat (8192MB)
     7 |       509607936 |          972 |       8.10 |      16.20 |  493.109 |    55.962 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        4072669184 |         7768 |      64.73 |     129.46 |  493.566 |    55.202


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |    331.312 |    331.312
   25th |        N/A |    455.160 |    455.160
   50th |        N/A |    491.612 |    491.612
   75th |        N/A |    529.735 |    529.735
   90th |        N/A |    565.762 |    565.762
   95th |        N/A |    585.555 |    585.555
   99th |        N/A |    626.465 |    626.465
3-nines |        N/A |    705.344 |    705.344
4-nines |        N/A |    957.882 |    957.882
5-nines |        N/A |    957.882 |    957.882
6-nines |        N/A |    957.882 |    957.882
7-nines |        N/A |    957.882 |    957.882
8-nines |        N/A |    957.882 |    957.882
    max |        N/A |    957.882 |    957.882
</code>

=== NFS ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L F:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L F:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'F:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   0.83%|   0.18%|    0.65%|  99.17%
   1|   0.52%|   0.26%|    0.26%|  99.48%
-------------------------------------------
avg.|   0.68%|   0.22%|    0.46%|  99.32%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       156237824 |          298 |       2.48 |       4.97 | 1649.946 |  1221.495 | F:\testfile.dat (8192MB)
     1 |       162004992 |          309 |       2.57 |       5.15 | 1578.751 |   884.018 | F:\testfile.dat (8192MB)
     2 |       160432128 |          306 |       2.55 |       5.10 | 1571.906 |   963.079 | F:\testfile.dat (8192MB)
     3 |       162529280 |          310 |       2.58 |       5.17 | 1540.152 |   810.981 | F:\testfile.dat (8192MB)
     4 |       155713536 |          297 |       2.47 |       4.95 | 1642.193 |  1229.414 | F:\testfile.dat (8192MB)
     5 |       162529280 |          310 |       2.58 |       5.17 | 1548.634 |   833.139 | F:\testfile.dat (8192MB)
     6 |       159383552 |          304 |       2.53 |       5.07 | 1599.569 |  1085.135 | F:\testfile.dat (8192MB)
     7 |       162004992 |          309 |       2.57 |       5.15 | 1538.734 |   804.873 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        1280835584 |         2443 |      20.36 |      40.72 | 1583.100 |   991.177

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       156237824 |          298 |       2.48 |       4.97 | 1649.946 |  1221.495 | F:\testfile.dat (8192MB)
     1 |       162004992 |          309 |       2.57 |       5.15 | 1578.751 |   884.018 | F:\testfile.dat (8192MB)
     2 |       160432128 |          306 |       2.55 |       5.10 | 1571.906 |   963.079 | F:\testfile.dat (8192MB)
     3 |       162529280 |          310 |       2.58 |       5.17 | 1540.152 |   810.981 | F:\testfile.dat (8192MB)
     4 |       155713536 |          297 |       2.47 |       4.95 | 1642.193 |  1229.414 | F:\testfile.dat (8192MB)
     5 |       162529280 |          310 |       2.58 |       5.17 | 1548.634 |   833.139 | F:\testfile.dat (8192MB)
     6 |       159383552 |          304 |       2.53 |       5.07 | 1599.569 |  1085.135 | F:\testfile.dat (8192MB)
     7 |       162004992 |          309 |       2.57 |       5.15 | 1538.734 |   804.873 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        1280835584 |         2443 |      20.36 |      40.72 | 1583.100 |   991.177


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |    488.675 |    488.675
   25th |        N/A |    987.196 |    987.196
   50th |        N/A |   1338.976 |   1338.976
   75th |        N/A |   1917.853 |   1917.853
   90th |        N/A |   2303.580 |   2303.580
   95th |        N/A |   3159.909 |   3159.909
   99th |        N/A |   5151.770 |   5151.770
3-nines |        N/A |  10736.144 |  10736.144
4-nines |        N/A |  11156.307 |  11156.307
5-nines |        N/A |  11156.307 |  11156.307
6-nines |        N/A |  11156.307 |  11156.307
7-nines |        N/A |  11156.307 |  11156.307
8-nines |        N/A |  11156.307 |  11156.307
    max |        N/A |  11156.307 |  11156.307
</code>

=== SSD ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L G:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L G:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'G:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing write test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   1.67%|   0.10%|    1.56%|  98.34%
   1|   1.74%|   0.08%|    1.67%|  98.26%
-------------------------------------------
avg.|   1.71%|   0.09%|    1.61%|  98.30%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |      2032140288 |         3876 |      32.29 |      64.59 |  123.860 |     3.092 | G:\testfile.dat (8192MB)
     1 |      2032140288 |         3876 |      32.29 |      64.59 |  123.837 |     2.970 | G:\testfile.dat (8192MB)
     2 |      2032664576 |         3877 |      32.30 |      64.60 |  123.885 |     3.750 | G:\testfile.dat (8192MB)
     3 |      2029518848 |         3871 |      32.25 |      64.50 |  124.010 |     4.757 | G:\testfile.dat (8192MB)
     4 |      2031616000 |         3875 |      32.28 |      64.57 |  123.919 |     4.005 | G:\testfile.dat (8192MB)
     5 |      2033188864 |         3878 |      32.31 |      64.62 |  123.797 |     2.028 | G:\testfile.dat (8192MB)
     6 |      2031091712 |         3874 |      32.28 |      64.55 |  123.913 |     3.660 | G:\testfile.dat (8192MB)
     7 |      2030567424 |         3873 |      32.27 |      64.54 |  123.958 |     3.963 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:       16252928000 |        31000 |     258.28 |     516.56 |  123.897 |     3.611

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |      2032140288 |         3876 |      32.29 |      64.59 |  123.860 |     3.092 | G:\testfile.dat (8192MB)
     1 |      2032140288 |         3876 |      32.29 |      64.59 |  123.837 |     2.970 | G:\testfile.dat (8192MB)
     2 |      2032664576 |         3877 |      32.30 |      64.60 |  123.885 |     3.750 | G:\testfile.dat (8192MB)
     3 |      2029518848 |         3871 |      32.25 |      64.50 |  124.010 |     4.757 | G:\testfile.dat (8192MB)
     4 |      2031616000 |         3875 |      32.28 |      64.57 |  123.919 |     4.005 | G:\testfile.dat (8192MB)
     5 |      2033188864 |         3878 |      32.31 |      64.62 |  123.797 |     2.028 | G:\testfile.dat (8192MB)
     6 |      2031091712 |         3874 |      32.28 |      64.55 |  123.913 |     3.660 | G:\testfile.dat (8192MB)
     7 |      2030567424 |         3873 |      32.27 |      64.54 |  123.958 |     3.963 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:       16252928000 |        31000 |     258.28 |     516.56 |  123.897 |     3.611


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |        N/A |    117.965 |    117.965
   25th |        N/A |    123.850 |    123.850
   50th |        N/A |    123.899 |    123.899
   75th |        N/A |    123.941 |    123.941
   90th |        N/A |    123.978 |    123.978
   95th |        N/A |    124.012 |    124.012
   99th |        N/A |    124.891 |    124.891
3-nines |        N/A |    199.822 |    199.822
4-nines |        N/A |    231.365 |    231.365
5-nines |        N/A |    238.747 |    238.747
6-nines |        N/A |    238.747 |    238.747
7-nines |        N/A |    238.747 |    238.747
8-nines |        N/A |    238.747 |    238.747
    max |        N/A |    238.747 |    238.747
</code>


==== Read 512K ====

=== HDD ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L E:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L E:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'E:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   0.83%|   0.29%|    0.55%|  99.16%
   1|   1.07%|   0.23%|    0.83%|  98.93%
-------------------------------------------
avg.|   0.95%|   0.26%|    0.69%|  99.04%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       587202560 |         1120 |       9.33 |      18.67 |  427.771 |   347.990 | E:\testfile.dat (8192MB)
     1 |       586153984 |         1118 |       9.32 |      18.63 |  429.810 |   349.144 | E:\testfile.dat (8192MB)
     2 |       589299712 |         1124 |       9.37 |      18.73 |  424.982 |   340.093 | E:\testfile.dat (8192MB)
     3 |       555745280 |         1060 |       8.83 |      17.67 |  455.375 |   411.710 | E:\testfile.dat (8192MB)
     4 |       575668224 |         1098 |       9.15 |      18.30 |  433.092 |   352.360 | E:\testfile.dat (8192MB)
     5 |       557318144 |         1063 |       8.86 |      17.72 |  449.838 |   399.745 | E:\testfile.dat (8192MB)
     6 |       576716800 |         1100 |       9.17 |      18.33 |  435.077 |   362.675 | E:\testfile.dat (8192MB)
     7 |       537395200 |         1025 |       8.54 |      17.08 |  465.737 |   427.123 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        4565499904 |         8708 |      72.56 |     145.12 |  439.789 |   374.471

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       587202560 |         1120 |       9.33 |      18.67 |  427.771 |   347.990 | E:\testfile.dat (8192MB)
     1 |       586153984 |         1118 |       9.32 |      18.63 |  429.810 |   349.144 | E:\testfile.dat (8192MB)
     2 |       589299712 |         1124 |       9.37 |      18.73 |  424.982 |   340.093 | E:\testfile.dat (8192MB)
     3 |       555745280 |         1060 |       8.83 |      17.67 |  455.375 |   411.710 | E:\testfile.dat (8192MB)
     4 |       575668224 |         1098 |       9.15 |      18.30 |  433.092 |   352.360 | E:\testfile.dat (8192MB)
     5 |       557318144 |         1063 |       8.86 |      17.72 |  449.838 |   399.745 | E:\testfile.dat (8192MB)
     6 |       576716800 |         1100 |       9.17 |      18.33 |  435.077 |   362.675 | E:\testfile.dat (8192MB)
     7 |       537395200 |         1025 |       8.54 |      17.08 |  465.737 |   427.123 | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        4565499904 |         8708 |      72.56 |     145.12 |  439.789 |   374.471

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | E:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |    134.665 |        N/A |    134.665
   25th |    308.128 |        N/A |    308.128
   50th |    367.192 |        N/A |    367.192
   75th |    431.843 |        N/A |    431.843
   90th |    495.140 |        N/A |    495.140
   95th |    562.580 |        N/A |    562.580
   99th |   2358.475 |        N/A |   2358.475
3-nines |   2484.729 |        N/A |   2484.729
4-nines |   2564.951 |        N/A |   2564.951
5-nines |   2564.951 |        N/A |   2564.951
6-nines |   2564.951 |        N/A |   2564.951
7-nines |   2564.951 |        N/A |   2564.951
8-nines |   2564.951 |        N/A |   2564.951
    max |   2564.951 |        N/A |   2564.951
</code>

=== NFS ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L F:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L F:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'F:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.01s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   0.29%|   0.00%|    0.29%|  99.70%
   1|   0.47%|   0.05%|    0.42%|  99.51%
-------------------------------------------
avg.|   0.38%|   0.03%|    0.35%|  99.61%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       268959744 |          513 |       4.27 |       8.55 |  939.445 |   294.138 | F:\testfile.dat (8192MB)
     1 |       268435456 |          512 |       4.27 |       8.53 |  934.389 |   224.634 | F:\testfile.dat (8192MB)
     2 |       265289728 |          506 |       4.22 |       8.43 |  980.260 |   484.648 | F:\testfile.dat (8192MB)
     3 |       268959744 |          513 |       4.27 |       8.55 |  957.880 |   385.836 | F:\testfile.dat (8192MB)
     4 |       263192576 |          502 |       4.18 |       8.37 |  989.031 |   557.801 | F:\testfile.dat (8192MB)
     5 |       267911168 |          511 |       4.26 |       8.52 |  934.999 |   222.781 | F:\testfile.dat (8192MB)
     6 |       267386880 |          510 |       4.25 |       8.50 |  946.895 |   365.036 | F:\testfile.dat (8192MB)
     7 |       269484032 |          514 |       4.28 |       8.57 |  929.988 |   220.322 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2139619328 |         4081 |      34.00 |      68.01 |  951.471 |   364.318

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |       268959744 |          513 |       4.27 |       8.55 |  939.445 |   294.138 | F:\testfile.dat (8192MB)
     1 |       268435456 |          512 |       4.27 |       8.53 |  934.389 |   224.634 | F:\testfile.dat (8192MB)
     2 |       265289728 |          506 |       4.22 |       8.43 |  980.260 |   484.648 | F:\testfile.dat (8192MB)
     3 |       268959744 |          513 |       4.27 |       8.55 |  957.880 |   385.836 | F:\testfile.dat (8192MB)
     4 |       263192576 |          502 |       4.18 |       8.37 |  989.031 |   557.801 | F:\testfile.dat (8192MB)
     5 |       267911168 |          511 |       4.26 |       8.52 |  934.999 |   222.781 | F:\testfile.dat (8192MB)
     6 |       267386880 |          510 |       4.25 |       8.50 |  946.895 |   365.036 | F:\testfile.dat (8192MB)
     7 |       269484032 |          514 |       4.28 |       8.57 |  929.988 |   220.322 | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:        2139619328 |         4081 |      34.00 |      68.01 |  951.471 |   364.318

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | F:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |    343.730 |        N/A |    343.730
   25th |    775.531 |        N/A |    775.531
   50th |    922.393 |        N/A |    922.393
   75th |   1088.764 |        N/A |   1088.764
   90th |   1241.313 |        N/A |   1241.313
   95th |   1336.883 |        N/A |   1336.883
   99th |   1475.941 |        N/A |   1475.941
3-nines |   6404.973 |        N/A |   6404.973
4-nines |   7456.621 |        N/A |   7456.621
5-nines |   7456.621 |        N/A |   7456.621
6-nines |   7456.621 |        N/A |   7456.621
7-nines |   7456.621 |        N/A |   7456.621
8-nines |   7456.621 |        N/A |   7456.621
    max |   7456.621 |        N/A |   7456.621
</code>

=== SSD ===

<code>
C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L G:\testfile.dat

Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L G:\testfile.dat

Input parameters:

        timespan:   1
        -------------
        duration: 60s
        warm up time: 5s
        cool down time: 0s
        measuring latency
        random seed: 0
        path: 'G:\testfile.dat'
                think time: 0ms
                burst size: 0
                software and hardware write cache disabled
                performing read test
                block size: 524288
                using random I/O (alignment: 524288)
                number of outstanding I/O operations: 8
                thread stride size: 0
                threads per file: 8
                using I/O Completion Ports
                IO priority: normal



Results for timespan 1:
*******************************************************************************

actual test time:       60.00s
thread count:           8
proc count:             2

CPU |  Usage |  User  |  Kernel |  Idle
-------------------------------------------
   0|   3.23%|   0.13%|    3.10%|  96.77%
   1|   4.27%|   0.26%|    4.01%|  95.73%
-------------------------------------------
avg.|   3.75%|   0.20%|    3.55%|  96.25%

Total IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |      4242538496 |         8092 |      67.43 |     134.86 |   59.329 |     0.560 | G:\testfile.dat (8192MB)
     1 |      4242014208 |         8091 |      67.42 |     134.85 |   59.329 |     0.540 | G:\testfile.dat (8192MB)
     2 |      4240441344 |         8088 |      67.40 |     134.80 |   59.329 |     0.586 | G:\testfile.dat (8192MB)
     3 |      4240965632 |         8089 |      67.41 |     134.81 |   59.328 |     0.552 | G:\testfile.dat (8192MB)
     4 |      4241489920 |         8090 |      67.42 |     134.83 |   59.325 |     0.547 | G:\testfile.dat (8192MB)
     5 |      4242014208 |         8091 |      67.42 |     134.85 |   59.326 |     0.546 | G:\testfile.dat (8192MB)
     6 |      4242014208 |         8091 |      67.42 |     134.85 |   59.327 |     0.539 | G:\testfile.dat (8192MB)
     7 |      4243062784 |         8093 |      67.44 |     134.88 |   59.326 |     0.543 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:       33934540800 |        64725 |     539.37 |    1078.73 |   59.327 |     0.552

Read IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |      4242538496 |         8092 |      67.43 |     134.86 |   59.329 |     0.560 | G:\testfile.dat (8192MB)
     1 |      4242014208 |         8091 |      67.42 |     134.85 |   59.329 |     0.540 | G:\testfile.dat (8192MB)
     2 |      4240441344 |         8088 |      67.40 |     134.80 |   59.329 |     0.586 | G:\testfile.dat (8192MB)
     3 |      4240965632 |         8089 |      67.41 |     134.81 |   59.328 |     0.552 | G:\testfile.dat (8192MB)
     4 |      4241489920 |         8090 |      67.42 |     134.83 |   59.325 |     0.547 | G:\testfile.dat (8192MB)
     5 |      4242014208 |         8091 |      67.42 |     134.85 |   59.326 |     0.546 | G:\testfile.dat (8192MB)
     6 |      4242014208 |         8091 |      67.42 |     134.85 |   59.327 |     0.539 | G:\testfile.dat (8192MB)
     7 |      4243062784 |         8093 |      67.44 |     134.88 |   59.326 |     0.543 | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:       33934540800 |        64725 |     539.37 |    1078.73 |   59.327 |     0.552

Write IO
thread |       bytes     |     I/Os     |     MB/s   |  I/O per s |  AvgLat  | LatStdDev |  file
-----------------------------------------------------------------------------------------------------
     0 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     1 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     2 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     3 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     4 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     5 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     6 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
     7 |               0 |            0 |       0.00 |       0.00 |    0.000 |       N/A | G:\testfile.dat (8192MB)
-----------------------------------------------------------------------------------------------------
total:                 0 |            0 |       0.00 |       0.00 |    0.000 |       N/A


  %-ile |  Read (ms) | Write (ms) | Total (ms)
----------------------------------------------
    min |     53.509 |        N/A |     53.509
   25th |     59.263 |        N/A |     59.263
   50th |     59.300 |        N/A |     59.300
   75th |     59.339 |        N/A |     59.339
   90th |     59.398 |        N/A |     59.398
   95th |     59.458 |        N/A |     59.458
   99th |     59.632 |        N/A |     59.632
3-nines |     72.851 |        N/A |     72.851
4-nines |     72.918 |        N/A |     72.918
5-nines |     75.488 |        N/A |     75.488
6-nines |     75.488 |        N/A |     75.488
7-nines |     75.488 |        N/A |     75.488
8-nines |     75.488 |        N/A |     75.488
    max |     75.488 |        N/A |     75.488
</code>