====== ESXi - Home Lab - VM Storage IOPS ====== The following tests were done in my [[os:esxi:home_lab#environment|Home Lab Environment]]. VM used: * OS: Windows Server 2012 R2 * RAM: 3GB * CPU: 2 * Partitions * C:\ (128GB, OS) * E:\ (10GB, local HDD) * F:\ (10GB, NFS on NAS) * G:\ (10GB, local SSD) All partitions are thick disks (eager zeroed). DiskSpd was used to do the tests. [[https://github.com/Microsoft/diskspd]] Tests inspired by this article: [[http://blogs.technet.com/b/josebda/archive/2014/10/13/diskspd-powershell-and-storage-performance-measuring-iops-throughput-and-latency-for-both-local-disks-and-smb-file-shares.aspx|DiskSpd, PowerShell and storage performance: measuring IOPs, throughput and latency for both local disks and SMB file shares]] ===== DiskSpd Parameters ===== * file size: 8GB * duration: 60s * random * threads: 8 //non-optimal parameters, could be optimized// ===== Summary - IOPS ===== ^ Storage Type ^ Write 8K ^ Read 8K ^ Write 512K ^ Read 512K ^ | HDD | 244.46 | 569.04 | 129.46 | 145.12 | | NFS | 736.07 | 3449.77 | 40.72 | 68.01 | | SSD | 5251.16 | 5261.11 | 516.56 | 1078.73 | ===== Test Results ===== ==== Write 8K ==== === HDD === C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L E:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L E:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'E:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing write test block size: 8192 using random I/O (alignment: 8192) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.01s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 0.81%| 0.26%| 0.55%| 99.20% 1| 1.20%| 0.16%| 1.04%| 98.81% ------------------------------------------- avg.| 1.00%| 0.21%| 0.79%| 99.00% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 14966784 | 1827 | 0.24 | 30.44 | 263.003 | 92.655 | E:\testfile.dat (8192MB) 1 | 14802944 | 1807 | 0.24 | 30.11 | 266.036 | 92.861 | E:\testfile.dat (8192MB) 2 | 14991360 | 1830 | 0.24 | 30.49 | 262.751 | 89.634 | E:\testfile.dat (8192MB) 3 | 15015936 | 1833 | 0.24 | 30.54 | 262.388 | 89.976 | E:\testfile.dat (8192MB) 4 | 15155200 | 1850 | 0.24 | 30.83 | 259.575 | 90.207 | E:\testfile.dat (8192MB) 5 | 15065088 | 1839 | 0.24 | 30.64 | 261.914 | 89.528 | E:\testfile.dat (8192MB) 6 | 15171584 | 1852 | 0.24 | 30.86 | 259.259 | 88.642 | E:\testfile.dat (8192MB) 7 | 15015936 | 1833 | 0.24 | 30.54 | 262.251 | 91.226 | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 120184832 | 14671 | 1.91 | 244.46 | 262.133 | 90.616 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 14966784 | 1827 | 0.24 | 30.44 | 263.003 | 92.655 | E:\testfile.dat (8192MB) 1 | 14802944 | 1807 | 0.24 | 30.11 | 266.036 | 92.861 | E:\testfile.dat (8192MB) 2 | 14991360 | 1830 | 0.24 | 30.49 | 262.751 | 89.634 | E:\testfile.dat (8192MB) 3 | 15015936 | 1833 | 0.24 | 30.54 | 262.388 | 89.976 | E:\testfile.dat (8192MB) 4 | 15155200 | 1850 | 0.24 | 30.83 | 259.575 | 90.207 | E:\testfile.dat (8192MB) 5 | 15065088 | 1839 | 0.24 | 30.64 | 261.914 | 89.528 | E:\testfile.dat (8192MB) 6 | 15171584 | 1852 | 0.24 | 30.86 | 259.259 | 88.642 | E:\testfile.dat (8192MB) 7 | 15015936 | 1833 | 0.24 | 30.54 | 262.251 | 91.226 | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 120184832 | 14671 | 1.91 | 244.46 | 262.133 | 90.616 %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | N/A | 5.062 | 5.062 25th | N/A | 199.542 | 199.542 50th | N/A | 251.012 | 251.012 75th | N/A | 313.644 | 313.644 90th | N/A | 384.289 | 384.289 95th | N/A | 424.078 | 424.078 99th | N/A | 511.867 | 511.867 3-nines | N/A | 693.836 | 693.836 4-nines | N/A | 823.742 | 823.742 5-nines | N/A | 827.650 | 827.650 6-nines | N/A | 827.650 | 827.650 7-nines | N/A | 827.650 | 827.650 8-nines | N/A | 827.650 | 827.650 max | N/A | 827.650 | 827.650 === NFS === C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L F:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L F:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'F:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing write test block size: 8192 using random I/O (alignment: 8192) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.00s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 1.02%| 0.18%| 0.83%| 98.98% 1| 1.17%| 0.16%| 1.02%| 98.85% ------------------------------------------- avg.| 1.09%| 0.17%| 0.92%| 98.92% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 45252608 | 5524 | 0.72 | 92.07 | 87.280 | 98.874 | F:\testfile.dat (8192MB) 1 | 45178880 | 5515 | 0.72 | 91.92 | 87.421 | 99.095 | F:\testfile.dat (8192MB) 2 | 45211648 | 5519 | 0.72 | 91.98 | 87.358 | 98.211 | F:\testfile.dat (8192MB) 3 | 45252608 | 5524 | 0.72 | 92.07 | 87.278 | 99.075 | F:\testfile.dat (8192MB) 4 | 45260800 | 5525 | 0.72 | 92.08 | 87.265 | 99.036 | F:\testfile.dat (8192MB) 5 | 45219840 | 5520 | 0.72 | 92.00 | 87.343 | 98.244 | F:\testfile.dat (8192MB) 6 | 45252608 | 5524 | 0.72 | 92.07 | 87.277 | 98.664 | F:\testfile.dat (8192MB) 7 | 45170688 | 5514 | 0.72 | 91.90 | 87.439 | 97.592 | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 361799680 | 44165 | 5.75 | 736.07 | 87.333 | 98.600 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 45252608 | 5524 | 0.72 | 92.07 | 87.280 | 98.874 | F:\testfile.dat (8192MB) 1 | 45178880 | 5515 | 0.72 | 91.92 | 87.421 | 99.095 | F:\testfile.dat (8192MB) 2 | 45211648 | 5519 | 0.72 | 91.98 | 87.358 | 98.211 | F:\testfile.dat (8192MB) 3 | 45252608 | 5524 | 0.72 | 92.07 | 87.278 | 99.075 | F:\testfile.dat (8192MB) 4 | 45260800 | 5525 | 0.72 | 92.08 | 87.265 | 99.036 | F:\testfile.dat (8192MB) 5 | 45219840 | 5520 | 0.72 | 92.00 | 87.343 | 98.244 | F:\testfile.dat (8192MB) 6 | 45252608 | 5524 | 0.72 | 92.07 | 87.277 | 98.664 | F:\testfile.dat (8192MB) 7 | 45170688 | 5514 | 0.72 | 91.90 | 87.439 | 97.592 | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 361799680 | 44165 | 5.75 | 736.07 | 87.333 | 98.600 %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | N/A | 1.214 | 1.214 25th | N/A | 5.322 | 5.322 50th | N/A | 70.497 | 70.497 75th | N/A | 141.700 | 141.700 90th | N/A | 204.554 | 204.554 95th | N/A | 206.099 | 206.099 99th | N/A | 404.667 | 404.667 3-nines | N/A | 818.114 | 818.114 4-nines | N/A | 818.939 | 818.939 5-nines | N/A | 819.543 | 819.543 6-nines | N/A | 819.543 | 819.543 7-nines | N/A | 819.543 | 819.543 8-nines | N/A | 819.543 | 819.543 max | N/A | 819.543 | 819.543 === SSD === C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L G:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b8K -h -L G:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'G:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing write test block size: 8192 using random I/O (alignment: 8192) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.00s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 4.74%| 0.55%| 4.19%| 95.26% 1| 4.84%| 0.60%| 4.24%| 95.15% ------------------------------------------- avg.| 4.79%| 0.57%| 4.22%| 95.21% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 322609152 | 39381 | 5.13 | 656.34 | 12.187 | 1.844 | G:\testfile.dat (8192MB) 1 | 322363392 | 39351 | 5.12 | 655.84 | 12.197 | 1.833 | G:\testfile.dat (8192MB) 2 | 322813952 | 39406 | 5.13 | 656.75 | 12.180 | 1.823 | G:\testfile.dat (8192MB) 3 | 322543616 | 39373 | 5.13 | 656.20 | 12.191 | 1.845 | G:\testfile.dat (8192MB) 4 | 322797568 | 39404 | 5.13 | 656.72 | 12.180 | 1.839 | G:\testfile.dat (8192MB) 5 | 322617344 | 39382 | 5.13 | 656.35 | 12.187 | 1.836 | G:\testfile.dat (8192MB) 6 | 322830336 | 39408 | 5.13 | 656.79 | 12.179 | 1.829 | G:\testfile.dat (8192MB) 7 | 322519040 | 39370 | 5.13 | 656.15 | 12.191 | 1.840 | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 2581094400 | 315075 | 41.02 | 5251.16 | 12.187 | 1.836 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 322609152 | 39381 | 5.13 | 656.34 | 12.187 | 1.844 | G:\testfile.dat (8192MB) 1 | 322363392 | 39351 | 5.12 | 655.84 | 12.197 | 1.833 | G:\testfile.dat (8192MB) 2 | 322813952 | 39406 | 5.13 | 656.75 | 12.180 | 1.823 | G:\testfile.dat (8192MB) 3 | 322543616 | 39373 | 5.13 | 656.20 | 12.191 | 1.845 | G:\testfile.dat (8192MB) 4 | 322797568 | 39404 | 5.13 | 656.72 | 12.180 | 1.839 | G:\testfile.dat (8192MB) 5 | 322617344 | 39382 | 5.13 | 656.35 | 12.187 | 1.836 | G:\testfile.dat (8192MB) 6 | 322830336 | 39408 | 5.13 | 656.79 | 12.179 | 1.829 | G:\testfile.dat (8192MB) 7 | 322519040 | 39370 | 5.13 | 656.15 | 12.191 | 1.840 | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 2581094400 | 315075 | 41.02 | 5251.16 | 12.187 | 1.836 %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | N/A | 1.885 | 1.885 25th | N/A | 11.873 | 11.873 50th | N/A | 12.098 | 12.098 75th | N/A | 12.282 | 12.282 90th | N/A | 12.398 | 12.398 95th | N/A | 12.533 | 12.533 99th | N/A | 22.468 | 22.468 3-nines | N/A | 24.253 | 24.253 4-nines | N/A | 33.970 | 33.970 5-nines | N/A | 35.659 | 35.659 6-nines | N/A | 35.892 | 35.892 7-nines | N/A | 35.892 | 35.892 8-nines | N/A | 35.892 | 35.892 max | N/A | 35.892 | 35.892 ==== Read 8K ==== === HDD === # diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L E:\testfile.dat C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L E:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L E:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'E:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing read test block size: 8192 using random I/O (alignment: 8192) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.00s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 1.54%| 0.23%| 1.30%| 98.46% 1| 2.27%| 0.31%| 1.95%| 97.73% ------------------------------------------- avg.| 1.90%| 0.27%| 1.63%| 98.09% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 34684928 | 4234 | 0.55 | 70.56 | 113.435 | 128.592 | E:\testfile.dat (8192MB) 1 | 34709504 | 4237 | 0.55 | 70.61 | 113.155 | 128.764 | E:\testfile.dat (8192MB) 2 | 35528704 | 4337 | 0.56 | 72.28 | 110.743 | 124.341 | E:\testfile.dat (8192MB) 3 | 34996224 | 4272 | 0.56 | 71.20 | 112.274 | 124.561 | E:\testfile.dat (8192MB) 4 | 35168256 | 4293 | 0.56 | 71.55 | 111.759 | 131.915 | E:\testfile.dat (8192MB) 5 | 34512896 | 4213 | 0.55 | 70.21 | 113.757 | 128.762 | E:\testfile.dat (8192MB) 6 | 34881536 | 4258 | 0.55 | 70.96 | 112.707 | 123.748 | E:\testfile.dat (8192MB) 7 | 35225600 | 4300 | 0.56 | 71.66 | 111.092 | 125.022 | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 279707648 | 34144 | 4.45 | 569.04 | 112.356 | 126.988 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 34684928 | 4234 | 0.55 | 70.56 | 113.435 | 128.592 | E:\testfile.dat (8192MB) 1 | 34709504 | 4237 | 0.55 | 70.61 | 113.155 | 128.764 | E:\testfile.dat (8192MB) 2 | 35528704 | 4337 | 0.56 | 72.28 | 110.743 | 124.341 | E:\testfile.dat (8192MB) 3 | 34996224 | 4272 | 0.56 | 71.20 | 112.274 | 124.561 | E:\testfile.dat (8192MB) 4 | 35168256 | 4293 | 0.56 | 71.55 | 111.759 | 131.915 | E:\testfile.dat (8192MB) 5 | 34512896 | 4213 | 0.55 | 70.21 | 113.757 | 128.762 | E:\testfile.dat (8192MB) 6 | 34881536 | 4258 | 0.55 | 70.96 | 112.707 | 123.748 | E:\testfile.dat (8192MB) 7 | 35225600 | 4300 | 0.56 | 71.66 | 111.092 | 125.022 | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 279707648 | 34144 | 4.45 | 569.04 | 112.356 | 126.988 Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 2.631 | N/A | 2.631 25th | 36.030 | N/A | 36.030 50th | 74.554 | N/A | 74.554 75th | 139.413 | N/A | 139.413 90th | 243.379 | N/A | 243.379 95th | 336.761 | N/A | 336.761 99th | 642.568 | N/A | 642.568 3-nines | 1191.057 | N/A | 1191.057 4-nines | 1753.558 | N/A | 1753.558 5-nines | 2034.270 | N/A | 2034.270 6-nines | 2034.270 | N/A | 2034.270 7-nines | 2034.270 | N/A | 2034.270 8-nines | 2034.270 | N/A | 2034.270 max | 2034.270 | N/A | 2034.270 === NFS === C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L F:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L F:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'F:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing read test block size: 8192 using random I/O (alignment: 8192) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.01s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 2.40%| 0.23%| 2.16%| 97.58% 1| 3.18%| 0.49%| 2.68%| 96.80% ------------------------------------------- avg.| 2.79%| 0.36%| 2.42%| 97.19% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 214147072 | 26141 | 3.40 | 435.60 | 18.364 | 23.401 | F:\testfile.dat (8192MB) 1 | 212246528 | 25909 | 3.37 | 431.73 | 18.527 | 24.628 | F:\testfile.dat (8192MB) 2 | 210927616 | 25748 | 3.35 | 429.05 | 18.644 | 25.510 | F:\testfile.dat (8192MB) 3 | 212099072 | 25891 | 3.37 | 431.43 | 18.542 | 23.859 | F:\testfile.dat (8192MB) 4 | 211320832 | 25796 | 3.36 | 429.85 | 18.610 | 23.947 | F:\testfile.dat (8192MB) 5 | 211124224 | 25772 | 3.36 | 429.45 | 18.624 | 25.017 | F:\testfile.dat (8192MB) 6 | 211083264 | 25767 | 3.35 | 429.36 | 18.631 | 24.475 | F:\testfile.dat (8192MB) 7 | 213024768 | 26004 | 3.39 | 433.31 | 18.457 | 23.861 | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 1695973376 | 207028 | 26.95 | 3449.77 | 18.549 | 24.344 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 214147072 | 26141 | 3.40 | 435.60 | 18.364 | 23.401 | F:\testfile.dat (8192MB) 1 | 212246528 | 25909 | 3.37 | 431.73 | 18.527 | 24.628 | F:\testfile.dat (8192MB) 2 | 210927616 | 25748 | 3.35 | 429.05 | 18.644 | 25.510 | F:\testfile.dat (8192MB) 3 | 212099072 | 25891 | 3.37 | 431.43 | 18.542 | 23.859 | F:\testfile.dat (8192MB) 4 | 211320832 | 25796 | 3.36 | 429.85 | 18.610 | 23.947 | F:\testfile.dat (8192MB) 5 | 211124224 | 25772 | 3.36 | 429.45 | 18.624 | 25.017 | F:\testfile.dat (8192MB) 6 | 211083264 | 25767 | 3.35 | 429.36 | 18.631 | 24.475 | F:\testfile.dat (8192MB) 7 | 213024768 | 26004 | 3.39 | 433.31 | 18.457 | 23.861 | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 1695973376 | 207028 | 26.95 | 3449.77 | 18.549 | 24.344 Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 2.665 | N/A | 2.665 25th | 4.659 | N/A | 4.659 50th | 11.208 | N/A | 11.208 75th | 24.630 | N/A | 24.630 90th | 40.427 | N/A | 40.427 95th | 53.052 | N/A | 53.052 99th | 96.056 | N/A | 96.056 3-nines | 297.746 | N/A | 297.746 4-nines | 571.361 | N/A | 571.361 5-nines | 828.978 | N/A | 828.978 6-nines | 1418.762 | N/A | 1418.762 7-nines | 1418.762 | N/A | 1418.762 8-nines | 1418.762 | N/A | 1418.762 max | 1418.762 | N/A | 1418.762 === SSD === C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L G:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b8K -h -L G:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'G:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing read test block size: 8192 using random I/O (alignment: 8192) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.01s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 4.45%| 0.52%| 3.93%| 95.55% 1| 4.35%| 0.73%| 3.62%| 95.68% ------------------------------------------- avg.| 4.40%| 0.62%| 3.78%| 95.61% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 322977792 | 39426 | 5.13 | 656.94 | 12.176 | 2.002 | G:\testfile.dat (8192MB) 1 | 323084288 | 39439 | 5.13 | 657.15 | 12.172 | 1.989 | G:\testfile.dat (8192MB) 2 | 324059136 | 39558 | 5.15 | 659.14 | 12.136 | 1.881 | G:\testfile.dat (8192MB) 3 | 323395584 | 39477 | 5.14 | 657.79 | 12.161 | 1.966 | G:\testfile.dat (8192MB) 4 | 322920448 | 39419 | 5.13 | 656.82 | 12.179 | 1.998 | G:\testfile.dat (8192MB) 5 | 322772992 | 39401 | 5.13 | 656.52 | 12.184 | 2.025 | G:\testfile.dat (8192MB) 6 | 323190784 | 39452 | 5.14 | 657.37 | 12.169 | 1.988 | G:\testfile.dat (8192MB) 7 | 324182016 | 39573 | 5.15 | 659.39 | 12.131 | 1.876 | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 2586583040 | 315745 | 41.10 | 5261.11 | 12.163 | 1.966 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 322977792 | 39426 | 5.13 | 656.94 | 12.176 | 2.002 | G:\testfile.dat (8192MB) 1 | 323084288 | 39439 | 5.13 | 657.15 | 12.172 | 1.989 | G:\testfile.dat (8192MB) 2 | 324059136 | 39558 | 5.15 | 659.14 | 12.136 | 1.881 | G:\testfile.dat (8192MB) 3 | 323395584 | 39477 | 5.14 | 657.79 | 12.161 | 1.966 | G:\testfile.dat (8192MB) 4 | 322920448 | 39419 | 5.13 | 656.82 | 12.179 | 1.998 | G:\testfile.dat (8192MB) 5 | 322772992 | 39401 | 5.13 | 656.52 | 12.184 | 2.025 | G:\testfile.dat (8192MB) 6 | 323190784 | 39452 | 5.14 | 657.37 | 12.169 | 1.988 | G:\testfile.dat (8192MB) 7 | 324182016 | 39573 | 5.15 | 659.39 | 12.131 | 1.876 | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 2586583040 | 315745 | 41.10 | 5261.11 | 12.163 | 1.966 Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 0.824 | N/A | 0.824 25th | 11.810 | N/A | 11.810 50th | 12.063 | N/A | 12.063 75th | 12.216 | N/A | 12.216 90th | 12.363 | N/A | 12.363 95th | 12.550 | N/A | 12.550 99th | 23.506 | N/A | 23.506 3-nines | 24.415 | N/A | 24.415 4-nines | 35.527 | N/A | 35.527 5-nines | 36.228 | N/A | 36.228 6-nines | 37.992 | N/A | 37.992 7-nines | 37.992 | N/A | 37.992 8-nines | 37.992 | N/A | 37.992 max | 37.992 | N/A | 37.992 ==== Write 512K ==== === HDD === C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L E:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L E:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'E:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing write test block size: 524288 using random I/O (alignment: 524288) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.00s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 1.02%| 0.26%| 0.76%| 99.01% 1| 1.43%| 0.21%| 1.22%| 98.59% ------------------------------------------- avg.| 1.22%| 0.23%| 0.99%| 98.80% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 506986496 | 967 | 8.06 | 16.12 | 494.441 | 54.611 | E:\testfile.dat (8192MB) 1 | 509083648 | 971 | 8.09 | 16.18 | 493.640 | 54.625 | E:\testfile.dat (8192MB) 2 | 508559360 | 970 | 8.08 | 16.17 | 494.926 | 55.924 | E:\testfile.dat (8192MB) 3 | 509607936 | 972 | 8.10 | 16.20 | 492.664 | 53.485 | E:\testfile.dat (8192MB) 4 | 510132224 | 973 | 8.11 | 16.22 | 492.701 | 54.730 | E:\testfile.dat (8192MB) 5 | 509083648 | 971 | 8.09 | 16.18 | 493.307 | 56.621 | E:\testfile.dat (8192MB) 6 | 509607936 | 972 | 8.10 | 16.20 | 493.745 | 55.556 | E:\testfile.dat (8192MB) 7 | 509607936 | 972 | 8.10 | 16.20 | 493.109 | 55.962 | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 4072669184 | 7768 | 64.73 | 129.46 | 493.566 | 55.202 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 506986496 | 967 | 8.06 | 16.12 | 494.441 | 54.611 | E:\testfile.dat (8192MB) 1 | 509083648 | 971 | 8.09 | 16.18 | 493.640 | 54.625 | E:\testfile.dat (8192MB) 2 | 508559360 | 970 | 8.08 | 16.17 | 494.926 | 55.924 | E:\testfile.dat (8192MB) 3 | 509607936 | 972 | 8.10 | 16.20 | 492.664 | 53.485 | E:\testfile.dat (8192MB) 4 | 510132224 | 973 | 8.11 | 16.22 | 492.701 | 54.730 | E:\testfile.dat (8192MB) 5 | 509083648 | 971 | 8.09 | 16.18 | 493.307 | 56.621 | E:\testfile.dat (8192MB) 6 | 509607936 | 972 | 8.10 | 16.20 | 493.745 | 55.556 | E:\testfile.dat (8192MB) 7 | 509607936 | 972 | 8.10 | 16.20 | 493.109 | 55.962 | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 4072669184 | 7768 | 64.73 | 129.46 | 493.566 | 55.202 %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | N/A | 331.312 | 331.312 25th | N/A | 455.160 | 455.160 50th | N/A | 491.612 | 491.612 75th | N/A | 529.735 | 529.735 90th | N/A | 565.762 | 565.762 95th | N/A | 585.555 | 585.555 99th | N/A | 626.465 | 626.465 3-nines | N/A | 705.344 | 705.344 4-nines | N/A | 957.882 | 957.882 5-nines | N/A | 957.882 | 957.882 6-nines | N/A | 957.882 | 957.882 7-nines | N/A | 957.882 | 957.882 8-nines | N/A | 957.882 | 957.882 max | N/A | 957.882 | 957.882 === NFS === C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L F:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L F:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'F:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing write test block size: 524288 using random I/O (alignment: 524288) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.00s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 0.83%| 0.18%| 0.65%| 99.17% 1| 0.52%| 0.26%| 0.26%| 99.48% ------------------------------------------- avg.| 0.68%| 0.22%| 0.46%| 99.32% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 156237824 | 298 | 2.48 | 4.97 | 1649.946 | 1221.495 | F:\testfile.dat (8192MB) 1 | 162004992 | 309 | 2.57 | 5.15 | 1578.751 | 884.018 | F:\testfile.dat (8192MB) 2 | 160432128 | 306 | 2.55 | 5.10 | 1571.906 | 963.079 | F:\testfile.dat (8192MB) 3 | 162529280 | 310 | 2.58 | 5.17 | 1540.152 | 810.981 | F:\testfile.dat (8192MB) 4 | 155713536 | 297 | 2.47 | 4.95 | 1642.193 | 1229.414 | F:\testfile.dat (8192MB) 5 | 162529280 | 310 | 2.58 | 5.17 | 1548.634 | 833.139 | F:\testfile.dat (8192MB) 6 | 159383552 | 304 | 2.53 | 5.07 | 1599.569 | 1085.135 | F:\testfile.dat (8192MB) 7 | 162004992 | 309 | 2.57 | 5.15 | 1538.734 | 804.873 | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 1280835584 | 2443 | 20.36 | 40.72 | 1583.100 | 991.177 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 156237824 | 298 | 2.48 | 4.97 | 1649.946 | 1221.495 | F:\testfile.dat (8192MB) 1 | 162004992 | 309 | 2.57 | 5.15 | 1578.751 | 884.018 | F:\testfile.dat (8192MB) 2 | 160432128 | 306 | 2.55 | 5.10 | 1571.906 | 963.079 | F:\testfile.dat (8192MB) 3 | 162529280 | 310 | 2.58 | 5.17 | 1540.152 | 810.981 | F:\testfile.dat (8192MB) 4 | 155713536 | 297 | 2.47 | 4.95 | 1642.193 | 1229.414 | F:\testfile.dat (8192MB) 5 | 162529280 | 310 | 2.58 | 5.17 | 1548.634 | 833.139 | F:\testfile.dat (8192MB) 6 | 159383552 | 304 | 2.53 | 5.07 | 1599.569 | 1085.135 | F:\testfile.dat (8192MB) 7 | 162004992 | 309 | 2.57 | 5.15 | 1538.734 | 804.873 | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 1280835584 | 2443 | 20.36 | 40.72 | 1583.100 | 991.177 %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | N/A | 488.675 | 488.675 25th | N/A | 987.196 | 987.196 50th | N/A | 1338.976 | 1338.976 75th | N/A | 1917.853 | 1917.853 90th | N/A | 2303.580 | 2303.580 95th | N/A | 3159.909 | 3159.909 99th | N/A | 5151.770 | 5151.770 3-nines | N/A | 10736.144 | 10736.144 4-nines | N/A | 11156.307 | 11156.307 5-nines | N/A | 11156.307 | 11156.307 6-nines | N/A | 11156.307 | 11156.307 7-nines | N/A | 11156.307 | 11156.307 8-nines | N/A | 11156.307 | 11156.307 max | N/A | 11156.307 | 11156.307 === SSD === C:\>diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L G:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w100 -t8 -o8 -b512K -h -L G:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'G:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing write test block size: 524288 using random I/O (alignment: 524288) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.01s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 1.67%| 0.10%| 1.56%| 98.34% 1| 1.74%| 0.08%| 1.67%| 98.26% ------------------------------------------- avg.| 1.71%| 0.09%| 1.61%| 98.30% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 2032140288 | 3876 | 32.29 | 64.59 | 123.860 | 3.092 | G:\testfile.dat (8192MB) 1 | 2032140288 | 3876 | 32.29 | 64.59 | 123.837 | 2.970 | G:\testfile.dat (8192MB) 2 | 2032664576 | 3877 | 32.30 | 64.60 | 123.885 | 3.750 | G:\testfile.dat (8192MB) 3 | 2029518848 | 3871 | 32.25 | 64.50 | 124.010 | 4.757 | G:\testfile.dat (8192MB) 4 | 2031616000 | 3875 | 32.28 | 64.57 | 123.919 | 4.005 | G:\testfile.dat (8192MB) 5 | 2033188864 | 3878 | 32.31 | 64.62 | 123.797 | 2.028 | G:\testfile.dat (8192MB) 6 | 2031091712 | 3874 | 32.28 | 64.55 | 123.913 | 3.660 | G:\testfile.dat (8192MB) 7 | 2030567424 | 3873 | 32.27 | 64.54 | 123.958 | 3.963 | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 16252928000 | 31000 | 258.28 | 516.56 | 123.897 | 3.611 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 2032140288 | 3876 | 32.29 | 64.59 | 123.860 | 3.092 | G:\testfile.dat (8192MB) 1 | 2032140288 | 3876 | 32.29 | 64.59 | 123.837 | 2.970 | G:\testfile.dat (8192MB) 2 | 2032664576 | 3877 | 32.30 | 64.60 | 123.885 | 3.750 | G:\testfile.dat (8192MB) 3 | 2029518848 | 3871 | 32.25 | 64.50 | 124.010 | 4.757 | G:\testfile.dat (8192MB) 4 | 2031616000 | 3875 | 32.28 | 64.57 | 123.919 | 4.005 | G:\testfile.dat (8192MB) 5 | 2033188864 | 3878 | 32.31 | 64.62 | 123.797 | 2.028 | G:\testfile.dat (8192MB) 6 | 2031091712 | 3874 | 32.28 | 64.55 | 123.913 | 3.660 | G:\testfile.dat (8192MB) 7 | 2030567424 | 3873 | 32.27 | 64.54 | 123.958 | 3.963 | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 16252928000 | 31000 | 258.28 | 516.56 | 123.897 | 3.611 %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | N/A | 117.965 | 117.965 25th | N/A | 123.850 | 123.850 50th | N/A | 123.899 | 123.899 75th | N/A | 123.941 | 123.941 90th | N/A | 123.978 | 123.978 95th | N/A | 124.012 | 124.012 99th | N/A | 124.891 | 124.891 3-nines | N/A | 199.822 | 199.822 4-nines | N/A | 231.365 | 231.365 5-nines | N/A | 238.747 | 238.747 6-nines | N/A | 238.747 | 238.747 7-nines | N/A | 238.747 | 238.747 8-nines | N/A | 238.747 | 238.747 max | N/A | 238.747 | 238.747 ==== Read 512K ==== === HDD === C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L E:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L E:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'E:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing read test block size: 524288 using random I/O (alignment: 524288) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.00s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 0.83%| 0.29%| 0.55%| 99.16% 1| 1.07%| 0.23%| 0.83%| 98.93% ------------------------------------------- avg.| 0.95%| 0.26%| 0.69%| 99.04% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 587202560 | 1120 | 9.33 | 18.67 | 427.771 | 347.990 | E:\testfile.dat (8192MB) 1 | 586153984 | 1118 | 9.32 | 18.63 | 429.810 | 349.144 | E:\testfile.dat (8192MB) 2 | 589299712 | 1124 | 9.37 | 18.73 | 424.982 | 340.093 | E:\testfile.dat (8192MB) 3 | 555745280 | 1060 | 8.83 | 17.67 | 455.375 | 411.710 | E:\testfile.dat (8192MB) 4 | 575668224 | 1098 | 9.15 | 18.30 | 433.092 | 352.360 | E:\testfile.dat (8192MB) 5 | 557318144 | 1063 | 8.86 | 17.72 | 449.838 | 399.745 | E:\testfile.dat (8192MB) 6 | 576716800 | 1100 | 9.17 | 18.33 | 435.077 | 362.675 | E:\testfile.dat (8192MB) 7 | 537395200 | 1025 | 8.54 | 17.08 | 465.737 | 427.123 | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 4565499904 | 8708 | 72.56 | 145.12 | 439.789 | 374.471 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 587202560 | 1120 | 9.33 | 18.67 | 427.771 | 347.990 | E:\testfile.dat (8192MB) 1 | 586153984 | 1118 | 9.32 | 18.63 | 429.810 | 349.144 | E:\testfile.dat (8192MB) 2 | 589299712 | 1124 | 9.37 | 18.73 | 424.982 | 340.093 | E:\testfile.dat (8192MB) 3 | 555745280 | 1060 | 8.83 | 17.67 | 455.375 | 411.710 | E:\testfile.dat (8192MB) 4 | 575668224 | 1098 | 9.15 | 18.30 | 433.092 | 352.360 | E:\testfile.dat (8192MB) 5 | 557318144 | 1063 | 8.86 | 17.72 | 449.838 | 399.745 | E:\testfile.dat (8192MB) 6 | 576716800 | 1100 | 9.17 | 18.33 | 435.077 | 362.675 | E:\testfile.dat (8192MB) 7 | 537395200 | 1025 | 8.54 | 17.08 | 465.737 | 427.123 | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 4565499904 | 8708 | 72.56 | 145.12 | 439.789 | 374.471 Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | E:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 134.665 | N/A | 134.665 25th | 308.128 | N/A | 308.128 50th | 367.192 | N/A | 367.192 75th | 431.843 | N/A | 431.843 90th | 495.140 | N/A | 495.140 95th | 562.580 | N/A | 562.580 99th | 2358.475 | N/A | 2358.475 3-nines | 2484.729 | N/A | 2484.729 4-nines | 2564.951 | N/A | 2564.951 5-nines | 2564.951 | N/A | 2564.951 6-nines | 2564.951 | N/A | 2564.951 7-nines | 2564.951 | N/A | 2564.951 8-nines | 2564.951 | N/A | 2564.951 max | 2564.951 | N/A | 2564.951 === NFS === C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L F:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L F:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'F:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing read test block size: 524288 using random I/O (alignment: 524288) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.01s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 0.29%| 0.00%| 0.29%| 99.70% 1| 0.47%| 0.05%| 0.42%| 99.51% ------------------------------------------- avg.| 0.38%| 0.03%| 0.35%| 99.61% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 268959744 | 513 | 4.27 | 8.55 | 939.445 | 294.138 | F:\testfile.dat (8192MB) 1 | 268435456 | 512 | 4.27 | 8.53 | 934.389 | 224.634 | F:\testfile.dat (8192MB) 2 | 265289728 | 506 | 4.22 | 8.43 | 980.260 | 484.648 | F:\testfile.dat (8192MB) 3 | 268959744 | 513 | 4.27 | 8.55 | 957.880 | 385.836 | F:\testfile.dat (8192MB) 4 | 263192576 | 502 | 4.18 | 8.37 | 989.031 | 557.801 | F:\testfile.dat (8192MB) 5 | 267911168 | 511 | 4.26 | 8.52 | 934.999 | 222.781 | F:\testfile.dat (8192MB) 6 | 267386880 | 510 | 4.25 | 8.50 | 946.895 | 365.036 | F:\testfile.dat (8192MB) 7 | 269484032 | 514 | 4.28 | 8.57 | 929.988 | 220.322 | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 2139619328 | 4081 | 34.00 | 68.01 | 951.471 | 364.318 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 268959744 | 513 | 4.27 | 8.55 | 939.445 | 294.138 | F:\testfile.dat (8192MB) 1 | 268435456 | 512 | 4.27 | 8.53 | 934.389 | 224.634 | F:\testfile.dat (8192MB) 2 | 265289728 | 506 | 4.22 | 8.43 | 980.260 | 484.648 | F:\testfile.dat (8192MB) 3 | 268959744 | 513 | 4.27 | 8.55 | 957.880 | 385.836 | F:\testfile.dat (8192MB) 4 | 263192576 | 502 | 4.18 | 8.37 | 989.031 | 557.801 | F:\testfile.dat (8192MB) 5 | 267911168 | 511 | 4.26 | 8.52 | 934.999 | 222.781 | F:\testfile.dat (8192MB) 6 | 267386880 | 510 | 4.25 | 8.50 | 946.895 | 365.036 | F:\testfile.dat (8192MB) 7 | 269484032 | 514 | 4.28 | 8.57 | 929.988 | 220.322 | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 2139619328 | 4081 | 34.00 | 68.01 | 951.471 | 364.318 Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | F:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 343.730 | N/A | 343.730 25th | 775.531 | N/A | 775.531 50th | 922.393 | N/A | 922.393 75th | 1088.764 | N/A | 1088.764 90th | 1241.313 | N/A | 1241.313 95th | 1336.883 | N/A | 1336.883 99th | 1475.941 | N/A | 1475.941 3-nines | 6404.973 | N/A | 6404.973 4-nines | 7456.621 | N/A | 7456.621 5-nines | 7456.621 | N/A | 7456.621 6-nines | 7456.621 | N/A | 7456.621 7-nines | 7456.621 | N/A | 7456.621 8-nines | 7456.621 | N/A | 7456.621 max | 7456.621 | N/A | 7456.621 === SSD === C:\>diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L G:\testfile.dat Command Line: diskspd.exe -c8G -d60 -r -w0 -t8 -o8 -b512K -h -L G:\testfile.dat Input parameters: timespan: 1 ------------- duration: 60s warm up time: 5s cool down time: 0s measuring latency random seed: 0 path: 'G:\testfile.dat' think time: 0ms burst size: 0 software and hardware write cache disabled performing read test block size: 524288 using random I/O (alignment: 524288) number of outstanding I/O operations: 8 thread stride size: 0 threads per file: 8 using I/O Completion Ports IO priority: normal Results for timespan 1: ******************************************************************************* actual test time: 60.00s thread count: 8 proc count: 2 CPU | Usage | User | Kernel | Idle ------------------------------------------- 0| 3.23%| 0.13%| 3.10%| 96.77% 1| 4.27%| 0.26%| 4.01%| 95.73% ------------------------------------------- avg.| 3.75%| 0.20%| 3.55%| 96.25% Total IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 4242538496 | 8092 | 67.43 | 134.86 | 59.329 | 0.560 | G:\testfile.dat (8192MB) 1 | 4242014208 | 8091 | 67.42 | 134.85 | 59.329 | 0.540 | G:\testfile.dat (8192MB) 2 | 4240441344 | 8088 | 67.40 | 134.80 | 59.329 | 0.586 | G:\testfile.dat (8192MB) 3 | 4240965632 | 8089 | 67.41 | 134.81 | 59.328 | 0.552 | G:\testfile.dat (8192MB) 4 | 4241489920 | 8090 | 67.42 | 134.83 | 59.325 | 0.547 | G:\testfile.dat (8192MB) 5 | 4242014208 | 8091 | 67.42 | 134.85 | 59.326 | 0.546 | G:\testfile.dat (8192MB) 6 | 4242014208 | 8091 | 67.42 | 134.85 | 59.327 | 0.539 | G:\testfile.dat (8192MB) 7 | 4243062784 | 8093 | 67.44 | 134.88 | 59.326 | 0.543 | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 33934540800 | 64725 | 539.37 | 1078.73 | 59.327 | 0.552 Read IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 4242538496 | 8092 | 67.43 | 134.86 | 59.329 | 0.560 | G:\testfile.dat (8192MB) 1 | 4242014208 | 8091 | 67.42 | 134.85 | 59.329 | 0.540 | G:\testfile.dat (8192MB) 2 | 4240441344 | 8088 | 67.40 | 134.80 | 59.329 | 0.586 | G:\testfile.dat (8192MB) 3 | 4240965632 | 8089 | 67.41 | 134.81 | 59.328 | 0.552 | G:\testfile.dat (8192MB) 4 | 4241489920 | 8090 | 67.42 | 134.83 | 59.325 | 0.547 | G:\testfile.dat (8192MB) 5 | 4242014208 | 8091 | 67.42 | 134.85 | 59.326 | 0.546 | G:\testfile.dat (8192MB) 6 | 4242014208 | 8091 | 67.42 | 134.85 | 59.327 | 0.539 | G:\testfile.dat (8192MB) 7 | 4243062784 | 8093 | 67.44 | 134.88 | 59.326 | 0.543 | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 33934540800 | 64725 | 539.37 | 1078.73 | 59.327 | 0.552 Write IO thread | bytes | I/Os | MB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | G:\testfile.dat (8192MB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 53.509 | N/A | 53.509 25th | 59.263 | N/A | 59.263 50th | 59.300 | N/A | 59.300 75th | 59.339 | N/A | 59.339 90th | 59.398 | N/A | 59.398 95th | 59.458 | N/A | 59.458 99th | 59.632 | N/A | 59.632 3-nines | 72.851 | N/A | 72.851 4-nines | 72.918 | N/A | 72.918 5-nines | 75.488 | N/A | 75.488 6-nines | 75.488 | N/A | 75.488 7-nines | 75.488 | N/A | 75.488 8-nines | 75.488 | N/A | 75.488 max | 75.488 | N/A | 75.488