Merge ~ian-may/+git/autotest-client-tests:dgx-fio-dev-mp into ~canonical-kernel-team/+git/autotest-client-tests:master

[Ian May]

For DGX performance testing we need to be able to run different tests on the various platforms. This MP includes changes to be able to define .fio files based on the targeted platform. The existing .fio files have been moved into a "Generic" directory and will be used if no DGX supported platform is identified. So there should be no functional change for any non DGX fio testing.

There is also a bug in the existing FIO that is unable to report rdwr mix tests. It is currently only reporting either the read or the write. We need the ability to report both.

The other changes should be self explanatory. I've been testing these changes on multiple DGX instances for multiple cycles with no issues. If the changes are viewed too extensive, I would propose carving out a "ubuntu_performance_dgx_fio" for them to live.

[Po-Hsu Lin (cypressyew)]

Hi Ian,
Overall it's looking good.

I got three questions and one inline comment about this MP:

1. I am curious why we're using not using "ioengine=libaio" in DGX2/dataset/global-include.fio, in this MP it's being used for DGXA100/dataset/global-include.fio and DGXH100/dataset/global-include.fio.
2. For DGXA100 and DGXH100, why most of the numjobs are 1/4 of the number stated in [testname], e.g.
+[rd-0,wr-100,rand,blk-128k,jobs-256]
+numjobs=64
It appears only ramdisk rd-100,wr-0 and rd-75,wr-25 are using the same number.
3. Why do we need unattended-upgrades package?

[Ian May (ian-may)]

> Hi Ian,
> Overall it's looking good.
>
> I got three questions and one inline comment about this MP:
>
> 1. I am curious why we're using not using "ioengine=libaio" in
> DGX2/dataset/global-include.fio, in this MP it's being used for
> DGXA100/dataset/global-include.fio and DGXH100/dataset/global-include.fio.
The NVIDIA DGX Perf team uses ioengine=sync on DGX2 and they preferred we use the same engine as them for result comparison and regression identification.
> 2. For DGXA100 and DGXH100, why most of the numjobs are 1/4 of the number
> stated in [testname], e.g.
> +[rd-0,wr-100,rand,blk-128k,jobs-256]
> +numjobs=64
> It appears only ramdisk rd-100,wr-0 and rd-75,wr-25 are using the same number.
Ah good catch! I'll try and get this fixed. The '[]' value is used by the shared report generation tooling and requires significant changes in another repo.
> 3. Why do we need unattended-upgrades package?
This change should be adding it to the list of services that we stop prior to running fio. I have concerns this could be running during testing and causing jitters.

[Ian May (ian-may)]

> Hi Ian,
> Overall it's looking good.
>
> I got three questions and one inline comment about this MP:
>
> 1. I am curious why we're using not using "ioengine=libaio" in
> DGX2/dataset/global-include.fio, in this MP it's being used for
> DGXA100/dataset/global-include.fio and DGXH100/dataset/global-include.fio.
> 2. For DGXA100 and DGXH100, why most of the numjobs are 1/4 of the number
> stated in [testname], e.g.
> +[rd-0,wr-100,rand,blk-128k,jobs-256]
> +numjobs=64
> It appears only ramdisk rd-100,wr-0 and rd-75,wr-25 are using the same number.
> 3. Why do we need unattended-upgrades package?

I pushed an update that has the .fio name field updated with the correct numjobs

[Po-Hsu Lin (cypressyew)]

> > Hi Ian,
> > Overall it's looking good.
> >
> > I got three questions and one inline comment about this MP:
> >
> > 1. I am curious why we're using not using "ioengine=libaio" in
> > DGX2/dataset/global-include.fio, in this MP it's being used for
> > DGXA100/dataset/global-include.fio and DGXH100/dataset/global-include.fio.
> > 2. For DGXA100 and DGXH100, why most of the numjobs are 1/4 of the number
> > stated in [testname], e.g.
> > +[rd-0,wr-100,rand,blk-128k,jobs-256]
> > +numjobs=64
> > It appears only ramdisk rd-100,wr-0 and rd-75,wr-25 are using the same
> number.
> > 3. Why do we need unattended-upgrades package?
>
> I pushed an update that has the .fio name field updated with the correct
> numjobs

Thanks for updating this. I will have a look.

How about the 'post-test-zfs-cleanup', in the end of the tests list, do we need that there? As we will append it with the if statement:
  if 'TEST_FILESYSTEM' in os.environ and os.environ['TEST_FILESYSTEM'] =='zfs':

[Ian May (ian-may)]

> > > Hi Ian,
> > > Overall it's looking good.
> > >
> > > I got three questions and one inline comment about this MP:
> > >
> > > 1. I am curious why we're using not using "ioengine=libaio" in
> > > DGX2/dataset/global-include.fio, in this MP it's being used for
> > > DGXA100/dataset/global-include.fio and DGXH100/dataset/global-include.fio.
> > > 2. For DGXA100 and DGXH100, why most of the numjobs are 1/4 of the number
> > > stated in [testname], e.g.
> > > +[rd-0,wr-100,rand,blk-128k,jobs-256]
> > > +numjobs=64
> > > It appears only ramdisk rd-100,wr-0 and rd-75,wr-25 are using the same
> > number.
> > > 3. Why do we need unattended-upgrades package?
> >
> > I pushed an update that has the .fio name field updated with the correct
> > numjobs
>
> Thanks for updating this. I will have a look.
>
> How about the 'post-test-zfs-cleanup', in the end of the tests list, do we
> need that there? As we will append it with the if statement:
> if 'TEST_FILESYSTEM' in os.environ and os.environ['TEST_FILESYSTEM']
> =='zfs':

Thanks! You are correct, we don't need 'post-test-zfs-cleanup' in the tests list. I've pushed an update with that removed.

[Po-Hsu Lin (cypressyew)]

Applied and pushed.
I've added comment for ioengine=sync to the commit message of "UBUNTU: SAUCE: ubuntu_performance_fio: Add plaform specific FIO config files":

    [PHLin: Ian's comment copied from the MP on launchpad: NVIDIA DGX Perf
     team uses ioengine=sync on DGX2 and they preferred we use the same.
     PHLin: therefore we're using libaio just on DGXA100 and DGXH100.]

Thanks!

diff --git a/ubuntu_performance_fio/rd-0,wr-100,rand,blk-128k,jobs-16.fio b/ubuntu_performance_fio/DGX2/dataset/global-include.fio
 similarity index 78%
 rename from ubuntu_performance_fio/rd-0,wr-100,rand,blk-128k,jobs-16.fio
 rename to ubuntu_performance_fio/DGX2/dataset/global-include.fio
index 14917fb..90b5995 100644
--- a/ubuntu_performance_fio/rd-0,wr-100,rand,blk-128k,jobs-16.fio
+++ b/ubuntu_performance_fio/DGX2/dataset/global-include.fio
@@ -1,20 +1,13 @@
-[global]
 ioengine=sync
+direct=1
 thread=1
 norandommap=1
 allrandrepeat=1
 clocksource=cpu
-size=32768M
 ramp_time=30
 disable_lat=0
-direct=1
 overwrite=1
-directory=DIRECTORY
 time_based
 runtime=60
 group_reporting
 unlink=1
-[rd-0,wr-100,rand,blk-128k,jobs-16]
-bs=128K
-rw=randwrite
-numjobs=16
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,rand,blk-128k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,rand,blk-128k.fio
 new file mode 100644
index 0000000..a4c1361
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-0,wr-100,rand,blk-128k,jobs-16]
+bs=128K
+rw=randwrite
+numjobs=16
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,rand,blk-8k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,rand,blk-8k.fio
 new file mode 100644
index 0000000..0cf1fa1
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+[rd-0,wr-100,rand,blk-8k,jobs-64]
+bs=8K
+rw=randwrite
+numjobs=64
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,seq,blk-128k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,seq,blk-128k.fio
 new file mode 100644
index 0000000..87bf704
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-0,wr-100,seq,blk-128k,jobs-16]
+bs=128K
+rw=write
+numjobs=16
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,seq,blk-8k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,seq,blk-8k.fio
 new file mode 100644
index 0000000..5a5c4b1
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-0,wr-100,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+[rd-0,wr-100,seq,blk-8k,jobs-64]
+bs=8K
+rw=write
+numjobs=64
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,rand,blk-128k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,rand,blk-128k.fio
 new file mode 100644
index 0000000..116868c
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-100,wr-0,rand,blk-128k,jobs-16]
+bs=128K
+rw=randread
+numjobs=16
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,rand,blk-8k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,rand,blk-8k.fio
 new file mode 100644
index 0000000..6872625
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+[rd-100,wr-0,rand,blk-8k,jobs-64]
+bs=8K
+rw=randread
+numjobs=64
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,seq,blk-128k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,seq,blk-128k.fio
 new file mode 100644
index 0000000..d84b290
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-100,wr-0,seq,blk-128k,jobs-16]
+bs=128K
+rw=read
+numjobs=16
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,seq,blk-8k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,seq,blk-8k.fio
 new file mode 100644
index 0000000..b5f4147
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-100,wr-0,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+[rd-100,wr-0,seq,blk-8k,jobs-64]
+bs=8K
+rw=read
+numjobs=64
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-75,wr-25,rand,blk-128k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-75,wr-25,rand,blk-128k.fio
 new file mode 100644
index 0000000..125af1b
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-75,wr-25,rand,blk-128k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-75,wr-25,rand,blk-128k,jobs-16]
+bs=128K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=16
diff --git a/ubuntu_performance_fio/DGX2/dataset/rd-75,wr-25,rand,blk-8k.fio b/ubuntu_performance_fio/DGX2/dataset/rd-75,wr-25,rand,blk-8k.fio
 new file mode 100644
index 0000000..4288630
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/dataset/rd-75,wr-25,rand,blk-8k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-75,wr-25,rand,blk-8k,jobs-64]
+bs=8K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=64
diff --git a/ubuntu_performance_fio/rd-100,wr-0,seq,blk-8k,jobs-64.fio b/ubuntu_performance_fio/DGX2/ramdisk/global-include.fio
 similarity index 72%
 rename from ubuntu_performance_fio/rd-100,wr-0,seq,blk-8k,jobs-64.fio
 rename to ubuntu_performance_fio/DGX2/ramdisk/global-include.fio
index f3ee52b..a697ace 100644
--- a/ubuntu_performance_fio/rd-100,wr-0,seq,blk-8k,jobs-64.fio
+++ b/ubuntu_performance_fio/DGX2/ramdisk/global-include.fio
@@ -1,20 +1,13 @@
-[global]
 ioengine=sync
+direct=0
 thread=1
 norandommap=1
 allrandrepeat=1
 clocksource=cpu
-size=8192M
 ramp_time=30
 disable_lat=0
-direct=1
 overwrite=1
-directory=DIRECTORY
 time_based
 runtime=60
 group_reporting
 unlink=1
-[rd-100,wr-0,seq,blk-8k,jobs-64]
-bs=8K
-rw=read
-numjobs=64
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,rand,blk-128k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,rand,blk-128k.fio
 new file mode 100644
index 0000000..2633cae
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-0,wr-100,rand,blk-128k,jobs-96]
+bs=128K
+rw=randwrite
+numjobs=96
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,rand,blk-8k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,rand,blk-8k.fio
 new file mode 100644
index 0000000..a40d2ba
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-0,wr-100,rand,blk-8k,jobs-96]
+bs=8K
+rw=randwrite
+numjobs=96
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,seq,blk-128k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,seq,blk-128k.fio
 new file mode 100644
index 0000000..f475b04
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-0,wr-100,seq,blk-128k,jobs-96]
+bs=128K
+rw=write
+numjobs=96
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,seq,blk-8k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,seq,blk-8k.fio
 new file mode 100644
index 0000000..761b0eb
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-0,wr-100,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-0,wr-100,seq,blk-8k,jobs-96]
+bs=8K
+rw=write
+numjobs=96
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,rand,blk-128k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,rand,blk-128k.fio
 new file mode 100644
index 0000000..032e3f4
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-100,wr-0,rand,blk-128k,jobs-96]
+bs=128K
+rw=randread
+numjobs=96
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,rand,blk-8k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,rand,blk-8k.fio
 new file mode 100644
index 0000000..3356480
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-100,wr-0,rand,blk-8k,jobs-96]
+bs=8K
+rw=randread
+numjobs=96
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,seq,blk-128k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,seq,blk-128k.fio
 new file mode 100644
index 0000000..f915335
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-100,wr-0,seq,blk-128k,jobs-96]
+bs=128K
+rw=read
+numjobs=96
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,seq,blk-8k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,seq,blk-8k.fio
 new file mode 100644
index 0000000..df58dd9
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-100,wr-0,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-100,wr-0,seq,blk-8k,jobs-96]
+bs=8K
+rw=read
+numjobs=96
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-75,wr-25,rand,blk-128k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-75,wr-25,rand,blk-128k.fio
 new file mode 100644
index 0000000..ae584bb
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-75,wr-25,rand,blk-128k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-75,wr-25,rand,blk-128k,jobs-96]
+bs=128K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=96
diff --git a/ubuntu_performance_fio/DGX2/ramdisk/rd-75,wr-25,rand,blk-8k.fio b/ubuntu_performance_fio/DGX2/ramdisk/rd-75,wr-25,rand,blk-8k.fio
 new file mode 100644
index 0000000..db767fd
--- /dev/null
+++ b/ubuntu_performance_fio/DGX2/ramdisk/rd-75,wr-25,rand,blk-8k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-75,wr-25,rand,blk-8k,jobs-96]
+bs=8K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=96
diff --git a/ubuntu_performance_fio/rd-0,wr-100,seq,blk-128k,jobs-16.fio b/ubuntu_performance_fio/DGXA100/dataset/global-include.fio
 similarity index 72%
 rename from ubuntu_performance_fio/rd-0,wr-100,seq,blk-128k,jobs-16.fio
 rename to ubuntu_performance_fio/DGXA100/dataset/global-include.fio
index 1497b00..eed94f4 100644
--- a/ubuntu_performance_fio/rd-0,wr-100,seq,blk-128k,jobs-16.fio
+++ b/ubuntu_performance_fio/DGXA100/dataset/global-include.fio
@@ -1,20 +1,13 @@
-[global]
-ioengine=sync
+ioengine=libaio
+direct=1
 thread=1
 norandommap=1
 allrandrepeat=1
 clocksource=cpu
-size=32768M
 ramp_time=30
 disable_lat=0
-direct=1
 overwrite=1
-directory=DIRECTORY
 time_based
 runtime=60
 group_reporting
 unlink=1
-[rd-0,wr-100,seq,blk-128k,jobs-16]
-bs=128K
-rw=write
-numjobs=16
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,rand,blk-128k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,rand,blk-128k.fio
 new file mode 100644
index 0000000..451080b
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,rand,blk-128k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-0,wr-100,rand,blk-128k,jobs-64]
+bs=128K
+rw=randwrite
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,rand,blk-8k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,rand,blk-8k.fio
 new file mode 100644
index 0000000..3606153
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,rand,blk-8k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-0,wr-100,rand,blk-8k,jobs-32]
+bs=8K
+rw=randwrite
+numjobs=32
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,seq,blk-128k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,seq,blk-128k.fio
 new file mode 100644
index 0000000..798aba3
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,seq,blk-128k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-0,wr-100,seq,blk-128k,jobs-64]
+bs=128K
+rw=write
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,seq,blk-8k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,seq,blk-8k.fio
 new file mode 100644
index 0000000..378b5c6
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-0,wr-100,seq,blk-8k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-0,wr-100,seq,blk-8k,jobs-32]
+bs=8K
+rw=write
+numjobs=32
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,rand,blk-128k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,rand,blk-128k.fio
 new file mode 100644
index 0000000..cdf45c1
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,rand,blk-128k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-100,wr-0,rand,blk-128k,jobs-64]
+bs=128K
+rw=randread
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,rand,blk-8k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,rand,blk-8k.fio
 new file mode 100644
index 0000000..02e9beb
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,rand,blk-8k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-100,wr-0,rand,blk-8k,jobs-32]
+bs=8K
+rw=randread
+numjobs=32
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,seq,blk-128k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,seq,blk-128k.fio
 new file mode 100644
index 0000000..8799117
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,seq,blk-128k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-100,wr-0,seq,blk-128k,jobs-64]
+bs=128K
+rw=read
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,seq,blk-8k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,seq,blk-8k.fio
 new file mode 100644
index 0000000..aa65847
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-100,wr-0,seq,blk-8k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-100,wr-0,seq,blk-8k,jobs-32]
+bs=8K
+rw=read
+numjobs=32
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-75,wr-25,rand,blk-128k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-75,wr-25,rand,blk-128k.fio
 new file mode 100644
index 0000000..0b96ef2
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-75,wr-25,rand,blk-128k.fio
@@ -0,0 +1,11 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-75,wr-25,rand,blk-128k,jobs-64]
+bs=128K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/dataset/rd-75,wr-25,rand,blk-8k.fio b/ubuntu_performance_fio/DGXA100/dataset/rd-75,wr-25,rand,blk-8k.fio
 new file mode 100644
index 0000000..ed3808e
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/dataset/rd-75,wr-25,rand,blk-8k.fio
@@ -0,0 +1,11 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-75,wr-25,rand,blk-8k,jobs-32]
+bs=8K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=32
diff --git a/ubuntu_performance_fio/rd-0,wr-100,seq,blk-8k,jobs-64.fio b/ubuntu_performance_fio/DGXA100/ramdisk/global-include.fio
 similarity index 72%
 rename from ubuntu_performance_fio/rd-0,wr-100,seq,blk-8k,jobs-64.fio
 rename to ubuntu_performance_fio/DGXA100/ramdisk/global-include.fio
index e66c364..a697ace 100644
--- a/ubuntu_performance_fio/rd-0,wr-100,seq,blk-8k,jobs-64.fio
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/global-include.fio
@@ -1,20 +1,13 @@
-[global]
 ioengine=sync
+direct=0
 thread=1
 norandommap=1
 allrandrepeat=1
 clocksource=cpu
-size=8192M
 ramp_time=30
 disable_lat=0
-direct=1
 overwrite=1
-directory=DIRECTORY
 time_based
 runtime=60
 group_reporting
 unlink=1
-[rd-0,wr-100,seq,blk-8k,jobs-64]
-bs=8K
-rw=write
-numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,rand,blk-128k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,rand,blk-128k.fio
 new file mode 100644
index 0000000..f6fc901
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-0,wr-100,rand,blk-128k,jobs-64]
+bs=128K
+rw=randwrite
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,rand,blk-8k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,rand,blk-8k.fio
 new file mode 100644
index 0000000..fb1beb7
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-0,wr-100,rand,blk-8k,jobs-64]
+bs=8K
+rw=randwrite
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,seq,blk-128k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,seq,blk-128k.fio
 new file mode 100644
index 0000000..f3299aa
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-0,wr-100,seq,blk-128k,jobs-64]
+bs=128K
+rw=write
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,seq,blk-8k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,seq,blk-8k.fio
 new file mode 100644
index 0000000..d4da8eb
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-0,wr-100,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-0,wr-100,seq,blk-8k,jobs-64]
+bs=8K
+rw=write
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,rand,blk-128k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,rand,blk-128k.fio
 new file mode 100644
index 0000000..aa05ba9
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-100,wr-0,rand,blk-128k,jobs-256]
+bs=128K
+rw=randread
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,rand,blk-8k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,rand,blk-8k.fio
 new file mode 100644
index 0000000..3ac63ef
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-100,wr-0,rand,blk-8k,jobs-256]
+bs=8K
+rw=randread
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,seq,blk-128k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,seq,blk-128k.fio
 new file mode 100644
index 0000000..2e4c500
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-100,wr-0,seq,blk-128k,jobs-256]
+bs=128K
+rw=read
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,seq,blk-8k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,seq,blk-8k.fio
 new file mode 100644
index 0000000..89764c0
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-100,wr-0,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-100,wr-0,seq,blk-8k,jobs-256]
+bs=8K
+rw=read
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-75,wr-25,rand,blk-128k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-75,wr-25,rand,blk-128k.fio
 new file mode 100644
index 0000000..9fdcd98
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-75,wr-25,rand,blk-128k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-75,wr-25,rand,blk-128k,jobs-256]
+bs=128K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXA100/ramdisk/rd-75,wr-25,rand,blk-8k.fio b/ubuntu_performance_fio/DGXA100/ramdisk/rd-75,wr-25,rand,blk-8k.fio
 new file mode 100644
index 0000000..80b53a0
--- /dev/null
+++ b/ubuntu_performance_fio/DGXA100/ramdisk/rd-75,wr-25,rand,blk-8k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-75,wr-25,rand,blk-8k,jobs-256]
+bs=8K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=256
diff --git a/ubuntu_performance_fio/rd-100,wr-0,rand,blk-128k,jobs-16.fio b/ubuntu_performance_fio/DGXH100/dataset/global-include.fio
 similarity index 72%
 rename from ubuntu_performance_fio/rd-100,wr-0,rand,blk-128k,jobs-16.fio
 rename to ubuntu_performance_fio/DGXH100/dataset/global-include.fio
index 6a1c969..eed94f4 100644
--- a/ubuntu_performance_fio/rd-100,wr-0,rand,blk-128k,jobs-16.fio
+++ b/ubuntu_performance_fio/DGXH100/dataset/global-include.fio
@@ -1,20 +1,13 @@
-[global]
-ioengine=sync
+ioengine=libaio
+direct=1
 thread=1
 norandommap=1
 allrandrepeat=1
 clocksource=cpu
-size=32768M
 ramp_time=30
 disable_lat=0
-direct=1
 overwrite=1
-directory=DIRECTORY
 time_based
 runtime=60
 group_reporting
 unlink=1
-[rd-100,wr-0,rand,blk-128k,jobs-16]
-bs=128K
-rw=randread
-numjobs=16
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,rand,blk-128k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,rand,blk-128k.fio
 new file mode 100644
index 0000000..451080b
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,rand,blk-128k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-0,wr-100,rand,blk-128k,jobs-64]
+bs=128K
+rw=randwrite
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,rand,blk-8k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,rand,blk-8k.fio
 new file mode 100644
index 0000000..3606153
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,rand,blk-8k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-0,wr-100,rand,blk-8k,jobs-32]
+bs=8K
+rw=randwrite
+numjobs=32
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,seq,blk-128k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,seq,blk-128k.fio
 new file mode 100644
index 0000000..798aba3
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,seq,blk-128k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-0,wr-100,seq,blk-128k,jobs-64]
+bs=128K
+rw=write
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,seq,blk-8k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,seq,blk-8k.fio
 new file mode 100644
index 0000000..378b5c6
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-0,wr-100,seq,blk-8k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-0,wr-100,seq,blk-8k,jobs-32]
+bs=8K
+rw=write
+numjobs=32
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,rand,blk-128k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,rand,blk-128k.fio
 new file mode 100644
index 0000000..cdf45c1
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,rand,blk-128k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-100,wr-0,rand,blk-128k,jobs-64]
+bs=128K
+rw=randread
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,rand,blk-8k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,rand,blk-8k.fio
 new file mode 100644
index 0000000..02e9beb
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,rand,blk-8k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-100,wr-0,rand,blk-8k,jobs-32]
+bs=8K
+rw=randread
+numjobs=32
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,seq,blk-128k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,seq,blk-128k.fio
 new file mode 100644
index 0000000..8799117
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,seq,blk-128k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-100,wr-0,seq,blk-128k,jobs-64]
+bs=128K
+rw=read
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,seq,blk-8k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,seq,blk-8k.fio
 new file mode 100644
index 0000000..aa65847
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-100,wr-0,seq,blk-8k.fio
@@ -0,0 +1,9 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-100,wr-0,seq,blk-8k,jobs-32]
+bs=8K
+rw=read
+numjobs=32
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-75,wr-25,rand,blk-128k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-75,wr-25,rand,blk-128k.fio
 new file mode 100644
index 0000000..0b96ef2
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-75,wr-25,rand,blk-128k.fio
@@ -0,0 +1,11 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+iodepth=1
+[rd-75,wr-25,rand,blk-128k,jobs-64]
+bs=128K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/dataset/rd-75,wr-25,rand,blk-8k.fio b/ubuntu_performance_fio/DGXH100/dataset/rd-75,wr-25,rand,blk-8k.fio
 new file mode 100644
index 0000000..ed3808e
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/dataset/rd-75,wr-25,rand,blk-8k.fio
@@ -0,0 +1,11 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+iodepth=64
+[rd-75,wr-25,rand,blk-8k,jobs-32]
+bs=8K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=32
diff --git a/ubuntu_performance_fio/rd-100,wr-0,rand,blk-8k,jobs-64.fio b/ubuntu_performance_fio/DGXH100/ramdisk/global-include.fio
 similarity index 72%
 rename from ubuntu_performance_fio/rd-100,wr-0,rand,blk-8k,jobs-64.fio
 rename to ubuntu_performance_fio/DGXH100/ramdisk/global-include.fio
index 38fde81..a697ace 100644
--- a/ubuntu_performance_fio/rd-100,wr-0,rand,blk-8k,jobs-64.fio
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/global-include.fio
@@ -1,20 +1,13 @@
-[global]
 ioengine=sync
+direct=0
 thread=1
 norandommap=1
 allrandrepeat=1
 clocksource=cpu
-size=8192M
 ramp_time=30
 disable_lat=0
-direct=1
 overwrite=1
-directory=DIRECTORY
 time_based
 runtime=60
 group_reporting
 unlink=1
-[rd-100,wr-0,rand,blk-8k,jobs-64]
-bs=8K
-rw=randread
-numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,rand,blk-128k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,rand,blk-128k.fio
 new file mode 100644
index 0000000..f6fc901
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-0,wr-100,rand,blk-128k,jobs-64]
+bs=128K
+rw=randwrite
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,rand,blk-8k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,rand,blk-8k.fio
 new file mode 100644
index 0000000..fb1beb7
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-0,wr-100,rand,blk-8k,jobs-64]
+bs=8K
+rw=randwrite
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,seq,blk-128k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,seq,blk-128k.fio
 new file mode 100644
index 0000000..f3299aa
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-0,wr-100,seq,blk-128k,jobs-64]
+bs=128K
+rw=write
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,seq,blk-8k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,seq,blk-8k.fio
 new file mode 100644
index 0000000..d4da8eb
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-0,wr-100,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-0,wr-100,seq,blk-8k,jobs-64]
+bs=8K
+rw=write
+numjobs=64
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,rand,blk-128k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,rand,blk-128k.fio
 new file mode 100644
index 0000000..aa05ba9
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-100,wr-0,rand,blk-128k,jobs-256]
+bs=128K
+rw=randread
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,rand,blk-8k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,rand,blk-8k.fio
 new file mode 100644
index 0000000..3ac63ef
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-100,wr-0,rand,blk-8k,jobs-256]
+bs=8K
+rw=randread
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,seq,blk-128k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,seq,blk-128k.fio
 new file mode 100644
index 0000000..2e4c500
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-100,wr-0,seq,blk-128k,jobs-256]
+bs=128K
+rw=read
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,seq,blk-8k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,seq,blk-8k.fio
 new file mode 100644
index 0000000..89764c0
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-100,wr-0,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-100,wr-0,seq,blk-8k,jobs-256]
+bs=8K
+rw=read
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-75,wr-25,rand,blk-128k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-75,wr-25,rand,blk-128k.fio
 new file mode 100644
index 0000000..9fdcd98
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-75,wr-25,rand,blk-128k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-75,wr-25,rand,blk-128k,jobs-256]
+bs=128K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=256
diff --git a/ubuntu_performance_fio/DGXH100/ramdisk/rd-75,wr-25,rand,blk-8k.fio b/ubuntu_performance_fio/DGXH100/ramdisk/rd-75,wr-25,rand,blk-8k.fio
 new file mode 100644
index 0000000..80b53a0
--- /dev/null
+++ b/ubuntu_performance_fio/DGXH100/ramdisk/rd-75,wr-25,rand,blk-8k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=2048M
+[rd-75,wr-25,rand,blk-8k,jobs-256]
+bs=8K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=256
diff --git a/ubuntu_performance_fio/rd-0,wr-100,rand,blk-8k,jobs-64.fio b/ubuntu_performance_fio/Generic/dataset/global-include.fio
 similarity index 78%
 rename from ubuntu_performance_fio/rd-0,wr-100,rand,blk-8k,jobs-64.fio
 rename to ubuntu_performance_fio/Generic/dataset/global-include.fio
index da9db7b..90b5995 100644
--- a/ubuntu_performance_fio/rd-0,wr-100,rand,blk-8k,jobs-64.fio
+++ b/ubuntu_performance_fio/Generic/dataset/global-include.fio
@@ -1,20 +1,13 @@
-[global]
 ioengine=sync
+direct=1
 thread=1
 norandommap=1
 allrandrepeat=1
 clocksource=cpu
-size=8192M
 ramp_time=30
 disable_lat=0
-direct=1
 overwrite=1
-directory=DIRECTORY
 time_based
 runtime=60
 group_reporting
 unlink=1
-[rd-0,wr-100,rand,blk-8k,jobs-64]
-bs=8K
-rw=randwrite
-numjobs=64
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,rand,blk-128k.fio b/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,rand,blk-128k.fio
 new file mode 100644
index 0000000..a4c1361
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-0,wr-100,rand,blk-128k,jobs-16]
+bs=128K
+rw=randwrite
+numjobs=16
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,rand,blk-8k.fio b/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,rand,blk-8k.fio
 new file mode 100644
index 0000000..0cf1fa1
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+[rd-0,wr-100,rand,blk-8k,jobs-64]
+bs=8K
+rw=randwrite
+numjobs=64
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,seq,blk-128k.fio b/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,seq,blk-128k.fio
 new file mode 100644
index 0000000..87bf704
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-0,wr-100,seq,blk-128k,jobs-16]
+bs=128K
+rw=write
+numjobs=16
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,seq,blk-8k.fio b/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,seq,blk-8k.fio
 new file mode 100644
index 0000000..5a5c4b1
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-0,wr-100,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+[rd-0,wr-100,seq,blk-8k,jobs-64]
+bs=8K
+rw=write
+numjobs=64
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,rand,blk-128k.fio b/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,rand,blk-128k.fio
 new file mode 100644
index 0000000..116868c
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-100,wr-0,rand,blk-128k,jobs-16]
+bs=128K
+rw=randread
+numjobs=16
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,rand,blk-8k.fio b/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,rand,blk-8k.fio
 new file mode 100644
index 0000000..6872625
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+[rd-100,wr-0,rand,blk-8k,jobs-64]
+bs=8K
+rw=randread
+numjobs=64
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,seq,blk-128k.fio b/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,seq,blk-128k.fio
 new file mode 100644
index 0000000..d84b290
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-100,wr-0,seq,blk-128k,jobs-16]
+bs=128K
+rw=read
+numjobs=16
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,seq,blk-8k.fio b/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,seq,blk-8k.fio
 new file mode 100644
index 0000000..b5f4147
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-100,wr-0,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=8192M
+[rd-100,wr-0,seq,blk-8k,jobs-64]
+bs=8K
+rw=read
+numjobs=64
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-75,wr-25,rand,blk-128k.fio b/ubuntu_performance_fio/Generic/dataset/rd-75,wr-25,rand,blk-128k.fio
 new file mode 100644
index 0000000..125af1b
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-75,wr-25,rand,blk-128k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-75,wr-25,rand,blk-128k,jobs-16]
+bs=128K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=16
diff --git a/ubuntu_performance_fio/Generic/dataset/rd-75,wr-25,rand,blk-8k.fio b/ubuntu_performance_fio/Generic/dataset/rd-75,wr-25,rand,blk-8k.fio
 new file mode 100644
index 0000000..4288630
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/dataset/rd-75,wr-25,rand,blk-8k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=32768M
+[rd-75,wr-25,rand,blk-8k,jobs-64]
+bs=8K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=64
diff --git a/ubuntu_performance_fio/rd-100,wr-0,seq,blk-128k,jobs-16.fio b/ubuntu_performance_fio/Generic/ramdisk/global-include.fio
 similarity index 72%
 rename from ubuntu_performance_fio/rd-100,wr-0,seq,blk-128k,jobs-16.fio
 rename to ubuntu_performance_fio/Generic/ramdisk/global-include.fio
index c66b903..a697ace 100644
--- a/ubuntu_performance_fio/rd-100,wr-0,seq,blk-128k,jobs-16.fio
+++ b/ubuntu_performance_fio/Generic/ramdisk/global-include.fio
@@ -1,20 +1,13 @@
-[global]
 ioengine=sync
+direct=0
 thread=1
 norandommap=1
 allrandrepeat=1
 clocksource=cpu
-size=32768M
 ramp_time=30
 disable_lat=0
-direct=1
 overwrite=1
-directory=DIRECTORY
 time_based
 runtime=60
 group_reporting
 unlink=1
-[rd-100,wr-0,seq,blk-128k,jobs-16]
-bs=128K
-rw=read
-numjobs=16
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,rand,blk-128k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,rand,blk-128k.fio
 new file mode 100644
index 0000000..2633cae
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-0,wr-100,rand,blk-128k,jobs-96]
+bs=128K
+rw=randwrite
+numjobs=96
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,rand,blk-8k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,rand,blk-8k.fio
 new file mode 100644
index 0000000..a40d2ba
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-0,wr-100,rand,blk-8k,jobs-96]
+bs=8K
+rw=randwrite
+numjobs=96
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,seq,blk-128k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,seq,blk-128k.fio
 new file mode 100644
index 0000000..f475b04
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-0,wr-100,seq,blk-128k,jobs-96]
+bs=128K
+rw=write
+numjobs=96
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,seq,blk-8k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,seq,blk-8k.fio
 new file mode 100644
index 0000000..761b0eb
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-0,wr-100,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-0,wr-100,seq,blk-8k,jobs-96]
+bs=8K
+rw=write
+numjobs=96
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,rand,blk-128k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,rand,blk-128k.fio
 new file mode 100644
index 0000000..032e3f4
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,rand,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-100,wr-0,rand,blk-128k,jobs-96]
+bs=128K
+rw=randread
+numjobs=96
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,rand,blk-8k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,rand,blk-8k.fio
 new file mode 100644
index 0000000..3356480
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,rand,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-100,wr-0,rand,blk-8k,jobs-96]
+bs=8K
+rw=randread
+numjobs=96
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,seq,blk-128k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,seq,blk-128k.fio
 new file mode 100644
index 0000000..f915335
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,seq,blk-128k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-100,wr-0,seq,blk-128k,jobs-96]
+bs=128K
+rw=read
+numjobs=96
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,seq,blk-8k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,seq,blk-8k.fio
 new file mode 100644
index 0000000..df58dd9
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-100,wr-0,seq,blk-8k.fio
@@ -0,0 +1,8 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-100,wr-0,seq,blk-8k,jobs-96]
+bs=8K
+rw=read
+numjobs=96
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-75,wr-25,rand,blk-128k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-75,wr-25,rand,blk-128k.fio
 new file mode 100644
index 0000000..ae584bb
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-75,wr-25,rand,blk-128k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-75,wr-25,rand,blk-128k,jobs-96]
+bs=128K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=96
diff --git a/ubuntu_performance_fio/Generic/ramdisk/rd-75,wr-25,rand,blk-8k.fio b/ubuntu_performance_fio/Generic/ramdisk/rd-75,wr-25,rand,blk-8k.fio
 new file mode 100644
index 0000000..db767fd
--- /dev/null
+++ b/ubuntu_performance_fio/Generic/ramdisk/rd-75,wr-25,rand,blk-8k.fio
@@ -0,0 +1,10 @@
+[global]
+include global-include.fio
+directory=DIRECTORY
+size=4096M
+[rd-75,wr-25,rand,blk-8k,jobs-96]
+bs=8K
+rw=randrw
+rwmixread=75
+rwmixwrite=25
+numjobs=96
diff --git a/ubuntu_performance_fio/control b/ubuntu_performance_fio/control
index 5651a59..12a7753 100644
--- a/ubuntu_performance_fio/control
+++ b/ubuntu_performance_fio/control
@@ -13,20 +13,20 @@ DOC = ""
 name = 'ubuntu_performance_fio'
 
 tests = [
-    'rd-0,wr-100,rand,blk-128k,jobs-16',
-    'rd-0,wr-100,rand,blk-8k,jobs-64',
+   'rd-0,wr-100,seq,blk-128k',
+   'rd-0,wr-100,seq,blk-8k',
 
-    'rd-0,wr-100,seq,blk-128k,jobs-16',
-    'rd-0,wr-100,seq,blk-8k,jobs-64',
+   'rd-0,wr-100,rand,blk-128k',
+   'rd-0,wr-100,rand,blk-8k',
 
-    'rd-100,wr-0,rand,blk-128k,jobs-16',
-    'rd-100,wr-0,rand,blk-8k,jobs-64',
+   'rd-100,wr-0,seq,blk-128k',
+   'rd-100,wr-0,seq,blk-8k',
 
-    'rd-100,wr-0,seq,blk-128k,jobs-16',
-    'rd-100,wr-0,seq,blk-8k,jobs-64',
+   'rd-100,wr-0,rand,blk-128k',
+   'rd-100,wr-0,rand,blk-8k',
 
-    'rd-75,wr-25,rand,blk-128k,jobs-16',
-    'rd-75,wr-25,rand,blk-8k,jobs-64',
+   'rd-75,wr-25,rand,blk-128k',
+   'rd-75,wr-25,rand,blk-8k',
 ]
 if 'TEST_FILESYSTEM' in os.environ and os.environ['TEST_FILESYSTEM'] =='zfs':
     tests.append('post-test-zfs-cleanup')
@@ -57,7 +57,7 @@ if result == 'GOOD':
         #
         #  Legacy fio tests for large host testing
         #
-        media_types = [ 'ramdisk', 'dataset' ]
+        media_types = [ 'dataset', 'ramdisk' ]
         #
         # Spec states that config1 should not run ramdisk tests
         #
@@ -68,6 +68,7 @@ if result == 'GOOD':
         #  Media is 'ramdisk' (/dev/shm) or 'dataset' (normally a raid device)
         #
         for media_type in media_types:
+            results = []
             for test in tests:
                 results += job.run_test_detail('ubuntu_performance_fio', test_name=test, tag='ubuntu-performance-fio-' + media_type + '-' + test, media=media_type, timeout=120*60)
 else:
diff --git a/ubuntu_performance_fio/rd-75,wr-25,rand,blk-128k,jobs-16.fio b/ubuntu_performance_fio/rd-75,wr-25,rand,blk-128k,jobs-16.fio
 deleted file mode 100644
index 2687072..0000000
--- a/ubuntu_performance_fio/rd-75,wr-25,rand,blk-128k,jobs-16.fio
+++ /dev/null
@@ -1,24 +0,0 @@
-[global]
-ioengine=sync
-thread=1
-norandommap=1
-allrandrepeat=1
-clocksource=cpu
-size=32768M
-ramp_time=30
-disable_lat=0
-direct=1
-overwrite=1
-directory=DIRECTORY
-time_based
-runtime=60
-group_reporting
-unlink=1
-[rd-75,wr-25,rand,blk-128k,jobs-16-rd-12]
-bs=128K
-rw=randread
-numjobs=12
-[rd-75,wr-25,rand,blk-128k,jobs-16-wr-4]
-bs=128K
-rw=randwrite
-numjobs=4
diff --git a/ubuntu_performance_fio/rd-75,wr-25,rand,blk-8k,jobs-64.fio b/ubuntu_performance_fio/rd-75,wr-25,rand,blk-8k,jobs-64.fio
 deleted file mode 100644
index 71a3227..0000000
--- a/ubuntu_performance_fio/rd-75,wr-25,rand,blk-8k,jobs-64.fio
+++ /dev/null
@@ -1,24 +0,0 @@
-[global]
-ioengine=sync
-thread=1
-norandommap=1
-allrandrepeat=1
-clocksource=cpu
-size=8192M
-ramp_time=30
-disable_lat=0
-direct=1
-overwrite=1
-directory=DIRECTORY
-time_based
-runtime=60
-group_reporting
-unlink=1
-[rd-75,wr-25,rand,blk-8k,jobs-64-rd-48]
-bs=8K
-rw=randread
-numjobs=48
-[rd-75,wr-25,rand,blk-8k,jobs-64-wr-16]
-bs=8K
-rw=randwrite
-numjobs=16
diff --git a/ubuntu_performance_fio/ubuntu_performance_fio.py b/ubuntu_performance_fio/ubuntu_performance_fio.py
index 0efdcd4..f80c0ed 100644
--- a/ubuntu_performance_fio/ubuntu_performance_fio.py
+++ b/ubuntu_performance_fio/ubuntu_performance_fio.py
@@ -43,6 +43,9 @@ class ubuntu_performance_fio(test.test):
         "logrotate.timer",
         "motd-news.timer",
         "man-db.timer",
+        "multipathd",
+        "snapd",
+        "unattended-upgrades"
     ]
     systemctl = "systemctl"
 
@@ -246,13 +249,32 @@ class ubuntu_performance_fio(test.test):
 
     def mk_ramdisk(self, ramdisk_bytes, mount_point):
         #print("ramfs device size: %.2f MB" % (float(ramdisk_bytes) / (1024.0 * 1024.0)))
-        cmd = 'mount -t ramfs none %s -o maxsize=%d' % (mount_point, ramdisk_bytes)
+        platform = self.get_platform()
+        if platform == 'DGX2':
+            cmd = 'mount -t tmpfs -o size=756G,mpol=bind:0 tmpfs %s ' % (mount_point)
+        elif platform == 'DGXA100':
+            cmd = 'mount -t tmpfs -o size=1000G,mpol=interleave:0-7 tmpfs %s ' % (mount_point)
+        elif platform == 'DGXH100':
+            cmd = 'mount -t tmpfs -o size=1000G,mpol=bind:0 tmpfs %s ' % (mount_point)
+        else:
+            cmd = 'mount -t ramfs none %s -o maxsize=%d' % (mount_point, ramdisk_bytes)
         utils.system_output(cmd, retain_output=True)
 
     def rm_ramdisk(self, mount_point):
         cmd = 'umount %s' % mount_point
         utils.system_output(cmd, retain_output=True)
 
+    def get_platform(self):
+        bpn = utils.system_output('dmidecode -s baseboard-product-name | head -1', retain_output=True)
+        if bpn == 'NVIDIA DGX-2':
+            return 'DGX2'
+        elif bpn == 'DGXA100':
+            return 'DGXA100'
+        elif bpn == 'DGXH100':
+            return 'DGXH100'
+        else:
+            return 'Generic'
+
     def run_fio(self, testname, ramdisk_bytes, media):
         kb_scale = {
             "KiB":  1024.0 / 1000.0,
@@ -276,17 +298,25 @@ class ubuntu_performance_fio(test.test):
         #  Edit various fio configs to use dynamic settings
         #  relevant to this test location and test size
         #
-        test_dir = os.path.join(self.srcdir, 'fio-test')
+        platform = self.get_platform()
+        print(platform)
+        if platform is not "Generic":
+            test_dir = os.path.join('/raid', 'fio-test')
+        else:
+            test_dir = os.path.join(self.srcdir, 'fio-test')
         if os.path.isdir(test_dir):
             shutil.rmtree(test_dir)
         os.mkdir(test_dir)
         if media == 'ramdisk':
             self.mk_ramdisk(ramdisk_bytes, test_dir)
 
+        shutil.copyfile(os.path.join(self.bindir, platform, media, "global-include.fio"), os.path.join(self.srcdir, "global-include.fio"))
+
         file = testname + ".fio"
-        fin = open(os.path.join(self.bindir, file), "r")
+        fin = open(os.path.join(self.bindir, platform, media, file), "r")
         fout = open(os.path.join(self.srcdir, file), "w")
 
+        values = {}
         for line in fin:
             if TEST_FILESYSTEM == None or TEST_DRIVE_DEV == None:
                 line = line.replace("DIRECTORY", test_dir)
@@ -294,6 +324,8 @@ class ubuntu_performance_fio(test.test):
                 line = line.replace("DIRECTORY", TEST_MNT)
             if line.startswith("size="):
                 file_size_mb = line.split("size=", 1)[1].rstrip('\n')
+            if line.startswith("[") and line.rstrip('\n').endswith("]") and not line.startswith("[global]"):
+                values['testname'] = line.rstrip('\n').strip('[]')
             #
             #  zfs and ramdisk can't do O_DIRECT, so skip this
             #
@@ -308,6 +340,13 @@ class ubuntu_performance_fio(test.test):
         self.drop_cache()
         self.fio_clean_files(testname)
 
+        #if DGXA100 run fstrim
+        if platform == 'DGXA100' or platform == 'DGXH100':
+            if media == 'dataset':
+                print("Run fstrim")
+                cmd = "fstrim " + test_dir
+                results = utils.system_output(cmd, retain_output=True)
+
         #
         #  Run fio
         #
@@ -329,6 +368,10 @@ class ubuntu_performance_fio(test.test):
             for s in l.split():
                 if s.startswith("BW="):
                     bw = float(re.findall(r"[-+]?\d*\.*\d+", s)[0])
+                    if "read: " in l:
+                        values['rd_bandwidth_per_sec'] = bw
+                    if "write: " in l:
+                        values['wr_bandwidth_per_sec'] = bw
                     for sc in kb_scale:
                         if sc in s:
                             bw = bw * kb_scale[sc]
@@ -346,7 +389,6 @@ class ubuntu_performance_fio(test.test):
 
         testname = testname.replace("-","_")
 
-        values = {}
         values['file_size_mb'] = file_size_mb
         values['bandwidth_kb_per_sec'] = bw
         values['latency_usec_average'] = avg
@@ -370,6 +412,10 @@ class ubuntu_performance_fio(test.test):
             print("Test %d of %d:" % (i + 1, test_iterations))
             values[i] = self.run_fio(testname, ramdisk_bytes, media)
             print("fio_%s%s_%s_file_size_mb[%d] %s" % (media, config, testname, i, values[i]['file_size_mb']))
+            if 'rd_bandwidth_per_sec' in values[i] and 'testname' in values[i]:
+                print("fio_%s%s_%s,rd_bandwidth_per_sec[%d] %.2f" % (media, config, values[i]['testname'], i, values[i]['rd_bandwidth_per_sec']))
+            if 'wr_bandwidth_per_sec' in values[i] and 'testname' in values[i]:
+                print("fio_%s%s_%s,wr_bandwidth_per_sec[%d] %.2f" % (media, config, values[i]['testname'], i, values[i]['wr_bandwidth_per_sec']))
             print("fio_%s%s_%s_bandwidth_kb_per_sec[%d] %.2f" % (media, config, testname, i, values[i]['bandwidth_kb_per_sec']))
             print("fio_%s%s_%s_latency_usec_average[%d] %.2f" % (media, config, testname, i, values[i]['latency_usec_average']))
             print("fio_%s%s_%s_latency_stddev[%d] %.2f" % (media, config, testname, i, values[i]['latency_stddev']))