Skip to content

Commit

Permalink
Results from self hosted Github actions - NVIDIARTX4090
Browse files Browse the repository at this point in the history
  • Loading branch information
@arjunsuresh
arjunsuresh committed Feb 12, 2025
1 parent e03c3ec commit 2a3ad98
Show file tree
Hide file tree
Showing 27 changed files with 676 additions and 676 deletions.
2 changes: 1 addition & 1 deletion open/MLCommons/measurements/arjun_spr-nvidia-gpu-TensorRT-scc24-base/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
|---------------------|------------|-----------------------|--------------|-------------------|
| stable-diffusion-xl | offline | (16.66382, 231.92373) | 1.315 | - |
| stable-diffusion-xl | offline | (16.81226, 232.55426) | 1.318 | - |
8 changes: 4 additions & 4 deletions .../arjun_spr-nvidia-gpu-TensorRT-scc24-base/stable-diffusion-xl/offline/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ pip install -U mlcflow

mlc rm cache -f

mlc pull repo mlcommons@mlperf-automations --checkout=9c07f8da01cb1d1a3f10fd8946ada3888356f5fe
mlc pull repo mlcommons@mlperf-automations --checkout=4be38a9703985e7e5949a74effeeda6b2b8910f3


```
Expand All @@ -38,8 +38,8 @@ Platform: arjun_spr-nvidia-gpu-TensorRT-scc24-base
Model Precision: int8

### Accuracy Results
`CLIP_SCORE`: `16.66382`, Required accuracy for closed division `>= 31.68632` and `<= 31.81332`
`FID_SCORE`: `231.92373`, Required accuracy for closed division `>= 23.01086` and `<= 23.95008`
`CLIP_SCORE`: `16.81226`, Required accuracy for closed division `>= 31.68632` and `<= 31.81332`
`FID_SCORE`: `232.55426`, Required accuracy for closed division `>= 23.01086` and `<= 23.95008`

### Performance Results
`Samples per second`: `1.31547`
`Samples per second`: `1.31839`
70 changes: 35 additions & 35 deletions ...arjun_spr-nvidia-gpu-TensorRT-scc24-base/stable-diffusion-xl/offline/accuracy_console.out
View file

Large diffs are not rendered by default.

238 changes: 119 additions & 119 deletions ...rements/arjun_spr-nvidia-gpu-TensorRT-scc24-base/stable-diffusion-xl/offline/mlc-deps.mmd
View file

Large diffs are not rendered by default.

Binary file modified ...jun_spr-nvidia-gpu-TensorRT-scc24-base/stable-diffusion-xl/offline/mlc-deps.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
254 changes: 127 additions & 127 deletions ...rjun_spr-nvidia-gpu-TensorRT-scc24-base/stable-diffusion-xl/offline/mlc-version-info.json
View file

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion ...rements/arjun_spr-nvidia-gpu-TensorRT-scc24-base/stable-diffusion-xl/offline/os_info.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -26,5 +26,5 @@
],
"MLC_HOST_PLATFORM_FLAVOR": "x86_64",
"MLC_HOST_PYTHON_BITS": "64",
"MLC_HOST_SYSTEM_NAME": "db261924bc3f"
"MLC_HOST_SYSTEM_NAME": "f2f806c1ee51"
}
70 changes: 35 additions & 35 deletions ...un_spr-nvidia-gpu-TensorRT-scc24-base/stable-diffusion-xl/offline/performance_console.out
View file

Large diffs are not rendered by default.

124 changes: 62 additions & 62 deletions ...ents/arjun_spr-nvidia-gpu-TensorRT-scc24-base/stable-diffusion-xl/offline/system_info.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,10 @@ Platform Details

------------------------------------------------------------
1. uname -a
Linux db261924bc3f 6.8.0-52-generic #53-Ubuntu SMP PREEMPT_DYNAMIC Sat Jan 11 00:06:25 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Linux f2f806c1ee51 6.8.0-52-generic #53-Ubuntu SMP PREEMPT_DYNAMIC Sat Jan 11 00:06:25 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
------------------------------------------------------------
2. w
12:29:13 up 9 days, 9:25, 0 users, load average: 1.02, 1.05, 1.42
03:45:18 up 11 days, 42 min, 0 users, load average: 1.48, 1.43, 1.45
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
------------------------------------------------------------
3. Username
Expand Down Expand Up @@ -40,7 +40,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 4000.000
cpu MHz : 861.354
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -68,7 +68,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 3984.251
cpu MHz : 3521.959
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -124,7 +124,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 800.092
cpu MHz : 1097.447
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -152,7 +152,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 800.000
cpu MHz : 3384.684
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -208,7 +208,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 800.000
cpu MHz : 3734.965
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -236,7 +236,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 800.000
cpu MHz : 800.205
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -404,7 +404,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 3385.087
cpu MHz : 3486.268
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -432,7 +432,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 900.000
cpu MHz : 3615.517
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -460,7 +460,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 798.701
cpu MHz : 800.000
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -488,7 +488,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 800.000
cpu MHz : 797.283
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -516,7 +516,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 800.000
cpu MHz : 1113.134
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -600,7 +600,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 1200.000
cpu MHz : 1194.230
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -628,7 +628,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 800.000
cpu MHz : 800.432
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -656,7 +656,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 1600.000
cpu MHz : 800.020
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -1076,7 +1076,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 800.000
cpu MHz : 1100.000
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -1104,7 +1104,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 1353.550
cpu MHz : 800.000
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -1160,7 +1160,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 801.423
cpu MHz : 800.000
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -1188,7 +1188,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 803.380
cpu MHz : 800.000
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -1216,7 +1216,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 800.000
cpu MHz : 801.128
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -1244,7 +1244,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 1091.515
cpu MHz : 798.686
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -1356,7 +1356,7 @@ model : 143
model name : Intel(R) Xeon(R) w7-2495X
stepping : 8
microcode : 0x2b000603
cpu MHz : 2782.051
cpu MHz : 800.000
cache size : 46080 KB
physical id : 0
siblings : 48
Expand Down Expand Up @@ -1394,7 +1394,7 @@ CPU family: 6
Model: 143
Model name: Intel(R) Xeon(R) w7-2495X
Stepping: 8
CPU MHz: 4001.850
CPU MHz: 801.226
CPU max MHz: 4800.0000
CPU min MHz: 800.0000
BogoMIPS: 4992.00
Expand Down Expand Up @@ -1424,49 +1424,49 @@ Flags: fpu vme de pse tsc msr pae mce cx8 apic se
available: 1 nodes (0)
node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47
node 0 size: 192709 MB
node 0 free: 85798 MB
node 0 free: 85158 MB
node distances:
node 0
0: 10
------------------------------------------------------------
9. /proc/meminfo
MemTotal: 197334528 kB
MemFree: 87865400 kB
MemAvailable: 192569420 kB
Buffers: 164688 kB
Cached: 105295016 kB
SwapCached: 29332 kB
Active: 41364912 kB
Inactive: 64481764 kB
Active(anon): 250524 kB
Inactive(anon): 180036 kB
Active(file): 41114388 kB
Inactive(file): 64301728 kB
MemFree: 87202128 kB
MemAvailable: 192161248 kB
Buffers: 122816 kB
Cached: 105207748 kB
SwapCached: 33500 kB
Active: 54070596 kB
Inactive: 51635488 kB
Active(anon): 311276 kB
Inactive(anon): 105808 kB
Active(file): 53759320 kB
Inactive(file): 51529680 kB
Unevictable: 6160 kB
Mlocked: 0 kB
SwapTotal: 8388604 kB
SwapFree: 8043004 kB
SwapFree: 8038324 kB
Zswap: 0 kB
Zswapped: 0 kB
Dirty: 2627768 kB
Writeback: 0 kB
AnonPages: 383484 kB
Mapped: 318876 kB
Shmem: 43576 kB
KReclaimable: 1150308 kB
Slab: 1792908 kB
SReclaimable: 1150308 kB
SUnreclaim: 642600 kB
KernelStack: 17184 kB
PageTables: 20280 kB
Dirty: 3041304 kB
Writeback: 4 kB
AnonPages: 365984 kB
Mapped: 297596 kB
Shmem: 41540 kB
KReclaimable: 1442412 kB
Slab: 2113832 kB
SReclaimable: 1442412 kB
SUnreclaim: 671420 kB
KernelStack: 16864 kB
PageTables: 19160 kB
SecPageTables: 0 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 107055868 kB
Committed_AS: 5076400 kB
Committed_AS: 4986004 kB
VmallocTotal: 13743895347199 kB
VmallocUsed: 152288 kB
VmallocUsed: 151872 kB
VmallocChunk: 0 kB
Percpu: 106944 kB
HardwareCorrupted: 56 kB
Expand All @@ -1482,9 +1482,9 @@ HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 0 kB
DirectMap4k: 28276324 kB
DirectMap2M: 128489472 kB
DirectMap1G: 46137344 kB
DirectMap4k: 36185700 kB
DirectMap2M: 136308736 kB
DirectMap1G: 30408704 kB
------------------------------------------------------------
10. who -r
------------------------------------------------------------
Expand Down Expand Up @@ -1577,16 +1577,16 @@ dev.tty.ldisc_autoload = 1
dev.tty.legacy_tiocsti = 0
fs.aio-max-nr = 65536
fs.aio-nr = 0
fs.dentry-state = 478798 407309 45 0 247593 0
fs.dentry-state = 801361 728452 45 0 399589 0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 43912503
fs.fanotify.max_queued_events = 16384
fs.fanotify.max_user_groups = 128
fs.fanotify.max_user_marks = 1048576
fs.file-max = 9223372036854775807
fs.file-nr = 6752 0 9223372036854775807
fs.inode-nr = 235676 18403
fs.inode-state = 235676 18403 0 0 0 0 0
fs.file-nr = 6176 0 9223372036854775807
fs.inode-nr = 414632 13994
fs.inode-state = 414632 13994 0 0 0 0 0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 128
fs.inotify.max_user_watches = 65536
Expand Down Expand Up @@ -1614,7 +1614,7 @@ fs.quota.drops = 0
fs.quota.free_dquots = 0
fs.quota.lookups = 0
fs.quota.reads = 0
fs.quota.syncs = 582
fs.quota.syncs = 704
fs.quota.writes = 0
fs.suid_dumpable = 2
fs.verity.require_signatures = 0
Expand All @@ -1641,7 +1641,7 @@ kernel.ftrace_dump_on_oops = 0
kernel.ftrace_enabled = 1
kernel.hardlockup_all_cpu_backtrace = 0
kernel.hardlockup_panic = 0
kernel.hostname = db261924bc3f
kernel.hostname = f2f806c1ee51
kernel.hotplug =
kernel.hung_task_all_cpu_backtrace = 0
kernel.hung_task_check_count = 4194304
Expand Down Expand Up @@ -1673,7 +1673,7 @@ kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.nmi_watchdog = 1
kernel.ns_last_pid = 11516
kernel.ns_last_pid = 11518
kernel.numa_balancing = 0
kernel.numa_balancing_promote_rate_limit_MBps = 65536
kernel.oops_all_cpu_backtrace = 0
Expand Down Expand Up @@ -1704,13 +1704,13 @@ kernel.printk_devkmsg = on
kernel.printk_ratelimit = 5
kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 3
kernel.pty.nr = 2
kernel.pty.reserve = 1024
kernel.random.boot_id = 266aa90c-a7a3-400b-90af-2740886ad693
kernel.random.entropy_avail = 256
kernel.random.poolsize = 256
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = ac37e85b-2d60-4821-b08b-0e27bf7ab1cc
kernel.random.uuid = 85330ef5-2f79-4c59-964e-61991b76b380
kernel.random.write_wakeup_threshold = 256
kernel.randomize_va_space = 2
kernel.real-root-dev = 0
Expand Down
Loading

0 comments on commit 2a3ad98

Please sign in to comment.