Skip to content

Commit

Permalink
Merge pull request #21 from GATEOverflow/master
Browse files Browse the repository at this point in the history
Merge from master
  • Loading branch information
arjunsuresh authored Sep 3, 2024
2 parents 4940585 + 99285f6 commit 9dbd46f
Show file tree
Hide file tree
Showing 15 changed files with 384 additions and 218 deletions.
124 changes: 0 additions & 124 deletions docs/benchmarks/index.md

This file was deleted.

9 changes: 1 addition & 8 deletions docs/benchmarks/language/bert.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,34 +8,27 @@ hide:
=== "MLCommons-Python"
## MLPerf Reference Implementation in Python

BERT-99
{{ mlperf_inference_implementation_readme (4, "bert-99", "reference") }}

BERT-99.9
{{ mlperf_inference_implementation_readme (4, "bert-99.9", "reference") }}

=== "Nvidia"
## Nvidia MLPerf Implementation

BERT-99
{{ mlperf_inference_implementation_readme (4, "bert-99", "nvidia") }}

BERT-99.9
{{ mlperf_inference_implementation_readme (4, "bert-99.9", "nvidia") }}

=== "Intel"
## Intel MLPerf Implementation
BERT-99

{{ mlperf_inference_implementation_readme (4, "bert-99", "intel") }}

BERT-99.9
{{ mlperf_inference_implementation_readme (4, "bert-99.9", "intel") }}

=== "Qualcomm"
## Qualcomm AI100 MLPerf Implementation

BERT-99
{{ mlperf_inference_implementation_readme (4, "bert-99", "qualcomm") }}

BERT-99.9
{{ mlperf_inference_implementation_readme (4, "bert-99.9", "qualcomm") }}
4 changes: 4 additions & 0 deletions docs/benchmarks/language/get-llama2-70b-data.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,4 +28,8 @@ Get the Official MLPerf LLAMA2-70b Model
```
cm run script --tags=get,ml-model,llama2-70b,_pytorch -j
```

!!! tip

Downloading llama2-70B model from Hugging Face will prompt you to enter the Hugging Face username and password. Please note that the password required is the [**access token**](https://huggingface.co/settings/tokens) generated for your account. Additionally, ensure that your account has access to the [llama2-70B](https://huggingface.co/meta-llama/Llama-2-70b-chat-hf) model.

8 changes: 1 addition & 7 deletions docs/benchmarks/language/gpt-j.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,37 +8,31 @@ hide:

=== "MLCommons-Python"
## MLPerf Reference Implementation in Python

GPT-J-99


{{ mlperf_inference_implementation_readme (4, "gptj-99", "reference") }}

GPTJ-99.9

{{ mlperf_inference_implementation_readme (4, "gptj-99.9", "reference") }}

=== "Nvidia"
## Nvidia MLPerf Implementation

GPTJ-99

{{ mlperf_inference_implementation_readme (4, "gptj-99", "nvidia") }}

GPTJ-99.9

{{ mlperf_inference_implementation_readme (4, "gptj-99.9", "nvidia") }}

=== "Intel"
## Intel MLPerf Implementation
GPTJ-99

{{ mlperf_inference_implementation_readme (4, "gptj-99", "intel") }}


=== "Qualcomm"
## Qualcomm AI100 MLPerf Implementation

GPTJ-99

{{ mlperf_inference_implementation_readme (4, "gptj-99", "qualcomm") }}

6 changes: 0 additions & 6 deletions docs/benchmarks/language/llama2-70b.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,26 +9,20 @@ hide:
=== "MLCommons-Python"
## MLPerf Reference Implementation in Python

LLAMA2-70b-99
{{ mlperf_inference_implementation_readme (4, "llama2-70b-99", "reference") }}

LLAMA2-70b-99.9
{{ mlperf_inference_implementation_readme (4, "llama2-70b-99.9", "reference") }}

=== "Nvidia"
## Nvidia MLPerf Implementation

LLAMA2-70b-99
{{ mlperf_inference_implementation_readme (4, "llama2-70b-99", "nvidia") }}

LLAMA2-70b-99.9
{{ mlperf_inference_implementation_readme (4, "llama2-70b-99.9", "nvidia") }}

=== "Neural Magic"
## Neural Magic MLPerf Implementation

LLAMA2-70b-99
{{ mlperf_inference_implementation_readme (4, "llama2-70b-99", "neuralmagic") }}

LLAMA2-70b-99.9
{{ mlperf_inference_implementation_readme (4, "llama2-70b-99.9", "neuralmagic") }}
1 change: 0 additions & 1 deletion docs/benchmarks/language/mixtral-8x7b.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,4 @@ hide:
=== "MLCommons-Python"
## MLPerf Reference Implementation in Python

MIXTRAL-8x7b
{{ mlperf_inference_implementation_readme (4, "mixtral-8x7b", "reference") }}
6 changes: 0 additions & 6 deletions docs/benchmarks/medical_imaging/3d-unet.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,30 +9,24 @@ hide:
=== "MLCommons-Python"
## MLPerf Reference Implementation in Python

3d-unet-99

{{ mlperf_inference_implementation_readme (4, "3d-unet-99", "reference") }}

3d-unet-99.9

{{ mlperf_inference_implementation_readme (4, "3d-unet-99.9", "reference") }}

=== "Nvidia"
## Nvidia MLPerf Implementation
3d-unet-99

{{ mlperf_inference_implementation_readme (4, "3d-unet-99", "nvidia") }}

3d-unet-99.9

{{ mlperf_inference_implementation_readme (4, "3d-unet-99.9", "nvidia") }}

=== "Intel"
## Intel MLPerf Implementation
3d-unet-99

{{ mlperf_inference_implementation_readme (4, "3d-unet-99", "intel") }}

3d-unet-99.9

{{ mlperf_inference_implementation_readme (4, "3d-unet-99.9", "intel") }}
9 changes: 7 additions & 2 deletions docs/benchmarks/medical_imaging/get-3d-unet-data.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,9 +12,14 @@ The benchmark implementation run command will automatically download the validat
=== "Validation"
3d-unet validation run uses the KiTS19 dataset performing [KiTS 2019](https://kits19.grand-challenge.org/) kidney tumor segmentation task

### Get Validation Dataset
### Get Validation Dataset(Original)
```
cm run script --tags=get,dataset,kits19,validation -j
cm run script --tags=get,dataset,kits19,_validation -j
```

### Get Validation Dataset(Preprocessed)
```
cm run script --tags=get,dataset,kits19,preprocessed -j
```

## Model
Expand Down
8 changes: 1 addition & 7 deletions docs/benchmarks/recommendation/dlrm-v2.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,26 +10,20 @@ hide:
=== "MLCommons-Python"
## MLPerf Reference Implementation in Python

DLRM-v2-99
{{ mlperf_inference_implementation_readme (4, "dlrm-v2-99", "reference") }}

DLRM-v2-99.9
{{ mlperf_inference_implementation_readme (4, "dlrm-v2-99.9", "reference") }}

=== "Nvidia"
## Nvidia MLPerf Implementation

DLRM-v2-99

{{ mlperf_inference_implementation_readme (4, "dlrm-v2-99", "nvidia") }}

DLRM-v2-99.9
{{ mlperf_inference_implementation_readme (4, "dlrm-v2-99.9", "nvidia") }}

=== "Intel"
## Intel MLPerf Implementation

DLRM-v2-99
{{ mlperf_inference_implementation_readme (4, "dlrm-v2-99", "intel") }}

DLRM-v2-99.9
{{ mlperf_inference_implementation_readme (4, "dlrm-v2-99.9", "intel") }}
1 change: 0 additions & 1 deletion docs/index.md

This file was deleted.

Loading

0 comments on commit 9dbd46f

Please sign in to comment.