Skip to content

Commit b7b5576

Browse files
committed
version 1.0.17
1 parent c082b72 commit b7b5576

File tree

52 files changed

+4527
-3295
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

52 files changed

+4527
-3295
lines changed

NBSETUP.md

+2
Original file line numberDiff line numberDiff line change
@@ -102,3 +102,5 @@ pip install azureml-sdk[explain]
102102
# install the core SDK and experimental components
103103
pip install azureml-sdk[contrib]
104104
```
105+
Drag and Drop
106+
The image will be downloaded by Fatkun

README.md

+9-12
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,6 @@
11
# Azure Machine Learning service example notebooks
22

3-
This repository contains example notebooks demonstrating the [Azure Machine Learning](https://azure.microsoft.com/en-us/services/machine-learning-service/) Python SDK
4-
which allows you to build, train, deploy and manage machine learning solutions using Azure. The AML SDK
5-
allows you the choice of using local or cloud compute resources, while managing
6-
and maintaining the complete data science workflow from the cloud.
3+
This repository contains example notebooks demonstrating the [Azure Machine Learning](https://azure.microsoft.com/en-us/services/machine-learning-service/) Python SDK which allows you to build, train, deploy and manage machine learning solutions using Azure. The AML SDK allows you the choice of using local or cloud compute resources, while managing and maintaining the complete data science workflow from the cloud.
74

85
![Azure ML workflow](https://raw.githubusercontent.com/MicrosoftDocs/azure-docs/master/articles/machine-learning/service/media/overview-what-is-azure-ml/aml.png)
96

@@ -18,16 +15,17 @@ You should always run the [Configuration](./configuration.ipynb) notebook first
1815

1916
If you want to...
2017

21-
* ...try out and explore Azure ML, start with image classification tutorials [part 1 training](./tutorials/img-classification-part1-training.ipynb) and [part 2 deployment](./tutorials/img-classification-part2-deploy.ipynb).
18+
* ...try out and explore Azure ML, start with image classification tutorials: [Part 1 (Training)](./tutorials/img-classification-part1-training.ipynb) and [Part 2 (Deployment)](./tutorials/img-classification-part2-deploy.ipynb).
19+
* ...prepare your data and do automated machine learning, start with regression tutorials: [Part 1 (Data Prep)](./tutorials/regression-part1-data-prep.ipynb) and [Part 2 (Automated ML)](./tutorials/regression-part2-automated-ml.ipynb).
2220
* ...learn about experimentation and tracking run history, first [train within Notebook](./how-to-use-azureml/training/train-within-notebook/train-within-notebook.ipynb), then try [training on remote VM](./how-to-use-azureml/training/train-on-remote-vm/train-on-remote-vm.ipynb) and [using logging APIs](./how-to-use-azureml/training/logging-api/logging-api.ipynb).
2321
* ...train deep learning models at scale, first learn about [Machine Learning Compute](./how-to-use-azureml/training/train-on-amlcompute/train-on-amlcompute.ipynb), and then try [distributed hyperparameter tuning](./how-to-use-azureml/training-with-deep-learning/train-hyperparameter-tune-deploy-with-pytorch/train-hyperparameter-tune-deploy-with-pytorch.ipynb) and [distributed training](./how-to-use-azureml/training-with-deep-learning/distributed-pytorch-with-horovod/distributed-pytorch-with-horovod.ipynb).
24-
* ...deploy model as realtime scoring service, first learn the basics by [training within Notebook and deploying to Azure Container Instance](./how-to-use-azureml/training/train-within-notebook/train-within-notebook.ipynb), then learn how to [register and manage models, and create Docker images](./how-to-use-azureml/deployment/register-model-create-image-deploy-service/register-model-create-image-deploy-service.ipynb), and [production deploy models on Azure Kubernetes Cluster](./how-to-use-azureml/deployment/production-deploy-to-aks/production-deploy-to-aks.ipynb).
25-
* ...deploy models as batch scoring service, first [train a model within Notebook](./how-to-use-azureml/training/train-within-notebook/train-within-notebook.ipynb), learn how to [register and manage models](./how-to-use-azureml/deployment/register-model-create-image-deploy-service/register-model-create-image-deploy-service.ipynb), then [create Machine Learning Compute for scoring compute](./how-to-use-azureml/training/train-on-amlcompute/train-on-amlcompute.ipynb), and [use Machine Learning Pipelines to deploy your model](./how-to-use-azureml/machine-learning-pipelines/pipeline-batch-scoring/pipeline-batch-scoring.ipynb).
22+
* ...deploy models as a realtime scoring service, first learn the basics by [training within Notebook and deploying to Azure Container Instance](./how-to-use-azureml/training/train-within-notebook/train-within-notebook.ipynb), then learn how to [register and manage models, and create Docker images](./how-to-use-azureml/deployment/register-model-create-image-deploy-service/register-model-create-image-deploy-service.ipynb), and [production deploy models on Azure Kubernetes Cluster](./how-to-use-azureml/deployment/production-deploy-to-aks/production-deploy-to-aks.ipynb).
23+
* ...deploy models as a batch scoring service, first [train a model within Notebook](./how-to-use-azureml/training/train-within-notebook/train-within-notebook.ipynb), learn how to [register and manage models](./how-to-use-azureml/deployment/register-model-create-image-deploy-service/register-model-create-image-deploy-service.ipynb), then [create Machine Learning Compute for scoring compute](./how-to-use-azureml/training/train-on-amlcompute/train-on-amlcompute.ipynb), and [use Machine Learning Pipelines to deploy your model](./how-to-use-azureml/machine-learning-pipelines/pipeline-mpi-batch-prediction.ipynb).
2624
* ...monitor your deployed models, learn about using [App Insights](./how-to-use-azureml/deployment/enable-app-insights-in-production-service/enable-app-insights-in-production-service.ipynb) and [model data collection](./how-to-use-azureml/deployment/enable-data-collection-for-models-in-aks/enable-data-collection-for-models-in-aks.ipynb).
2725

2826
## Tutorials
2927

30-
The [Tutorials](./tutorials) folder contains notebooks for the tutorials described in the [Azure Machine Learning documentation](https://aka.ms/aml-docs)
28+
The [Tutorials](./tutorials) folder contains notebooks for the tutorials described in the [Azure Machine Learning documentation](https://aka.ms/aml-docs).
3129

3230
## How to use Azure ML
3331

@@ -45,9 +43,8 @@ The [How to use Azure ML](./how-to-use-azureml) folder contains specific example
4543
## Documentation
4644

4745
* Quickstarts, end-to-end tutorials, and how-tos on the [official documentation site for Azure Machine Learning service](https://docs.microsoft.com/en-us/azure/machine-learning/service/).
48-
49-
* [Python SDK reference]( https://docs.microsoft.com/en-us/python/api/overview/azure/ml/intro?view=azure-ml-py)
50-
46+
* [Python SDK reference](https://docs.microsoft.com/en-us/python/api/overview/azure/ml/intro?view=azure-ml-py)
47+
* Azure ML Data Prep SDK [overview](https://aka.ms/data-prep-sdk), [Python SDK reference](https://aka.ms/aml-data-prep-apiref), and [tutorials and how-tos](https://aka.ms/aml-data-prep-notebooks).
5148

5249
---
5350

@@ -56,4 +53,4 @@ The [How to use Azure ML](./how-to-use-azureml) folder contains specific example
5653
Visit following repos to see projects contributed by Azure ML users:
5754

5855
- [Fine tune natural language processing models using Azure Machine Learning service](https://github.com/Microsoft/AzureML-BERT)
59-
- [Fashion MNIST with Azure ML SDK](https://github.com/amynic/azureml-sdk-fashion)
56+
- [Fashion MNIST with Azure ML SDK](https://github.com/amynic/azureml-sdk-fashion)

configuration.ipynb

+1-1
Original file line numberDiff line numberDiff line change
@@ -96,7 +96,7 @@
9696
"source": [
9797
"import azureml.core\n",
9898
"\n",
99-
"print(\"This notebook was created using version 1.0.15 of the Azure ML SDK\")\n",
99+
"print(\"This notebook was created using version 1.0.17 of the Azure ML SDK\")\n",
100100
"print(\"You are currently using version\", azureml.core.VERSION, \"of the Azure ML SDK\")"
101101
]
102102
},

how-to-use-azureml/README.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -5,8 +5,8 @@ Learn how to use Azure Machine Learning services for experimentation and model m
55
As a pre-requisite, run the [configuration Notebook](../configuration.ipynb) notebook first to set up your Azure ML Workspace. Then, run the notebooks in following recommended order.
66

77
* [train-within-notebook](./training/train-within-notebook): Train a model hile tracking run history, and learn how to deploy the model as web service to Azure Container Instance.
8-
* [train-on-local](./training/train-on-local): Learn how to submit a run and use Azure ML managed run configuration.
9-
* [train-on-amlcompute](./training/train-on-amlcompute): Use a 1-n node managed compute cluster as a remote compute target for CPU or GPU based training.
8+
* [train-on-local](./training/train-on-local): Learn how to submit a run to local computer and use Azure ML managed run configuration.
9+
* [train-on-amlcompute](./training/train-on-amlcompute): Use a 1-n node Azure ML managed compute cluster for remote runs on Azure CPU or GPU infrastructure.
1010
* [train-on-remote-vm](./training/train-on-remote-vm): Use Data Science Virtual Machine as a target for remote runs.
1111
* [logging-api](./training/logging-api): Learn about the details of logging metrics to run history.
1212
* [register-model-create-image-deploy-service](./deployment/register-model-create-image-deploy-service): Learn about the details of model management.

how-to-use-azureml/automated-machine-learning/README.md

+3
Original file line numberDiff line numberDiff line change
@@ -229,6 +229,9 @@ If a sample notebook fails with an error that property, method or library does n
229229
1) Check that you have selected correct kernel in jupyter notebook. The kernel is displayed in the top right of the notebook page. It can be changed using the `Kernel | Change Kernel` menu option. For Azure Notebooks, it should be `Python 3.6`. For local conda environments, it should be the conda envioronment name that you specified in automl_setup. The default is azure_automl. Note that the kernel is saved as part of the notebook. So, if you switch to a new conda environment, you will have to select the new kernel in the notebook.
230230
2) Check that the notebook is for the SDK version that you are using. You can check the SDK version by executing `azureml.core.VERSION` in a jupyter notebook cell. You can download previous version of the sample notebooks from GitHub by clicking the `Branch` button, selecting the `Tags` tab and then selecting the version.
231231

232+
## Numpy import fails on Windows
233+
Some Windows environments see an error loading numpy with the latest Python version 3.6.8. If you see this issue, try with Python version 3.6.7.
234+
232235
## Remote run: DsvmCompute.create fails
233236
There are several reasons why the DsvmCompute.create can fail. The reason is usually in the error message but you have to look at the end of the error message for the detailed reason. Some common reasons are:
234237
1) `Compute name is invalid, it should start with a letter, be between 2 and 16 character, and only include letters (a-zA-Z), numbers (0-9) and \'-\'.` Note that underscore is not allowed in the name.

how-to-use-azureml/automated-machine-learning/automl_env.yml

+2-1
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ name: azure_automl
22
dependencies:
33
# The python interpreter version.
44
# Currently Azure ML only supports 3.5.2 and later.
5-
- python=3.6
5+
- python>=3.5.2,<3.6.8
66
- nb_conda
77
- matplotlib==2.1.0
88
- numpy>=1.11.0,<1.15.0
@@ -12,6 +12,7 @@ dependencies:
1212
- scikit-learn>=0.18.0,<=0.19.1
1313
- pandas>=0.22.0,<0.23.0
1414
- tensorflow>=1.12.0
15+
- py-xgboost<=0.80
1516

1617
- pip:
1718
# Required packages for AzureML execution, history, and data preparation.

how-to-use-azureml/automated-machine-learning/automl_env_mac.yml

+2-1
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ name: azure_automl
22
dependencies:
33
# The python interpreter version.
44
# Currently Azure ML only supports 3.5.2 and later.
5-
- python=3.6
5+
- python>=3.5.2,<3.6.8
66
- nb_conda
77
- matplotlib==2.1.0
88
- numpy>=1.15.3
@@ -12,6 +12,7 @@ dependencies:
1212
- scikit-learn>=0.18.0,<=0.19.1
1313
- pandas>=0.22.0,<0.23.0
1414
- tensorflow>=1.12.0
15+
- py-xgboost<=0.80
1516

1617
- pip:
1718
# Required packages for AzureML execution, history, and data preparation.

how-to-use-azureml/automated-machine-learning/classification-with-deployment/auto-ml-classification-with-deployment.ipynb

+2-21
Original file line numberDiff line numberDiff line change
@@ -84,9 +84,9 @@
8484
"ws = Workspace.from_config()\n",
8585
"\n",
8686
"# choose a name for experiment\n",
87-
"experiment_name = 'automl-local-classification'\n",
87+
"experiment_name = 'automl-classification-deployment'\n",
8888
"# project folder\n",
89-
"project_folder = './sample_projects/automl-local-classification'\n",
89+
"project_folder = './sample_projects/automl-classification-deployment'\n",
9090
"\n",
9191
"experiment=Experiment(ws, experiment_name)\n",
9292
"\n",
@@ -103,23 +103,6 @@
103103
"outputDf.T"
104104
]
105105
},
106-
{
107-
"cell_type": "markdown",
108-
"metadata": {},
109-
"source": [
110-
"Opt-in diagnostics for better experience, quality, and security of future releases."
111-
]
112-
},
113-
{
114-
"cell_type": "code",
115-
"execution_count": null,
116-
"metadata": {},
117-
"outputs": [],
118-
"source": [
119-
"from azureml.telemetry import set_diagnostics_collection\n",
120-
"set_diagnostics_collection(send_diagnostics = True)"
121-
]
122-
},
123106
{
124107
"cell_type": "markdown",
125108
"metadata": {},
@@ -289,8 +272,6 @@
289272
"metadata": {},
290273
"outputs": [],
291274
"source": [
292-
"experiment_name = 'automl-local-classification'\n",
293-
"\n",
294275
"experiment = Experiment(ws, experiment_name)\n",
295276
"ml_run = AutoMLRun(experiment = experiment, run_id = local_run.id)"
296277
]

how-to-use-azureml/automated-machine-learning/classification-with-whitelisting/auto-ml-classification-with-whitelisting.ipynb

-17
Original file line numberDiff line numberDiff line change
@@ -100,23 +100,6 @@
100100
"outputDf.T"
101101
]
102102
},
103-
{
104-
"cell_type": "markdown",
105-
"metadata": {},
106-
"source": [
107-
"Opt-in diagnostics for better experience, quality, and security of future releases."
108-
]
109-
},
110-
{
111-
"cell_type": "code",
112-
"execution_count": null,
113-
"metadata": {},
114-
"outputs": [],
115-
"source": [
116-
"from azureml.telemetry import set_diagnostics_collection\n",
117-
"set_diagnostics_collection(send_diagnostics = True)"
118-
]
119-
},
120103
{
121104
"cell_type": "markdown",
122105
"metadata": {},

how-to-use-azureml/automated-machine-learning/classification/auto-ml-classification.ipynb

+2-19
Original file line numberDiff line numberDiff line change
@@ -81,8 +81,8 @@
8181
"ws = Workspace.from_config()\n",
8282
"\n",
8383
"# Choose a name for the experiment and specify the project folder.\n",
84-
"experiment_name = 'automl-local-classification'\n",
85-
"project_folder = './sample_projects/automl-local-classification'\n",
84+
"experiment_name = 'automl-classification'\n",
85+
"project_folder = './sample_projects/automl-classification'\n",
8686
"\n",
8787
"experiment = Experiment(ws, experiment_name)\n",
8888
"\n",
@@ -99,23 +99,6 @@
9999
"outputDf.T"
100100
]
101101
},
102-
{
103-
"cell_type": "markdown",
104-
"metadata": {},
105-
"source": [
106-
"Opt-in diagnostics for better experience, quality, and security of future releases."
107-
]
108-
},
109-
{
110-
"cell_type": "code",
111-
"execution_count": null,
112-
"metadata": {},
113-
"outputs": [],
114-
"source": [
115-
"from azureml.telemetry import set_diagnostics_collection\n",
116-
"set_diagnostics_collection(send_diagnostics = True)"
117-
]
118-
},
119102
{
120103
"cell_type": "markdown",
121104
"metadata": {},

how-to-use-azureml/automated-machine-learning/dataprep-remote-execution/auto-ml-dataprep-remote-execution.ipynb

-17
Original file line numberDiff line numberDiff line change
@@ -49,23 +49,6 @@
4949
"Currently, Data Prep only supports __Ubuntu 16__ and __Red Hat Enterprise Linux 7__. We are working on supporting more linux distros."
5050
]
5151
},
52-
{
53-
"cell_type": "markdown",
54-
"metadata": {},
55-
"source": [
56-
"Opt-in diagnostics for better experience, quality, and security of future releases."
57-
]
58-
},
59-
{
60-
"cell_type": "code",
61-
"execution_count": null,
62-
"metadata": {},
63-
"outputs": [],
64-
"source": [
65-
"from azureml.telemetry import set_diagnostics_collection\n",
66-
"set_diagnostics_collection(send_diagnostics = True)"
67-
]
68-
},
6952
{
7053
"cell_type": "markdown",
7154
"metadata": {},

how-to-use-azureml/automated-machine-learning/dataprep/auto-ml-dataprep.ipynb

-17
Original file line numberDiff line numberDiff line change
@@ -49,23 +49,6 @@
4949
"Currently, Data Prep only supports __Ubuntu 16__ and __Red Hat Enterprise Linux 7__. We are working on supporting more linux distros."
5050
]
5151
},
52-
{
53-
"cell_type": "markdown",
54-
"metadata": {},
55-
"source": [
56-
"Opt-in diagnostics for better experience, quality, and security of future releases."
57-
]
58-
},
59-
{
60-
"cell_type": "code",
61-
"execution_count": null,
62-
"metadata": {},
63-
"outputs": [],
64-
"source": [
65-
"from azureml.telemetry import set_diagnostics_collection\n",
66-
"set_diagnostics_collection(send_diagnostics = True)"
67-
]
68-
},
6952
{
7053
"cell_type": "markdown",
7154
"metadata": {},

how-to-use-azureml/automated-machine-learning/exploring-previous-runs/auto-ml-exploring-previous-runs.ipynb

-17
Original file line numberDiff line numberDiff line change
@@ -70,23 +70,6 @@
7070
"ws = Workspace.from_config()"
7171
]
7272
},
73-
{
74-
"cell_type": "markdown",
75-
"metadata": {},
76-
"source": [
77-
"Opt-in diagnostics for better experience, quality, and security of future releases."
78-
]
79-
},
80-
{
81-
"cell_type": "code",
82-
"execution_count": null,
83-
"metadata": {},
84-
"outputs": [],
85-
"source": [
86-
"from azureml.telemetry import set_diagnostics_collection\n",
87-
"set_diagnostics_collection(send_diagnostics = True)"
88-
]
89-
},
9073
{
9174
"cell_type": "markdown",
9275
"metadata": {},

0 commit comments

Comments
 (0)