Skip to content

Commit 44aa636

Browse files
jeff-shepherdjeff-shepherd
committed
2 parents 4678f9a + ea1b759 commit 44aa636

File tree

58 files changed

+4814
-1762
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

58 files changed

+4814
-1762
lines changed

‎Dockerfiles/1.0.21/Dockerfile

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
FROM continuumio/miniconda:4.5.11
2+
3+
# install git
4+
RUN apt-get update && apt-get upgrade -y && apt-get install -y git
5+
6+
# create a new conda environment named azureml
7+
RUN conda create -n azureml -y -q Python=3.6
8+
9+
# install additional packages used by sample notebooks. this is optional
10+
RUN ["/bin/bash", "-c", "source activate azureml && conda install -y tqdm cython matplotlib scikit-learn"]
11+
12+
# install azurmel-sdk components
13+
RUN ["/bin/bash", "-c", "source activate azureml && pip install azureml-sdk[notebooks]==1.0.21"]
14+
15+
# clone Azure ML GitHub sample notebooks
16+
RUN cd /home && git clone -b "azureml-sdk-1.0.21" --single-branch https://github.com/Azure/MachineLearningNotebooks.git
17+
18+
# generate jupyter configuration file
19+
RUN ["/bin/bash", "-c", "source activate azureml && mkdir ~/.jupyter && cd ~/.jupyter && jupyter notebook --generate-config"]
20+
21+
# set an emtpy token for Jupyter to remove authentication.
22+
# this is NOT recommended for production environment
23+
RUN echo "c.NotebookApp.token = ''" >> ~/.jupyter/jupyter_notebook_config.py
24+
25+
# open up port 8887 on the container
26+
EXPOSE 8887
27+
28+
# start Jupyter notebook server on port 8887 when the container starts
29+
CMD /bin/bash -c "cd /home/MachineLearningNotebooks && source activate azureml && jupyter notebook --port 8887 --no-browser --ip 0.0.0.0 --allow-root"

‎configuration.ipynb

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -96,7 +96,7 @@
9696
"source": [
9797
"import azureml.core\n",
9898
"\n",
99-
"print(\"This notebook was created using version 1.0.18 of the Azure ML SDK\")\n",
99+
"print(\"This notebook was created using version 1.0.21 of the Azure ML SDK\")\n",
100100
"print(\"You are currently using version\", azureml.core.VERSION, \"of the Azure ML SDK\")"
101101
]
102102
},
@@ -336,7 +336,7 @@
336336
"\n",
337337
"In this notebook you configured this notebook library to connect easily to an Azure ML workspace. You can copy this notebook to your own libraries to connect them to you workspace, or use it to bootstrap new workspaces completely.\n",
338338
"\n",
339-
"If you came here from another notebook, you can return there and complete that exercise, or you can try out the [Tutorials](./tutorials) or jump into \"how-to\" notebooks and start creating and deploying models. A good place to start is the [train in notebook](./how-to-use-azureml/training/train-in-notebook) example that walks through a simplified but complete end to end machine learning process."
339+
"If you came here from another notebook, you can return there and complete that exercise, or you can try out the [Tutorials](./tutorials) or jump into \"how-to\" notebooks and start creating and deploying models. A good place to start is the [train within notebook](./how-to-use-azureml/training/train-within-notebook) example that walks through a simplified but complete end to end machine learning process."
340340
]
341341
},
342342
{

‎how-to-use-azureml/automated-machine-learning/README.md

Lines changed: 16 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -42,21 +42,7 @@ Below are the three execution environments supported by AutoML.
4242
## Running samples in a Local Conda environment
4343

4444
To run these notebook on your own notebook server, use these installation instructions.
45-
46-
The instructions below will install everything you need and then start a Jupyter notebook. To start your Jupyter notebook manually, use:
47-
48-
```
49-
conda activate azure_automl
50-
jupyter notebook
51-
```
52-
53-
or on Mac:
54-
55-
```
56-
source activate azure_automl
57-
jupyter notebook
58-
```
59-
45+
The instructions below will install everything you need and then start a Jupyter notebook.
6046

6147
### 1. Install mini-conda from [here](https://conda.io/miniconda.html), choose 64-bit Python 3.7 or higher.
6248
- **Note**: if you already have conda installed, you can keep using it but it should be version 4.4.10 or later (as shown by: conda -V). If you have a previous version installed, you can update it using the command: conda update conda.
@@ -97,6 +83,21 @@ bash automl_setup_linux.sh
9783
- Please make sure you use the Python [conda env:azure_automl] kernel when trying the sample Notebooks.
9884
- Follow the instructions in the individual notebooks to explore various features in AutoML
9985

86+
### 6. Starting jupyter notebook manually
87+
To start your Jupyter notebook manually, use:
88+
89+
```
90+
conda activate azure_automl
91+
jupyter notebook
92+
```
93+
94+
or on Mac or Linux:
95+
96+
```
97+
source activate azure_automl
98+
jupyter notebook
99+
```
100+
100101
<a name="samples"></a>
101102
# Automated ML SDK Sample Notebooks
102103

‎how-to-use-azureml/automated-machine-learning/automl_env.yml

Lines changed: 22 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,22 @@
1-
name: azure_automl
2-
dependencies:
3-
# The python interpreter version.
4-
# Currently Azure ML only supports 3.5.2 and later.
5-
- python>=3.5.2,<3.6.8
6-
- nb_conda
7-
- matplotlib==2.1.0
8-
- numpy>=1.11.0,<1.15.0
9-
- cython
10-
- urllib3<1.24
11-
- scipy>=1.0.0,<=1.1.0
12-
- scikit-learn>=0.18.0,<=0.19.1
13-
- pandas>=0.22.0,<0.23.0
14-
- tensorflow>=1.12.0
15-
- py-xgboost<=0.80
16-
17-
- pip:
18-
# Required packages for AzureML execution, history, and data preparation.
19-
- azureml-sdk[automl,explain]
20-
- azureml-widgets
21-
- pandas_ml
22-
1+
name: azure_automl
2+
dependencies:
3+
# The python interpreter version.
4+
# Currently Azure ML only supports 3.5.2 and later.
5+
- python>=3.5.2,<3.6.8
6+
- nb_conda
7+
- matplotlib==2.1.0
8+
- numpy>=1.11.0,<1.15.0
9+
- cython
10+
- urllib3<1.24
11+
- scipy>=1.0.0,<=1.1.0
12+
- scikit-learn>=0.18.0,<=0.19.1
13+
- pandas>=0.22.0,<0.23.0
14+
- tensorflow>=1.12.0
15+
- py-xgboost<=0.80
16+
17+
- pip:
18+
# Required packages for AzureML execution, history, and data preparation.
19+
- azureml-sdk[automl,explain]
20+
- azureml-widgets
21+
- pandas_ml
22+

‎how-to-use-azureml/automated-machine-learning/automl_env_mac.yml

Lines changed: 23 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -1,23 +1,23 @@
1-
name: azure_automl
2-
dependencies:
3-
# The python interpreter version.
4-
# Currently Azure ML only supports 3.5.2 and later.
5-
- python>=3.5.2,<3.6.8
6-
- nb_conda
7-
- matplotlib==2.1.0
8-
- numpy>=1.15.3
9-
- cython
10-
- urllib3<1.24
11-
- scipy>=1.0.0,<=1.1.0
12-
- scikit-learn>=0.18.0,<=0.19.1
13-
- pandas>=0.22.0,<0.23.0
14-
- tensorflow>=1.12.0
15-
- py-xgboost<=0.80
16-
17-
- pip:
18-
# Required packages for AzureML execution, history, and data preparation.
19-
- azureml-sdk[automl,explain]
20-
- azureml-widgets
21-
- pandas_ml
22-
23-
1+
name: azure_automl
2+
dependencies:
3+
# The python interpreter version.
4+
# Currently Azure ML only supports 3.5.2 and later.
5+
- python>=3.5.2,<3.6.8
6+
- nb_conda
7+
- matplotlib==2.1.0
8+
- numpy>=1.15.3
9+
- cython
10+
- urllib3<1.24
11+
- scipy>=1.0.0,<=1.1.0
12+
- scikit-learn>=0.18.0,<=0.19.1
13+
- pandas>=0.22.0,<0.23.0
14+
- tensorflow>=1.12.0
15+
- py-xgboost<=0.80
16+
17+
- pip:
18+
# Required packages for AzureML execution, history, and data preparation.
19+
- azureml-sdk[automl,explain]
20+
- azureml-widgets
21+
- pandas_ml
22+
23+

‎how-to-use-azureml/automated-machine-learning/automl_setup.cmd

Lines changed: 50 additions & 50 deletions
Original file line numberDiff line numberDiff line change
@@ -1,51 +1,51 @@
1-
@echo off
2-
set conda_env_name=%1
3-
set automl_env_file=%2
4-
set options=%3
5-
set PIP_NO_WARN_SCRIPT_LOCATION=0
6-
7-
IF "%conda_env_name%"=="" SET conda_env_name="azure_automl"
8-
IF "%automl_env_file%"=="" SET automl_env_file="automl_env.yml"
9-
10-
IF NOT EXIST %automl_env_file% GOTO YmlMissing
11-
12-
call conda activate %conda_env_name% 2>nul:
13-
14-
if not errorlevel 1 (
15-
echo Upgrading azureml-sdk[automl,notebooks,explain] in existing conda environment %conda_env_name%
16-
call pip install --upgrade azureml-sdk[automl,notebooks,explain]
17-
if errorlevel 1 goto ErrorExit
18-
) else (
19-
call conda env create -f %automl_env_file% -n %conda_env_name%
20-
)
21-
22-
call conda activate %conda_env_name% 2>nul:
23-
if errorlevel 1 goto ErrorExit
24-
25-
call python -m ipykernel install --user --name %conda_env_name% --display-name "Python (%conda_env_name%)"
26-
27-
REM azureml.widgets is now installed as part of the pip install under the conda env.
28-
REM Removing the old user install so that the notebooks will use the latest widget.
29-
call jupyter nbextension uninstall --user --py azureml.widgets
30-
31-
echo.
32-
echo.
33-
echo ***************************************
34-
echo * AutoML setup completed successfully *
35-
echo ***************************************
36-
IF NOT "%options%"=="nolaunch" (
37-
echo.
38-
echo Starting jupyter notebook - please run the configuration notebook
39-
echo.
40-
jupyter notebook --log-level=50 --notebook-dir='..\..'
41-
)
42-
43-
goto End
44-
45-
:YmlMissing
46-
echo File %automl_env_file% not found.
47-
48-
:ErrorExit
49-
echo Install failed
50-
1+
@echo off
2+
set conda_env_name=%1
3+
set automl_env_file=%2
4+
set options=%3
5+
set PIP_NO_WARN_SCRIPT_LOCATION=0
6+
7+
IF "%conda_env_name%"=="" SET conda_env_name="azure_automl"
8+
IF "%automl_env_file%"=="" SET automl_env_file="automl_env.yml"
9+
10+
IF NOT EXIST %automl_env_file% GOTO YmlMissing
11+
12+
call conda activate %conda_env_name% 2>nul:
13+
14+
if not errorlevel 1 (
15+
echo Upgrading azureml-sdk[automl,notebooks,explain] in existing conda environment %conda_env_name%
16+
call pip install --upgrade azureml-sdk[automl,notebooks,explain]
17+
if errorlevel 1 goto ErrorExit
18+
) else (
19+
call conda env create -f %automl_env_file% -n %conda_env_name%
20+
)
21+
22+
call conda activate %conda_env_name% 2>nul:
23+
if errorlevel 1 goto ErrorExit
24+
25+
call python -m ipykernel install --user --name %conda_env_name% --display-name "Python (%conda_env_name%)"
26+
27+
REM azureml.widgets is now installed as part of the pip install under the conda env.
28+
REM Removing the old user install so that the notebooks will use the latest widget.
29+
call jupyter nbextension uninstall --user --py azureml.widgets
30+
31+
echo.
32+
echo.
33+
echo ***************************************
34+
echo * AutoML setup completed successfully *
35+
echo ***************************************
36+
IF NOT "%options%"=="nolaunch" (
37+
echo.
38+
echo Starting jupyter notebook - please run the configuration notebook
39+
echo.
40+
jupyter notebook --log-level=50 --notebook-dir='..\..'
41+
)
42+
43+
goto End
44+
45+
:YmlMissing
46+
echo File %automl_env_file% not found.
47+
48+
:ErrorExit
49+
echo Install failed
50+
5151
:End

‎how-to-use-azureml/automated-machine-learning/automl_setup_linux.sh

Lines changed: 52 additions & 52 deletions
Original file line numberDiff line numberDiff line change
@@ -1,52 +1,52 @@
1-
#!/bin/bash
2-
3-
CONDA_ENV_NAME=$1
4-
AUTOML_ENV_FILE=$2
5-
OPTIONS=$3
6-
PIP_NO_WARN_SCRIPT_LOCATION=0
7-
8-
if [ "$CONDA_ENV_NAME" == "" ]
9-
then
10-
CONDA_ENV_NAME="azure_automl"
11-
fi
12-
13-
if [ "$AUTOML_ENV_FILE" == "" ]
14-
then
15-
AUTOML_ENV_FILE="automl_env.yml"
16-
fi
17-
18-
if [ ! -f $AUTOML_ENV_FILE ]; then
19-
echo "File $AUTOML_ENV_FILE not found"
20-
exit 1
21-
fi
22-
23-
if source activate $CONDA_ENV_NAME 2> /dev/null
24-
then
25-
echo "Upgrading azureml-sdk[automl,notebooks,explain] in existing conda environment" $CONDA_ENV_NAME
26-
pip install --upgrade azureml-sdk[automl,notebooks,explain] &&
27-
jupyter nbextension uninstall --user --py azureml.widgets
28-
else
29-
conda env create -f $AUTOML_ENV_FILE -n $CONDA_ENV_NAME &&
30-
source activate $CONDA_ENV_NAME &&
31-
python -m ipykernel install --user --name $CONDA_ENV_NAME --display-name "Python ($CONDA_ENV_NAME)" &&
32-
jupyter nbextension uninstall --user --py azureml.widgets &&
33-
echo "" &&
34-
echo "" &&
35-
echo "***************************************" &&
36-
echo "* AutoML setup completed successfully *" &&
37-
echo "***************************************" &&
38-
if [ "$OPTIONS" != "nolaunch" ]
39-
then
40-
echo "" &&
41-
echo "Starting jupyter notebook - please run the configuration notebook" &&
42-
echo "" &&
43-
jupyter notebook --log-level=50 --notebook-dir '../..'
44-
fi
45-
fi
46-
47-
if [ $? -gt 0 ]
48-
then
49-
echo "Installation failed"
50-
fi
51-
52-
1+
#!/bin/bash
2+
3+
CONDA_ENV_NAME=$1
4+
AUTOML_ENV_FILE=$2
5+
OPTIONS=$3
6+
PIP_NO_WARN_SCRIPT_LOCATION=0
7+
8+
if [ "$CONDA_ENV_NAME" == "" ]
9+
then
10+
CONDA_ENV_NAME="azure_automl"
11+
fi
12+
13+
if [ "$AUTOML_ENV_FILE" == "" ]
14+
then
15+
AUTOML_ENV_FILE="automl_env.yml"
16+
fi
17+
18+
if [ ! -f $AUTOML_ENV_FILE ]; then
19+
echo "File $AUTOML_ENV_FILE not found"
20+
exit 1
21+
fi
22+
23+
if source activate $CONDA_ENV_NAME 2> /dev/null
24+
then
25+
echo "Upgrading azureml-sdk[automl,notebooks,explain] in existing conda environment" $CONDA_ENV_NAME
26+
pip install --upgrade azureml-sdk[automl,notebooks,explain] &&
27+
jupyter nbextension uninstall --user --py azureml.widgets
28+
else
29+
conda env create -f $AUTOML_ENV_FILE -n $CONDA_ENV_NAME &&
30+
source activate $CONDA_ENV_NAME &&
31+
python -m ipykernel install --user --name $CONDA_ENV_NAME --display-name "Python ($CONDA_ENV_NAME)" &&
32+
jupyter nbextension uninstall --user --py azureml.widgets &&
33+
echo "" &&
34+
echo "" &&
35+
echo "***************************************" &&
36+
echo "* AutoML setup completed successfully *" &&
37+
echo "***************************************" &&
38+
if [ "$OPTIONS" != "nolaunch" ]
39+
then
40+
echo "" &&
41+
echo "Starting jupyter notebook - please run the configuration notebook" &&
42+
echo "" &&
43+
jupyter notebook --log-level=50 --notebook-dir '../..'
44+
fi
45+
fi
46+
47+
if [ $? -gt 0 ]
48+
then
49+
echo "Installation failed"
50+
fi
51+
52+

0 commit comments

Comments
 (0)