|
| 1 | +**Azure HDInsight** |
| 2 | + |
| 3 | +Azure HDInsight is a fully managed cloud Hadoop & Spark offering the gives |
| 4 | +optimized open-source analytic clusters for Spark, Hive, MapReduce, HBase, |
| 5 | +Storm, and Kafka. HDInsight Spark clusters provide kernels that you can use with |
| 6 | +the Jupyter notebook on [Apache Spark](https://spark.apache.org/) for testing |
| 7 | +your applications. |
| 8 | + |
| 9 | +How Azure HDInsight works with Azure Machine Learning service |
| 10 | + |
| 11 | +- You can train a model using Spark clusters and deploy the model to ACI/AKS |
| 12 | + from within Azure HDInsight. |
| 13 | + |
| 14 | +- You can also use [automated machine |
| 15 | + learning](https://docs.microsoft.com/en-us/azure/machine-learning/service/concept-automated-ml) capabilities |
| 16 | + integrated within Azure HDInsight. |
| 17 | + |
| 18 | +You can use Azure HDInsight as a compute target from an [Azure Machine Learning |
| 19 | +pipeline](https://docs.microsoft.com/en-us/azure/machine-learning/service/concept-ml-pipelines). |
| 20 | + |
| 21 | +**Set up your HDInsight cluster** |
| 22 | + |
| 23 | +Create [HDInsight |
| 24 | +cluster](https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters) |
| 25 | + |
| 26 | +**Quick create: Basic cluster setup** |
| 27 | + |
| 28 | +This article walks you through setup in the [Azure |
| 29 | +portal](https://portal.azure.com/), where you can create an HDInsight cluster |
| 30 | +using *Quick create* or *Custom*. |
| 31 | + |
| 32 | + |
| 33 | + |
| 34 | +Follow instructions on the screen to do a basic cluster setup. Details are |
| 35 | +provided below for: |
| 36 | + |
| 37 | +- [Resource group |
| 38 | + name](https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters#resource-group-name) |
| 39 | + |
| 40 | +- [Cluster types and |
| 41 | + configuration](https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters#cluster-types) |
| 42 | + (Cluster must be Spark 2.3 (HDI 3.6) or greater) |
| 43 | + |
| 44 | +- Cluster login and SSH username |
| 45 | + |
| 46 | +- [Location](https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters#location) |
| 47 | + |
| 48 | +**Import the sample HDI notebook in Jupyter** |
| 49 | + |
| 50 | +**Important links:** |
| 51 | + |
| 52 | +Create HDI cluster: |
| 53 | +<https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters> |
0 commit comments