Skip to content

Commit c351ac9

Browse files
committed
Sample HDI notebook
sample HDI notebook
1 parent 759ec39 commit c351ac9

File tree

3 files changed

+690
-0
lines changed

3 files changed

+690
-0
lines changed
Lines changed: 53 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,53 @@
1+
**Azure HDInsight**
2+
3+
Azure HDInsight is a fully managed cloud Hadoop & Spark offering the gives
4+
optimized open-source analytic clusters for Spark, Hive, MapReduce, HBase,
5+
Storm, and Kafka. HDInsight Spark clusters provide kernels that you can use with
6+
the Jupyter notebook on [Apache Spark](https://spark.apache.org/) for testing
7+
your applications. 
8+
9+
How Azure HDInsight works with Azure Machine Learning service
10+
11+
- You can train a model using Spark clusters and deploy the model to ACI/AKS
12+
from within Azure HDInsight.
13+
14+
- You can also use [automated machine
15+
learning](https://docs.microsoft.com/en-us/azure/machine-learning/service/concept-automated-ml) capabilities
16+
integrated within Azure HDInsight.
17+
18+
You can use Azure HDInsight as a compute target from an [Azure Machine Learning
19+
pipeline](https://docs.microsoft.com/en-us/azure/machine-learning/service/concept-ml-pipelines).
20+
21+
**Set up your HDInsight cluster**
22+
23+
Create [HDInsight
24+
cluster](https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters)
25+
26+
**Quick create: Basic cluster setup**
27+
28+
This article walks you through setup in the [Azure
29+
portal](https://portal.azure.com/), where you can create an HDInsight cluster
30+
using *Quick create* or *Custom*.
31+
32+
![hdinsight create options custom quick create](media/0a235b34c0b881117e51dc31a232dbe1.png)
33+
34+
Follow instructions on the screen to do a basic cluster setup. Details are
35+
provided below for:
36+
37+
- [Resource group
38+
name](https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters#resource-group-name)
39+
40+
- [Cluster types and
41+
configuration](https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters#cluster-types)
42+
(Cluster must be Spark 2.3 (HDI 3.6) or greater)
43+
44+
- Cluster login and SSH username
45+
46+
- [Location](https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters#location)
47+
48+
**Import the sample HDI notebook in Jupyter**
49+
50+
**Important links:**
51+
52+
Create HDI cluster:
53+
<https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters>

0 commit comments

Comments
 (0)