You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Oct 12, 2023. It is now read-only.
Copy file name to clipboardExpand all lines: README.md
+42-29Lines changed: 42 additions & 29 deletions
Original file line number
Diff line number
Diff line change
@@ -1,11 +1,8 @@
1
-
# Azure SQL Database Spark Connector
1
+
# Spark connector for Azure SQL Databases and SQL Server
2
2
3
-
The official connector for Spark and Azure SQL Database.
4
-
5
-
This project provides a client library that allows your Azure SQL Database to be an input source or output sink for SparkJobs
6
-
7
-
## Requirements
3
+
The Spark connector for [Azure SQL Database](https://azure.microsoft.com/en-us/services/sql-database/) and [SQL Server](https://www.microsoft.com/en-us/sql-server/default.aspx) enables SQL databases, including Azure SQL Databases and SQL Server, to act as input data source or output data sink for Spark jobs. It allows you to utilize real time transactional data in big data analytics and persist results for adhoc queries or reporting.
8
4
5
+
Comparing to the built-in Spark connector, this connector provides the ability to bulk insert data into SQL databases. It can outperform row by row insertion with 10x to 20x faster performance. The Spark connector for Azure SQL Databases and SQL Server also supports AAD authentication. It allows you securely connecting to your Azure SQL databases from Azure Databricks using your AAD account. It provides similar interfaces with the built-in JDBC connector. It is easy to migrate your existing Spark jobs to use this new connector.
9
6
10
7
## How to connect to Spark using this library
11
8
This connector uses Microsoft SQLServer JDBC driver to fetch data from/to the Azure SQL Database.
@@ -16,7 +13,8 @@ All connection properties in
16
13
Microsoft JDBC Driver for SQL Server
17
14
</a> are supported in this connector. Add connection properties as fields in the `com.microsoft.azure.sqldb.spark.config.Config` object.
0 commit comments