-
Notifications
You must be signed in to change notification settings - Fork 47
Closed
Description
I realise you don't officially support these, but - if only for use as sample templates of how to properly build and deploy DSE-based Spark jobs - it would be useful if the examples actually worked.
I've just tried the Scala/sbt/DSE example, and I get the following error messages:
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:4: object cql is not a member of package com.datastax.spark.connector
[error] import com.datastax.spark.connector.cql.CassandraConnector
[error] ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:5: object apache is not a member of package org
[error] import org.apache.spark.sql.hive.HiveContext
[error] ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:6: object apache is not a member of package org
[error] import org.apache.spark.{SparkConf, SparkContext}
[error] ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:13: not found: type SparkConf
[error] val conf = new SparkConf()
[error] ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:16: not found: value CassandraConnector
[error] CassandraConnector(conf).withSessionDo { session =>
[error] ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:24: not found: type SparkContext
[error] val sc = new SparkContext(conf)
[error] ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:25: not found: type HiveContext
[error] val hiveContext = new HiveContext(sc)
[error] ^
[error] 7 errors found
[error] (compile:compileIncremental) Compilation failed
[error] Total time: 271 s, completed 25/01/2017 11:33:59 AM
Metadata
Metadata
Assignees
Labels
No labels