Skip to content

Examples don't work #7

@ivan-m

Description

@ivan-m

I realise you don't officially support these, but - if only for use as sample templates of how to properly build and deploy DSE-based Spark jobs - it would be useful if the examples actually worked.

I've just tried the Scala/sbt/DSE example, and I get the following error messages:

[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:4: object cql is not a member of package com.datastax.spark.connector
[error] import com.datastax.spark.connector.cql.CassandraConnector
[error]                                     ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:5: object apache is not a member of package org
[error] import org.apache.spark.sql.hive.HiveContext
[error]            ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:6: object apache is not a member of package org
[error] import org.apache.spark.{SparkConf, SparkContext}
[error]            ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:13: not found: type SparkConf
[error]   val conf = new SparkConf()
[error]                  ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:16: not found: value CassandraConnector
[error]   CassandraConnector(conf).withSessionDo { session =>
[error]   ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:24: not found: type SparkContext
[error]   val sc = new SparkContext(conf)
[error]                ^
[error] /path/to/repository/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:25: not found: type HiveContext
[error]   val hiveContext = new HiveContext(sc)
[error]                         ^
[error] 7 errors found
[error] (compile:compileIncremental) Compilation failed
[error] Total time: 271 s, completed 25/01/2017 11:33:59 AM

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions