Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I'm getting errors on the SBT builds on the latest version 5.1.4 #21

Closed
phact opened this issue Nov 27, 2017 · 4 comments
Closed

I'm getting errors on the SBT builds on the latest version 5.1.4 #21

phact opened this issue Nov 27, 2017 · 4 comments

Comments

@phact
Copy link

phact commented Nov 27, 2017

$ sbt -Dsbt.log.noformat=true --error assembly             (master✱)
[error] /Users/sebastianestevez/Desktop/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:4: object CassandraConnector is not a member of package com.datastax.spark.connector.cql
[error] import com.datastax.spark.connector.cql.CassandraConnector
[error]        ^
[error] /Users/sebastianestevez/Desktop/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:5: object apache is not a member of package org
[error] import org.apache.spark.sql.{SaveMode, SparkSession}
[error]            ^
[error] /Users/sebastianestevez/Desktop/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:6: object apache is not a member of package org
[error] import org.apache.spark.sql.cassandra._
[error]            ^
[error] /Users/sebastianestevez/Desktop/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:12: not found: value SparkSession
[error]   val spark = SparkSession.builder
[error]               ^
[error] /Users/sebastianestevez/Desktop/SparkBuildExamples/scala/sbt/dse/src/main/scala/com/datastax/spark/example/WriteRead.scala:20: not found: value CassandraConnector
[error]   CassandraConnector(spark.sparkContext).withSessionDo { session =>
[error]   ^
[error] 5 errors found
[error] (compile:compileIncremental) Compilation failed
[error] Total time: 2 s, completed Nov 27, 2017 5:30:11 PM
@jtgrabowski
Copy link
Collaborator

Clean 5.1.4 tag works for me. What sbt do you use? Min version is 0.13.13 https://github.com/datastax/SparkBuildExamples#dse

@bcantoni
Copy link

I'm going to close this one as not reproducible, but if you are still having trouble please reopen.

@phact
Copy link
Author

phact commented Mar 26, 2018

Hm interestingly I'm still getting this error on latest

$ sbt sbtVersion                                                                                            (master✱)
[info] Loading settings from assembly.sbt ...
[info] Loading project definition from /Users/sebastianestevez/Desktop/SparkBuildExamples/scala/sbt/dse/project
[info] Loading settings from build.sbt ...
[info] Set current project to writeRead (in build file:/Users/sebastianestevez/Desktop/SparkBuildExamples/scala/sbt/dse/)
[info] 1.1.1

@jtgrabowski
Copy link
Collaborator

Hello @phact,
it works for me (sbt 1.1.1)

SparkBuildExamples/scala/sbt/dse:[(HEAD detached at 5.1.4)]$ sbt assembly
...
[success] Total time: 45 s, completed Mar 28, 2018 9:20:21 AM

Could you please see if this snippet from readme.md is helpfull?

Please note that DSE projects templates are meant to be built with sbt 0.13.13 or newer. In case of unresolved dependencies errors, please update sbt and than clean ivy cache (with rm ~/.ivy2/cache/com.datastax.dse/dse-spark-dependencies/ command)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants