有 Java 编程相关的问题?

你可以在下面搜索框中键入要查询的问题!

java连接Cassandra节点和spark

我有一个运行spark作业的节点,它和我试图连接的cassandra节点在同一个环境中。 使用ssl auth,我为SparkConf设置了以下属性

SparkConf sparkConf = new SparkConf()
    .setAppName("AppName")
    .set("spark.cassandra.connection.ssl.trusStore.path","/path/trustStore")
    .set("spark.cassandra.connection.ssl.trustStore.password","password")
    .set("spark.cassandra.connection.ssl.keyStore.path","/path/keyStore")
    .set("spark.cassandra.connection.ssl.keyStore.password","password")
    .set("spark.cassandra.connection.host",args[0])
    .set("spark.executor.JAVA_HOME","/path/jdk64/jdk1.8.0_112")
    .set("spark.cassandra.auth.username","username")
    .set("spark.cassandra.auth.password","password")
    .set("spark.cassandra.connection.timeout_ms","50000")
    .set("spark.cassandra.connection.ssl.enabled","true")
    .set("spark.cassandra.sql.cluster","Cluster")
    .set("spark.cassandra.connection.local_dc","local_dc");

当我尝试使用openSession()方法初始化连接时,它会抛出一个异常

JavaSparkContext jssc = new JavaSparkContext(sparkConf);
CassandraConnector connector = CassandraConnector.apply(jssc.getConf());
Session session = connector.openSession();

抛出的异常如下所示,还包括当我得到异常的原因并打印错误消息时发生的情况

java.io.IOException: Failed to open native connection to Cassandra at {HOST}:PORT
[NODE_NAME/HOST:PORT] Channel has been closed

我已经验证了从用户名/密码到密钥库信任库文件的所有凭据是否正确;密码。在cassandra节点端,日志中甚至没有显示有人试图连接

我查过了,这不是防火墙问题

编辑:这是我的spark提交代码

spark-submit --master local[*] --class 
com.sparkCassandra.Main file:///path/SparkCass.jar XXX.X.X.XXX

共 (0) 个答案