JDK21 Spark3.5.0

使用JDK21做spark开发 启动代码出现 Exception in thread "main" java.lang.IllegalAccessError: class org.apache.spark.storage.StorageUtils$ (in unnamed module @0x461ad730) cannot access class sun.nio.ch.DirectBuffer (in module java.base) because module java.base does not export sun.nio.ch to unnamed module @0x461ad730 报错信息 需要在环境变量中设置 JAVA_OPT 和 JAVA_TOOL_OPTIONS 为 --add-exports=java.base/sun.nio.ch=ALL-UNNAMED

Exception in thread "main" java.lang.IllegalAccessError: class org.apache.spark.storage.StorageUtils$ (in unnamed module @0x461ad730) cannot access class sun.nio.ch.DirectBuffer (in module java.base) because module java.base does not export sun.nio.ch to unnamed module @0x461ad730

at org.apache.spark.storage.StorageUtils$.(StorageUtils.scala:213)

at org.apache.spark.storage.BlockManagerMasterEndpoint.(BlockManagerMasterEndpoint.scala:121)

at org.apache.spark.SparkEnv$.$anonfun$create$9(SparkEnv.scala:358)

at org.apache.spark.SparkEnv$.registerOrLookupEndpoint$1(SparkEnv.scala:295)

at org.apache.spark.SparkEnv$.create(SparkEnv.scala:344)

at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:196)

at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:284)

at org.apache.spark.SparkContext.(SparkContext.scala:483)

at com.lihaozhe.course01.ScalaDemo01$.main(ScalaDemo01.scala:20)

at com.lihaozhe.course01.ScalaDemo01.main(ScalaDemo01.scala)

一切正常

Picked up JAVA_TOOL_OPTIONS: --add-exports=java.base/sun.nio.ch=ALL-UNNAMED

Using Spark's default log4j profile: org/apache/spark/log4j2-defaults.properties

相关链接

评论可见，请评论后查看内容，谢谢！！！
 您阅读本篇文章共花了：