scala 当我尝试使用spark(版本3.1.1)创建一个sparkSession时，发生了堆栈溢出异常

8mmmxcuj  于 2023-10-18  发布在  Scala
关注(0)|答案(1)|浏览(139)

当我尝试使用spark-shell创建一个sparkSession时，会发生堆栈溢出错误。我跟踪堆栈溢出到scala-reflect-2.12.10.jar路径处理的问题，并在创建sessionState时由spark触发，但我无法获得更多细节。
当spark创建sparSession时，什么特定的操作会触发这个问题，我应该如何避免这个问题。
exec envs：spark 3.1.1

exec命令：

  1. scala
  2. val spark =  org.apache.spark.sql.SparkSession.builder().appName("test")
  3. spark.getOrCreate()

错误：

  1. scala> val spark =  org.apache.spark.sql.SparkSession.builder().appName("test")
  2. spark: org.apache.spark.sql.SparkSession.Builder = org.apache.spark.sql.SparkSession$Builder@3dcb28de
  4. scala> spark.getOrCreate()
  5. Start create spark session
  6. 23/08/21 12:08:20 ERROR SparkSession$Builder: Start create spark session
  7. 23/08/21 12:08:20 ERROR SparkSession$Builder: Get spark session from active
  8. Start get spark session state
  9. Start get sparksession className:org.apache.spark.sql.internal.SessionStateBuilder
  10. 23/08/21 12:08:20 ERROR SparkSession: Successfully get class
  11. 23/08/21 12:08:20 ERROR SparkSession: Successfully get costructor
  12. 23/08/21 12:08:20 ERROR SparkSession: Successfully get new Instance
  13. 23/08/21 12:08:20 ERROR SparkSession: Successfully type convert to BaseSessionStateBuilder
  14. Start create new Session state
  15. 2023-08-21 12:08:30,734 main DEBUG null null initializing configuration org.apache.logging.log4j.core.config.properties.PropertiesConfiguration@4acbe932
  16. 2023-08-21 12:08:30,789 main DEBUG Installed 2 script engines
  17. Warning: Nashorn engine is planned to be removed from a future JDK release
  18. 2023-08-21 12:08:31,851 Thread Context Data Task DEBUG Thread Context Data Service Provider initialization complete
  19. 2023-08-21 12:08:32,088 main DEBUG Oracle Nashorn version: 11.0.16, language: ECMAScript, threading: Not Thread Safe, compile: true, names: [nashorn, Nashorn, js, JS, JavaScript, javascript, ECMAScript, ecmascript], factory class: jdk.nashorn.api.scripting.NashornScriptEngineFactory
  20. java.lang.StackOverflowError
  21.     at scala.reflect.io.ZipArchive$.splitPath(ZipArchive.scala:62)
  22.     at scala.reflect.io.ZipArchive$.scala$reflect$io$ZipArchive$$dirName(ZipArchive.scala:58)
  23.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  24.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  25.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  26.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  27.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  28.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  29.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  30.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  31.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  32.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  33.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  34.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  35.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  36.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  37.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  38.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  39.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  40.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  41.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  42.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  43.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  44.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  45.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  46.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  47.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  48.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  49.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  50.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  51.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  52.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  53.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  54.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  55.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  56.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  57.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  58.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  59.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  60.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  61.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  62.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  63.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  64.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  65.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  66.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  67.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  68.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  69.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  70.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  71.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  72.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  73.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  74.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  75.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  76.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  77.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  78.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  79.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  80.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  81.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  82.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  83.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  84.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  85.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  86.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  87.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  88.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  89.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  90.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  91.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  92.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  93.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  94.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  95.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  96.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  97.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  98.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  99.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  100.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  101.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  102.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  103.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  104.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  105.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  106.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  107.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  108.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  109.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  110.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  111.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  112.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  113.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  114.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  115.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  116.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  117.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  118.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  119.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  120.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  121.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  122.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  123.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  124.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  125.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  126.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  127.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  128.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  129.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  130.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  131.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  132.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  133.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  134.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  135.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  136.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  137.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  138.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  139.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  140.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  141.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  142.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  143.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  144.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  145.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  146.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  147.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  148.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  149.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  150.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  151.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  152.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  153.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  154.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  155.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  156.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  157.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  158.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  159.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  160.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  161.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  162.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  163.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  164.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  165.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  166.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  167.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  168.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  169.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  170.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  171.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  172.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  173.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  174.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  175.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  176.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  177.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  178.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  179.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  180.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  181.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  182.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  183.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  184.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  185.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  186.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  187.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  188.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  189.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  190.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  191.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  192.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  193.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  194.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  195.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  196.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  197.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  198.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  199.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  200.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  201.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  202.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  203.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  204.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  205.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  206.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  207.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  208.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  209.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  210.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  211.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  212.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  213.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  214.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  215.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  216.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  217.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  218.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  219.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  220.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  221.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  222.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  223.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  224.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  225.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  226.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  227.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  228.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  229.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  230.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  231.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  232.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  233.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  234.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  235.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  236.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  237.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  238.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  239.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  240.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  241.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  242.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  243.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  244.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  245.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  246.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  247.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  248.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  249.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  250.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  251.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  252.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  253.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  254.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  255.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  256.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  257.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  258.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  259.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  260.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  261.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  262.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  263.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  264.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  265.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  266.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  267.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  268.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  269.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  270.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  271.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  272.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  273.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  274.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  275.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  276.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  277.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  278.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  279.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  280.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  281.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  282.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  283.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  284.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  285.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  286.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  287.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  288.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  289.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  290.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  291.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  292.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  293.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  294.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  295.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  296.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  297.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  298.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  299.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  300.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  301.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  302.         at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  303.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  304.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  305.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  306.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  307.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  308.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  309.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  310.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  311.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  312.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  313.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  314.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  315.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  316.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  317.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  318.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  319.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  320.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  321.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  322.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  323.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  324.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  325.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  326.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  327.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  328.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  329.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  330.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  331.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  332.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  333.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  334.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  335.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  336.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  337.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  338.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  339.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  340.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  341.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  342.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  343.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)
  344.     at scala.reflect.io.ZipArchive.ensureDir(ZipArchive.scala:114)

可以忽略此日志

  1. 23/08/21 12:08:20 ERROR SparkSession$Builder: Start create spark session
  2. 23/08/21 12:08:20 ERROR SparkSession$Builder: Get spark session from active
  3. Start get spark session state
  4. Start get sparksession className:org.apache.spark.sql.internal.SessionStateBuilder
  5. 23/08/21 12:08:20 ERROR SparkSession: Successfully get class
  6. 23/08/21 12:08:20 ERROR SparkSession: Successfully get costructor
  7. 23/08/21 12:08:20 ERROR SparkSession: Successfully get new Instance
  8. 23/08/21 12:08:20 ERROR SparkSession: Successfully type convert to BaseSessionStateBuilder
  9. Start create new Session state

scala

1条答案

按热度按时间
lbsnaicq

lbsnaicq1#

spark-shell会自动创建Spark Session，并命名为“spark”。您不能创建或覆盖现有会话，即spark。
如果您查看您共享的spark-shell屏幕打印，就在Spark徽标上方，有一行已经提到

  • Spark Session以“spark”形式提供 *。

如果您有任何需要传递某些配置的用例，则可以将其作为spark-shell命令的一部分传递，如下所示

  1. spark-shell --conf spark.driver.extraJavaOptions="-Duser.timezone=GMT+5:30"
赞(0）分享  回复(0）举报  2023-10-18
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com