spark解析企业人工制品背后的外部包

wfypjpf4  于 2021-05-27  发布在  Spark
关注(0)|答案(0)|浏览(272)

我想在spark中解析公司人工制品背后的包:

spark-shell --repositories https://bin.mycorp.com/artifactory/maven/ --packages io.delta:delta-core_2.12:0.7.0

对我来说根本无法解决。在日志中我发现:

found io.delta#delta-core_2.12;0.7.0 in repo-1
found org.antlr#antlr4;4.7 in repo-1 https://bin.mycorp.com/artifactory/maven/ --packages io.delta:delta-core_2.12:0.7.0                                                                      [https://found org.antlr#antlr4-runtime;4.7 in repo-1a remote repository with the name: repo-1
Ivy Default Cache set to: ~/.ivy2/cache
The jars for the packages stored in: ~/.ivy2/jars
:: loading settings :: url = jar:file:/usr/hdp/3.1.x.x-xxx/spark2/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
io.delta#delta-core_2.12 added as a dependency
:: resolving dependencies :: org.apache.spark#spark-submit-parent-ae4e5fbb-afc7-4c44-8262-b5c40ee2a1d5;1.0
        confs: [default]

没有输出。
jar里的常春藤( /usr/hdp/3.1.4.0-315/spark2/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml )它们是:

<ivysettings>
        <settings defaultResolver="default"/>
        <include url="${ivy.default.settings.dir}/ivysettings-public.xml"/>
        <include url="${ivy.default.settings.dir}/ivysettings-shared.xml"/>
        <include url="${ivy.default.settings.dir}/ivysettings-local.xml"/>
        <include url="${ivy.default.settings.dir}/ivysettings-main-chain.xml"/>
        <include url="${ivy.default.settings.dir}/ivysettings-default-chain.xml"/>
</ivysettings>

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题