Spark 在 yarn 集群中提交任务失败

问答 Xibaibai ⋅ 于 2017-12-25 17:31:45 ⋅ 最后回复由 青牛 2017-12-25 18:13:04 ⋅ 3872 阅读

日志如下:

17/12/25 09:09:15 INFO Client: Requesting a new application from cluster with 8 NodeManagers
17/12/25 09:09:15 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (192512 MB per container)
17/12/25 09:09:15 INFO Client: Will allocate AM container, with 33792 MB memory including 3072 MB overhead
17/12/25 09:09:15 INFO Client: Setting up container launch context for our AM
17/12/25 09:09:15 INFO Client: Setting up the launch environment for our AM container
17/12/25 09:09:15 INFO Client: Preparing resources for our AM container
17/12/25 09:09:17 INFO Client: Uploading resource file:/data/beh/core/spark/lib/spark-assembly-1.6.0-hadoop2.6.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spark-assembly-1.6.0-hadoop2.6.0.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdajar/chda-spark-sd-201711166.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/chda-spark-sd-201711166.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/activation-1.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/activation-1.1.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/apacheds-i18n-2.0.0-M15.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/apacheds-i18n-2.0.0-M15.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/apacheds-kerberos-codec-2.0.0-M15.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/apacheds-kerberos-codec-2.0.0-M15.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/api-asn1-api-1.0.0-M20.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/api-asn1-api-1.0.0-M20.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/api-util-1.0.0-M20.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/api-util-1.0.0-M20.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/asm-3.2.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/asm-3.2.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/avro-1.7.6-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/avro-1.7.6-cdh5.5.0.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-beanutils-1.7.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-beanutils-1.7.0.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-beanutils-core-1.8.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-beanutils-core-1.8.0.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-cli-1.2.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-cli-1.2.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-codec-1.9.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-codec-1.9.jar
17/12/25 09:09:20 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-collections-3.2.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-collections-3.2.1.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-compress-1.4.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-compress-1.4.1.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-configuration-1.6.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-configuration-1.6.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-csv-1.4.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-csv-1.4.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-daemon-1.0.3.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-daemon-1.0.3.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-dbcp-1.2.2.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-dbcp-1.2.2.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-digester-1.8.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-digester-1.8.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-el-1.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-el-1.0.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-httpclient-3.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-httpclient-3.1.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-io-2.4.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-io-2.4.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-lang-2.6.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-lang-2.6.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-logging-1.2.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-logging-1.2.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-math3-3.1.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-math3-3.1.1.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-net-3.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-net-3.1.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/commons-pool2-2.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/commons-pool2-2.0.jar
17/12/25 09:09:21 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/core-3.1.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/core-3.1.1.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/curator-client-2.7.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/curator-client-2.7.1.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/curator-framework-2.7.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/curator-framework-2.7.1.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/curator-recipes-2.7.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/curator-recipes-2.7.1.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/disruptor-3.3.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/disruptor-3.3.0.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/elasticsearch-hadoop-2.3.3.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/elasticsearch-hadoop-2.3.3.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/findbugs-annotations-1.3.9-1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/findbugs-annotations-1.3.9-1.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/gson-2.2.4.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/gson-2.2.4.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/guava-12.0.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/guava-12.0.1.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hadoop-annotations-2.6.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hadoop-annotations-2.6.0-cdh5.5.0.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hadoop-auth-2.6.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hadoop-auth-2.6.0-cdh5.5.0.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hadoop-common-2.6.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hadoop-common-2.6.0-cdh5.5.0.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hadoop-hdfs-2.6.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hadoop-hdfs-2.6.0-cdh5.5.0.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hadoop-hdfs-2.6.0-cdh5.5.0-tests.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hadoop-hdfs-2.6.0-cdh5.5.0-tests.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hamcrest-core-1.3.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hamcrest-core-1.3.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-annotations-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-annotations-1.0.0-cdh5.5.0.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-annotations-1.0.0-cdh5.5.0-tests.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-annotations-1.0.0-cdh5.5.0-tests.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-checkstyle-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-checkstyle-1.0.0-cdh5.5.0.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-client-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-client-1.0.0-cdh5.5.0.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-common-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-common-1.0.0-cdh5.5.0.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-common-1.0.0-cdh5.5.0-tests.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-common-1.0.0-cdh5.5.0-tests.jar
17/12/25 09:09:22 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-examples-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-examples-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-hadoop2-compat-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-hadoop2-compat-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-hadoop2-compat-1.0.0-cdh5.5.0-tests.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-hadoop2-compat-1.0.0-cdh5.5.0-tests.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-hadoop-compat-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-hadoop-compat-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-hadoop-compat-1.0.0-cdh5.5.0-tests.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-hadoop-compat-1.0.0-cdh5.5.0-tests.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-it-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-it-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-it-1.0.0-cdh5.5.0-tests.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-it-1.0.0-cdh5.5.0-tests.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-prefix-tree-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-prefix-tree-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-protocol-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-protocol-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-rest-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-rest-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-server-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-server-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-server-1.0.0-cdh5.5.0-tests.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-server-1.0.0-cdh5.5.0-tests.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-shell-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-shell-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-spark-1.2.0-cdh5.7.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-spark-1.2.0-cdh5.7.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-testing-util-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-testing-util-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hbase-thrift-1.0.0-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hbase-thrift-1.0.0-cdh5.5.0.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/high-scale-lib-1.1.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/high-scale-lib-1.1.1.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/hsqldb-1.8.0.10.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/hsqldb-1.8.0.10.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/htrace-core-3.2.0-incubating.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/htrace-core-3.2.0-incubating.jar
17/12/25 09:09:23 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/htrace-core4-4.0.1-incubating.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/htrace-core4-4.0.1-incubating.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/httpclient-4.2.5.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/httpclient-4.2.5.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/httpcore-4.2.5.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/httpcore-4.2.5.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jackson-core-asl-1.8.8.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jackson-core-asl-1.8.8.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jackson-jaxrs-1.8.8.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jackson-jaxrs-1.8.8.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jackson-mapper-asl-1.8.8.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jackson-mapper-asl-1.8.8.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jackson-xc-1.8.8.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jackson-xc-1.8.8.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jamon-runtime-2.3.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jamon-runtime-2.3.1.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jasper-compiler-5.5.23.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jasper-compiler-5.5.23.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jasper-runtime-5.5.23.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jasper-runtime-5.5.23.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/java-xmlbuilder-0.4.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/java-xmlbuilder-0.4.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jaxb-api-2.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jaxb-api-2.1.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jaxb-impl-2.2.3-1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jaxb-impl-2.2.3-1.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jcodings-1.0.8.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jcodings-1.0.8.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jedis-2.6.2.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jedis-2.6.2.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jersey-client-1.9.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jersey-client-1.9.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jersey-core-1.9.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jersey-core-1.9.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jersey-json-1.9.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jersey-json-1.9.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jersey-server-1.9.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jersey-server-1.9.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jets3t-0.9.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jets3t-0.9.0.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jettison-1.3.3.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jettison-1.3.3.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jetty-6.1.26.cloudera.4.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jetty-6.1.26.cloudera.4.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jetty-6.1.26.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jetty-6.1.26.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jetty-server-8.1.14.v20131031.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jetty-server-8.1.14.v20131031.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jetty-sslengine-6.1.26.cloudera.4.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jetty-sslengine-6.1.26.cloudera.4.jar
17/12/25 09:09:24 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jetty-util-6.1.26.cloudera.4.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jetty-util-6.1.26.cloudera.4.jar
17/12/25 09:09:25 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jetty-util-6.1.26.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jetty-util-6.1.26.jar
17/12/25 09:09:25 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/joni-2.1.2.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/joni-2.1.2.jar
17/12/25 09:09:25 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jruby-cloudera-1.0.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jruby-cloudera-1.0.0.jar
17/12/25 09:09:25 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jruby-complete-1.6.8.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jruby-complete-1.6.8.jar
17/12/25 09:09:25 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jsch-0.1.42.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jsch-0.1.42.jar
17/12/25 09:09:25 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jsp-2.1-6.1.14.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jsp-2.1-6.1.14.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jsp-api-2.1-6.1.14.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jsp-api-2.1-6.1.14.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/jsr305-1.3.9.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/jsr305-1.3.9.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/junit-4.12.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/junit-4.12.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/leveldbjni-all-1.8.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/leveldbjni-all-1.8.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/libthrift-0.9.2.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/libthrift-0.9.2.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/log4j-1.2.17.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/log4j-1.2.17.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/metrics-core-2.2.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/metrics-core-2.2.0.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/netty-3.6.6.Final.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/netty-3.6.6.Final.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/netty-all-4.0.23.Final.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/netty-all-4.0.23.Final.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/ojdbc14.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/ojdbc14.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/paranamer-2.3.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/paranamer-2.3.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/protobuf-java-2.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/protobuf-java-2.5.0.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/ruleModule.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/ruleModule.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/servlet-api-2.5-6.1.14.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/servlet-api-2.5-6.1.14.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/servlet-api-2.5.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/servlet-api-2.5.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/slf4j-api-1.7.5.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/slf4j-api-1.7.5.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/slf4j-log4j12-1.7.5.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/slf4j-log4j12-1.7.5.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/snappy-java-1.0.4.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/snappy-java-1.0.4.1.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-aop.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-aop.jar
17/12/25 09:09:26 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-aspects.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-aspects.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-beans.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-beans.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-context.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-context.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-context-support.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-context-support.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-core.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-core.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-data-redis-1.5.0.RELEASE.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-data-redis-1.5.0.RELEASE.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-expression.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-expression.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-jdbc.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-jdbc.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-orm.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-orm.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-scala_2.10-1.0.0.RC1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-scala_2.10-1.0.0.RC1.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-security-config.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-security-config.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-security-core.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-security-core.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-security-web.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-security-web.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/spring-tx.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/spring-tx.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/xercesImpl-2.9.1.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/xercesImpl-2.9.1.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/xml-apis-1.3.04.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/xml-apis-1.3.04.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/xmlenc-0.52.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/xmlenc-0.52.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/xz-1.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/xz-1.0.jar
17/12/25 09:09:27 INFO Client: Uploading resource file:/data/beh/core/spark/chdalib/zookeeper-3.4.5-cdh5.5.0.jar -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/zookeeper-3.4.5-cdh5.5.0.jar
17/12/25 09:09:28 INFO Client: Uploading resource file:/data/disk01/tmp/spark/local/spark-89be2ace-a840-40f9-8187-380c529d3abc/__spark_conf__3124586413785722491.zip -> hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/__spark_conf__3124586413785722491.zip
17/12/25 09:09:28 WARN Client: spark.yarn.am.extraJavaOptions will not take effect in cluster mode
17/12/25 09:09:28 INFO SecurityManager: Changing view acls to: zte
17/12/25 09:09:28 INFO SecurityManager: Changing modify acls to: zte
17/12/25 09:09:28 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(zte); users with modify permissions: Set(zte)
17/12/25 09:09:28 INFO Client: Submitting application 137748 to ResourceManager
17/12/25 09:09:28 INFO YarnClientImpl: Submitted application application_1510818417328_137748
17/12/25 09:09:29 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:29 INFO Client: 
     client token: N/A
     diagnostics: N/A
     ApplicationMaster host: N/A
     ApplicationMaster RPC port: -1
     queue: root.zte
     start time: 1514192905566
     final status: UNDEFINED
     tracking URL: http://dphdp-nn001:23188/proxy/application_1510818417328_137748/
     user: zte
17/12/25 09:09:30 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:31 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:32 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:33 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:34 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:35 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:36 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:37 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:38 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:39 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:40 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:41 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:42 INFO Client: Application report for application_1510818417328_137748 (state: ACCEPTED)
17/12/25 09:09:43 INFO Client: Application report for application_1510818417328_137748 (state: FAILED)
17/12/25 09:09:43 INFO Client: 
     client token: N/A
     diagnostics: Application application_1510818417328_137748 failed 2 times due to AM Container for appattempt_1510818417328_137748_000002 exited with  exitCode: -1000
For more detailed output, check application tracking page:http://dphdp-nn001:23188/proxy/application_1510818417328_137748/Then, click on links to logs of each attempt.
Diagnostics: File does not exist: hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/protobuf-java-2.5.0.jar
java.io.FileNotFoundException: File does not exist: hdfs://beh/user/zte/.sparkStaging/application_1510818417328_137748/protobuf-java-2.5.0.jar
    at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1218)
    at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1210)
    at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1210)
    at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:251)
    at org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:61)
    at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:359)
    at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:357)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
    at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:356)
    at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:60)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)

Failing this attempt. Failing the application.
     ApplicationMaster host: N/A
     ApplicationMaster RPC port: -1
     queue: root.zte
     start time: 1514192905566
     final status: FAILED
     tracking URL: http://dphdp-nn001:23188/cluster/app/application_1510818417328_137748
     user: zte
Exception in thread "main" org.apache.spark.SparkException: Application application_1510818417328_137748 finished with failed status
    at org.apache.spark.deploy.yarn.Client.run(Client.scala:1029)
    at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1076)
    at org.apache.spark.deploy.yarn.Client.main(Client.scala)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
    at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
    at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
17/12/25 09:09:43 INFO ShutdownHookManager: Shutdown hook called
17/12/25 09:09:43 INFO ShutdownHookManager: Deleting directory /data/disk01/tmp/spark/local/spark-89be2ace-a840-40f9-8187-380c529d3abc

依赖包是通过spark-submit的时候--jars 上传的,且观察过hdfs中该路径的确存在该jar包.
哪位大神遇到过这种情况么。

成为第一个点赞的人吧 :bowtie:
回复数量: 1
  • 青牛 海汼部落创始人,80后程序员一枚,曾就职于金山,喜欢倒腾技术做产品
    2017-12-25 18:13:04

    你看一下你这个包是不是坏掉了 /data/beh/core/spark/chdalib/protobuf-java-2.5.0.jar

暂无评论~~
  • 请注意单词拼写,以及中英文排版,参考此页
  • 支持 Markdown 格式, **粗体**、~~删除线~~、`单行代码`, 更多语法请见这里 Markdown 语法
  • 支持表情,可用Emoji的自动补全, 在输入的时候只需要 ":" 就可以自动提示了 :metal: :point_right: 表情列表 :star: :sparkles:
  • 上传图片, 支持拖拽和剪切板黏贴上传, 格式限制 - jpg, png, gif,教程
  • 发布框支持本地存储功能,会在内容变更时保存,「提交」按钮点击时清空
Ctrl+Enter