博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
Hadoop 系列YARN:资源调度平台(YARN的命令)
阅读量:6149 次
发布时间:2019-06-21

本文共 58833 字,大约阅读时间需要 196 分钟。

yarn命令的用法

[root@node1 ~]# yarnUsage: yarn [--config confdir] [COMMAND | CLASSNAME]  CLASSNAME                             run the class named CLASSNAME or  where COMMAND is one of:  resourcemanager -format-state-store   deletes the RMStateStore  resourcemanager                       run the ResourceManager  nodemanager                           run a nodemanager on each slave  timelineserver                        run the timeline server  rmadmin                               admin tools  sharedcachemanager                    run the SharedCacheManager daemon  scmadmin                              SharedCacheManager admin tools  version                               print the version  jar 
run a jar file application prints application(s) report/kill application applicationattempt prints applicationattempt(s) report container prints container(s) report node prints node report(s) queue prints queue information logs dump container logs classpath prints the class path needed to get the Hadoop jar and the required libraries cluster prints cluster information daemonlog get/set the log level for each daemon

 

classpath

使用: yarn classpath

打印需要得到Hadoop的jar和所需要的lib包路径

查看节点列表

[root@node1 ~]# yarn node -list18/11/28 22:37:03 INFO client.RMProxy: Connecting to ResourceManager at node1/192.168.55.128:8032Total Nodes:3         Node-Id	     Node-State	Node-Http-Address	Number-of-Running-Containers     node2:45474	        RUNNING	       node2:8042	                           0     node3:40652	        RUNNING	       node3:8042	                           0     node1:46541	        RUNNING	       node1:8042	                           0

 查看节点状况

[root@node1 ~]# yarn node -status node3:4065218/11/28 22:38:29 INFO client.RMProxy: Connecting to ResourceManager at node1/192.168.55.128:8032Node Report : 	Node-Id : node3:40652	Rack : /default-rack	Node-State : RUNNING	Node-Http-Address : node3:8042	Last-Health-Update : Wed 28/Nov/18 10:37:10:693EST	Health-Report : 	Containers : 0	Memory-Used : 0MB	Memory-Capacity : 27640MB	CPU-Used : 0 vcores	CPU-Capacity : 10 vcores	Node-Labels :

 先停止YARN,然后通过yarn命令来启动resourcemanager和nodemanager

 

[root@node1 ~]# stop-yarn.shstopping yarn daemonsstopping resourcemanagernode2: stopping nodemanagernode1: stopping nodemanagernode3: stopping nodemanagerno proxyserver to stop

 JPS命令,已经没有YARN的相关服务了

[root@node1 ~]# yarn resourcemangerError: Could not find or load main class resourcemanger[root@node1 ~]# yarn resourcemanager18/11/28 22:44:13 INFO resourcemanager.ResourceManager: STARTUP_MSG: /************************************************************STARTUP_MSG: Starting ResourceManagerSTARTUP_MSG:   host = node1/192.168.55.128STARTUP_MSG:   args = []STARTUP_MSG:   version = 2.7.3STARTUP_MSG:   classpath = /opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jets3t-0.9.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/httpclient-4.2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/httpcore-4.2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-configuration-1.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-digester-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/avro-1.7.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hadoop-auth-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-framework-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-client-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsch-0.1.42.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/junit-4.11.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/xmlenc-0.52.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-httpclient-3.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-net-3.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3-tests.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-nfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3-tests.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/opt/hadoop-2.7.3/contrib/capacity-scheduler/*.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/etc/hadoop/rm-config/log4j.propertiesSTARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r baa91f7c6bc9cb92be5982de4719c1c8af91ccff; compiled by 'root' on 2016-08-18T01:41ZSTARTUP_MSG:   java = 1.8.0_112************************************************************/18/11/28 22:44:13 INFO resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT]18/11/28 22:44:14 INFO conf.Configuration: found resource core-site.xml at file:/opt/hadoop-2.7.3/etc/hadoop/core-site.xml18/11/28 22:44:14 INFO security.Groups: clearing userToGroupsMap cache18/11/28 22:44:15 INFO conf.Configuration: found resource yarn-site.xml at file:/opt/hadoop-2.7.3/etc/hadoop/yarn-site.xml18/11/28 22:44:15 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMFatalEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMFatalEventDispatcher18/11/28 22:44:16 INFO security.NMTokenSecretManagerInRM: NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms18/11/28 22:44:16 INFO security.RMContainerTokenSecretManager: ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms18/11/28 22:44:16 INFO security.AMRMTokenSecretManager: AMRMTokenKeyRollingInterval: 86400000ms and AMRMTokenKeyActivationDelay: 900000 ms18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager18/11/28 22:44:16 INFO resourcemanager.ResourceManager: Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher18/11/28 22:44:16 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties18/11/28 22:44:16 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).18/11/28 22:44:16 INFO impl.MetricsSystemImpl: ResourceManager metrics system started18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager18/11/28 22:44:16 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher18/11/28 22:44:16 INFO resourcemanager.RMNMInfo: Registered RMNMInfo MBean18/11/28 22:44:17 INFO security.YarnAuthorizationProvider: org.apache.hadoop.yarn.security.ConfiguredYarnAuthorizer is instiantiated.18/11/28 22:44:17 INFO util.HostsFileReader: Refreshing hosts (include/exclude) list18/11/28 22:44:17 INFO conf.Configuration: found resource capacity-scheduler.xml at file:/opt/hadoop-2.7.3/etc/hadoop/capacity-scheduler.xml18/11/28 22:44:17 INFO capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root is undefined18/11/28 22:44:17 INFO capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root is undefined18/11/28 22:44:17 INFO capacity.ParentQueue: root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=ADMINISTER_QUEUE:*SUBMIT_APP:*, labels=*,, reservationsContinueLooking=true18/11/28 22:44:17 INFO capacity.ParentQueue: Initialized parent-queue root name=root, fullname=root18/11/28 22:44:17 INFO capacity.CapacitySchedulerConfiguration: max alloc mb per queue for root.default is undefined18/11/28 22:44:17 INFO capacity.CapacitySchedulerConfiguration: max alloc vcore per queue for root.default is undefined18/11/28 22:44:17 INFO capacity.LeafQueue: Initializing defaultcapacity = 1.0 [= (float) configuredCapacity / 100 ]asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]maxCapacity = 1.0 [= configuredMaxCapacity ]absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]userLimit = 100 [= configuredUserLimit ]userLimitFactor = 1.0 [= configuredUserLimitFactor ]maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]minimumAllocationFactor = 0.33333334 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]maximumAllocation = 
[= configuredMaxAllocation ]numContainers = 0 [= currentNumContainers ]state = RUNNING [= configuredState ]acls = ADMINISTER_QUEUE:*SUBMIT_APP:* [= configuredAcls ]nodeLocalityDelay = 40labels=*,nodeLocalityDelay = 40reservationsContinueLooking = truepreemptionDisabled = true18/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=
, usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=018/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=
usedCapacity=0.0, numApps=0, numContainers=018/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=
usedCapacity=0.0, numApps=0, numContainers=018/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized queue mappings, override: false18/11/28 22:44:17 INFO capacity.CapacityScheduler: Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<
>, maximumAllocation=<
>, asynchronousScheduling=false, asyncScheduleInterval=5ms18/11/28 22:44:17 INFO metrics.SystemMetricsPublisher: YARN system metrics publishing service is not enabled18/11/28 22:44:17 INFO resourcemanager.ResourceManager: Transitioning to active state18/11/28 22:44:17 INFO recovery.RMStateStore: Updating AMRMToken18/11/28 22:44:17 INFO security.RMContainerTokenSecretManager: Rolling master-key for container-tokens18/11/28 22:44:17 INFO security.NMTokenSecretManagerInRM: Rolling master-key for nm-tokens18/11/28 22:44:17 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens18/11/28 22:44:17 INFO security.RMDelegationTokenSecretManager: storing master key with keyID 118/11/28 22:44:17 INFO recovery.RMStateStore: Storing RMDTMasterKey.18/11/28 22:44:17 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)18/11/28 22:44:17 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens18/11/28 22:44:17 INFO security.RMDelegationTokenSecretManager: storing master key with keyID 218/11/28 22:44:17 INFO recovery.RMStateStore: Storing RMDTMasterKey.18/11/28 22:44:17 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.nodelabels.event.NodeLabelsStoreEventType for class org.apache.hadoop.yarn.nodelabels.CommonNodeLabelsManager$ForwardingEventHandler18/11/28 22:44:17 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue18/11/28 22:44:17 INFO ipc.Server: Starting Socket Reader #1 for port 803118/11/28 22:44:17 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server18/11/28 22:44:17 INFO ipc.Server: IPC Server Responder: starting18/11/28 22:44:17 INFO ipc.Server: IPC Server listener on 8031: starting18/11/28 22:44:17 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue18/11/28 22:44:17 INFO ipc.Server: Starting Socket Reader #1 for port 803018/11/28 22:44:17 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server18/11/28 22:44:17 INFO ipc.Server: IPC Server Responder: starting18/11/28 22:44:17 INFO ipc.Server: IPC Server listener on 8030: starting18/11/28 22:44:17 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue18/11/28 22:44:17 INFO ipc.Server: Starting Socket Reader #1 for port 803218/11/28 22:44:17 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server18/11/28 22:44:17 INFO ipc.Server: IPC Server Responder: starting18/11/28 22:44:17 INFO ipc.Server: IPC Server listener on 8032: starting18/11/28 22:44:17 INFO resourcemanager.ResourceManager: Transitioned to active state18/11/28 22:44:18 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog18/11/28 22:44:18 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.18/11/28 22:44:18 INFO http.HttpRequestLog: Http request log for http.requests.resourcemanager is not defined18/11/28 22:44:18 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)18/11/28 22:44:18 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context cluster18/11/28 22:44:18 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context logs18/11/28 22:44:18 INFO http.HttpServer2: Added filter RMAuthenticationFilter (class=org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter) to context static18/11/28 22:44:18 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster18/11/28 22:44:18 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs18/11/28 22:44:18 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static18/11/28 22:44:18 INFO http.HttpServer2: adding path spec: /cluster/*18/11/28 22:44:18 INFO http.HttpServer2: adding path spec: /ws/*18/11/28 22:44:19 INFO webapp.WebApps: Registered webapp guice modules18/11/28 22:44:19 INFO http.HttpServer2: Jetty bound to port 808818/11/28 22:44:19 INFO mortbay.log: jetty-6.1.2618/11/28 22:44:19 INFO mortbay.log: Extract jar:file:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar!/webapps/cluster to /tmp/Jetty_node1_8088_cluster____uqk9cr/webapp18/11/28 22:44:19 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens18/11/28 22:44:19 INFO delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)18/11/28 22:44:19 INFO delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokensNov 28, 2018 10:44:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory registerINFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider classNov 28, 2018 10:44:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory registerINFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource classNov 28, 2018 10:44:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory registerINFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider classNov 28, 2018 10:44:20 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiateINFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'Nov 28, 2018 10:44:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProviderINFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"Nov 28, 2018 10:44:21 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProviderINFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"Nov 28, 2018 10:44:22 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProviderINFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"18/11/28 22:44:22 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@node1:808818/11/28 22:44:22 INFO webapp.WebApps: Web app cluster started at 808818/11/28 22:44:22 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue18/11/28 22:44:22 INFO ipc.Server: Starting Socket Reader #1 for port 803318/11/28 22:44:22 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server18/11/28 22:44:22 INFO ipc.Server: IPC Server Responder: starting18/11/28 22:44:22 INFO ipc.Server: IPC Server listener on 8033: starting

 

[root@node1 ~]# yarn nodemanager18/11/28 22:53:58 INFO nodemanager.NodeManager: STARTUP_MSG: /************************************************************STARTUP_MSG: Starting NodeManagerSTARTUP_MSG:   host = node1/192.168.55.128STARTUP_MSG:   args = []STARTUP_MSG:   version = 2.7.3STARTUP_MSG:   classpath = /opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/etc/hadoop:/opt/hadoop-2.7.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jets3t-0.9.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/httpclient-4.2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/httpcore-4.2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-configuration-1.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-digester-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/avro-1.7.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hadoop-auth-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-framework-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-client-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsch-0.1.42.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/junit-4.11.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/xmlenc-0.52.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-httpclient-3.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-net-3.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3-tests.jar:/opt/hadoop-2.7.3/share/hadoop/common/hadoop-nfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3-tests.jar:/opt/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/opt/hadoop-2.7.3/contrib/capacity-scheduler/*.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.7.3/etc/hadoop/nm-config/log4j.propertiesSTARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r baa91f7c6bc9cb92be5982de4719c1c8af91ccff; compiled by 'root' on 2016-08-18T01:41ZSTARTUP_MSG:   java = 1.8.0_112************************************************************/18/11/28 22:53:58 INFO nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT]18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl18/11/28 22:54:00 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager18/11/28 22:54:00 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties18/11/28 22:54:01 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).18/11/28 22:54:01 INFO impl.MetricsSystemImpl: NodeManager metrics system started18/11/28 22:54:01 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService18/11/28 22:54:01 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.sharedcache.SharedCacheUploadService18/11/28 22:54:01 INFO localizer.ResourceLocalizationService: per directory file limit = 819218/11/28 22:54:01 INFO localizer.ResourceLocalizationService: usercache path : file:/hadoop/yarn/local/usercache_DEL_154346364117618/11/28 22:54:01 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker18/11/28 22:54:01 WARN containermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.18/11/28 22:54:01 INFO containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce_shuffle"18/11/28 22:54:01 INFO monitor.ContainersMonitorImpl:  Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@7ac296f618/11/28 22:54:01 INFO monitor.ContainersMonitorImpl:  Using ResourceCalculatorProcessTree : null18/11/28 22:54:01 INFO monitor.ContainersMonitorImpl: Physical memory check enabled: false18/11/28 22:54:01 INFO monitor.ContainersMonitorImpl: Virtual memory check enabled: false18/11/28 22:54:01 INFO nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=27640 virtual-memory=58044 virtual-cores=1018/11/28 22:54:01 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue18/11/28 22:54:01 INFO ipc.Server: Starting Socket Reader #1 for port 3853818/11/28 22:54:01 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server18/11/28 22:54:01 INFO containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting.18/11/28 22:54:01 INFO security.NMContainerTokenSecretManager: Updating node address : node1:3853818/11/28 22:54:01 INFO ipc.Server: IPC Server Responder: starting18/11/28 22:54:01 INFO ipc.Server: IPC Server listener on 38538: starting18/11/28 22:54:01 INFO ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue18/11/28 22:54:01 INFO ipc.Server: Starting Socket Reader #1 for port 804018/11/28 22:54:01 INFO pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server18/11/28 22:54:01 INFO ipc.Server: IPC Server Responder: starting18/11/28 22:54:01 INFO ipc.Server: IPC Server listener on 8040: starting18/11/28 22:54:01 INFO localizer.ResourceLocalizationService: Localizer started on port 804018/11/28 22:54:02 INFO mapred.IndexCache: IndexCache created with max memory = 1048576018/11/28 22:54:02 INFO mapred.ShuffleHandler: httpshuffle listening on port 1356218/11/28 22:54:02 INFO monitor.ContainersMonitorImpl: Neither virutal-memory nor physical-memory monitoring is needed. Not running the monitor-thread18/11/28 22:54:02 INFO containermanager.ContainerManagerImpl: ContainerManager started at node1/192.168.55.128:3853818/11/28 22:54:02 INFO containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:018/11/28 22:54:02 INFO webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:804218/11/28 22:54:02 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog18/11/28 22:54:02 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.18/11/28 22:54:02 INFO http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined18/11/28 22:54:02 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)18/11/28 22:54:02 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node18/11/28 22:54:02 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static18/11/28 22:54:02 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs18/11/28 22:54:02 INFO http.HttpServer2: adding path spec: /node/*18/11/28 22:54:02 INFO http.HttpServer2: adding path spec: /ws/*18/11/28 22:54:03 INFO webapp.WebApps: Registered webapp guice modules18/11/28 22:54:03 INFO http.HttpServer2: Jetty bound to port 804218/11/28 22:54:03 INFO mortbay.log: jetty-6.1.2618/11/28 22:54:03 INFO mortbay.log: Extract jar:file:/opt/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webappNov 28, 2018 10:54:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory registerINFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource classNov 28, 2018 10:54:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory registerINFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider classNov 28, 2018 10:54:03 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory registerINFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider classNov 28, 2018 10:54:03 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiateINFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'Nov 28, 2018 10:54:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProviderINFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"Nov 28, 2018 10:54:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProviderINFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"Nov 28, 2018 10:54:05 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProviderINFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"18/11/28 22:54:05 INFO mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:804218/11/28 22:54:05 INFO webapp.WebApps: Web app node started at 804218/11/28 22:54:05 INFO client.RMProxy: Connecting to ResourceManager at node1/192.168.55.128:803118/11/28 22:54:05 INFO nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []18/11/28 22:54:05 INFO nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]18/11/28 22:54:06 INFO security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 213368873818/11/28 22:54:06 INFO security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id 96197106018/11/28 22:54:06 INFO nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as node1:38538 with total resource of 
18/11/28 22:54:06 INFO nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requests

 查看YARN版本

 

转载于:https://www.cnblogs.com/mtime2004/p/10037446.html

你可能感兴趣的文章
[解决方案]sql server复制需要有实际的服务器名称才能连接到服务器
查看>>
用yarn替代npm
查看>>
ReSharper2017.3的列对齐、排版格式、列对齐错误的修复
查看>>
BZOJ3273 : liars
查看>>
mysql开发之---每日一得01
查看>>
Java基础-MySQL数据库扫盲篇
查看>>
Echarts关于仪表盘
查看>>
php实现求数组中出现次数超过一半的数字(isset($arr[$val]))(取不同数看剩)(排序取中)...
查看>>
(转)创业的注意事项
查看>>
超简单的视频对象提取程序
查看>>
『TensorFlow』线程控制器类&变量作用域
查看>>
【知识小结】Git 个人学习笔记及心得
查看>>
已超过传入消息(65536)的最大消息大小配额。若要增加配额,请使用相应绑定元素上的 MaxReceivedMessageSize 属性...
查看>>
『流畅的Python』第9章笔记_对象
查看>>
结构化数据、半结构化数据和非结构化数据
查看>>
SQLServer 2014 本地机房HA+灾备机房DR解决方案
查看>>
centos7安装配置mysql5.6
查看>>
反爬虫:利用ASP.NET MVC的Filter和缓存(入坑出坑)
查看>>
SaaS技术栈的走势
查看>>
nunit单元测试详解
查看>>