zoukankan      html  css  js  c++  java
  • hadoop使用

    hadoop@ubuntu:~$ cd hadoop-2.0.5-alpha/

    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ ls

    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ sbin/start-yarn.sh

    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ cd etc
    hadoop@ubuntu:~/hadoop-2.0.5-alpha/etc$ ls

    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ sbin/start-dfs.sh

    hadoop@ubuntu:~/hadoop-2.0.5-alpha/etc/hadoop$ cd
    hadoop@ubuntu:~$ cd hdDir
    hadoop@ubuntu:~/hdDir$ cd hadoopName/
    hadoop@ubuntu:~/hdDir/hadoopName$ LS
    The program 'LS' is currently not installed.  You can install it by typing:
    sudo apt-get install sl
    hadoop@ubuntu:~/hdDir/hadoopName$ ls
    current  in_use.lock
    hadoop@ubuntu:~/hdDir/hadoopName$ rm -r current/
    hadoop@ubuntu:~/hdDir/hadoopName$ rm in_use.lock
    hadoop@ubuntu:~/hdDir/hadoopName$ ls
    hadoop@ubuntu:~/hdDir/hadoopName$ cd
    hadoop@ubuntu:~$ cd hadoop-2.0.5-alpha/
    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ sbin/stop-all.sh
    This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh
    14/04/09 06:13:00 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    Stopping namenodes on [master]
    master: stopping namenode
    master: no datanode to stop
    Stopping secondary namenodes [master]
    master: stopping secondarynamenode
    14/04/09 06:13:20 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    stopping yarn daemons
    stopping resourcemanager
    master: stopping nodemanager
    no proxyserver to stop
    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ bin/hadoop namenode -format
    DEPRECATED: Use of this script to execute hdfs command is deprecated.
    Instead use the hdfs command for it.

    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ sbin/start-dfs.sh
    14/04/09 06:21:48 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    Starting namenodes on [master]
    master: starting namenode, logging to /home/hadoop/hadoop-2.0.5-alpha/logs/hadoop-hadoop-namenode-ubuntu.out
    master: starting datanode, logging to /home/hadoop/hadoop-2.0.5-alpha/logs/hadoop-hadoop-datanode-ubuntu.out
    Starting secondary namenodes [master]
    master: starting secondarynamenode, logging to /home/hadoop/hadoop-2.0.5-alpha/logs/hadoop-hadoop-secondarynamenode-ubuntu.out
    14/04/09 06:22:13 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ jps
    26155 SecondaryNameNode
    2628 org.eclipse.equinox.launcher_1.3.0.v20130327-1440.jar
    26285 Jps
    25648 NameNode
    25874 DataNode
    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ sbin/start-yarn.sh
    starting yarn daemons
    starting resourcemanager, logging to /home/hadoop/hadoop-2.0.5-alpha/logs/yarn-hadoop-resourcemanager-ubuntu.out
    master: starting nodemanager, logging to /home/hadoop/hadoop-2.0.5-alpha/logs/yarn-hadoop-nodemanager-ubuntu.out
    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ bin/hadoop fs -mkdir
    ^Chadoop@ubuntu:~/hadoop-2.0.5-alpha$ ^C
    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ bin/hadoop fs -mkdir /input
    14/04/09 06:23:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ bin/hadoop fs -put ~/hadoop-2.0.5-alpha/share/doc/hadoop/common/README.txt /input
    14/04/09 06:27:13 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    hadoop@ubuntu:~/hadoop-2.0.5-alpha$ bin/hadoop jar ~/hadoop-2.0.5-alpha/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.5-alpha.jar wordcount /input /output

    bin/hadoop fs -ls /output

    bin/hadoop fs -cat /output/part-r-00000

  • 相关阅读:
    centos中安装docker
    docker es
    Linux 定时备份数据库
    Linux 防火墙firewalld
    Linux Systemd
    Linux at定时任务
    Linux运行级别
    原来这就是网络
    LeetCode-897-递增顺序搜索树
    SSM整合配置文件
  • 原文地址:https://www.cnblogs.com/nannanITeye/p/3655191.html
Copyright © 2011-2022 走看看