zoukankan      html  css  js  c++  java
  • 公司hadoop客户端试用

    今天用了一下公司的hadoop客户端,从外面下载的客户端不能用,只能用这个wiki里面提供的:link

    装在了 tc-cm-201511novam12x12n0.tc 目录 /home/work/vip/hadoop-client/hadoop/bin

    命令

    $./hadoop fs -D fs.default.name=afs://pegasus.afs.baidu.com:9902 -D hadoop.job.ugi=nuomi-c-vip,密码 -put abc afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip
    
    16/11/28 14:50:22 INFO fs.LibdfsLoader: Trying to load the libdfs library...
    16/11/28 14:50:22 INFO fs.LibdfsLoader: Loaded the libdfs library
    16/11/28 14:50:22 INFO fs.DFileSystem: Loaded the libdfs library
    
    
    $ ./hadoop fs -D fs.default.name=afs://pegasus.afs.baidu.com:9902 -D hadoop.job.ugi=nuomi-c-vip,密码 -ls afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip
    
    16/11/28 14:50:29 INFO fs.LibdfsLoader: Trying to load the libdfs library...
    16/11/28 14:50:29 INFO fs.LibdfsLoader: Loaded the libdfs library
    16/11/28 14:50:29 INFO fs.DFileSystem: Loaded the libdfs library
    Found 1 items
    -rwxrwxrwx   3 nuomi-c-vip nuomi-c-vip          4 2016-11-28 14:50 /app/nuomi/c-vip/abc

    然后再把这个文件删掉吧:

    $ ./hadoop fs -D fs.default.name=afs://pegasus.afs.baidu.com:9902 -D hadoop.job.ugi=nuomi-c-vip,密码 -rm afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip/abc
    
    16/11/28 14:54:36 INFO fs.LibdfsLoader: Trying to load the libdfs library...
    16/11/28 14:54:36 INFO fs.LibdfsLoader: Loaded the libdfs library
    16/11/28 14:54:36 INFO fs.DFileSystem: Loaded the libdfs library
    Deleted afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip/abc

    支持的命令包括:

    Usage: java FsShell
               [-ls <path>]
               [-lsr <path>]
               [-du <path>]
               [-dus <path>]
               [-count[-q] <path>]
               [-mv <src> <dst>]
               [-cp <src> <dst>]
               [-ln <src> <dst>]
               [-rm <path>]
               [-rmr <path>]
               [-expunge]
               [-put <localsrc> ... <dst>]
               [-copyFromLocal <localsrc> ... <dst>]
               [-moveFromLocal <localsrc> ... <dst>]
               [-get [-ignoreCrc] [-crc] [-repair] <src> <localdst>]
               [-getmerge [-addnl] <src> <localdst> | -getmerge <src> <localdst> [addnl]]
               [-cat <src>]
               [-text <src>]
               [-copyToLocal [-ignoreCrc] [-crc] [-repair] <src> <localdst>]
               [-copySeqFileToLocal [-ignoreLen] <srcFile> <localDstFile>]
               [-moveToLocal [-crc] <src> <localdst>]
               [-mkdir <path>]
               [-setrep [-R] [-w] [-d] <rep> <path/file>]
               [-setAcl <user> <path> <permission>]
               [-getAcl [-u <user>] [-p <path>] ]
               [-removeAcl [-u <user>] [-p <path>] ]
               [-touchz <path>]
               [-test -[ezd] <path>]
               [-stat [format] <path>]
               [-tail [-f] <file>]
               [-chmod [-R] <MODE[,MODE]... | OCTALMODE> PATH...]
               [-chown [-R] [OWNER][:[GROUP]] PATH...]
               [-chgrp [-R] GROUP PATH...]
               [-help [cmd]]
  • 相关阅读:
    理解KMP算法
    Rabin-Karp字符串查找算法
    利用有限自动机(finite automata)进行模式匹配
    Trie树详解
    win7 64位安装redis 及Redis Desktop Manager使用
    Struts2中EL表达式取值
    jquery的each()详细介绍
    double 类型运算会出现精度问题
    Navicat 导入数据报错 --- 1153
    JAVAAPI学习之Calendar类;Calendar类set()、add()、roll()方法区别
  • 原文地址:https://www.cnblogs.com/charlesblc/p/6109540.html
Copyright © 2011-2022 走看看