zoukankan      html  css  js  c++  java
  • 公司hadoop客户端试用

    今天用了一下公司的hadoop客户端,从外面下载的客户端不能用,只能用这个wiki里面提供的:link

    装在了 tc-cm-201511novam12x12n0.tc 目录 /home/work/vip/hadoop-client/hadoop/bin

    命令

    $./hadoop fs -D fs.default.name=afs://pegasus.afs.baidu.com:9902 -D hadoop.job.ugi=nuomi-c-vip,密码 -put abc afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip
    
    16/11/28 14:50:22 INFO fs.LibdfsLoader: Trying to load the libdfs library...
    16/11/28 14:50:22 INFO fs.LibdfsLoader: Loaded the libdfs library
    16/11/28 14:50:22 INFO fs.DFileSystem: Loaded the libdfs library
    
    
    $ ./hadoop fs -D fs.default.name=afs://pegasus.afs.baidu.com:9902 -D hadoop.job.ugi=nuomi-c-vip,密码 -ls afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip
    
    16/11/28 14:50:29 INFO fs.LibdfsLoader: Trying to load the libdfs library...
    16/11/28 14:50:29 INFO fs.LibdfsLoader: Loaded the libdfs library
    16/11/28 14:50:29 INFO fs.DFileSystem: Loaded the libdfs library
    Found 1 items
    -rwxrwxrwx   3 nuomi-c-vip nuomi-c-vip          4 2016-11-28 14:50 /app/nuomi/c-vip/abc

    然后再把这个文件删掉吧:

    $ ./hadoop fs -D fs.default.name=afs://pegasus.afs.baidu.com:9902 -D hadoop.job.ugi=nuomi-c-vip,密码 -rm afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip/abc
    
    16/11/28 14:54:36 INFO fs.LibdfsLoader: Trying to load the libdfs library...
    16/11/28 14:54:36 INFO fs.LibdfsLoader: Loaded the libdfs library
    16/11/28 14:54:36 INFO fs.DFileSystem: Loaded the libdfs library
    Deleted afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip/abc

    支持的命令包括:

    Usage: java FsShell
               [-ls <path>]
               [-lsr <path>]
               [-du <path>]
               [-dus <path>]
               [-count[-q] <path>]
               [-mv <src> <dst>]
               [-cp <src> <dst>]
               [-ln <src> <dst>]
               [-rm <path>]
               [-rmr <path>]
               [-expunge]
               [-put <localsrc> ... <dst>]
               [-copyFromLocal <localsrc> ... <dst>]
               [-moveFromLocal <localsrc> ... <dst>]
               [-get [-ignoreCrc] [-crc] [-repair] <src> <localdst>]
               [-getmerge [-addnl] <src> <localdst> | -getmerge <src> <localdst> [addnl]]
               [-cat <src>]
               [-text <src>]
               [-copyToLocal [-ignoreCrc] [-crc] [-repair] <src> <localdst>]
               [-copySeqFileToLocal [-ignoreLen] <srcFile> <localDstFile>]
               [-moveToLocal [-crc] <src> <localdst>]
               [-mkdir <path>]
               [-setrep [-R] [-w] [-d] <rep> <path/file>]
               [-setAcl <user> <path> <permission>]
               [-getAcl [-u <user>] [-p <path>] ]
               [-removeAcl [-u <user>] [-p <path>] ]
               [-touchz <path>]
               [-test -[ezd] <path>]
               [-stat [format] <path>]
               [-tail [-f] <file>]
               [-chmod [-R] <MODE[,MODE]... | OCTALMODE> PATH...]
               [-chown [-R] [OWNER][:[GROUP]] PATH...]
               [-chgrp [-R] GROUP PATH...]
               [-help [cmd]]
  • 相关阅读:
    分布式任务框架elastic-job 学习笔记
    spring 基础知识复习
    Spring MVC 搭建
    python引入自定义模块
    python操作Excel读写--使用xlrd
    selenium2.0关于python的常用函数
    从零开始学Python07作业源码:虚拟人生(仅供参考)
    通过System.getProperties()获取系统参数
    Android Studio启动后出现cannot bind to 127.0.0.1:5037 10048的解决办法
    开发环境入门 linux基础 (部分)awk 赋值变量 if
  • 原文地址:https://www.cnblogs.com/charlesblc/p/6109540.html
Copyright © 2011-2022 走看看