zoukankan      html  css  js  c++  java
  • Hadoop将本地文件复制到Hadoop文件系统

    代码:

    package com.hadoop;
    
    import java.io.BufferedInputStream;
    import java.io.FileInputStream;
    import java.io.InputStream;
    import java.io.OutputStream;
    import java.net.URI;
    
    import org.apache.hadoop.conf.Configuration;
    import org.apache.hadoop.fs.FileSystem;
    import org.apache.hadoop.fs.Path;
    import org.apache.hadoop.io.IOUtils;
    import org.apache.hadoop.util.Progressable;
    
    public class FileCopyWithProgress {
    
    	public static void main(String[] args) throws Exception {
    		
    		String localSrc = args[0];
    		String dst = args[1];
    		
    		InputStream in = new BufferedInputStream(new FileInputStream(localSrc));
    		
    		Configuration config = new Configuration();
    		FileSystem fs = FileSystem.get(URI.create(dst),config);
    		
    		OutputStream out = fs.create(new Path(dst),new Progressable() {
    			
    			@Override
    			public void progress() {
    				System.out.println(".");
    			}
    		});
    		
    		IOUtils.copyBytes(in, out, 4096, true);
    	}
    }
    

      hadoop中执行:

  • 相关阅读:
    [BZOJ1584][Usaco2009 Mar]Cleaning Up 打扫卫生
    CSS浮动
    Django by example -----1总结
    C#函数重载
    linux目录的特点
    Linux调优
    linux
    对齐方式
    19-10-25-G-悲伤
    19-10-24-H
  • 原文地址:https://www.cnblogs.com/yixiwenwen/p/5588290.html
Copyright © 2011-2022 走看看