zoukankan      html  css  js  c++  java
  • Hadoop之简单文件读写

     文件简单写操作:

     1 import org.apache.hadoop.conf.Configuration;
     2 import org.apache.hadoop.fs.FSDataOutputStream;
     3 import org.apache.hadoop.fs.FileSystem;
     4 import org.apache.hadoop.fs.Path;
     5 public class writeFile {
     6     public static void main(String[] args) {
     7         try{
     8             Configuration conf=new Configuration();
     9             //如果没有把配置文件加入bin文件夹,那么需要加入下面两行
    10             //conf.set("fs.defaultFS","hdfs://localhost:9000" );
    11             //conf.set("fs.hdfs.impl", "org.apache.hadoop.hdfs.DistributedFileSystem");
    12             FileSystem fs =FileSystem.get(conf);
    13             byte[] buffer="Hello world!".getBytes();
    14             String Filename="hdfs://localhost:9000/user/hadoop/file5.txt";
    15  
    16             FSDataOutputStream os=fs.create(new Path(Filename));
    17             os.write(buffer,0,buffer.length);
    18             
    19             System.out.println("creat "+Filename+" successfully");
    20             os.close();
    21             fs.close();
    22         }
    23         catch(Exception e){
    24             e.printStackTrace();
    25         }
    26     }
    27 }

    文件简单读操作:

     1 import java.io.BufferedReader;
     2 import java.io.InputStreamReader;
     3 
     4 import org.apache.hadoop.conf.Configuration;
     5 import org.apache.hadoop.fs.FSDataInputStream;
     6 import org.apache.hadoop.fs.FileSystem;
     7 import org.apache.hadoop.fs.Path;
     8 
     9 public class readFile {
    10     public static void main(String argsp[]){
    11         try{
    12             Configuration conf = new Configuration();
    13             conf.set("fs.defaultFS","hdfs://localhost:9000" );
    14             conf.set("fs.hdfs.impl", "org.apache.hadoop.hdfs.DistributedFileSystem");
    15             FileSystem fs = FileSystem.get(conf);
    16             
    17             Path file = new Path("hdfs://localhost:9000/user/hadoop/file5.txt");
    18             
    19             FSDataInputStream is = fs.open(file);
    20             
    21             BufferedReader bd = new BufferedReader(new InputStreamReader(is));
    22             String content = bd.readLine();
    23             
    24             System.out.println(content);
    25             
    26             bd.close();
    27             fs.close();
    28         }
    29         catch(Exception e){
    30             e.printStackTrace();
    31         }
    32     }
    33 }

     

  • 相关阅读:
    AtCoder Beginner Contest 162 C~F
    题解 | 【CF896B】 Ithea Plays With Chtholly
    C# | C#快速入门
    Codeforces Round #618 (Div. 2) A~E
    Educational Codeforces Round 92 (Rated for Div. 2) A~C
    使用 Python 参与算法竞赛
    【网络爬虫学习】实战,爬取网页以及贴吧数据
    国内pip源提示“not a trusted or secure host”解决方案
    【网络爬虫学习】第一个Python爬虫程序 & 编码与解码详解 & Pythonの实现
    【网络爬虫学习】网页的基本构成
  • 原文地址:https://www.cnblogs.com/zyb993963526/p/10219608.html
Copyright © 2011-2022 走看看