zoukankan      html  css  js  c++  java
  • HDFS权限问题

    HDFS权限问题 

    Win下Eclipse提交hadoop程序出错:org.apache.hadoop.security.AccessControlException: Permission denied: user=mango, access=WRITE


    描述:在window下使用Eclipse进行hadoop的程序编写,然后Run on hadoop 后,出现如下错误:


    11/10/28 16:05:53 INFO mapred.JobClient: Running job: job_201110281103_0003
    11/10/28 16:05:54 INFO mapred.JobClient: map 0% reduce 0%
    11/10/28 16:06:05 INFO mapred.JobClient: Task Id : attempt_201110281103_0003_m_000002_0, Status : FAILED
    org.apache.hadoop.security.AccessControlException: org.apache.hadoop.security.AccessControlException: Permission denied: user=mango, access=WRITE, inode="hadoop"/inode="tmp":hadoop:supergroup:rwxr-xr-x
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)


     


    解决方法:


      到服务器上修改hadoop的配置文件:conf/hdfs-site.xml, 找到 dfs.permissions 的配置项 , 将value值改为 false


    <property>
    <name>dfs.permissions</name>
    <value>false</value>
    <description>
    If "true", enable permission checking in HDFS.
    If "false", permission checking is turned off,
    but all other behavior is unchanged.
    Switching from one parameter value to the other does not change the mode,
    owner or group of files or directories.
    </description>
    </property>

    如果配置文件中没有该内容,可以自己添加
     


    修改完貌似要重启下hadoop的进程才能生效

  • 相关阅读:
    msql查询指定日期
    NLP常见任务
    KTT条件及其理解
    距离度量--熵,KL散度,JS散度,GAN相关应用
    常见的激活函数
    分类问题的判别标准
    最大似然估计
    损失函数
    【ML-10】多分类及多标签分类算法
    【ML-9】支持向量机--实验scitit-learn SVM
  • 原文地址:https://www.cnblogs.com/catWang/p/4014696.html
Copyright © 2011-2022 走看看