zoukankan      html  css  js  c++  java
  • Hadoop MapReduce程序中解决第三方jar包问题方案

    hadoop怎样提交多个第三方jar包?

    方案1:把所有的第三方jar和自己的class打成一个大的jar包,这种方案显然笨拙,而且更新升级比较繁琐。 

    方案2: 
    在你的project里面建立一个lib文件夹,然后把所有的第三方jar包放到里面去,hadoop会自动加载lib依赖里面的jar。 

    http://www.blowide.com/2010/04/including-external-jars-in-a-hadoop-job/ 

    注意最后一段: 
    Luckily, I bumped into a solution suggested Doug Cutting as an answer to someone who had a similar predicament. The solution was to create a “lib” folder in your project and copy all the external jars into this folder. According to Doug, Hadoop will look for third-party jars in this folder. It works great! 

    原作者给的solution。 

  • 相关阅读:
    Minimum Size Subarray Sum 最短子数组之和
    mutiplemap 总结
    Remove-Invalid-Parentheses-题解
    Splay-Tree理解
    Subsets LeetCode总结
    Trie树理解
    Treap树理解
    Trie树之C-实现
    word-ladder总结
    Javascript 对象
  • 原文地址:https://www.cnblogs.com/tmeily/p/4503393.html
Copyright © 2011-2022 走看看