现在的位置: 首页 > 云计算 > 正文

在Eclipse中导入hadoop

2013年12月26日 云计算 ⁄ 共 2241字 ⁄ 字号 评论关闭

秒速赛车公式 www.l19l7.cn 0. 准备
(1) 需要有gcc、autoconf、automake来编译安装google的protocol buffer
(2) //protobuf.googlecode.com/files/protobuf-2.4.1.tar.gz
./configure --prefix=/usr/local
make
make check
sudo make install
完成后,检验
$ protoc
Missing input file.
(3) JDK、ANT、Maven(MVN)

1. 在Eclipse中增加SVN插件
在help->install new software
添加 //subclipse.tigris.org/update/

在window/Open Perspective中就会右SVN的视图

2. 导出代码(该trunk下面右多个project)

svn checkout //svn.apache.org/repos/asf/hadoop/common/trunk/ hadoop-trunk

3. mvn: build the code to get it ready for importing into Eclipse.

cd haoop-trunk
$ mvn install -DskipTests
$ mvn eclipse:eclipse -DdownloadSources=true -DdownloadJavadocs=true
Note: This may take a while the first time,?
as all libraries are fetched from the internet, and the whole build is performed
error:
Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-proto)?
on project hadoop-common: Command execution failed. Cannot run program "protoc"
issue: ?install google's protocol buffer

4. In Eclipse
After the above, do the following to finally have projects in Eclipse ready and waiting for you to go on that scratch-itching development spree:

For Common
File -> Import...
Choose "Existing Projects into Workspace"
Select the hadoop-common-project directory as the root directory
Select the hadoop-annotations, hadoop-auth, hadoop-auth-examples and hadoop-common projects
Click "Finish"
File -> Import...
Choose "Existing Projects into Workspace"
Select the hadoop-assemblies directory as the root directory
Select the hadoop-assemblies project
Click "Finish"
To get the projects to build cleanly:
* Add target/generated-test-sources/java as a source directory for hadoop-common
* You may have to add then remove the JRE System Library to avoid errors due to access restrictions

For HDFS
File -> Import...
Choose "Existing Projects into Workspace"
Select the hadoop-hdfs-project directory as the root directory
Select the hadoop-hdfs project
Click "Finish"

For MapReduce
File -> Import...
Choose "Existing Projects into Workspace"
Select the hadoop-mapreduce-project directory as the root directory
Select the hadoop-mapreduce-project project
Click "Finish"
Note: in the case of MapReduce the testjar package is broken. This is expected since it is a part of a testcase that checks for incorrect packaging. This is not to be worried about.

To run tests from Eclipse you need to additionally do the following:
Under project Properties, select Java Build Path, and the Libraries tab
Click "Add External Class Folder" and select the build directory of the current project

抱歉!评论已关闭.

  • 海淀区中关村街道开展幼儿园反恐防暴实战演习活动 2019-01-22
  • 安徽支持大学创新创业筹划设20亿科技转化基金 2019-01-22
  • 老外赛龙舟  南半球最大规模龙舟赛开赛 2019-01-21
  • 《事业单位公开招聘分类考试公共科目笔试考试大纲解读》出版 2019-01-21
  • 黔江:1000余亩蓝莓成熟 市民乐享“莓”好时光 2019-01-20
  • 中华龙舟如何奋楫争先?习近平这些话要牢记 2019-01-20
  • 只有存在社会财富的个人所有制即和公有制并存的私有制,人们所占有的私有财产就会有多寡的不同,占有私有财产多的人富裕,占有私有财产少的人贫穷,人们就会有贫... 2019-01-19
  • 高温雷暴一起来 注意防雨和防晒 2019-01-19
  • 几家性价比超高的烤肉店 赶紧去试试 2019-01-19
  • 北京市最大单体分布式光伏发电项目并网 2019-01-19
  • 探索日本静冈茶园转型发展 2019-01-18
  • 一语惊坛(5月9日):推动中朝友谊,造福两国人民。 2019-01-18
  • 卢思骋:粤港澳大湾区生态规划要趁早 2019-01-17
  • 持久战是真打,因为会有清单被逐步落实。美国与中国一样不希望两败俱伤的真打,现在还是叫板中,以增加今后谈判筹码。由于我顺差太大,打不多久就没得打了。所以要来个速决 2019-01-17
  • 反思顾雏军案,营造可预期的法治环境 2019-01-16
  • 877| 360| 115| 106| 951| 257| 877| 403| 52| 958|