惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Martin Fowler
Martin Fowler
Blog — PlanetScale
Blog — PlanetScale
Vercel News
Vercel News
L
LangChain Blog
Google DeepMind News
Google DeepMind News
H
Hackread – Cybersecurity News, Data Breaches, AI and More
F
Fortinet All Blogs
The GitHub Blog
The GitHub Blog
Recent Announcements
Recent Announcements
D
DataBreaches.Net
云风的 BLOG
云风的 BLOG
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
A
About on SuperTechFans
博客园_首页
N
Netflix TechBlog - Medium
Y
Y Combinator Blog
Hugging Face - Blog
Hugging Face - Blog
Last Week in AI
Last Week in AI
酷 壳 – CoolShell
酷 壳 – CoolShell
B
Blog
Apple Machine Learning Research
Apple Machine Learning Research
罗磊的独立博客
美团技术团队
V
V2EX

博客园 - LixingTie

Git添加排除文件规则 [RabbitMQ+Python入门经典] 兔子和兔子窝 Win7强制删除文件 vim配置 Ubuntu部署HBase Ubuntu部署Zookeeper Ubuntu 12.04下安装Extmail 白话MongoDB(三) 白话MongoDB(二) 白话MongoDB(一) 关于HBase的一些零碎事 Paxos在大型系统中常见的应用场景 某分布式应用实践一致性哈希的一些问题 多IDC的数据分布设计(二) 多IDC的数据分布设计(一) Redis新的存储模式diskstore Redis容量及使用规划 Redis几个认识误区 一致性哈希(Consistent Hashing)
Ubuntu 12.04 Hadoop自动安装脚本
LixingTie · 2012-06-27 · via 博客园 - LixingTie

安装烦了,写个脚本吧。

#!/bin/bash

if [ `id -u` == 0 ]; then
  echo "must not be root!"
  exit 0
fi

#hadoop install
if [ ! -d ~/software/hadoop/ ]; then
  mkdir ~/software/hadoop/
fi

wget http://archive.apache.org/dist/hadoop/core/stable/hadoop-1.0.3.tar.gz -O ~/software/hadoop/hadoop-1.0.3.tar.gz
tar xvzf ~/software/hadoop/hadoop-*.tar.gz -C ~/software/hadoop/
rm ~/software/hadoop/hadoop-*.tar.gz

#hadoop config
if [ $(getconf LONG_BIT) == 64 ]; then
  echo "export JAVA_HOME=/usr/lib/jvm/java-6-openjdk-amd64" >> /etc/profile
else
  echo "export JAVA_HOME=/usr/lib/jvm/java-6-openjdk-i386" >> /etc/profile
fi
echo "export HADOOP_HOME=~/software/hadoop/hadoop-1.0.3" >> /etc/profile
echo "export PATH=$PATH:$HADOOP_HOME/bin:$JAVA_HOME/bin" >> /etc/profile
echo "export HADOOP_HOME_WARN_SUPPRESS=1" >> /etc/profile

#hadoop core-site.xml
echo "<?xml version='1.0'?>" > ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "<?xml-stylesheet type='text/xsl' href='configuration.xsl'?>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "<configuration>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "  <property>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "    <name>fs.default.name</name>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "    <value>hdfs://localhost:9000</value>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "  </property>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "  <property>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "    <name>hadoop.tmp.dir</name>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "    <value>~/software/hadoop/tmp</value>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "  </property>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml
echo "</configuration>" >> ~/software/hadoop/hadoop-1.0.3/conf/core-site.xml

#hadoop hdfs-site.xml
echo "<?xml version='1.0'?>" > ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "<?xml-stylesheet type='text/xsl' href='configuration.xsl'?>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "<configuration>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "  <property>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "    <name>dfs.name.dir</name>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "    <value>~/software/hadoop/name</value>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "  </property>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "  <property>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "    <name>dfs.data.dir</name>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "    <value>~/software/hadoop/data</value>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "  </property>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "  <property>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "    <name>dfs.replication</name>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "    <value>2</value>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "  </property>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml
echo "</configuration>" >> ~/software/hadoop/hadoop-1.0.3/conf/hdfs-site.xml

#hadoop mapred-site.xml
echo "<?xml version='1.0'?>" > ~/software/hadoop/hadoop-1.0.3/conf/mapred-site.xml
echo "<?xml-stylesheet type='text/xsl' href='configuration.xsl'?>" >> ~/software/hadoop/hadoop-1.0.3/conf/mapred-site.xml
echo "<configuration>" >> ~/software/hadoop/hadoop-1.0.3/conf/mapred-site.xml
echo "  <property>" >> ~/software/hadoop/hadoop-1.0.3/conf/mapred-site.xml
echo "    <name>mapred.job.tracker</name>" >> ~/software/hadoop/hadoop-1.0.3/conf/mapred-site.xml
echo "    <value>localhost:9001</value>" >> ~/software/hadoop/hadoop-1.0.3/conf/mapred-site.xml
echo "  </property>" >> ~/software/hadoop/hadoop-1.0.3/conf/mapred-site.xml
echo "</configuration>" >> ~/software/hadoop/hadoop-1.0.3/conf/mapred-site.xml

source /etc/profile
hadoop namenode -fromat
$HADOOP_HOME/bin/start-all.sh