第一步:准备3台虚拟机
cloudera-scm server 内存分配4G
cloudera-scm agent 内存分配2G
cloudera-scm agent 内存分配2G
第二步:每台机器安装jdk环境
并查看Java版本 java -version
第三步:关闭防火墙
指令:sudo apt-get install ufw
指令:sudo ufw disable
指令:sudo ufw status
第四步:三台机器都安装ssh
指令:sudo apt-get install ssh
指令:sudo mv /usr/bin/host /usr/bin/host.bak
指令:echo 0 > /proc/sys/vm/swappiness
第五步:下载安装cloudera-manager
下载网址:http://archive.cloudera.com/cm5/installer
cd到目录/usr/cloudera
指令:wget -r -O cloudera-manager-installer.bin "http://archive.cloudera.com/cm5/installer/latest/cloudera-manager-installer.bin"
指令:chmod u+x cloudera-manager-installer.bin 改变执行权限
指令:sudo ./cloudera-manager-installer.bin 安装
安装错误:
在这里安装时出现了点问题:
首先需要执行指令:vim /var/log/cloudera-manager-installer/2.refresh-repo.log 查看安装日志
有如下错误:
Err http://security.ubuntu.com trusty-security/main amd64 Packages 404 Not Found [IP: 91.189.91.26 80]
Fetched 1,107 kB in 11s (92.8 kB/s)
W: GPG error: http://extras.ubuntu.com trusty Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 16126D3A3E5C1192
W: Failed to fetch http://security.ubuntu.com/ubuntu/dists/trusty-security/main/binary-amd64/Packages 404 Not Found [IP: 91.189.91.26 80]
W: Failed to fetch http://security.ubuntu.com/ubuntu/dists/trusty-security/main/binary-i386/Packages Hash Sum mismatch
E: Some index files failed to download. They have been ignored, or old ones used instead.
搜寻资料显示是源的故障:指令sudo apt-get updata 会报同样的错误
所以清空源缓存:指令:sudo rm -vfr /var/lib/apt/lists/*
更改源:指令 sudo vim /etc/apt/sources.list
将之前的源去掉,或者添加 # 到源前面。
然后添加下来源,并且sudo apt-get update 和 sudo apt-get upgrade
deb http://mirrors.aliyun.com/ubuntu/ trusty main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ trusty-security main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ trusty-updates main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ trusty-proposed main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ trusty-backports main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ trusty main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ trusty-security main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ trusty-updates main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ trusty-proposed main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ trusty-backports main restricted universe multiverse
然后再次安装 指令:sudo ./cloudera-manager-installer.bin
第六步:登陆cloudera
win7上登陆 http://10.0.83.201:7180 账号密码都是admin
根据提示点“继续”
直到搜索,输入:10.0.83.173,10.0.83.201,10.0.83.202
到集群安装又遇到新问题如下:
因为设置密码登陆时是需要填写root的登陆密码。