Use libhdfs and fuse-dfs in cloudera hadoop to mount the files in hdfs for the nearby really hard disk.txt

recover mbr partition table and fuse-dfs in clouderahadoop to mount the files in hdfs towards the nearby tough disk 1. The operating system version in the cluster atmosphere is centos5.8hadoop version is clouderahadoopcdh3u3.Soon after installing and deploying the hadoop cluster, manually set up fuse2.8.five download address http:/ /down.51cto.com/data/207767 installation strategy #tarzxvffuse-2.eight.5.tar.gz#cdfuse-2.eight.5#./configure--libdir=/lib64makemakeinstall set up hadoop-fuse to get cdh3yum supply wget-chttp:/ /archive.cloudera.com/redhat/cdh/cdh3-repository-1.0-1.noarch.rpm install the downloaded rpm package yum--nogpgchecklocalinstallcdh3-repository-1.0-1.noarch.rpm import rpmkeyrpm--importhttp://archive .cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera set up hadoop-0.20-fuseyum-yinstallhadoop-0.20-fuse If clouderahadoop is installed manually, which is, using the tar.gz compressed package for deployment, it can need to be utilised since the hadoop execution file automatically installed in the course of yum installation of hadoop-fuse is renamed mv/usr/bin/hadoop/usr/bin/hadoop_back to view the dependency library linux-gate of ldd/usr/lib/hadoop-0.20/bin/fuse_dfs so.1=(0xffffe000)libhdfs.so.0=notfoundlibfuse.so.2=/lib/libfuse.so.2(0xf7f64000)libjvm.so=notfoundlibc.so.6=/lib/libc.so.6(0x00417000 )libm.so.6=/lib/libm.so.6(0x00681000)librt.so.1=/lib/librt.so.1(0x00595000)libdl.so.2=/lib/libdl.so.two( 0x0058e000) libpthread.so.0=/lib/libpthread.so.0 (0x00572000)/lib/ld-linux.so.two(0x003f8000) It might be noticed that the dependent library path on the file fuse_dfs is incorrect, so this file can't be made use of to copy $HADOOP_HOME/contrib/fuse-dfs/fuse_dfs to $HADOOP_HOME/bin The file fuse_dfs file offers executable permissions #chmod+xfuse_dfs to view the shared dependency library path of fuse_dfs#ldd$HADOOP_HOME/bin/fuse_dfslinux-vdso.so.1=(0x00007fffca6b8000)libhdfs.so.0=/lib64/libhdfs.so.0 (0x00002ba98d785000)libfuse.so.2=/lib64/libfuse.so.two(0x00002ba98d98f000)libjvm.so=/lib64/libjvm.so(0x00002ba98dbc2000)libc.so.6=/lib64/libc.so.6(0x0000003093800000) libm.so.6=/lib64/libm.so.six(0x0000003094400000)libdl.so.2=/lib64/libdl.so.two(0x0000003093c00000)libpthread.so.0=/lib64/libpthread.so.0(0x0000003094000000 )librt.so.1=/lib64/librt.so.1(0x0000003095400000)/lib64/ld-linux-x86-64.so.2(0x0000003093400000) for those who encounter the file libhdfs.so.0=notfound then find/- Name 'libhdfs.so.0' find the file and copy it to /lib64. If it can be libjvm.so=notfound, execute the command cp$JAVA_HOME/jre/lib/amd64/server/libjvm.so/lib64 to modify vi/usr/bin/ After saving the file inside the $HADOOP_HOME path in the hadoop-fuse-dfs file, you could mount the file in hdfs for the nearby disk to make a mount point and mount hdfsmkdir-p/data/hdfs/chown-Rhadoop:hadoop/data/hdfs /hadoop-fuse-dfsdfs://namenode:900 Right after 0/data/hdfs is mounted, it is possible to view the files in hdfs in /data/hdfs to unmount hdfs files umount/data/hdfs