Pitfalls in Hadoop

Pitfalls in Hadoop

Logs1:

Solution1:

The issue is that a /tmp/hadoop-xxx/xxx/LICENSE file and a /tmp/hadoop-xxx/xxx/license directory are being created on a case-insensitive file system when unjarring the mahout jobs. (stackoverflow)

Logs2:

Solution2:

Perhaps it is because when exeucuting hadoop jar x.jar x.X /a/b /c/d , the first args[0] is the class name rather than the input address, try to change args[0] and args[1] to args[1] and args[2] in your driver code.

Log3:

Solution3:

Try to manually add your JAVA_HOME in /etc/hadoop/hadoop-env.sh and restart the cluster. (stackoverflow)