Labels

Thursday, September 3, 2015

Error - Cannot run program "chmod": CreateProcess error=2, The system cannot find the file specified in wso2 BAM

Hi,
I got this error when starting the WSO2 BAM in Windows Machine.
I had struggle with this error for a few hours and finally got it working.

ERROR {org.apache.hadoop.hive.ql.exec.ExecDriver} -  Job Submission failed with exception 'java.io.IOException(Cannot run program "chmod": CreateProcess error=2, The system cannot find the file specified)'
java.io.IOException: Cannot run program "chmod": CreateProcess error=2, The system cannot find the file specified
 at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
 at org.apache.hadoop.util.Shell.runCommand(Shell.java:200)
 at org.apache.hadoop.util.Shell.run(Shell.java:182)
 at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:375)
 at org.apache.hadoop.util.Shell.execCommand(Shell.java:461)
 at org.apache.hadoop.util.Shell.execCommand(Shell.java:444)
 at org.apache.hadoop.fs.RawLocalFileSystem.execCommand(RawLocalFileSystem.java:553)
 at org.apache.hadoop.fs.RawLocalFileSystem.execSetPermission(RawLocalFileSystem.java:545)
 at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:531)
 at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:324)
 at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)
 at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
 at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:798)
 at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:792)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1123)
 at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:792)
 at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:766)
 at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:460)
 at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:733)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.io.IOException: CreateProcess error=2, The system cannot find the file specified
 at java.lang.ProcessImpl.create(Native Method)
 at java.lang.ProcessImpl.(ProcessImpl.java:385)
 at java.lang.ProcessImpl.start(ProcessImpl.java:136)
 at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
 ... 25 more
 {org.apache.hadoop.hive.ql.exec.ExecDriver}
TID: [0] [BAM] [2015-09-03 12:58:12,130] ERROR {org.apache.hadoop.hive.ql.exec.Task} -  Execution failed with exit status: 2 {org.apache.hadoop.hive.ql.exec.Task}
TID: [0] [BAM] [2015-09-03 12:58:12,130] ERROR {org.apache.hadoop.hive.ql.exec.Task} -  Obtaining error information {org.apache.hadoop.hive.ql.exec.Task}
TID: [0] [BAM] [2015-09-03 12:58:12,130] ERROR {org.apache.hadoop.hive.ql.exec.Task} -  
Task failed!
Task ID:
  Stage-0

Logs:
 {org.apache.hadoop.hive.ql.exec.Task}
TID: [0] [BAM] [2015-09-03 12:58:12,130] ERROR {org.apache.hadoop.hive.ql.exec.Task} -  C:\Users\wso2\Desktop\ME\WSO2BA~1.0\WSO2BA~1.0\bin\../repository/logs//wso2carbon.log {org.apache.hadoop.hive.ql.exec.Task}
TID: [0] [BAM] [2015-09-03 12:58:12,130] ERROR {org.apache.hadoop.hive.ql.exec.ExecDriver} -  Execution failed with exit status: 2 {org.apache.hadoop.hive.ql.exec.ExecDriver}
TID: [0] [BAM] [2015-09-03 12:58:12,130] ERROR {org.apache.hadoop.hive.ql.Driver} -  FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask {org.apache.hadoop.hive.ql.Driver}
TID: [0] [BAM] [2015-09-03 12:58:12,130] ERROR {org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl} -  Error executing query: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask {org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl}
java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
 at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:189)
 at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.executeHiveQuery(HiveExecutorServiceImpl.java:599)
 at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:304)
 at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:192)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
TID: [0] [BAM] [2015-09-03 12:58:12,130] ERROR {org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl} -  Error while executing Hive script.
Query returned non-zero code: 9, cause: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask {org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl}
java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
 at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:189)
 at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.executeHiveQuery(HiveExecutorServiceImpl.java:599)
 at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:304)
 at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:192)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
TID: [0] [BAM] [2015-09-03 12:58:12,130] ERROR {org.wso2.carbon.analytics.hive.task.HiveScriptExecutorTask} -  Error while executing script : am_stats_analyzer {org.wso2.carbon.analytics.hive.task.HiveScriptExecutorTask}


If you are facing the same error there is 2 main things you have to clarify in-order to get it working properly.

1. Check If you have correctly added the cygwin in the windows system Path variable. Check if there is any spaces and file path is correct.
2. If the 1st step is properly done and you still getting the above error then that means you haven't install cygwin properly.  When you install the cygwin make sure you have installed basic,  net (OpenSSH,tcp_wrapper packages)  and security related cygwin packages. 

using those 2 steps you can get rid of this unwanted error.
Hope this post saved your time 
Thanks,
~Vinu~

No comments:

Post a Comment