16 Messages
Issue with Hive query (FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask)
We are running a POC for customer RBC and running into an issue with the Hive environment specifically.
Other sources are able to profile and run jobs with no issue.
The error occurs when we try to just Estimate Job, not even at the point of running the profiling yet. The operation appears to be doing select counts. Attached are the logs (changed extension to allow attachment).
Checking google appears to indicate many different solutions to this issue, tried a few but wanted to see if anyone has seen this issue before working with Hive for DQ.
RBC-owl-web.txt (8.3 MB)
laurentweichberger
101 Messages
3 years ago
Hi Adam, I see a security problem in the log here, which would rapidly stop a DQ Check:
FAILED: SemanticException Unable to fetch table cdr_data. org.apache.hadoop.security.AccessControlException: Permission denied: user=DSJD0SRVCMHIVE, access=EXECUTE, inode="/qa/06295/app/ZIU0/data/cdr/outbound_timeseries":hdfs:hdfs:drwxr-x---
2
0
adamblalock
16 Messages
3 years ago
Provided them this documentation. The latest error is:
Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, 10.241.165.29, executor 0): java.sql.SQLException: [Cloudera]HiveJDBCDriver Error creating login context using ticket cache: Unable to obtain Principal Name for authentication . at com.cloudera.hiveserver2.hivecommon.api.HiveServer2ClientFactory.createTransport(Unknown Source) at com.cloudera.hiveserver2.hivecommon.api.ServiceDiscoveryFactory.createClient(Unknown Source) at com.cloudera.hiveserver2.hivecommon.core.HiveJDBCCommonConnection.establishConnection(Unknown Source) at com.cloudera.hiveserver2.jdbc.core.LoginTimeoutConnection.connect(Unknown Source) at com.cloudera.hiveserver2.jdbc.common.BaseConnectionFactory.doConnect(Unknown Source) at com.cloudera.hiveserver2.jdbc.common.AbstractDriver.connect(Unknown Source) at org.apache.spark.sql.execution.datasources.jdbc.DriverWrapper.connect(DriverWrapper.scala:45) at org.apache.spark.sql.exe
0
0