learn from error…
Error: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in fetcher#21 at org.apache.hadoop.mapreduce.task.reduce.Shuffle.run(Shuffle.java:134) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:376) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(AccessController.java:488) at javax.security.auth.Subject.doAs(Subject.java:572) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) Caused by: java.lang.ArrayIndexOutOfBoundsException at sun.nio.cs.UTF_8$Encoder.encode(UTF_8.java:652) at java.lang.StringCoding.encode(StringCoding.java:899) at java.lang.String.getBytes(String.java:2221) at org.apache.hadoop.mapreduce.security.SecureShuffleUtils.hashFromString(SecureShuffleUtils.java:89) at org.apache.hadoop.mapreduce.task.reduce.Fetcher.copyFromHost(Fetcher.java:270) at org.apache.hadoop.mapreduce.task.reduce.Fetcher.run(Fetcher.java:165)
Error: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in fetcher#34 at org.apache.hadoop.mapreduce.task.reduce.Shuffle.run(Shuffle.java:134) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:376) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(AccessController.java:488) at javax.security.auth.Subject.doAs(Subject.java:572) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) Caused by: java.lang.IllegalArgumentException: Invalid key to HMAC computation at org.apache.hadoop.security.token.SecretManager.createPassword(SecretManager.java:176) at org.apache.hadoop.mapreduce.security.token.JobTokenSecretManager.computeHash(JobTokenSecretManager.java:56) at org.apache.hadoop.mapreduce.security.SecureShuffleUtils.generateByteHash(SecureShuffleUtils.java:67) at org.apache.hadoop.mapreduce.security.SecureShuffleUtils.generateHash(SecureShuffleUtils.java:57) at org.apache.hadoop.mapreduce.security.SecureShuffleUtils.hashFromString(SecureShuffleUtils.java:89) at org.apache.hadoop.mapreduce.task.reduce.Fetcher.copyFromHost(Fetcher.java:270) at org.apache.hadoop.mapreduce.task.reduce.Fetcher.run(Fetcher.java:165) Caused by: java.security.InvalidKeyException: No installed provider supports this key: javax.crypto.spec.SecretKeySpec at javax.crypto.Mac.a(Unknown Source) at javax.crypto.Mac.init(Unknown Source) at org.apache.hadoop.security.token.SecretManager.createPassword(SecretManager.java:174) ... 6 more Caused by: java.security.NoSuchAlgorithmException: java.lang.reflect.InvocationTargetException at com.ibm.crypto.provider.ay.newInstance(ay.java:33) ... 9 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:86) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:58) at java.lang.reflect.Constructor.newInstance(Constructor.java:542) at com.ibm.crypto.provider.ay.newInstance(ay.java:11) ... 9 more Caused by: java.lang.SecurityException: The IBMJCE provider may have been tampered. at com.ibm.crypto.provider.HmacSHA1.<init>(HmacSHA1.java:32) ... 14 more Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143