zoukankan      html  css  js  c++  java
  • spark 通过keytab 获取认证

    /usr/local/spark-2.3.0-bin-2.6.0-cdh5.8.0/bin/spark-submit 
    --keytab /home/jj/tl.keytab 
    --principal vf@FC.COM  
    --class com.bb.sailer.engine_client.JobAa9d67c8c46843349043610b6d7b21dd 
    --master yarn 
    --deploy-mode client 
    --name flow_1547016972595_ocdwlgoz 
    --verbose 
    --driver-memory 2G --num-executors 4 
    --executor-cores 2 --executor-memory 4G 
    --conf spark.default.parallelism=16 
    --conf spark.ui.showConsoleProgress=true 
    target/sailer-engine-client-1.0-SNAPSHOT.jar
    

      

    "KDC can't fulfill requested option while renewing credentials" errors when running Db2 Big SQL statements on a Kerberized cluster

    When running Db2® Big SQL statements on a Kerberized cluster, you might encounter Kerberos key distribution center (KDC) errors about credentials renewal in the bigsql.log file.

    Symptoms

    The following exception is an example of the type of error that you might encounter:
    
    WARN org.apache.hadoop.security.UserGroupInformation [TGT Renewer 
    for bigsql/bigaperf061.svl.ibm.com@IBM.COM] : Exception encountered while running the renewal command 
    for bigsql/bigaperf061.svl.ibm.com@IBM.COM. (TGT end time:1537469365000, renewalFailures: 
    org.apache.hadoop.metrics2.lib.MutableGaugeInt@d5c962e6,renewalFailuresTotal: 
    org.apache.hadoop.metrics2.lib.MutableGaugeLong@abc4d818)
    ExitCodeException exitCode=1: kinit: KDC can't fulfill requested option while renewing credentials
    

    Causes

    This error occurs when the KDC fails to generate a renewable ticket-granting ticket (TGT).

    Resolving the problem

    1. To ensure that a TGT is generated and renewed appropriately while Db2 Big SQL processes are running, set up the max_renewable_life parameter appropriately in the realms section of the /var/kerberos/krb5kdc/kdc.conf file on the Kerberos server. This step is not required on the client side.
      In the following example max_renewable_life is set to 7 days:
      max_renewable_life = 7d
      For the renewal policy to work, you must also run the following command on the KDC host:
      kadmin.local -q "modprinc -maxrenewlife max_renewable_life_value krbtgt/<REALM_in_CAPS>"
    2. Specify or modify the maximum renewable life of tickets (maxrenewlife) parameter for the service principals to enable long running processes (such as LOAD) to run and complete.
      The following example shows how to modify maxrenewlife for the bigsql and hive service principals on node bdavm750.svl.ibm.com from the kadmin command line prompt. Be sure to modify maxrenewlife for the bigsql and hive service principals on all nodes.
      
      modprinc -maxrenewlife "1 week" +allow_renewable bigsql/bdavm750.ibm.com@IBM.COM
      modprinc -maxrenewlife "1 week" +allow_renewable hive/bdavm750.ibm.com@IBM.COM
  • 相关阅读:
    正确理解TensorFlow中的logits
    笔记:TensorFlow全连接层函数tf.layers.dense()原理
    Pandas读取行列数据最全方法
    Oracle 怎么同时插入多条数据?
    tensorflow 中 sigmoid, softmax, sparse_softmax 的 cross_entropy_with_logits,常见loss
    Tensorflow同时加载使用多个模型
    衡量机器学习模型的三大指标:准确率、精度和召回率。
    【tensorflow】Decaying the learning rate
    2019.7.29 区块链论文翻译
    2019.7.16 区块链论文翻译
  • 原文地址:https://www.cnblogs.com/irobotzz/p/15275530.html
Copyright © 2011-2022 走看看