zoukankan      html  css  js  c++  java
  • Sqoop2常用命令介绍

    命令行操作之Create Command

    1、Create Connection Function
    create connection --cid 1  说明:Create new connection object for connector with id <x>
    sqoop:000> create connection --cid 1
    Creating connection for connector with id 1
    Please fill following values to create new connection object
    Name: jdbc
    Connection configuration
    JDBC Driver Class: com.mysql.jdbc.Driver
    JDBC Connection String: jdbc:mysql://hadoop000:3306/hive
    Username: root
    Password: ****
    JDBC Connection Properties:
    There are currently 0 values in the map:
    entry#
    Security related configuration options
    Max connections: 100
    New connection was successfully created with validation status FINE and persistent id 5
    2、Create Job Function
    create job --xid 1    说明:Create new job object for connection with id <x>
    create job --xid 1 --type import    说明:Create new job object with type <t> (import, export)
    sqoop:000> create job --xid 5 --type import
    Creating job for connection with id 5
    Please fill following values to create new job object
    Name: tbls_import
    Database configuration
    Schema name: hive
    Table name: TBLS
    Table SQL statement:
    Table column names:
    Partition column name:
    Nulls in partition column:
    Boundary query:
    Output configuration
    Storage type:
      0 : HDFS
    Choose: 0
    Output format:
      0 : TEXT_FILE
      1 : SEQUENCE_FILE
    Choose: 0
    Compression format:
      0 : NONE
      1 : DEFAULT
      2 : DEFLATE
      3 : GZIP
      4 : BZIP2
      5 : LZO
      6 : LZ4
      7 : SNAPPY
    Choose: 0
    Output directory: hdfs://hadoop000:8020/sqoop2/tbls/
    Throttling resources
    Extractors:
    Loaders:
    New job was successfully created with validation status FINE  and persistent id 3

    命令行操作之Show Command

    1、Show Server Function
    说明:Show details about configuration connection to Sqoop server.
    sqoop:000> show server --all
    Server host: localhost
    Server port: 12000
    Server webapp: sqoop
    sqoop:000> show server --host
    Server host: localhost
    sqoop:000> show server --port
    Server port: 12000
    sqoop:000> show server --webapp
    Server webapp: sqoop
    2、Show Option Function
    Show values of various client side options. This function will show all client options when called without arguments.
    sqoop:000> show option --name verbose
    Verbose = false
    3、Show Version Function
    Show versions of both client and server as well as supported protocols.
    sqoop:000> show version --all
    client version:
      Sqoop 1.99.3-cdh5.0.0 revision Unknown
      Compiled by jenkins on Thu Mar 27 23:34:50 PDT 2014
    server version:
      Sqoop 1.99.3-cdh5.0.0 revision Unknown
      Compiled by jenkins on Thu Mar 27 23:34:50 PDT 2014
    Protocol version:
      [1]
    sqoop:000> show version --client
    client version:
      Sqoop 1.99.3-cdh5.0.0 revision Unknown
      Compiled by jenkins on Thu Mar 27 23:34:50 PDT 2014
    sqoop:000> show version --server
    server version:
      Sqoop 1.99.3-cdh5.0.0 revision Unknown
      Compiled by jenkins on Thu Mar 27 23:34:50 PDT 2014
    sqoop:000> show version --protocol
    Protocol version:
      [1]
    4、Show Connector Function
    Show connector meta data - parameters that connectors need in order to create new connection and job objects.
    show connector --all
    5、Show Connection Function 
    show connection -all
    show connection --xid 5
    6、Show Job Function
    show job --all
    show job --jid 4

    命令行操作之Update Command

    1、Update Connection Function
    update connection --xid 1 
    2、Update Job Function 
    update job --jid 1

    命令行操作之Delete Command

    1、Delete Connection Function

    delete connection --xid 1 

    2、Delete Job Function

    delete job --jid 1

    命令行操作之Clone Command

    1、Clone Connection Function

    clone connection --xid 3

    2、Clone Job Function

    clone job --jid 3

    命令行操作之Submission Command

    1、Submission Start Function
    Start job (submit new submission). Starting already running job is considered as invalid operation.
    start job --jid 3 -s
    2、Submission Stop Function
    Interrupt running job.
    stop job  --jid 3
    3、Submission Status Function
    Retrieve last status for given job.
    status job --jid 3
  • 相关阅读:
    p1229
    2017.01.21
    P1136 超车 归并排序 求逆序对个数
    2017年寒假计划
    递归一题总结(OJ P1117倒牛奶)
    原来scanf读入字符串还能这样..
    2016NOIP总结
    公式推♂倒题
    kmp+DP x 子串相关的计数问题
    XXXXXXXX不会太多吧?
  • 原文地址:https://www.cnblogs.com/luogankun/p/4209076.html
Copyright © 2011-2022 走看看