zoukankan      html  css  js  c++  java
  • DataxWeb 设置运行错误

    2021-09-09 09:21:15 [JobThread.run-130] <br>----------- datax-web job execute start -----------<br>----------- Param:
    2021-09-09 09:21:15 [BuildCommand.buildDataXParam-100] ------------------Command parameters:
    2021-09-09 09:21:15 [ExecutorJobHandler.execute-57] ------------------DataX process id: 1948
    2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
    2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.
    2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:15 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:15 [ProcessCallbackThread.callbackLog-186] <br>----------- datax-web job callback finish.
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.234 [main] INFO  VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.240 [main] INFO  Engine - the machine info  => 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     osInfo:    Oracle Corporation 1.8 25.202-b08
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     jvmInfo:    Windows 10 amd64 10.0
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     cpu num:    8
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     totalPhysicalMemory:    -0.00G
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     freePhysicalMemory:    -0.00G
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     maxFileDescriptorCount:    -1
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     currentOpenFileDescriptorCount:    -1
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     GC Names    [PS MarkSweep, PS Scavenge]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     MEMORY_NAME                    | allocation_size                | init_size                      
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     PS Eden Space                  | 256.00MB                       | 256.00MB                       
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     Code Cache                     | 240.00MB                       | 2.44MB                         
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     Compressed Class Space         | 1,024.00MB                     | 0.00MB                         
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     PS Survivor Space              | 42.50MB                        | 42.50MB                        
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     PS Old Gen                     | 683.00MB                       | 683.00MB                       
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     Metaspace                      | -0.00MB                        | 0.00MB                         
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.260 [main] INFO  Engine - 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] {
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     "content":[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         {
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "reader":{
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 "name":"mysqlreader",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 "parameter":{
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "column":[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`id`",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`name`",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`content`",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`createdate`"
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "connection":[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         {
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             "jdbcUrl":[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                                 "jdbc:mysql://192.168.8.248:3306/sourcedb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8"
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             ],
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             "table":[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                                 "t_user_info"
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             ]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         }
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "password":"****",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "splitPk":"id",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "username":"root"
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 }
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             },
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "writer":{
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 "name":"mysqlwriter",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 "parameter":{
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "column":[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`id`",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`name`",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`content`",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "`createdate`"
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "connection":[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         {
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             "jdbcUrl":"jdbc:mysql://192.168.8.248:3306/targetdb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             "table":[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                                 "t_user_info"
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                             ]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         }
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "password":"****",
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "preSql":[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                         "delete from t_user_info"
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     ],
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                     "username":"root"
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]                 }
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             }
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         }
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     ],
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     "setting":{
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         "errorLimit":{
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "percentage":0.02,
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "record":0
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         },
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         "speed":{
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "byte":1048576,
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]             "channel":3
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]         }
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     }
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] }
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.284 [main] WARN  Engine - prioriy set to 0, because NumberFormatException, the value is: null
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.286 [main] INFO  PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.286 [main] INFO  JobContainer - DataX jobContainer starts job.
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.287 [main] INFO  JobContainer - Set jobId = 0
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.496 [job-0] INFO  OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://192.168.8.248:3306/sourcedb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8&yearIsDateType=false&zeroDateTimeBehavior=CONVERT_TO_NULL&tinyInt1isBit=false&rewriteBatchedStatements=true.
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.522 [job-0] INFO  OriginalConfPretreatmentUtil - table:[t_user_info] has columns:[id,name,content,createdate].
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.676 [job-0] INFO  OriginalConfPretreatmentUtil - table:[t_user_info] all columns:[
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] id,name,content,createdate
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] ].
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.699 [job-0] INFO  OriginalConfPretreatmentUtil - Write data [
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] INSERT INTO %s (`id`,`name`,`content`,`createdate`) VALUES(?,?,?,?)
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] ], which jdbcUrl like:[jdbc:mysql://192.168.8.248:3306/targetdb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8&yearIsDateType=false&zeroDateTimeBehavior=CONVERT_TO_NULL&rewriteBatchedStatements=true&tinyInt1isBit=false]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.700 [job-0] INFO  JobContainer - jobContainer starts to do prepare ...
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.700 [job-0] INFO  JobContainer - DataX Reader.Job [mysqlreader] do prepare work .
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.700 [job-0] INFO  JobContainer - DataX Writer.Job [mysqlwriter] do prepare work .
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.711 [job-0] INFO  CommonRdbmsWriter$Job - Begin to execute preSqls:[delete from t_user_info]. context info:jdbc:mysql://192.168.8.248:3306/targetdb?serverTimezone=Asia/Shanghai&useLegacyDatetimeCode=false&useSSL=false&nullNamePatternMatchesAll=true&useUnicode=true&characterEncoding=UTF-8&yearIsDateType=false&zeroDateTimeBehavior=CONVERT_TO_NULL&rewriteBatchedStatements=true&tinyInt1isBit=false.
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.712 [job-0] INFO  JobContainer - jobContainer starts to do split ...
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.818 [job-0] ERROR JobContainer - Exception when job run
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] com.alibaba.datax.common.exception.DataXException: Code:[Framework-03], Description:[DataX引擎配置错误,该问题通常是由于DataX安装错误引起,请联系您的运维解决 .].  - 在有总bps限速条件下,单个channel的bps值不能为空,也不能为非正数
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:26) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.adjustChannelNumber(JobContainer.java:430) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.split(JobContainer.java:387) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:117) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.start(Engine.java:92) [datax-core-0.0.1-SNAPSHOT.jar:na]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.entry(Engine.java:171) [datax-core-0.0.1-SNAPSHOT.jar:na]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.main(Engine.java:204) [datax-core-0.0.1-SNAPSHOT.jar:na]
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.823 [job-0] INFO  StandAloneJobContainerCommunicator - Total 0 records, 0 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes |  All Task WaitWriterTime 0.000s |  All Task WaitReaderTime 0.000s | Percentage 0.00%
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 2021-09-09 09:21:16.825 [job-0] ERROR Engine - 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 经DataX智能分析,该任务最可能的错误原因是:
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] com.alibaba.datax.common.exception.DataXException: Code:[Framework-03], Description:[DataX引擎配置错误,该问题通常是由于DataX安装错误引起,请联系您的运维解决 .].  - 在有总bps限速条件下,单个channel的bps值不能为空,也不能为非正数
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:26)
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.adjustChannelNumber(JobContainer.java:430)
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.split(JobContainer.java:387)
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:117)
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.start(Engine.java:92)
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.entry(Engine.java:171)
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53]     at com.alibaba.datax.core.Engine.main(Engine.java:204)
    2021-09-09 09:21:16 [AnalysisStatistics.analysisStatisticsLog-53] 
    2021-09-09 09:21:16 [JobThread.run-165] <br>----------- datax-web job execute end(finish) -----------<br>----------- ReturnT:ReturnT [code=500, msg=command exit value(1) is failed, content=null]
    2021-09-09 09:21:16 [TriggerCallbackThread.callbackLog-186] <br>----------- datax-web job callback finish.

     去掉    "byte": 1048576

    "errorLimit": {
    "record": 0,
    "percentage": 0.02
    }
    },

  • 相关阅读:
    百度brpc 压测工具rpc_press解析
    Reactor反应器模式 (epoll)
    hive和hbase的区别
    Hive和HBase
    入门HBase,看这一篇就够了
    Docker保存修改后的镜像
    怎样将本地文件上传到docker容器
    Docker 安装tomcat访问空白页问题解决办法
    Centos中查看系统信息的常用命令
    Docker 镜像加速
  • 原文地址:https://www.cnblogs.com/Jeely/p/15245582.html
Copyright © 2011-2022 走看看