zoukankan      html  css  js  c++  java
  • DataX案例:读取MongoDB的数据导入MySQL

    读取MongoDB的数据导入MySQL

    1)在MySQL中创建表

    mysql> create table jason(name varchar(20),url varchar(20));

    2)编写DataX配置文件

    [jason@hadoop102 datax]$ vim job/mongodb2mysql.json
    
    {
    
        "job": {
    
            "content": [
    
                {
    
                    "reader": {
    
                        "name": "mongodbreader",
    
                        "parameter": {
    
                            "address": ["127.0.0.1:27017"],
    
                            "collectionName": "jason",
    
                            "column": [
    
                             {
    
                             "name":"name",
    
                             "type":"string"
    
                             },
    
                             {
    
                             "name":"url",
    
                             "type":"string"
    
                             }
    
                            ],
    
                            "dbName": "test",
    
                        }
    
                    },
    
                    "writer": {
    
                        "name": "mysqlwriter",
    
                        "parameter": {
    
                            "column": ["*"],
    
                            "connection": [
    
                                {
    
                                    "jdbcUrl": "jdbc:mysql://hadoop102:3306/test",
    
                                    "table": ["jason"]
    
                                }
    
                            ],
    
                            "password": "000000",
    
                            "username": "root",
    
                            "writeMode": "insert"
    
                        }
    
                    }
    
                }
    
            ],
    
            "setting": {
    
                "speed": {
    
                    "channel": "1"
    
                }
    
            }
    
        }
    
    }

    3)执行

    [jason@hadoop102 datax]$ bin/datax.py job/mongodb2mysql.json

    4)查看结果

    mysql> select * from jason;
    
    +---------+-----------------+
    
    | name    | url             |
    
    +---------+-----------------+
    
    | jason | www.jason.com |
    
    +---------+-----------------+
  • 相关阅读:
    python3调用js的库之execjs
    字体替换 re.sub
    asyncio和aiohttp
    微信公众号数据抓取
    celery
    Airtest 的连接安卓模拟器
    Scrapy同时启动多个爬虫
    随机IP代理插件Scrapy-Proxies
    Charles和mitmproxy代理设置
    win下删除EFI分区
  • 原文地址:https://www.cnblogs.com/LIAOBO/p/13666845.html
Copyright © 2011-2022 走看看