DataX 安装和使用

阿里云介绍：

1. 下载安装包。作为阿里主要的数据传输工具Datax，阿里已经完全开源到github上面了。下载地址（https://github.com/alibaba/DataX）。

2. 安装环境：

• JDK(1.6以上，推荐1.6)
• Python(推荐Python2.6.X)
• Apache Maven 3.x (Compile DataX)

3. 解压到工作目录。/usr/local/datax

4. 编写源和目标表的json文件

{"job": {"setting": {"speed": {"channel": 3},"errorLimit": {"record": 0,"percentage": 0.02}},"content": [{"reader": {"name": "mysqlreader","parameter": {"writeMode": "insert","username": "root","password": "******","column": ["rec_id","column","etl_time"],"connection": [{"table": ["source_table"],"jdbcUrl": ["jdbc:mysql://11.278.80.200:34001/DW"]}]}},"writer": {"name": "mysqlwriter","parameter": {"username": "root","password": "*****","column": ["rec_id","column","etl_time"],"connection": [{"jdbcUrl": "jdbc:mysql://10.208.83.202:30001/DW","table": ["target_table"]}],              }}}],"setting": {"speed": {"channel": 1},"errorLimit": {         "record": 10}}}
}

5. 运行脚本

python /home/admin/datax3/bin/datax.py ./json/table_1.json