【问题】:当前遇到的问题
sqoop export
-Dmapreduce.job.queuename=hive
–connect “jdbc:mysql://xxx/processed_data?useUnicode=true&characterEncoding=utf-8”
–username xxx
–password xxx
–table ads_fans_count
-m 1
–export-dir /warehouse/douyin/ads/ads_fans_count
–input-fields-terminated-by “\t”
–update-mode allowinsert
–update-key “uid,dt”
–input-null-string ‘\N’
–input-null-non-string ‘\N’
–batch
使用sqoop 从hive导出到tidb 报错
org.apache.sqoop.mapreduce.AsyncSqlOutputFormat: Got exception in update thread: java.sql.SQLException: Information schema is changed during the execution of the statement(for example, table definition may be updated by other DDL ran in parallel). If you see this error often, try increasing tidb_max_delta_schema_count. [try again later]
【业务影响】:
导出失败
【TiDB 版本】:
5.0
【日志】: log.txt (219.2 KB)logs.zip (31.4 KB)
[2021/06/17 03:30:38.861 +08:00] [Warn] [session.go:564] ["commit failed"] [conn=173557] ["finished txn"="Txn{state=invalid}"] [error="[domain:8028]Information schema is changed during the execution of the statement(for example, table definition may be updated by other DDL ran in parallel). If you see this error often, try increasing `tidb_max_delta_schema_count`. [try again later]"]
Get all TiDB DDL job history information.
curl http://{TiDBIP}:10080/ddl/history
Get count {number} TiDB DDL job history information.
curl http://{TiDBIP}:10080/ddl/history?limit={number}
Note: If you request a tidb that is not ddl owner, the response will be This node is not a ddl owner, can't be resigned.