【 TiDB 使用环境】生产环境
【遇到的问题：问题现象及影响】
delete 语句跑tiflash报错
尝试删除tiflash 副本数再添加，还是报错
另外报错提示的column 96, 没有这个这个字段
报错日志
[2025/11/13 14:14:47.559 +08:00] [INFO] [FlashService.cpp:601] [“Handling establish mpp connection request: sender_meta {\n start_ts: 462163669789442144\n task_id: 7\n address: "192.168.6.42:3930"\n gather_id: 1\n query_ts: 1763014487435399852\n local_query_id: 7797397\n server_id: 744\n mpp_version: 2\n connection_id: 1560918944\n}\nreceiver_meta {\n start_ts: 462163669789442144\n task_id: 10\n address: "192.168.6.52:3930"\n gather_id: 1\n query_ts: 1763014487435399852\n local_query_id: 7797397\n server_id: 744\n mpp_version: 2\n keyspace_id: 4294967295\n coordinator_address: "192.168.6.32:10080"\n resource_group_name: "default"\n connection_id: 1560918944\n}\n”] [source=FlashService] [thread_id=250]
[2025/11/13 14:14:47.559 +08:00] [INFO] [SegmentReadTaskScheduler.cpp:247] [“Erase pool_id=75622793”] [source=“Coprocessor, is_remote_read: true, start_ts: 462163669670690929, region_info: {20956324, 28033, 75634} table_id=179702”] [thread_id=201]
[2025/11/13 14:14:47.560 +08:00] [INFO] [SegmentReadTaskPool.h:150] [“Done. pool_id=75622793 pop=8 pop_empty=4 pop_empty_ratio=0.5 max_queue_size=1 blk_avg_bytes=369115 approx_max_pending_block_bytes=0.35MB total_count=3 total_bytes=1.06MB total_rows=528 avg_block_rows=176 avg_rows_bytes=2097B”] [source=“Coprocessor, is_remote_read: true, start_ts: 462163669670690929, region_info: {20956324, 28033, 75634} table_id=179702”] [thread_id=201]
[2025/11/13 14:14:47.575 +08:00] [INFO] [UnorderedSourceOp.h:48] [“All unordered input streams are finished, pool_id=75622792 last_stream_ref_no=3”] [source=“MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10> table_id=179702”] [thread_id=195]
[2025/11/13 14:14:47.575 +08:00] [INFO] [MPPTask.cpp:581] [“mpp task finish execute, is_success: false, status: RUNNING”] [source=“MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10>”] [thread_id=516]
[2025/11/13 14:14:47.592 +08:00] [INFO] [] [“cop task exit because has been cancelled”] [source=“MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10> pingcap/coprocessor”] [thread_id=85248]
[2025/11/13 14:14:47.592 +08:00] [ERROR] [MPPTask.cpp:653] [“task running meets error: Code: 49, e.displayText() = DB::Exception: CHBlockChunkCodec schema mismatch at column 96, expected Nullable(Int64), actual Int64, e.what() = DB::Exception, Stack trace:\n\n\n 0x55e5a629da03\tDB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator> const&, int) [tiflash+33667587]\n \tdbms/src/Common/StackTrace.cpp:23\n 0x55e5accc3394\tDB::CodecUtils::checkDataTypeName(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator> const&, unsigned long, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator> const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator> const&) [tiflash+144970644]\n \tdbms/src/Flash/Coprocessor/CodecUtils.cpp:39\n 0x55e5accb4a91\tDB::CHBlockChunkCodec::readColumnMeta(unsigned long, DB::ReadBuffer&, DB::ColumnWithTypeAndName&) [tiflash+144910993]\n \tdbms/src/Flash/Coprocessor/CHBlockChunkCodec.cpp:229\n 0x55e5accb44d2\tDB::CHBlockChunkCodec::decodeImpl(DB::ReadBuffer&, unsigned long) [tiflash+144909522]\n \tdbms/src/Flash/Coprocessor/CHBlockChunkCodec.cpp:182\n 0x55e5accb4eaf\tDB::CHBlockChunkCodec::decode(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator> const&, DB::Block const&) [tiflash+144912047]\n \tdbms/src/Flash/Coprocessor/CHBlockChunkCodec.cpp:247\n 0x55e5a6255b5d\tDB::CoprocessorReader::decodeChunks(std::__1::shared_ptrtipb::SelectResponse const&, std::__1::queue<DB::Block, std::__1::deque<DB::Block, std::__1::allocatorDB::Block>>&, DB::Block const&, std::__1::vector<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator>, TiDB::ColumnInfo>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator>, TiDB::ColumnInfo>>> const&) [tiflash+33373021]\n \tdbms/src/Flash/Coprocessor/CoprocessorReader.h:228\n 0x55e5ad0714ad\tDB::CoprocessorReader::toResult(std::__1::pair<pingcap::coprocessor::ResponseIter::Result, bool>&, std::__1::queue<DB::Block, std::__1::deque<DB::Block, std::__1::allocatorDB::Block>>&, DB::Block const&) [tiflash+148829357]\n \tdbms/src/Flash/Coprocessor/CoprocessorReader.h:293\n 0x55e5ad08118a\tDB::CoprocessorReaderSourceOp::readImpl(DB::Block&) [tiflash+148894090]\n \tdbms/src/Operators/CoprocessorReaderSourceOp.cpp:73\n 0x55e5ace0a853\tDB::SourceOp::read(DB::Block&) [tiflash+146311251]\n \tdbms/src/Operators/Operator.cpp:102\n 0x55e5ace06acb\tDB::PipelineExec::executeImpl() [tiflash+146295499]\n \tdbms/src/Flash/Pipeline/Exec/PipelineExec.cpp:167\n 0x55e5ace1ac06\tDB::PipelineTaskBase::runExecute() [tiflash+146377734]\n \tdbms/src/Flash/Pipeline/Exec/PipelineExec.cpp:114\n 0x55e5ace2f19e\tDB::Task::execute() [tiflash+146461086]\n \tdbms/src/Flash/Pipeline/Schedule/Tasks/Task.cpp:128\n 0x55e5a6258bd9\tDB::TaskThreadPoolDB::CPUImpl::loop(unsigned long) [tiflash+33385433]\n \tdbms/src/Flash/Pipeline/Schedule/ThreadPool/TaskThreadPoolImpl.h:32\n 0x55e5a6259436\tvoid* std::__1::__thread_proxy[abi:ue170006]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_deletestd::__1::__thread_struct>, void (DB::TaskThreadPoolDB::CPUImpl::)(unsigned long), DB::TaskThreadPoolDB::CPUImpl, unsigned long>>(void*) [tiflash+33387574]\n \t/data/build_tiflash/sysroot/bin/…/include/c++/v1/__type_traits/invoke.h:308\n 0x7fc367a4dea5\tstart_thread [libpthread.so.0+32421]\n 0x7fc36729f96d\t__clone [libc.so.6+1042797]”] [source=“MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10>”] [thread_id=516]
[2025/11/13 14:14:47.593 +08:00] [WARN] [MPPTask.cpp:751] [“Begin abort task: MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10>, abort type: ONERROR”] [source=“MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10>”] [thread_id=516]
[2025/11/13 14:14:47.593 +08:00] [WARN] [MPPTask.cpp:780] [“Finish abort task from running”] [source=“MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10>”] [thread_id=516]
[2025/11/13 14:14:47.593 +08:00] [INFO] [MPPTaskStatistics.cpp:139] [“{"query_tso":462163669670690929,"task_id":10,"is_root":true,"sender_executor_id":"ExchangeSender_13","executors":[{"id":"ExchangeSender_13","type":"ExchangeSender","children":["Selection_12"],"outbound_rows":0,"outbound_blocks":0,"outbound_bytes":0,"outbound_allocated_bytes":0,"concurrency":0,"execution_time_ns":0,"partition_num":1,"sender_target_task_ids":[-1],"exchange_type":"PassThrough","connection_details":[{"tunnel_id":"tunnel10±1","sender_target_task_id":-1,"sender_target_host":"192.168.6.42:30009","is_local":false,"packets":0,"bytes":0}]},{"id":"Selection_12","type":"Selection","children":["TableFullScan_11"],"outbound_rows":0,"outbound_blocks":0,"outbound_bytes":0,"outbound_allocated_bytes":0,"concurrency":0,"execution_time_ns":0},{"id":"TableFullScan_11","type":"TableScan","children":,"outbound_rows":0,"outbound_blocks":0,"outbound_bytes":0,"outbound_allocated_bytes":0,"concurrency":0,"execution_time_ns":0,"connection_details":[{"is_local":true,"packets":0,"bytes":0,"max":0,"min":0},{"is_local":false,"packets":0,"bytes":0,"max":0,"min":0}],"scan_details":{"build_bitmap_time":"265.327ms","build_stream_time":"609.508ms","create_snapshot_time":"0.145ms","delta_bytes":85435307,"delta_rows":59081,"dmfile_data_scanned_rows":420597,"dmfile_data_skipped_rows":822653,"dmfile_lm_filter_scanned_rows":420597,"dmfile_lm_filter_skipped_rows":822653,"dmfile_mvcc_scanned_rows":1354278,"dmfile_mvcc_skipped_rows":2300239,"dmfile_read_time":"1946.696ms","late_materialization_skip_rows":0,"learner_read_time":"16.939ms","local_max_stream_cost_ms":"0.000ms","local_min_stream_cost_ms":"0.000ms","mvcc_input_bytes":20002557,"mvcc_input_rows":1176621,"mvcc_skip_rows":152856,"num_columns":97,"num_local_region":31,"num_read_tasks":8,"num_remote_region":29,"num_segments":8,"num_stale_read":0,"pushdown":{"rs_operator":{"children":[{"col":"create_time","op":"less","value":"1853022339453681664"},{"col":"tenant_id","op":"less","value":"4"},{"col":"relate_activity_product_status","op":"in","value":["2","3"]}],"op":"and"}},"read_bytes":605780474,"read_mode":"Bitmap","region_num_of_instance":[{"instance_id":"192.168.6.42:3930","region_num":31}],"remote_max_stream_cost_ms":"0.000ms","remote_min_stream_cost_ms":"0.000ms","rs_dmfile_read_with_all":0,"rs_pack_filter_all":0,"rs_pack_filter_all_null":0,"rs_pack_filter_check_time":"2.199ms","rs_pack_filter_none":149,"rs_pack_filter_some":157}}],"host":"192.168.6.42:3930","task_init_timestamp":1763014487001245000,"task_start_timestamp":1763014487049542000,"task_end_timestamp":1763014487593096000,"compile_start_timestamp":1763014487002320000,"compile_end_timestamp":1763014487049508000,"read_wait_index_start_timestamp":1763014487020512000,"read_wait_index_end_timestamp":1763014487020582000,"local_input_bytes":9283294,"remote_input_bytes":0,"output_bytes":0,"status":"FAILED","error_message":"Code: 49, e.displayText() = DB::Exception: CHBlockChunkCodec schema mismatch at column 96, expected Nullable(Int64), actual Int64, e.what() = DB::Exception,","cpu_ru":101,"read_ru":9243.476470947266,"memory_peak":0,"extra_info":{"cpu_execute_time_ns":302005652,"cpu_pending_time_ns":1030019279,"io_execute_time_ns":0,"io_pending_time_ns":0,"await_time_ns":5889110212,"wait_for_notify_time_ns":8229154009}}”] [source=“mpp_task_tracing MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10>”] [thread_id=516]
[2025/11/13 14:14:47.593 +08:00] [INFO] [MPPTask.cpp:155] [“finish MPPTask: MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10>”] [source=“MPP<gather_id:2, query_ts:1763014367404393943, local_query_id:4650271, server_id:165, start_ts:462163669670690929,task_id:10>”] [thread_id=516]
[2025/11/13 14:14:47.594 +08:00] [INFO] [UnorderedSourceOp.h:48] [“All unordered input streams are finished, pool_id=75622807 last_stream_ref_no=0”] [source=“Coprocessor, is_remote_read: true, start_ts: 462163669670690929, region_info: {19448914, 27829, 75623} table_id=179702”] [thread_id=150]