2025-06-30 19:05:01 | INFO | data_prepare::345 - {'action': 'data_prepare', 'status': 'started'}
2025-06-30 19:05:01 | INFO | data_prepare:gen_daily_data:230 - {'action': 'gen_daily_data', 'status': 'started'}
2025-06-30 19:05:05 | INFO | data_prepare:gen_daily_data:236 - {'action': 'connect_client', 'status': 'success'}
2025-06-30 19:05:05 | INFO | data_prepare:gen_daily_data:238 - {'action': 'fetch_meta_mapping', 'status': 'started'}
2025-06-30 19:05:05 | INFO | data_prepare:gen_daily_data:251 - {'action': 'get_trading_day_path', 'status': 'attempt'}
2025-06-30 19:05:05 | INFO | data_prepare:get_trading_day_path:64 - {'action': 'get_trading_day_path', 'status': 'started'}
2025-06-30 19:05:05 | INFO | data_prepare:get_trading_day_path:110 - {'action': 'get_trading_day_path', 'status': 'completed', 'path': '/root/data/Research1//daily_data//2025-06-30/'}
2025-06-30 19:05:05 | INFO | data_prepare:gen_daily_data:254 - {'action': 'fetch_data', 'status': 'started', 'category': 'basic_trading'}
2025-06-30 19:05:05 | INFO | data_prepare:get_and_save_daily_data:120 - {'action': 'get_save_data', 'file': 'switch', 'status': 'started'}
2025-06-30 19:05:07 | INFO | data_prepare:get_and_save_daily_data:131 - {'action': 'process_data', 'file': 'switch', 'last_date': '2025-06-30 00:00:00+08:00'}
2025-06-30 19:05:07 | INFO | data_prepare:get_and_save_daily_data:155 - {'action': 'get_save_data', 'file': 'switch', 'status': 'completed', 'date': '2025-06-30 00:00:00+08:00'}
2025-06-30 19:05:07 | INFO | data_prepare:get_and_save_daily_data:120 - {'action': 'get_save_data', 'file': 'history_factor', 'status': 'started'}
2025-06-30 19:05:10 | INFO | data_prepare:get_and_save_daily_data:131 - {'action': 'process_data', 'file': 'history_factor', 'last_date': '2025-06-30 00:00:00+08:00'}
2025-06-30 19:05:10 | INFO | data_prepare:get_and_save_daily_data:155 - {'action': 'get_save_data', 'file': 'history_factor', 'status': 'completed', 'date': '2025-06-30 00:00:00+08:00'}
2025-06-30 19:05:10 | INFO | data_prepare:get_and_save_daily_data:120 - {'action': 'get_save_data', 'file': 'volume', 'status': 'started'}
2025-06-30 19:05:12 | INFO | data_prepare:get_and_save_daily_data:131 - {'action': 'process_data', 'file': 'volume', 'last_date': '2025-06-30 00:00:00+08:00'}
2025-06-30 19:05:12 | ERROR | data_prepare:get_and_save_daily_data:142 - {'file': 'volume', 'date': '2025-06-30 00:00:00+08:00', 'status': 'incomplete', 'missing_ratio': '0.30'}
2025-06-30 19:05:12 | CRITICAL | data_prepare:gen_daily_data:339 - {'action': 'gen_daily_data', 'status': 'failed', 'error': 'volume data is not complete for 2025-06-30 00:00:00+08:00'}
2025-06-30 19:05:12 | ERROR | data_prepare:gen_daily_data:340 - 生成每日数据过程中发生严重错误
Traceback (most recent call last):
File "/root/project/auto/auto/data_prepare.py", line 347, in
gen_daily_data()
└
> File "/root/project/auto/auto/data_prepare.py", line 257, in gen_daily_data
volume = get_and_save_daily_data('volume', trading_day_path, xd_cli, latest_trading_day=latest_trading_day)
│ │ │ └ datetime.date(2025, 6, 30)
│ │ └
│ └ '/root/data/Research1//daily_data//2025-06-30/'
└
File "/root/project/auto/auto/data_prepare.py", line 148, in get_and_save_daily_data
raise ValueError(f'{file_name} data is not complete for {data.index[-1]}')
ValueError: volume data is not complete for 2025-06-30 00:00:00+08:00
2025-06-30 19:05:12 | INFO | data_prepare:generate_and_save_dicts:27 - {'action': 'generate_dicts', 'status': 'started'}
2025-06-30 19:05:12 | INFO | data_prepare:generate_and_save_dicts:59 - {'action': 'generate_dicts', 'status': 'completed', 'dicts': ['commodity', 'sector', 'exchange']}
2025-06-30 19:05:12 | INFO | data_prepare::350 - {'action': 'generate_dicts', 'status': 'completed'}
2025-06-30 19:05:12 | INFO | data_prepare::355 - {'action': 'data_prepare', 'status': 'completed'}
future_1d/main_daily/switch
select date, comd, switch from main_daily where method='turnover'
future_1d/main_daily/history_factor
select date, comd, history_factor from main_daily where method='turnover'
future_1d/main_daily/volume
select date, comd, volume from main_daily where method='turnover'