6. Load country and state data¶
2025-03-01¶
===========================================================================
Start run_io_avstats_dev
---------------------------------------------------------------------------
IO-AVSTATS - Aviation Event Statistics.
---------------------------------------------------------------------------
ENV_FOR_DYNACONF : prod
PYTHONPATH : .
---------------------------------------------------------------------------
TASK : l_c_s
APPLICATION :
COMPOSE_TASK :
MSACCESS :
MSEXCEL :
---------------------------------------------------------------------------
The current time is: 4:51:50.58
Enter the new time:
===========================================================================
2025-03-01 04:51:51,443 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-03-01 04:51:51,444 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-03-01 04:51:51,444 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-03-01 04:51:51,458 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-03-01 03:51:52.702709+00:00 : ===============================================================================.
Progress update 2025-03-01 03:51:52.702709+00:00 : INFO.00.004 Start Launcher.
2025-03-01 04:51:52,702 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'l_c_s']
2025-03-01 04:51:52,702 [root] [launcher.py ] INFO Start launcher.py
2025-03-01 04:51:52,713 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-03-01 03:51:52.714709+00:00 : INFO.00.005 Argument task='l_c_s'.
Progress update 2025-03-01 03:51:52.714709+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 03:51:52.714709+00:00 : INFO.00.057 Load country and state data.
Progress update 2025-03-01 03:51:52.714709+00:00 : --------------------------------------------------------------------------------
2025-03-01 04:51:52,977 [root] [db_dml_base.py ] INFO ================================================================================
2025-03-01 04:51:52,978 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'https://raw.githubusercontent.com/mledoze/countries/master/dist/countries.csv'
2025-03-01 04:51:52,978 [root] [db_dml_base.py ] INFO --------------------------------------------------------------------------------
2025-03-01 04:51:52,978 [root] [db_dml_base.py ] INFO
2025-03-01 04:51:52,978 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2025-03-01 04:51:53,054 [root] [db_dml_base.py ] INFO
2025-03-01 04:51:53,059 [root] [db_dml_base.py ] INFO Number rows existing : 250
2025-03-01 04:51:53,125 [root] [db_dml_base.py ] INFO
2025-03-01 04:51:53,125 [root] [db_dml_base.py ] INFO Number rows selected : 250
2025-03-01 04:51:53,125 [root] [db_dml_base.py ] INFO Number rows relevant : 250
2025-03-01 04:51:53,125 [root] [db_dml_base.py ] INFO Number rows updated : 1
2025-03-01 04:51:53,156 [root] [db_dml_base.py ] INFO ================================================================================
2025-03-01 04:51:53,156 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'https://public.opendatasoft.com/api/explore/v2.1/catalog/datasets/us-state-boundaries/exports/csv?lang=en&timezone=Europe%2FBerlin&use_labels=true&delimiter=%3B'
2025-03-01 04:51:54,171 [root] [db_dml_base.py ] INFO ================================================================================
2025-03-01 04:51:54,171 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'data\opendatasoft\us-state-boundaries.csv'
2025-03-01 04:51:54,171 [root] [db_dml_base.py ] INFO --------------------------------------------------------------------------------
2025-03-01 04:51:54,185 [root] [db_dml_base.py ] INFO
2025-03-01 04:51:54,186 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2025-03-01 04:51:54,263 [root] [db_dml_base.py ] INFO
2025-03-01 04:51:54,266 [root] [db_dml_base.py ] INFO Number rows existing : 56
2025-03-01 04:51:54,320 [root] [db_dml_base.py ] INFO
2025-03-01 04:51:54,320 [root] [db_dml_base.py ] INFO Number rows selected : 56
2025-03-01 04:51:54,320 [root] [db_dml_base.py ] INFO Number rows relevant : 56
Progress update 2025-03-01 03:51:54.382825+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 03:51:54.382825+00:00 : 1 s - Total time launcher.
Progress update 2025-03-01 03:51:54.382825+00:00 : INFO.00.006 End Launcher.
Progress update 2025-03-01 03:51:54.382825+00:00 : ===============================================================================.
---------------------------------------------------------------------------
The current time is: 4:51:54.69
Enter the new time:
---------------------------------------------------------------------------
End run_io_avstats_dev
===========================================================================
2025-01-31¶
===========================================================================
Start run_io_avstats_dev
---------------------------------------------------------------------------
IO-AVSTATS - Aviation Event Statistics.
---------------------------------------------------------------------------
ENV_FOR_DYNACONF : prod
PYTHONPATH : .
---------------------------------------------------------------------------
TASK : l_c_s
APPLICATION :
COMPOSE_TASK :
MSACCESS :
MSEXCEL :
---------------------------------------------------------------------------
The current time is: 4:15:27.57
Enter the new time:
===========================================================================
2025-01-31 04:15:28,598 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-01-31 04:15:28,598 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-01-31 04:15:28,598 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-01-31 04:15:28,599 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-01-31 03:15:29.964424+00:00 : ===============================================================================.
Progress update 2025-01-31 03:15:29.964424+00:00 : INFO.00.004 Start Launcher.
2025-01-31 04:15:29,964 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'l_c_s']
2025-01-31 04:15:29,965 [root] [launcher.py ] INFO Start launcher.py
2025-01-31 04:15:29,975 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-01-31 03:15:29.976427+00:00 : INFO.00.005 Argument task='l_c_s'.
Progress update 2025-01-31 03:15:29.977427+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-31 03:15:29.977427+00:00 : INFO.00.057 Load country and state data.
Progress update 2025-01-31 03:15:29.977427+00:00 : --------------------------------------------------------------------------------
2025-01-31 04:15:30,490 [root] [db_dml_base.py ] INFO ================================================================================
2025-01-31 04:15:30,490 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'https://raw.githubusercontent.com/mledoze/countries/master/dist/countries.csv'
2025-01-31 04:15:30,490 [root] [db_dml_base.py ] INFO --------------------------------------------------------------------------------
2025-01-31 04:15:30,490 [root] [db_dml_base.py ] INFO
2025-01-31 04:15:30,491 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2025-01-31 04:15:30,562 [root] [db_dml_base.py ] INFO
2025-01-31 04:15:30,575 [root] [db_dml_base.py ] INFO Number rows existing : 250
2025-01-31 04:15:30,641 [root] [db_dml_base.py ] INFO
2025-01-31 04:15:30,642 [root] [db_dml_base.py ] INFO Number rows selected : 250
2025-01-31 04:15:30,642 [root] [db_dml_base.py ] INFO Number rows relevant : 250
2025-01-31 04:15:30,642 [root] [db_dml_base.py ] INFO Number rows updated : 12
2025-01-31 04:15:30,670 [root] [db_dml_base.py ] INFO ================================================================================
2025-01-31 04:15:30,670 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'https://public.opendatasoft.com/api/explore/v2.1/catalog/datasets/us-state-boundaries/exports/csv?lang=en&timezone=Europe%2FBerlin&use_labels=true&delimiter=%3B'
2025-01-31 04:15:31,311 [root] [db_dml_base.py ] INFO ================================================================================
2025-01-31 04:15:31,311 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'data\opendatasoft\us-state-boundaries.csv'
2025-01-31 04:15:31,311 [root] [db_dml_base.py ] INFO --------------------------------------------------------------------------------
2025-01-31 04:15:31,323 [root] [db_dml_base.py ] INFO
2025-01-31 04:15:31,323 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2025-01-31 04:15:31,396 [root] [db_dml_base.py ] INFO
2025-01-31 04:15:31,399 [root] [db_dml_base.py ] INFO Number rows existing : 56
2025-01-31 04:15:31,453 [root] [db_dml_base.py ] INFO
2025-01-31 04:15:31,453 [root] [db_dml_base.py ] INFO Number rows selected : 56
2025-01-31 04:15:31,453 [root] [db_dml_base.py ] INFO Number rows relevant : 56
Progress update 2025-01-31 03:15:31.478225+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-31 03:15:31.478225+00:00 : 1 s - Total time launcher.
Progress update 2025-01-31 03:15:31.478225+00:00 : INFO.00.006 End Launcher.
Progress update 2025-01-31 03:15:31.478225+00:00 : ===============================================================================.
---------------------------------------------------------------------------
The current time is: 4:15:31.91
Enter the new time:
---------------------------------------------------------------------------
End run_io_avstats_dev
===========================================================================
2024-11-04¶
===========================================================================
Start run_io_avstats_dev
---------------------------------------------------------------------------
IO-AVSTATS - Aviation Event Statistics.
---------------------------------------------------------------------------
ENV_FOR_DYNACONF : prod
PYTHONPATH : .
---------------------------------------------------------------------------
TASK : l_c_s
APPLICATION :
COMPOSE_TASK :
MSACCESS :
MSEXCEL :
---------------------------------------------------------------------------
The current time is: 0:42:09.50
Enter the new time:
===========================================================================
2024-11-04 00:42:11,009 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.60 logger (Copyright (c) 2022-2024 IO-Aero)
2024-11-04 00:42:11,009 [root] [io_settings.py ] INFO Starting the configuration management system.
2024-11-04 00:42:11,010 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2024-11-04 00:42:11,010 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2024-11-03 23:42:12.724828+00:00 : ===============================================================================.
Progress update 2024-11-03 23:42:12.724828+00:00 : INFO.00.004 Start Launcher.
2024-11-04 00:42:12,724 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'l_c_s']
2024-11-04 00:42:12,725 [root] [launcher.py ] INFO Start launcher.py
2024-11-04 00:42:12,734 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2024-11-03 23:42:12.735836+00:00 : INFO.00.005 Argument task='l_c_s'.
Progress update 2024-11-03 23:42:12.735836+00:00 : -------------------------------------------------------------------------------.
Progress update 2024-11-03 23:42:12.736832+00:00 : INFO.00.057 Load country and state data.
Progress update 2024-11-03 23:42:12.736832+00:00 : --------------------------------------------------------------------------------
2024-11-04 00:42:13,459 [root] [db_dml_base.py ] INFO INFO.00.133 Data successfully saved to 'data\Rest Countries\rest_countries.csv'
2024-11-04 00:42:13,459 [root] [db_dml_base.py ] INFO ================================================================================
2024-11-04 00:42:13,459 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'data\Rest Countries\rest_countries.csv'
2024-11-04 00:42:13,459 [root] [db_dml_base.py ] INFO --------------------------------------------------------------------------------
2024-11-04 00:42:13,464 [root] [db_dml_base.py ] INFO
2024-11-04 00:42:13,464 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2024-11-04 00:42:13,523 [root] [db_dml_base.py ] INFO
2024-11-04 00:42:13,546 [root] [db_dml_base.py ] INFO Number rows existing : 1
2024-11-04 00:42:13,663 [root] [db_dml_base.py ] INFO
2024-11-04 00:42:13,663 [root] [db_dml_base.py ] INFO Number rows selected : 250
2024-11-04 00:42:13,663 [root] [db_dml_base.py ] INFO Number rows relevant : 250
2024-11-04 00:42:13,663 [root] [db_dml_base.py ] INFO Number rows inserted : 249
2024-11-04 00:42:13,663 [root] [db_dml_base.py ] INFO Number rows updated : 1
2024-11-04 00:42:13,695 [root] [db_dml_base.py ] INFO ================================================================================
2024-11-04 00:42:13,696 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'https://public.opendatasoft.com/api/explore/v2.1/catalog/datasets/us-state-boundaries/exports/csv?lang=en&timezone=Europe%2FBerlin&use_labels=true&delimiter=%3B'
2024-11-04 00:42:14,864 [root] [db_dml_base.py ] INFO ================================================================================
2024-11-04 00:42:14,865 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'data\opendatasoft\us-state-boundaries.csv'
2024-11-04 00:42:14,865 [root] [db_dml_base.py ] INFO --------------------------------------------------------------------------------
2024-11-04 00:42:14,876 [root] [db_dml_base.py ] INFO
2024-11-04 00:42:14,876 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2024-11-04 00:42:14,945 [root] [db_dml_base.py ] INFO
2024-11-04 00:42:14,950 [root] [db_dml_base.py ] INFO Number rows existing : 56
2024-11-04 00:42:15,000 [root] [db_dml_base.py ] INFO
2024-11-04 00:42:15,000 [root] [db_dml_base.py ] INFO Number rows selected : 56
2024-11-04 00:42:15,001 [root] [db_dml_base.py ] INFO Number rows relevant : 56
Progress update 2024-11-03 23:42:15.053969+00:00 : -------------------------------------------------------------------------------.
Progress update 2024-11-03 23:42:15.054967+00:00 : 2 s - Total time launcher.
Progress update 2024-11-03 23:42:15.054967+00:00 : INFO.00.006 End Launcher.
Progress update 2024-11-03 23:42:15.054967+00:00 : ===============================================================================.
---------------------------------------------------------------------------
The current time is: 0:42:15.29
Enter the new time:
---------------------------------------------------------------------------
End run_io_avstats_dev
===========================================================================
2024-11-01¶
===========================================================================
Start run_io_avstats_dev
---------------------------------------------------------------------------
IO-AVSTATS - Aviation Event Statistics.
---------------------------------------------------------------------------
ENV_FOR_DYNACONF : prod
PYTHONPATH : .
---------------------------------------------------------------------------
TASK : l_c_s
APPLICATION :
COMPOSE_TASK :
MSACCESS :
MSEXCEL :
---------------------------------------------------------------------------
The current time is: 5:47:54.81
Enter the new time:
===========================================================================
2024-11-01 05:47:55,762 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.60 logger (Copyright (c) 2022-2024 IO-Aero)
2024-11-01 05:47:55,763 [root] [io_settings.py ] INFO Starting the configuration management system.
2024-11-01 05:47:55,763 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2024-11-01 05:47:55,763 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2024-11-01 04:47:56.706464+00:00 : ===============================================================================.
Progress update 2024-11-01 04:47:56.706464+00:00 : INFO.00.004 Start Launcher.
2024-11-01 05:47:56,706 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'l_c_s']
2024-11-01 05:47:56,707 [root] [launcher.py ] INFO Start launcher.py
2024-11-01 05:47:56,716 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2024-11-01 04:47:56.717467+00:00 : INFO.00.005 Argument task='l_c_s'.
Progress update 2024-11-01 04:47:56.717467+00:00 : -------------------------------------------------------------------------------.
Progress update 2024-11-01 04:47:56.717467+00:00 : INFO.00.057 Load country and state data.
Progress update 2024-11-01 04:47:56.717467+00:00 : --------------------------------------------------------------------------------
2024-11-01 05:47:56,718 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2024-11-01 04:47:56.774847+00:00 : Number rows selected : 52.
2024-11-01 05:47:56,775 [root] [db_dml_base.py ] INFO
2024-11-01 05:47:56,776 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'https://public.opendatasoft.com/api/explore/v2.1/catalog/datasets/us-state-boundaries/exports/csv?lang=en&timezone=Europe%2FBerlin&use_labels=true&delimiter=%3B'
2024-11-01 05:47:56,776 [root] [db_dml_base.py ] INFO
2024-11-01 05:47:57,098 [root] [db_dml_base.py ] INFO ================================================================================
2024-11-01 05:47:57,098 [root] [db_dml_base.py ] INFO INFO.00.132 Processing file 'data\opendatasoft\us-state-boundaries.csv'
2024-11-01 05:47:57,098 [root] [db_dml_base.py ] INFO --------------------------------------------------------------------------------
2024-11-01 05:47:57,110 [root] [db_dml_base.py ] INFO
2024-11-01 05:47:57,110 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2024-11-01 05:47:57,176 [root] [db_dml_base.py ] INFO
2024-11-01 05:47:57,178 [root] [db_dml_base.py ] INFO Number rows existing : 51
2024-11-01 05:47:57,178 [root] [db_dml_base.py ] INFO
2024-11-01 05:47:57,292 [root] [db_dml_base.py ] INFO
2024-11-01 05:47:57,292 [root] [db_dml_base.py ] INFO Number rows selected : 56
2024-11-01 05:47:57,293 [root] [db_dml_base.py ] INFO Number rows relevant : 56
2024-11-01 05:47:57,293 [root] [db_dml_base.py ] INFO Number rows inserted : 5
2024-11-01 05:47:57,293 [root] [db_dml_base.py ] INFO Number rows updated : 51
Progress update 2024-11-01 04:47:57.319510+00:00 : -------------------------------------------------------------------------------.
Progress update 2024-11-01 04:47:57.320510+00:00 : 0 s - Total time launcher.
Progress update 2024-11-01 04:47:57.320510+00:00 : INFO.00.006 End Launcher.
Progress update 2024-11-01 04:47:57.320510+00:00 : ===============================================================================.
---------------------------------------------------------------------------
The current time is: 5:47:57.53
Enter the new time:
---------------------------------------------------------------------------
End run_io_avstats_dev
===========================================================================
2023-08-22¶
=======================================================================
Start run_io_avstats
-----------------------------------------------------------------------
IO-AVSTATS - Aviation Event Statistics.
-----------------------------------------------------------------------
PYTHONPATH : D:\SoftDevelopment\Projects\IO-Aero\io-avstats-db\dist;D:\SoftDevelopment\Projects\IO-Aero\io-maps\dist
-----------------------------------------------------------------------
TASK : l_c_s
APPLICATION :
COMPOSE_TASK :
MSACCESS :
MSEXCEL :
-----------------------------------------------------------------------
The current time is: 1:44:20.24
Enter the new time:
=======================================================================
Progress update 2023-08-22 01:44:21.477431 : ===============================================================================.
Progress update 2023-08-22 01:44:21.477431 : INFO.00.004 Start Launcher.
Progress update 2023-08-22 01:44:21.479430 : INFO.00.001 The logger is configured and ready.
Progress update 2023-08-22 01:44:21.487935 : INFO.00.005 Argument task='l_c_s'.
Progress update 2023-08-22 01:44:21.487935 : -------------------------------------------------------------------------------.
Progress update 2023-08-22 01:44:21.487935 : INFO.00.057 Load country and state data.
Progress update 2023-08-22 01:44:21.487935 : --------------------------------------------------------------------------------
Progress update 2023-08-22 01:44:21.487935 : INFO.00.081 User connect request host=localhost port=5432 dbname=io_aero_db user=io_aero.
Progress update 2023-08-22 01:44:21.542434 : INFO.00.059 Load country data.
Progress update 2023-08-22 01:44:21.542434 : --------------------------------------------------------------------------------
Progress update 2023-08-22 01:44:21.584342 : Number rows selected : 52.
Progress update 2023-08-22 01:44:21.584342 : Number rows inserted : 1.
Progress update 2023-08-22 01:44:21.584342 : --------------------------------------------------------------------------------
Progress update 2023-08-22 01:44:21.584342 : INFO.00.060 Load state data.
Progress update 2023-08-22 01:44:21.584342 : --------------------------------------------------------------------------------
Progress update 2023-08-22 01:44:21.643456 : Number rows selected : 52.
Progress update 2023-08-22 01:44:21.643456 : Number rows inserted : 51.
Progress update 2023-08-22 01:44:21.644458 : -------------------------------------------------------------------------------.
Progress update 2023-08-22 01:44:21.644458 : 167,026,300 ns - Total time launcher.
Progress update 2023-08-22 01:44:21.644458 : INFO.00.006 End Launcher.
Progress update 2023-08-22 01:44:21.644458 : ===============================================================================.