===========================================================================
Start run_io_avstats_dev
---------------------------------------------------------------------------
IO-AVSTATS - Aviation Event Statistics.
---------------------------------------------------------------------------
ENV_FOR_DYNACONF : prod
PYTHONPATH : .
---------------------------------------------------------------------------
TASK : u_p_d
APPLICATION :
COMPOSE_TASK :
MSACCESS : up01JAN
MSEXCEL :
---------------------------------------------------------------------------
The current time is: 17:53:31.51
Enter the new time:
===========================================================================
2025-01-01 17:53:32,684 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-01-01 17:53:32,684 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-01-01 17:53:32,685 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-01-01 17:53:32,685 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-01-01 16:53:34.162853+00:00 : ===============================================================================.
Progress update 2025-01-01 16:53:34.162853+00:00 : INFO.00.004 Start Launcher.
2025-01-01 17:53:34,162 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'd_n_a', '-m', 'up01JAN']
2025-01-01 17:53:34,163 [root] [launcher.py ] INFO Start launcher.py
2025-01-01 17:53:34,174 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-01-01 16:53:34.175538+00:00 : INFO.00.008 Arguments task='d_n_a' msaccess='up01JAN'.
Progress update 2025-01-01 16:53:34.175538+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:53:34.175538+00:00 : INFO.00.047 Download NTSB MS Access database file 'up01JAN'.
Progress update 2025-01-01 16:53:34.175538+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:34.608521+00:00 : INFO.00.013 The connection to the MS Access database file 'up01JAN.zip' on the NTSB download page was successfully established.
Progress update 2025-01-01 16:53:34.945106+00:00 : INFO.00.014 From the file 'up01JAN.zip' 1 chunks were downloaded.
Progress update 2025-01-01 16:53:34.956649+00:00 : INFO.00.015 The file 'up01JAN.zip' was successfully unpacked.
Progress update 2025-01-01 16:53:35.001760+00:00 : INFO.00.051 msaccess_file='D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\IO-AVSTATS.mdb'.
Progress update 2025-01-01 16:53:35.001760+00:00 : INFO.00.051 msaccess_file='D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\up01JAN.sql'.
Progress update 2025-01-01 16:53:35.002294+00:00 : INFO.00.052 razorsql_jar_file='C:\Program Files\RazorSQL\razorsql.jar'.
Progress update 2025-01-01 16:53:35.002294+00:00 : INFO.00.053 razorsql_java_path='C:\Program Files\RazorSQL\jre11\bin\java'.
1735750415125: launching RazorSQL . . .
1735750415125: args . . .
-backup
IO-AVSTATS
null
null
;
null
D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\up01JAN.sql
NO
tables
YES
null
NO
NO
1735750415164: userName: walte
1735750415164: libraryPath: C:\Program Files\RazorSQL\jre11\bin;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\ProgramData\miniconda3\envs\ioavstats;C:\ProgramData\miniconda3\envs\ioavstats\Library\mingw-w64\bin;C:\ProgramData\miniconda3\envs\ioavstats\Library\usr\bin;C:\ProgramData\miniconda3\envs\ioavstats\Library\bin;C:\ProgramData\miniconda3\envs\ioavstats\Scripts;C:\ProgramData\miniconda3\envs\ioavstats\bin;C:\ProgramData\miniconda3\condabin;C:\Program Files\Python313\Scripts;C:\Program Files\Python313;C:\Program Files (x86)\infogridpacific\AZARDI;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\dotnet;C:\Program Files\Git LFS;C:\Program Files\Microsoft SQL Server\110\Tools\Binn;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Software\GnuWin32\bin;C:\WINDOWS;C:\WINDOWS\System32;C:\WINDOWS\System32\OpenSSH;C:\WINDOWS\System32\wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;C:\Users\walte\.nimble\bin;\bin;\bin;\bin;C:\ProgramData\miniconda3\condabin;C:\Program Files\PostgreSQL\16\bin;C:\Software\jdk-20.0.1\bin;C:\Program Files\PuTTY;C:\Software\LAStools\bin;C:\Software\GnuPG\bin;C:\Program Files\nodejs;C:\Program Files\Calibre2;C:\Program Files\TortoiseGit\bin;C:\Program Files\Go\bin;C:\Program Files\Git\cmd;C:\Program Files\Amazon\AWSCLIV2;C:\Program Files\Zero Install;C:\Program Files\GitHub CLI;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;C:\WINDOWS\System32\OpenSSH;C:\Program Files\Docker\Docker\resources\bin;C:\Users\walte\.cargo\bin;C:\Users\walte\AppData\Local\Microsoft\WindowsApps;C:\Software\Microsoft VS Code\bin;c:\users\walte\.local\bin;C:\Users\walte\AppData\Local\JetBrains\Toolbox\scripts;C:\Users\walte\AppData\Local\Pandoc;C:\Users\walte\AppData\Local\GitHubDesktop\bin;C:\Users\walte\AppData\Roaming\npm;C:\Users\walte\AppData\Local\Microsoft\WinGet\Links;D:\Batch;C:\Program Files\Redis;C:\ProgramData\miniconda3\condabin;C:\Program Files\JetBrains\JetBrains Gateway 2024.3\bin;.;C:\Users\walte\AppData\Local\Microsoft\WindowsApps;C:\Users\walte\AppData\Local\Programs\Windsurf\bin;.
1735750415164: javaVersion: 17.0.7
1735750415164:
1735750415165: Verifying RazorSQL resources location.
1735750415165:
1735750415165: testing base url: / = file:/C:/Program%20Files/RazorSQL/
1735750415165:
1735750415165: testString1: file:/C:/Program%20Files/RazorSQL/razorsql.jar
1735750415165: testString2: file:/C:/Program%20Files/RazorSQL/data/base.ssql
1735750415166: testFile1: C:\Program Files\RazorSQL\razorsql.jar
1735750415166: testFile2: C:\Program Files\RazorSQL\data\base.ssql
1735750415166: both test file exists. Base URL found.
1735750415166: resource directory: file:/C:/Program%20Files/RazorSQL/
1735750415166: user home: C:\Users\walte
1735750415167: user profile: C:\Users\walte
1735750415167: app data: C:\Users\walte\AppData\Roaming
1735750415167: checking write access to: C:\Users\walte\AppData\Roaming
1735750415168: write dir: C:\Users\walte\AppData\Roaming\RichardsonSoftware
1735750415168: can write to C:\Users\walte\AppData\Roaming
1735750415168: user.home: C:\Users\walte\AppData\Roaming
1735750415168: RazorSQL Scratch Directory: C:\Users\walte\AppData\Roaming\RazorSQL
1735750415168: RazorSQL Scratch Directory exists
1735750415168: checking for sub directories
1735750415168: razorsql launch log: C:\Users\walte\AppData\Roaming\RazorSQL\razorsql_launch_log.txt
1735750415168: launch log file = C:\Users\walte\AppData\Roaming\RazorSQL\razorsql_launch_log.txt
1735750415169: Checking for graphics properties
1735750415169: graphics properties file: C:\Users\walte\AppData\Roaming\RazorSQL\data\graphics_properties.txt
1735750415169: gOverride: null
1735750415169: not disabling advanced graphics
1735750415170: path0: file:/C:/Program%20Files/RazorSQL/data/run.ssql
1735750415170: path1: file:/C:/Program%20Files/RazorSQL/razorsql.jar
1735750415170: runArgs: true
1735750415170: showScreen: false
1735750415170: args[0]: -backup
1735750415170: args[1]: IO-AVSTATS
1735750415170: args[2]: null
1735750415170: args[3]: null
1735750415170: args[4]: ;
1735750415170: args[5]: null
1735750415171: args[6]: D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\up01JAN.sql
1735750415171: args[7]: NO
1735750415171: args[8]: tables
1735750415171: args[9]: YES
1735750415171: args[10]: null
1735750415171: args[11]: NO
1735750415171: args[12]: NO
1735750415171: Command: -backup
1735750415171: Running -backup
h: name = C:\Program Files\RazorSQL\data\run.ssql
h: name = C:\Program Files\RazorSQL\razorsql.jar
1735750415179: Attempting to load . . .
command found
uOne: file:/C:/Program%20Files/RazorSQL/
h: name = C:\Program Files\RazorSQL\data\run.ssql
1735750415190reading file . . .C:\Program Files\RazorSQL\data\base.ssql
1735750415212done reading . . .
1735750415222done converting
1735750415222starting lib load.
1735750415232lib load complete.
In command line processor
Max Memory: 30688.0
Current Total Memory: 2048.0
Free Memory: 1916.14453125
1735750415305: r init
1735750415305: d init
1735750415305: get default file encoding
1735750415307: end d init
custom home directory: null
Checking for user data from old versions
1735750415308: user home: C:\Users\walte
1735750415309: user profile: C:\Users\walte
1735750415309: app data: C:\Users\walte\AppData\Roaming
1735750415309: checking write access to: C:\Users\walte\AppData\Roaming
1735750415309: write dir: C:\Users\walte\AppData\Roaming\RichardsonSoftware
1735750415309: can write to C:\Users\walte\AppData\Roaming
newHome: C:\Users\walte\AppData\Roaming\RazorSQL
dataHome: C:\Users\walte\AppData\Roaming/RazorSQL/data/
preferences file: C:\Users\walte\AppData\Roaming\RazorSQL\data\preferences.txt
Profiles Exist
1735750415318: loading icons
1735750415733: done r init
Getting connection data from: IO-AVSTATS
1735750415735: r init
1735750415735: d init
1735750415735: get default file encoding
1735750415735: end d init
custom home directory: null
Checking for user data from old versions
newHome: C:\Users\walte\AppData\Roaming\RazorSQL
dataHome: C:\Users\walte\AppData\Roaming/RazorSQL/data/
preferences file: C:\Users\walte\AppData\Roaming\RazorSQL\data\preferences.txt
Profiles Exist
1735750415736: loading icons
1735750415747: done r init
getting connection . . .
Not using SSH Tunnel
driver: sun.jdbc.odbc.JdbcOdbcDriver
classLocation: C:\Program Files\RazorSQL\drivers\common\odbc.jar
loadedCommonJars: false
commonURL: file:/C:/Program%20Files/RazorSQL/drivers/common/
commonDir: C:\Program Files\RazorSQL\drivers\common
commonFiles[0]: file:/C:/Program%20Files/RazorSQL/drivers/common/activation.jar
commonFiles[1]: file:/C:/Program%20Files/RazorSQL/drivers/common/common.jar
commonFiles[2]: file:/C:/Program%20Files/RazorSQL/drivers/common/jaxb-api.jar
commonFiles[3]: file:/C:/Program%20Files/RazorSQL/drivers/common/jaxb-core.jar
commonFiles[4]: file:/C:/Program%20Files/RazorSQL/drivers/common/jaxb-impl.jar
commonFiles[6]: file:/C:/Program%20Files/RazorSQL/drivers/common/odbc.jar
connection type: ODBC
final classLocation: C:\Program Files\RazorSQL\drivers\common\odbc.jar
classLocation file: C:\Program Files\RazorSQL\drivers\common\odbc.jar
building sql manager
Loading driver
Done loading driver
Getting connection with no login info
JdbcOdbcDriver: in initialize
OdbcApi == null
Creating new OdbcApi, nativePrefix:
JdbcOdbc constructor
Attempting to load JdbcOdbc library
Got OdbcApi: sun.jdbc.odbc.JdbcOdbc@77846d2c
Getting charset
JdbcOdbcDriver.OdbcApi.charSet: Cp1252
Connection obtained
obtained connection
database major version = 2
database product name: ACCESS
multiValueInsert: false
includeIdentifyColumns: false
Calling backup . . .
Retrieving Tables . . .
Generating Table DDL . . .
1 of 20
number of columns 93
column map size: 93
foundNull: false
2 of 20
number of columns 2
column map size: 2
foundNull: false
3 of 20
number of columns 11
column map size: 11
foundNull: false
4 of 20
number of columns 2
column map size: 2
foundNull: false
5 of 20
number of columns 6
column map size: 6
foundNull: false
6 of 20
number of columns 5
column map size: 5
foundNull: false
7 of 20
number of columns 7
column map size: 7
foundNull: false
8 of 20
number of columns 13
column map size: 13
foundNull: false
9 of 20
number of columns 17
column map size: 17
foundNull: false
10 of 20
number of columns 73
column map size: 73
foundNull: false
11 of 20
number of columns 10
column map size: 10
foundNull: false
12 of 20
number of columns 14
column map size: 14
foundNull: false
13 of 20
number of columns 33
column map size: 33
foundNull: false
14 of 20
number of columns 8
column map size: 8
foundNull: false
15 of 20
number of columns 7
column map size: 7
foundNull: false
16 of 20
number of columns 8
column map size: 8
foundNull: false
17 of 20
number of columns 5
column map size: 5
foundNull: false
18 of 20
number of columns 8
column map size: 8
foundNull: false
19 of 20
number of columns 11
column map size: 11
foundNull: false
20 of 20
number of columns 3
column map size: 3
foundNull: false
Generating Alter Table DDL . . .
1 of 20
2 of 20
3 of 20
4 of 20
5 of 20
6 of 20
7 of 20
8 of 20
9 of 20
10 of 20
11 of 20
12 of 20
13 of 20
14 of 20
15 of 20
16 of 20
17 of 20
18 of 20
19 of 20
20 of 20
backup finished
closing connection . . .
connection closed.
Shutting down logging streams
Done shutting down logging streams
Exiting . . .
Progress update 2025-01-01 16:53:36.792931+00:00 : INFO.00.011 The DDL script for the MS Access database 'up01JAN.mdb' was created successfully.
Progress update 2025-01-01 16:53:36.793936+00:00 : INFO.00.012 The DDL script for the MS Access database 'up01JAN.mdb' is identical to the reference script.
Progress update 2025-01-01 16:53:36.794933+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:53:36.794933+00:00 : 2 s - Total time launcher.
Progress update 2025-01-01 16:53:36.794933+00:00 : INFO.00.006 End Launcher.
Progress update 2025-01-01 16:53:36.794933+00:00 : ===============================================================================.
2025-01-01 17:53:38,354 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-01-01 17:53:38,355 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-01-01 17:53:38,355 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-01-01 17:53:38,355 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-01-01 16:53:39.751281+00:00 : ===============================================================================.
Progress update 2025-01-01 16:53:39.752280+00:00 : INFO.00.004 Start Launcher.
2025-01-01 17:53:39,752 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'l_n_a', '-m', 'up01JAN']
2025-01-01 17:53:39,752 [root] [launcher.py ] INFO Start launcher.py
2025-01-01 17:53:39,763 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-01-01 16:53:39.764785+00:00 : INFO.00.008 Arguments task='l_n_a' msaccess='up01JAN'.
Progress update 2025-01-01 16:53:39.764785+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:53:39.764785+00:00 : INFO.00.049 Load NTSB MS Access database data from file 'up01JAN'.
Progress update 2025-01-01 16:53:39.764785+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:39.765791+00:00 : INFO.00.054 ODBC driver='DRIVER={Microsoft Access Driver (*.mdb, *.accdb)};DBQ=D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\up01JAN.mdb;'.
2025-01-01 17:53:40,053 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-01-01 16:53:40.122230+00:00 : INFO.00.021 The following database table is not processed: 'MSysAccessObjects'.
Progress update 2025-01-01 16:53:40.123228+00:00 : INFO.00.021 The following database table is not processed: 'MSysACEs'.
Progress update 2025-01-01 16:53:40.123228+00:00 : INFO.00.021 The following database table is not processed: 'MSysIMEXColumns'.
Progress update 2025-01-01 16:53:40.123228+00:00 : INFO.00.021 The following database table is not processed: 'MSysIMEXSpecs'.
Progress update 2025-01-01 16:53:40.123228+00:00 : INFO.00.021 The following database table is not processed: 'MSysModules2'.
Progress update 2025-01-01 16:53:40.123228+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneGroupCategories'.
Progress update 2025-01-01 16:53:40.123228+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneGroups'.
Progress update 2025-01-01 16:53:40.123228+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneGroupToObjects'.
Progress update 2025-01-01 16:53:40.123228+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneObjectIDs'.
Progress update 2025-01-01 16:53:40.123228+00:00 : INFO.00.021 The following database table is not processed: 'MSysObjects'.
Progress update 2025-01-01 16:53:40.124228+00:00 : INFO.00.021 The following database table is not processed: 'MSysQueries'.
Progress update 2025-01-01 16:53:40.124228+00:00 : INFO.00.021 The following database table is not processed: 'MSysRelationships'.
Progress update 2025-01-01 16:53:40.124228+00:00 : INFO.00.021 The following database table is not processed: 'Country'.
Progress update 2025-01-01 16:53:40.124228+00:00 : INFO.00.021 The following database table is not processed: 'ct_iaids'.
Progress update 2025-01-01 16:53:40.124228+00:00 : INFO.00.021 The following database table is not processed: 'ct_seqevt'.
Progress update 2025-01-01 16:53:40.124228+00:00 : INFO.00.021 The following database table is not processed: 'eADMSPUB_DataDictionary'.
Progress update 2025-01-01 16:53:40.124228+00:00 : INFO.00.021 The following database table is not processed: 'states'.
Progress update 2025-01-01 16:53:40.124228+00:00 :
Progress update 2025-01-01 16:53:40.124228+00:00 : Database table : events <-----------------------------------.
Progress update 2025-01-01 16:53:40.327097+00:00 : Number rows selected : 45.
Progress update 2025-01-01 16:53:40.327097+00:00 :
Progress update 2025-01-01 16:53:40.327097+00:00 : Database table : aircraft <-----------------------------------.
Progress update 2025-01-01 16:53:40.477397+00:00 : Number rows selected : 47.
Progress update 2025-01-01 16:53:40.478397+00:00 :
Progress update 2025-01-01 16:53:40.478397+00:00 : Database table : dt_events <-----------------------------------.
Progress update 2025-01-01 16:53:40.670861+00:00 : Number rows selected : 167.
Progress update 2025-01-01 16:53:40.670861+00:00 :
Progress update 2025-01-01 16:53:40.670861+00:00 : Database table : ntsb_admin <-----------------------------------.
Progress update 2025-01-01 16:53:40.726966+00:00 : Number rows selected : 45.
Progress update 2025-01-01 16:53:40.726966+00:00 :
Progress update 2025-01-01 16:53:40.726966+00:00 : Database table : dt_aircraft <-----------------------------------.
Progress update 2025-01-01 16:53:40.973270+00:00 : Number rows selected : 215.
Progress update 2025-01-01 16:53:40.974271+00:00 :
Progress update 2025-01-01 16:53:40.974271+00:00 : Database table : engines <-----------------------------------.
Progress update 2025-01-01 16:53:40.974271+00:00 : Number rows selected : 0.
Progress update 2025-01-01 16:53:40.975270+00:00 :
Progress update 2025-01-01 16:53:40.975270+00:00 : Database table : events_sequence <-----------------------------------.
Progress update 2025-01-01 16:53:41.054656+00:00 : Number rows selected : 63.
Progress update 2025-01-01 16:53:41.054656+00:00 :
Progress update 2025-01-01 16:53:41.055656+00:00 : Database table : findings <-----------------------------------.
Progress update 2025-01-01 16:53:41.055656+00:00 : Number rows selected : 0.
Progress update 2025-01-01 16:53:41.055656+00:00 :
Progress update 2025-01-01 16:53:41.055656+00:00 : Database table : flight_crew <-----------------------------------.
Progress update 2025-01-01 16:53:41.056657+00:00 : Number rows selected : 0.
Progress update 2025-01-01 16:53:41.056657+00:00 :
Progress update 2025-01-01 16:53:41.056657+00:00 : Database table : injury <-----------------------------------.
Progress update 2025-01-01 16:53:41.381435+00:00 : Number rows selected : 280.
Progress update 2025-01-01 16:53:41.381435+00:00 :
Progress update 2025-01-01 16:53:41.382433+00:00 : Database table : narratives <-----------------------------------.
Progress update 2025-01-01 16:53:41.494841+00:00 : Number rows selected : 10.
Progress update 2025-01-01 16:53:41.495839+00:00 :
Progress update 2025-01-01 16:53:41.495839+00:00 : Database table : occurrences <-----------------------------------.
Progress update 2025-01-01 16:53:41.495839+00:00 : Number rows selected : 0.
Progress update 2025-01-01 16:53:41.495839+00:00 :
Progress update 2025-01-01 16:53:41.495839+00:00 : Database table : dt_flight_crew <-----------------------------------.
Progress update 2025-01-01 16:53:41.496839+00:00 : Number rows selected : 0.
Progress update 2025-01-01 16:53:41.496839+00:00 :
Progress update 2025-01-01 16:53:41.496839+00:00 : Database table : flight_time <-----------------------------------.
Progress update 2025-01-01 16:53:41.496839+00:00 : Number rows selected : 0.
Progress update 2025-01-01 16:53:41.496839+00:00 :
Progress update 2025-01-01 16:53:41.496839+00:00 : Database table : seq_of_events <-----------------------------------.
Progress update 2025-01-01 16:53:41.497838+00:00 : Number rows selected : 0.
Progress update 2025-01-01 16:53:41.671759+00:00 : INFO.00.065 Cleansing PostgreSQL data.
Progress update 2025-01-01 16:53:41.671759+00:00 : --------------------------------------------------------------------------------
2025-01-01 17:53:41,671 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-01-01 16:53:41.736407+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'acft_category'.
Progress update 2025-01-01 16:53:42.660442+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:42.660442+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'dest_country'.
Progress update 2025-01-01 16:53:43.559717+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:43.559717+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'dprt_country'.
Progress update 2025-01-01 16:53:44.458380+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:44.458380+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'far_part'.
Progress update 2025-01-01 16:53:45.314134+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:45.314134+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'oper_country'.
Progress update 2025-01-01 16:53:46.203144+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:46.204153+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'owner_country'.
Progress update 2025-01-01 16:53:47.050778+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:47.050778+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'regis_no'.
Progress update 2025-01-01 16:53:47.868527+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:47.868527+00:00 : INFO.00.066 Cleansing table 'events' column 'ev_city'.
Progress update 2025-01-01 16:53:47.913958+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:47.913958+00:00 : INFO.00.066 Cleansing table 'events' column 'ev_site_zipcode'.
Progress update 2025-01-01 16:53:47.952574+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:47.953574+00:00 : INFO.00.066 Cleansing table 'events' column 'latitude'.
Progress update 2025-01-01 16:53:47.993814+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:47.993814+00:00 : INFO.00.066 Cleansing table 'events' column 'longitude'.
Progress update 2025-01-01 16:53:48.037555+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:53:48.037555+00:00 : INFO.00.066 Cleansing table 'events_sequence' column 'occurrence_code'.
Progress update 2025-01-01 16:53:48.059068+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:53:48.059068+00:00 : 8 s - Total time launcher.
Progress update 2025-01-01 16:53:48.060068+00:00 : INFO.00.006 End Launcher.
Progress update 2025-01-01 16:53:48.060068+00:00 : ===============================================================================.
2025-01-01 17:53:49,781 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-01-01 17:53:49,781 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-01-01 17:53:49,781 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-01-01 17:53:49,782 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-01-01 16:53:51.259224+00:00 : ===============================================================================.
Progress update 2025-01-01 16:53:51.259224+00:00 : INFO.00.004 Start Launcher.
2025-01-01 17:53:51,259 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'c_l_l']
2025-01-01 17:53:51,259 [root] [launcher.py ] INFO Start launcher.py
2025-01-01 17:53:51,272 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-01-01 16:53:51.274229+00:00 : INFO.00.005 Argument task='c_l_l'.
Progress update 2025-01-01 16:53:51.274229+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:53:51.274229+00:00 : INFO.00.040 Correct decimal US latitudes and longitudes.
Progress update 2025-01-01 16:53:51.275229+00:00 : --------------------------------------------------------------------------------
2025-01-01 17:53:51,275 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2025-01-01 17:53:51,383 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-01-01 16:53:59.613893+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 16:54:05.270001+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 16:54:10.776406+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 16:54:16.192639+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 16:54:21.715610+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 16:54:27.156111+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 16:54:32.537428+00:00 : Number of rows so far read : 70000.
Progress update 2025-01-01 16:54:38.052642+00:00 : Number of rows so far read : 80000.
Progress update 2025-01-01 16:54:43.534095+00:00 : Number of rows so far read : 90000.
Progress update 2025-01-01 16:54:49.908195+00:00 : Number of rows so far read : 100000.
Progress update 2025-01-01 16:54:56.039428+00:00 : Number of rows so far read : 110000.
Progress update 2025-01-01 16:55:01.629877+00:00 : Number of rows so far read : 120000.
Progress update 2025-01-01 16:55:07.261204+00:00 : Number of rows so far read : 130000.
Progress update 2025-01-01 16:55:13.567406+00:00 : Number of rows so far read : 140000.
Progress update 2025-01-01 16:55:15.242999+00:00 : Number rows selected : 142580.
Progress update 2025-01-01 16:55:15.242999+00:00 : Number rows updated : 142580.
Progress update 2025-01-01 16:55:15.263341+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:55:15.264342+00:00 : 84 s - Total time launcher.
Progress update 2025-01-01 16:55:15.264342+00:00 : INFO.00.006 End Launcher.
Progress update 2025-01-01 16:55:15.264342+00:00 : ===============================================================================.
2025-01-01 17:55:16,796 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-01-01 17:55:16,797 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-01-01 17:55:16,797 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-01-01 17:55:16,797 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-01-01 16:55:18.290464+00:00 : ===============================================================================.
Progress update 2025-01-01 16:55:18.291468+00:00 : INFO.00.004 Start Launcher.
2025-01-01 17:55:18,291 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'f_n_a']
2025-01-01 17:55:18,291 [root] [launcher.py ] INFO Start launcher.py
2025-01-01 17:55:18,302 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-01-01 16:55:18.303816+00:00 : INFO.00.005 Argument task='f_n_a'.
Progress update 2025-01-01 16:55:18.303816+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:55:18.303816+00:00 : INFO.00.086 Find the nearest airports.
Progress update 2025-01-01 16:55:18.303816+00:00 : --------------------------------------------------------------------------------
2025-01-01 17:55:18,303 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2025-01-01 17:55:18,410 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-01-01 16:55:45.284561+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 16:56:10.327143+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 16:56:35.361305+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 16:57:01.320625+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 16:57:25.859251+00:00 : ERROR.00.942 Event '20220711105442': issue with the Haversine algorithm: 'Longitude -894627.0 is out of range [-180, 180]'.
Progress update 2025-01-01 16:57:25.897561+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 16:57:50.090721+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 16:58:15.100543+00:00 : Number of rows so far read : 70000.
Progress update 2025-01-01 16:58:17.228950+00:00 : ERROR.00.942 Event '20210419102938': issue with the Haversine algorithm: 'Latitude 4603.0 is out of range [-90, 90]'.
Progress update 2025-01-01 16:58:17.228950+00:00 : ERROR.00.942 Event '20221027106211': issue with the Haversine algorithm: 'Latitude 36940.21 is out of range [-90, 90]'.
Progress update 2025-01-01 16:58:17.228950+00:00 : ERROR.00.942 Event '20221108106263': issue with the Haversine algorithm: 'Latitude 390408.0 is out of range [-90, 90]'.
Progress update 2025-01-01 16:58:17.228950+00:00 : ERROR.00.942 Event '20220803105651': issue with the Haversine algorithm: 'Latitude 41370104.0 is out of range [-90, 90]'.
Progress update 2025-01-01 16:58:17.229948+00:00 : ERROR.00.942 Event '20221108106264': issue with the Haversine algorithm: 'Latitude 43511185.0 is out of range [-90, 90]'.
Progress update 2025-01-01 16:58:17.257479+00:00 : Number rows selected : 70884.
Progress update 2025-01-01 16:58:17.258479+00:00 : Number rows updated : 70878.
Progress update 2025-01-01 16:58:17.259480+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:58:17.260482+00:00 : 178 s - Total time launcher.
Progress update 2025-01-01 16:58:17.260482+00:00 : INFO.00.006 End Launcher.
Progress update 2025-01-01 16:58:17.260482+00:00 : ===============================================================================.
2025-01-01 17:58:18,920 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-01-01 17:58:18,920 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-01-01 17:58:18,920 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-01-01 17:58:18,920 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-01-01 16:58:20.371939+00:00 : ===============================================================================.
Progress update 2025-01-01 16:58:20.371939+00:00 : INFO.00.004 Start Launcher.
2025-01-01 17:58:20,371 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'v_n_d']
2025-01-01 17:58:20,372 [root] [launcher.py ] INFO Start launcher.py
2025-01-01 17:58:20,383 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-01-01 16:58:20.385488+00:00 : INFO.00.005 Argument task='v_n_d'.
Progress update 2025-01-01 16:58:20.385488+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:58:20.385488+00:00 : INFO.00.043 Verify selected NTSB data.
Progress update 2025-01-01 16:58:20.385488+00:00 : --------------------------------------------------------------------------------
2025-01-01 17:58:20,385 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-01-01 16:58:22.414791+00:00 : INFO.00.063 Processed data source 'events'.
Progress update 2025-01-01 16:58:22.414791+00:00 : Number cols deleted : 91334.
Progress update 2025-01-01 16:58:22.415790+00:00 : --------------------------------------------------------------------------------
2025-01-01 17:58:22,415 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-01-01 16:58:22.479228+00:00 : INFO.00.064 Verification of table 'events' column(s) 'latitude & longitude'.
Progress update 2025-01-01 16:58:22.479228+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:58:24.697501+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 16:58:26.422261+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 16:58:28.121890+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 16:58:29.937756+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 16:58:32.028710+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 16:58:35.511926+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 16:58:39.051740+00:00 : Number of rows so far read : 70000.
Progress update 2025-01-01 16:58:41.495909+00:00 : Number rows errors : 27947.
Progress update 2025-01-01 16:58:41.495909+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:58:41.495909+00:00 : INFO.00.064 Verification of table 'events' column(s) 'ev_city'.
Progress update 2025-01-01 16:58:41.932805+00:00 : Number rows errors : 6256.
Progress update 2025-01-01 16:58:41.933318+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:58:41.933318+00:00 : INFO.00.064 Verification of table 'events' column(s) 'ev_city & ev_site_zipcode'.
Progress update 2025-01-01 16:58:42.614518+00:00 : Number rows errors : 16955.
Progress update 2025-01-01 16:58:42.614518+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:58:42.615038+00:00 : INFO.00.064 Verification of table 'events' column(s) 'ev_state'.
Progress update 2025-01-01 16:58:42.652498+00:00 : Number rows errors : 176.
Progress update 2025-01-01 16:58:42.652498+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:58:42.652498+00:00 : INFO.00.064 Verification of table 'events' column(s) 'ev_site_zipcode'.
Progress update 2025-01-01 16:58:42.810742+00:00 : Number rows errors : 5138.
Progress update 2025-01-01 16:58:42.811742+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:58:42.811742+00:00 : Number rows selected : 76738.
Progress update 2025-01-01 16:58:42.811742+00:00 : Number rows updated : 56472.
Progress update 2025-01-01 16:58:42.811742+00:00 : Number rows errors : 56472.
Progress update 2025-01-01 16:58:42.814743+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:58:42.814743+00:00 : 22 s - Total time launcher.
Progress update 2025-01-01 16:58:42.814743+00:00 : INFO.00.006 End Launcher.
Progress update 2025-01-01 16:58:42.814743+00:00 : ===============================================================================.
2025-01-01 17:58:44,391 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-01-01 17:58:44,391 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-01-01 17:58:44,391 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-01-01 17:58:44,391 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-01-01 16:58:45.839957+00:00 : ===============================================================================.
Progress update 2025-01-01 16:58:45.839957+00:00 : INFO.00.004 Start Launcher.
2025-01-01 17:58:45,839 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'r_d_s']
2025-01-01 17:58:45,839 [root] [launcher.py ] INFO Start launcher.py
2025-01-01 17:58:45,851 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-01-01 16:58:45.853960+00:00 : INFO.00.005 Argument task='r_d_s'.
Progress update 2025-01-01 16:58:45.853960+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 16:58:45.853960+00:00 : INFO.00.071 Refreshing the database schema.
Progress update 2025-01-01 16:58:45.853960+00:00 : --------------------------------------------------------------------------------
2025-01-01 17:58:45,853 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-01-01 16:58:45.912089+00:00 :
Progress update 2025-01-01 16:58:45.913089+00:00 : Database table : io_md_codes_eventsoe <-----------------------------------.
Progress update 2025-01-01 16:58:45.975054+00:00 : Number rows deleted : 13.
Progress update 2025-01-01 16:58:46.038271+00:00 : Number rows selected : 1557.
Progress update 2025-01-01 16:58:48.450006+00:00 : Number rows inserted : 96.
Progress update 2025-01-01 16:58:48.450006+00:00 :
Progress update 2025-01-01 16:58:48.451005+00:00 : Database table : io_md_codes_phase <-----------------------------------.
Progress update 2025-01-01 16:58:48.482331+00:00 : Number rows deleted : 12.
Progress update 2025-01-01 16:58:48.537839+00:00 : Number rows selected : 1557.
Progress update 2025-01-01 16:58:49.732548+00:00 : Number rows inserted : 48.
Progress update 2025-01-01 16:58:49.735548+00:00 :
Progress update 2025-01-01 16:58:49.735548+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:58:49.735548+00:00 : INFO.00.084 Database table io_md_codes_phase: Load description_main_phase from file 'data/Main_Phases_of_Flight/main_phases_of_flight.xlsx'.
Progress update 2025-01-01 16:58:49.735548+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 16:58:50.973746+00:00 : Number rows selected : 48.
Progress update 2025-01-01 16:58:50.973746+00:00 : Number rows updated : 48.
Progress update 2025-01-01 16:58:50.974747+00:00 :
Progress update 2025-01-01 16:58:50.974747+00:00 : Database table : io_md_codes_category <-----------------------------------.
Progress update 2025-01-01 16:58:51.023377+00:00 : Number rows deleted : 4.
Progress update 2025-01-01 16:58:51.477173+00:00 : Number rows selected : 7602.
Progress update 2025-01-01 16:58:51.597754+00:00 : Number rows inserted : 5.
Progress update 2025-01-01 16:58:51.598754+00:00 :
Progress update 2025-01-01 16:58:51.598754+00:00 : Database table : io_md_codes_subcategory <-----------------------------------.
Progress update 2025-01-01 16:58:52.080950+00:00 : Number rows selected : 7602.
Progress update 2025-01-01 16:58:53.114035+00:00 : Number rows inserted : 21.
Progress update 2025-01-01 16:58:53.115038+00:00 :
Progress update 2025-01-01 16:58:53.115038+00:00 : Database table : io_md_codes_section <-----------------------------------.
Progress update 2025-01-01 16:58:53.369105+00:00 : Number rows selected : 7602.
Progress update 2025-01-01 16:58:57.796413+00:00 : Number rows inserted : 129.
Progress update 2025-01-01 16:58:57.797413+00:00 :
Progress update 2025-01-01 16:58:57.797413+00:00 : Database table : io_md_codes_subsection <-----------------------------------.
Progress update 2025-01-01 16:58:58.054486+00:00 : Number rows selected : 7602.
Progress update 2025-01-01 16:59:16.858146+00:00 : Number rows inserted : 774.
Progress update 2025-01-01 16:59:16.859662+00:00 :
Progress update 2025-01-01 16:59:16.859662+00:00 : Database table : io_md_codes_modifier <-----------------------------------.
Progress update 2025-01-01 16:59:16.899555+00:00 : Number rows deleted : 8.
Progress update 2025-01-01 16:59:17.141688+00:00 : Number rows selected : 7602.
Progress update 2025-01-01 16:59:18.416150+00:00 : Number rows inserted : 74.
Progress update 2025-01-01 17:02:07.703585+00:00 : INFO.00.069 Materialized database view is refreshed: io_app_ae1982.
Progress update 2025-01-01 17:02:07.704115+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 17:02:07.704639+00:00 : 201 s - Total time launcher.
Progress update 2025-01-01 17:02:07.704639+00:00 : INFO.00.006 End Launcher.
Progress update 2025-01-01 17:02:07.704639+00:00 : ===============================================================================.
---------------------------------------------------------------------------
The current time is: 18:02:08.25
Enter the new time:
---------------------------------------------------------------------------
End run_io_avstats_dev
===========================================================================