===========================================================================
Start run_io_avstats_dev
---------------------------------------------------------------------------
IO-AVSTATS - Aviation Event Statistics.
---------------------------------------------------------------------------
ENV_FOR_DYNACONF : prod
PYTHONPATH : .
---------------------------------------------------------------------------
TASK : u_p_d
APPLICATION :
COMPOSE_TASK :
MSACCESS : up01MAR
MSEXCEL :
---------------------------------------------------------------------------
The current time is: 18:16:40.58
Enter the new time:
===========================================================================
2025-03-01 18:16:41,450 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-03-01 18:16:41,451 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-03-01 18:16:41,451 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-03-01 18:16:41,451 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-03-01 17:16:42.686400+00:00 : ===============================================================================.
Progress update 2025-03-01 17:16:42.686400+00:00 : INFO.00.004 Start Launcher.
2025-03-01 18:16:42,686 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'd_n_a', '-m', 'up01MAR']
2025-03-01 18:16:42,686 [root] [launcher.py ] INFO Start launcher.py
2025-03-01 18:16:42,697 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-03-01 17:16:42.698905+00:00 : INFO.00.008 Arguments task='d_n_a' msaccess='up01MAR'.
Progress update 2025-03-01 17:16:42.698905+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:16:42.698905+00:00 : INFO.00.047 Download NTSB MS Access database file 'up01MAR'.
Progress update 2025-03-01 17:16:42.698905+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:16:43.101534+00:00 : INFO.00.013 The connection to the MS Access database file 'up01MAR.zip' on the NTSB download page was successfully established.
Progress update 2025-03-01 17:16:43.479441+00:00 : INFO.00.014 From the file 'up01MAR.zip' 2 chunks were downloaded.
Progress update 2025-03-01 17:16:43.491896+00:00 : INFO.00.015 The file 'up01MAR.zip' was successfully unpacked.
Progress update 2025-03-01 17:16:43.544205+00:00 : INFO.00.051 msaccess_file='D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\IO-AVSTATS.mdb'.
Progress update 2025-03-01 17:16:43.544205+00:00 : INFO.00.051 msaccess_file='D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\up01MAR.sql'.
Progress update 2025-03-01 17:16:43.545711+00:00 : INFO.00.052 razorsql_jar_file='C:\Program Files\RazorSQL\razorsql.jar'.
Progress update 2025-03-01 17:16:43.545711+00:00 : INFO.00.053 razorsql_java_path='C:\Program Files\RazorSQL\jre11\bin\java'.
1740849403661: launching RazorSQL . . .
1740849403661: args . . .
-backup
IO-AVSTATS
null
null
;
null
D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\up01MAR.sql
NO
tables
YES
null
NO
NO
1740849403696: userName: walte
1740849403696: libraryPath: C:\Program Files\RazorSQL\jre11\bin;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\ProgramData\miniconda3\envs\ioavstats;C:\ProgramData\miniconda3\envs\ioavstats\Library\mingw-w64\bin;C:\ProgramData\miniconda3\envs\ioavstats\Library\usr\bin;C:\ProgramData\miniconda3\envs\ioavstats\Library\bin;C:\ProgramData\miniconda3\envs\ioavstats\Scripts;C:\ProgramData\miniconda3\envs\ioavstats\bin;C:\ProgramData\miniconda3\condabin;C:\Program Files\Python313\Scripts;C:\Program Files\Python313;C:\Program Files (x86)\infogridpacific\AZARDI;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\dotnet;C:\Program Files\Git LFS;C:\Program Files\Microsoft SQL Server\110\Tools\Binn;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Software\GnuWin32\bin;C:\WINDOWS;C:\WINDOWS\System32;C:\WINDOWS\System32\OpenSSH;C:\WINDOWS\System32\wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;\bin;\bin;\bin;C:\ProgramData\miniconda3\condabin;C:\Program Files\PostgreSQL\16\bin;C:\Software\jdk-20.0.1\bin;C:\Program Files\PuTTY;C:\Software\LAStools\bin;C:\Software\GnuPG\bin;C:\Program Files\nodejs;C:\Program Files\Calibre2;C:\Program Files\Go\bin;C:\Program Files\Git\cmd;C:\Program Files\Zero Install;C:\Program Files\GitHub CLI;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;C:\WINDOWS\System32\OpenSSH;C:\Program Files\TortoiseGit\bin;C:\Program Files\Amazon\AWSCLIV2;C:\Program Files\Docker\Docker\resources\bin;C:\Users\walte\.cargo\bin;C:\Users\walte\AppData\Local\Microsoft\WindowsApps;C:\Software\Microsoft VS Code\bin;c:\users\walte\.local\bin;C:\Users\walte\AppData\Local\JetBrains\Toolbox\scripts;C:\Users\walte\AppData\Local\Pandoc;C:\Users\walte\AppData\Local\GitHubDesktop\bin;C:\Users\walte\AppData\Roaming\npm;C:\Users\walte\AppData\Local\Microsoft\WinGet\Links;D:\Batch;C:\Program Files\Redis;C:\ProgramData\miniconda3\condabin;C:\Program Files\JetBrains\JetBrains Gateway 2024.3\bin;.;C:\Users\walte\AppData\Local\Microsoft\WindowsApps;.
1740849403696: javaVersion: 17.0.7
1740849403696:
1740849403696: Verifying RazorSQL resources location.
1740849403696:
1740849403697: testing base url: / = file:/C:/Program%20Files/RazorSQL/
1740849403697:
1740849403697: testString1: file:/C:/Program%20Files/RazorSQL/razorsql.jar
1740849403697: testString2: file:/C:/Program%20Files/RazorSQL/data/base.ssql
1740849403697: testFile1: C:\Program Files\RazorSQL\razorsql.jar
1740849403697: testFile2: C:\Program Files\RazorSQL\data\base.ssql
1740849403697: both test file exists. Base URL found.
1740849403697: resource directory: file:/C:/Program%20Files/RazorSQL/
1740849403697: user home: C:\Users\walte
1740849403698: user profile: C:\Users\walte
1740849403698: app data: C:\Users\walte\AppData\Roaming
1740849403699: checking write access to: C:\Users\walte\AppData\Roaming
1740849403699: write dir: C:\Users\walte\AppData\Roaming\RichardsonSoftware
1740849403699: can write to C:\Users\walte\AppData\Roaming
1740849403699: user.home: C:\Users\walte\AppData\Roaming
1740849403699: RazorSQL Scratch Directory: C:\Users\walte\AppData\Roaming\RazorSQL
1740849403699: RazorSQL Scratch Directory exists
1740849403699: checking for sub directories
1740849403699: razorsql launch log: C:\Users\walte\AppData\Roaming\RazorSQL\razorsql_launch_log.txt
1740849403700: launch log file = C:\Users\walte\AppData\Roaming\RazorSQL\razorsql_launch_log.txt
1740849403700: Checking for graphics properties
1740849403700: graphics properties file: C:\Users\walte\AppData\Roaming\RazorSQL\data\graphics_properties.txt
1740849403700: gOverride: null
1740849403700: not disabling advanced graphics
1740849403700: path0: file:/C:/Program%20Files/RazorSQL/data/run.ssql
1740849403700: path1: file:/C:/Program%20Files/RazorSQL/razorsql.jar
1740849403701: runArgs: true
1740849403701: showScreen: false
1740849403701: args[0]: -backup
1740849403701: args[1]: IO-AVSTATS
1740849403701: args[2]: null
1740849403701: args[3]: null
1740849403701: args[4]: ;
1740849403701: args[5]: null
1740849403701: args[6]: D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\up01MAR.sql
1740849403701: args[7]: NO
1740849403701: args[8]: tables
1740849403701: args[9]: YES
1740849403701: args[10]: null
1740849403701: args[11]: NO
1740849403701: args[12]: NO
1740849403701: Command: -backup
1740849403702: Running -backup
h: name = C:\Program Files\RazorSQL\data\run.ssql
h: name = C:\Program Files\RazorSQL\razorsql.jar
1740849403708: Attempting to load . . .
command found
uOne: file:/C:/Program%20Files/RazorSQL/
h: name = C:\Program Files\RazorSQL\data\run.ssql
1740849403718reading file . . .C:\Program Files\RazorSQL\data\base.ssql
1740849403737done reading . . .
1740849403747done converting
1740849403747starting lib load.
1740849403755lib load complete.
In command line processor
Max Memory: 30688.0
Current Total Memory: 2048.0
Free Memory: 1916.0260467529297
1740849403820: r init
1740849403820: d init
1740849403820: get default file encoding
1740849403820: end d init
custom home directory: null
Checking for user data from old versions
1740849403821: user home: C:\Users\walte
1740849403821: user profile: C:\Users\walte
1740849403822: app data: C:\Users\walte\AppData\Roaming
1740849403822: checking write access to: C:\Users\walte\AppData\Roaming
1740849403822: write dir: C:\Users\walte\AppData\Roaming\RichardsonSoftware
1740849403822: can write to C:\Users\walte\AppData\Roaming
newHome: C:\Users\walte\AppData\Roaming\RazorSQL
dataHome: C:\Users\walte\AppData\Roaming/RazorSQL/data/
preferences file: C:\Users\walte\AppData\Roaming\RazorSQL\data\preferences.txt
Profiles Exist
1740849403832: loading icons
1740849404078: done r init
Getting connection data from: IO-AVSTATS
1740849404080: r init
1740849404080: d init
1740849404080: get default file encoding
1740849404080: end d init
custom home directory: null
Checking for user data from old versions
newHome: C:\Users\walte\AppData\Roaming\RazorSQL
dataHome: C:\Users\walte\AppData\Roaming/RazorSQL/data/
preferences file: C:\Users\walte\AppData\Roaming\RazorSQL\data\preferences.txt
Profiles Exist
1740849404080: loading icons
1740849404092: done r init
getting connection . . .
Not using SSH Tunnel
driver: sun.jdbc.odbc.JdbcOdbcDriver
classLocation: C:\Program Files\RazorSQL\drivers\common\odbc.jar
loadedCommonJars: false
commonURL: file:/C:/Program%20Files/RazorSQL/drivers/common/
commonDir: C:\Program Files\RazorSQL\drivers\common
commonFiles[0]: file:/C:/Program%20Files/RazorSQL/drivers/common/activation.jar
commonFiles[1]: file:/C:/Program%20Files/RazorSQL/drivers/common/common.jar
commonFiles[2]: file:/C:/Program%20Files/RazorSQL/drivers/common/jaxb-api.jar
commonFiles[3]: file:/C:/Program%20Files/RazorSQL/drivers/common/jaxb-core.jar
commonFiles[4]: file:/C:/Program%20Files/RazorSQL/drivers/common/jaxb-impl.jar
commonFiles[6]: file:/C:/Program%20Files/RazorSQL/drivers/common/odbc.jar
connection type: ODBC
final classLocation: C:\Program Files\RazorSQL\drivers\common\odbc.jar
classLocation file: C:\Program Files\RazorSQL\drivers\common\odbc.jar
building sql manager
Loading driver
Done loading driver
Getting connection with no login info
JdbcOdbcDriver: in initialize
OdbcApi == null
Creating new OdbcApi, nativePrefix:
JdbcOdbc constructor
Attempting to load JdbcOdbc library
Got OdbcApi: sun.jdbc.odbc.JdbcOdbc@77846d2c
Getting charset
JdbcOdbcDriver.OdbcApi.charSet: Cp1252
Connection obtained
obtained connection
database major version = 2
database product name: ACCESS
multiValueInsert: false
includeIdentifyColumns: false
Calling backup . . .
Retrieving Tables . . .
Generating Table DDL . . .
1 of 20
number of columns 93
column map size: 93
foundNull: false
2 of 20
number of columns 2
column map size: 2
foundNull: false
3 of 20
number of columns 11
column map size: 11
foundNull: false
4 of 20
number of columns 2
column map size: 2
foundNull: false
5 of 20
number of columns 6
column map size: 6
foundNull: false
6 of 20
number of columns 5
column map size: 5
foundNull: false
7 of 20
number of columns 7
column map size: 7
foundNull: false
8 of 20
number of columns 13
column map size: 13
foundNull: false
9 of 20
number of columns 17
column map size: 17
foundNull: false
10 of 20
number of columns 73
column map size: 73
foundNull: false
11 of 20
number of columns 10
column map size: 10
foundNull: false
12 of 20
number of columns 14
column map size: 14
foundNull: false
13 of 20
number of columns 33
column map size: 33
foundNull: false
14 of 20
number of columns 8
column map size: 8
foundNull: false
15 of 20
number of columns 7
column map size: 7
foundNull: false
16 of 20
number of columns 8
column map size: 8
foundNull: false
17 of 20
number of columns 5
column map size: 5
foundNull: false
18 of 20
number of columns 8
column map size: 8
foundNull: false
19 of 20
number of columns 11
column map size: 11
foundNull: false
20 of 20
number of columns 3
column map size: 3
foundNull: false
Generating Alter Table DDL . . .
1 of 20
2 of 20
3 of 20
4 of 20
5 of 20
6 of 20
7 of 20
8 of 20
9 of 20
10 of 20
11 of 20
12 of 20
13 of 20
14 of 20
15 of 20
16 of 20
17 of 20
18 of 20
19 of 20
20 of 20
backup finished
closing connection . . .
connection closed.
Shutting down logging streams
Done shutting down logging streams
Exiting . . .
Progress update 2025-03-01 17:16:44.883579+00:00 : INFO.00.011 The DDL script for the MS Access database 'up01MAR.mdb' was created successfully.
Progress update 2025-03-01 17:16:44.884582+00:00 : INFO.00.012 The DDL script for the MS Access database 'up01MAR.mdb' is identical to the reference script.
Progress update 2025-03-01 17:16:44.884582+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:16:44.885581+00:00 : 2 s - Total time launcher.
Progress update 2025-03-01 17:16:44.885581+00:00 : INFO.00.006 End Launcher.
Progress update 2025-03-01 17:16:44.885581+00:00 : ===============================================================================.
2025-03-01 18:16:45,990 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-03-01 18:16:45,991 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-03-01 18:16:45,991 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-03-01 18:16:45,991 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-03-01 17:16:47.221598+00:00 : ===============================================================================.
Progress update 2025-03-01 17:16:47.221598+00:00 : INFO.00.004 Start Launcher.
2025-03-01 18:16:47,221 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'l_n_a', '-m', 'up01MAR']
2025-03-01 18:16:47,221 [root] [launcher.py ] INFO Start launcher.py
2025-03-01 18:16:47,233 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-03-01 17:16:47.234105+00:00 : INFO.00.008 Arguments task='l_n_a' msaccess='up01MAR'.
Progress update 2025-03-01 17:16:47.234105+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:16:47.234105+00:00 : INFO.00.049 Load NTSB MS Access database data from file 'up01MAR'.
Progress update 2025-03-01 17:16:47.234105+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:16:47.235609+00:00 : INFO.00.054 ODBC driver='DRIVER={Microsoft Access Driver (*.mdb, *.accdb)};DBQ=D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\up01MAR.mdb;'.
2025-03-01 18:16:47,444 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-03-01 17:16:47.509528+00:00 : INFO.00.021 The following database table is not processed: 'MSysAccessObjects'.
Progress update 2025-03-01 17:16:47.510528+00:00 : INFO.00.021 The following database table is not processed: 'MSysACEs'.
Progress update 2025-03-01 17:16:47.510528+00:00 : INFO.00.021 The following database table is not processed: 'MSysIMEXColumns'.
Progress update 2025-03-01 17:16:47.510528+00:00 : INFO.00.021 The following database table is not processed: 'MSysIMEXSpecs'.
Progress update 2025-03-01 17:16:47.510528+00:00 : INFO.00.021 The following database table is not processed: 'MSysModules2'.
Progress update 2025-03-01 17:16:47.510528+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneGroupCategories'.
Progress update 2025-03-01 17:16:47.510528+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneGroups'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneGroupToObjects'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneObjectIDs'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'MSysObjects'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'MSysQueries'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'MSysRelationships'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'Country'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'ct_iaids'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'ct_seqevt'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'eADMSPUB_DataDictionary'.
Progress update 2025-03-01 17:16:47.511530+00:00 : INFO.00.021 The following database table is not processed: 'states'.
Progress update 2025-03-01 17:16:47.511530+00:00 :
Progress update 2025-03-01 17:16:47.512529+00:00 : Database table : events <-----------------------------------.
Progress update 2025-03-01 17:16:47.722751+00:00 : Number rows selected : 77.
Progress update 2025-03-01 17:16:47.722751+00:00 :
Progress update 2025-03-01 17:16:47.723750+00:00 : Database table : aircraft <-----------------------------------.
Progress update 2025-03-01 17:16:47.933936+00:00 : Number rows selected : 81.
Progress update 2025-03-01 17:16:47.935439+00:00 :
Progress update 2025-03-01 17:16:47.935439+00:00 : Database table : dt_events <-----------------------------------.
Progress update 2025-03-01 17:16:48.343313+00:00 : Number rows selected : 353.
Progress update 2025-03-01 17:16:48.343313+00:00 :
Progress update 2025-03-01 17:16:48.343313+00:00 : Database table : ntsb_admin <-----------------------------------.
Progress update 2025-03-01 17:16:48.447808+00:00 : Number rows selected : 77.
Progress update 2025-03-01 17:16:48.447808+00:00 :
Progress update 2025-03-01 17:16:48.448806+00:00 : Database table : dt_aircraft <-----------------------------------.
Progress update 2025-03-01 17:16:49.197657+00:00 : Number rows selected : 662.
Progress update 2025-03-01 17:16:49.197657+00:00 :
Progress update 2025-03-01 17:16:49.197657+00:00 : Database table : engines <-----------------------------------.
Progress update 2025-03-01 17:16:49.265718+00:00 : Number rows selected : 49.
Progress update 2025-03-01 17:16:49.267080+00:00 :
Progress update 2025-03-01 17:16:49.267080+00:00 : Database table : events_sequence <-----------------------------------.
Progress update 2025-03-01 17:16:49.422816+00:00 : Number rows selected : 121.
Progress update 2025-03-01 17:16:49.422816+00:00 :
Progress update 2025-03-01 17:16:49.422816+00:00 : Database table : findings <-----------------------------------.
Progress update 2025-03-01 17:16:49.543185+00:00 : Number rows selected : 96.
Progress update 2025-03-01 17:16:49.543185+00:00 :
Progress update 2025-03-01 17:16:49.543185+00:00 : Database table : flight_crew <-----------------------------------.
Progress update 2025-03-01 17:16:49.652348+00:00 : Number rows selected : 68.
Progress update 2025-03-01 17:16:49.652348+00:00 :
Progress update 2025-03-01 17:16:49.652348+00:00 : Database table : injury <-----------------------------------.
Progress update 2025-03-01 17:16:50.118215+00:00 : Number rows selected : 388.
Progress update 2025-03-01 17:16:50.118215+00:00 :
Progress update 2025-03-01 17:16:50.118215+00:00 : Database table : narratives <-----------------------------------.
Progress update 2025-03-01 17:16:52.035448+00:00 : Number rows selected : 48.
Progress update 2025-03-01 17:16:52.035448+00:00 :
Progress update 2025-03-01 17:16:52.035448+00:00 : Database table : occurrences <-----------------------------------.
Progress update 2025-03-01 17:16:52.036453+00:00 : Number rows selected : 0.
Progress update 2025-03-01 17:16:52.036453+00:00 :
Progress update 2025-03-01 17:16:52.036453+00:00 : Database table : dt_flight_crew <-----------------------------------.
Progress update 2025-03-01 17:16:52.436297+00:00 : Number rows selected : 340.
Progress update 2025-03-01 17:16:52.436297+00:00 :
Progress update 2025-03-01 17:16:52.436297+00:00 : Database table : flight_time <-----------------------------------.
Progress update 2025-03-01 17:16:53.463632+00:00 : Number rows selected : 914.
Progress update 2025-03-01 17:16:53.463632+00:00 :
Progress update 2025-03-01 17:16:53.463632+00:00 : Database table : seq_of_events <-----------------------------------.
Progress update 2025-03-01 17:16:53.464633+00:00 : Number rows selected : 0.
Progress update 2025-03-01 17:16:53.653189+00:00 : INFO.00.065 Cleansing PostgreSQL data.
Progress update 2025-03-01 17:16:53.654190+00:00 : --------------------------------------------------------------------------------
2025-03-01 18:16:53,654 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-03-01 17:16:53.722356+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'acft_category'.
Progress update 2025-03-01 17:16:54.734610+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:16:54.734610+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'dest_country'.
Progress update 2025-03-01 17:16:55.726738+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:16:55.726738+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'dprt_country'.
Progress update 2025-03-01 17:16:56.727992+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:16:56.727992+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'far_part'.
Progress update 2025-03-01 17:16:57.700770+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:16:57.701773+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'oper_country'.
Progress update 2025-03-01 17:16:58.636926+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:16:58.636926+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'owner_country'.
Progress update 2025-03-01 17:16:59.583786+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:16:59.583786+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'regis_no'.
Progress update 2025-03-01 17:17:00.509872+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:17:00.509872+00:00 : INFO.00.066 Cleansing table 'events' column 'ev_city'.
Progress update 2025-03-01 17:17:00.557194+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:17:00.557194+00:00 : INFO.00.066 Cleansing table 'events' column 'ev_site_zipcode'.
Progress update 2025-03-01 17:17:00.594641+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:17:00.594641+00:00 : INFO.00.066 Cleansing table 'events' column 'latitude'.
Progress update 2025-03-01 17:17:00.633752+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:17:00.633752+00:00 : INFO.00.066 Cleansing table 'events' column 'longitude'.
Progress update 2025-03-01 17:17:00.672824+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:17:00.672824+00:00 : INFO.00.066 Cleansing table 'events_sequence' column 'occurrence_code'.
Progress update 2025-03-01 17:17:00.695490+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:17:00.695490+00:00 : 13 s - Total time launcher.
Progress update 2025-03-01 17:17:00.695996+00:00 : INFO.00.006 End Launcher.
Progress update 2025-03-01 17:17:00.695996+00:00 : ===============================================================================.
2025-03-01 18:17:01,869 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-03-01 18:17:01,869 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-03-01 18:17:01,870 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-03-01 18:17:01,870 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-03-01 17:17:03.124332+00:00 : ===============================================================================.
Progress update 2025-03-01 17:17:03.124332+00:00 : INFO.00.004 Start Launcher.
2025-03-01 18:17:03,124 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'c_l_l']
2025-03-01 18:17:03,125 [root] [launcher.py ] INFO Start launcher.py
2025-03-01 18:17:03,135 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-03-01 17:17:03.137003+00:00 : INFO.00.005 Argument task='c_l_l'.
Progress update 2025-03-01 17:17:03.137003+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:17:03.137003+00:00 : INFO.00.040 Correct decimal US latitudes and longitudes.
Progress update 2025-03-01 17:17:03.137003+00:00 : --------------------------------------------------------------------------------
2025-03-01 18:17:03,138 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2025-03-01 18:17:03,233 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-03-01 17:17:10.680287+00:00 : Number of rows so far read : 10000.
Progress update 2025-03-01 17:17:16.087317+00:00 : Number of rows so far read : 20000.
Progress update 2025-03-01 17:17:21.485686+00:00 : Number of rows so far read : 30000.
Progress update 2025-03-01 17:17:26.976549+00:00 : Number of rows so far read : 40000.
Progress update 2025-03-01 17:17:32.423716+00:00 : Number of rows so far read : 50000.
Progress update 2025-03-01 17:17:37.963920+00:00 : Number of rows so far read : 60000.
Progress update 2025-03-01 17:17:43.505253+00:00 : Number of rows so far read : 70000.
Progress update 2025-03-01 17:17:48.978384+00:00 : Number of rows so far read : 80000.
Progress update 2025-03-01 17:17:54.452004+00:00 : Number of rows so far read : 90000.
Progress update 2025-03-01 17:18:00.167298+00:00 : Number of rows so far read : 100000.
Progress update 2025-03-01 17:18:05.766168+00:00 : Number of rows so far read : 110000.
Progress update 2025-03-01 17:18:11.172325+00:00 : Number of rows so far read : 120000.
Progress update 2025-03-01 17:18:16.504544+00:00 : Number of rows so far read : 130000.
Progress update 2025-03-01 17:18:21.798180+00:00 : Number of rows so far read : 140000.
Progress update 2025-03-01 17:18:23.510389+00:00 : Number rows selected : 142872.
Progress update 2025-03-01 17:18:23.511392+00:00 : Number rows updated : 142872.
Progress update 2025-03-01 17:18:23.538951+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:18:23.538951+00:00 : 80 s - Total time launcher.
Progress update 2025-03-01 17:18:23.538951+00:00 : INFO.00.006 End Launcher.
Progress update 2025-03-01 17:18:23.538951+00:00 : ===============================================================================.
2025-03-01 18:18:24,637 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-03-01 18:18:24,637 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-03-01 18:18:24,638 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-03-01 18:18:24,638 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-03-01 17:18:25.859518+00:00 : ===============================================================================.
Progress update 2025-03-01 17:18:25.859518+00:00 : INFO.00.004 Start Launcher.
2025-03-01 18:18:25,859 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'f_n_a']
2025-03-01 18:18:25,859 [root] [launcher.py ] INFO Start launcher.py
2025-03-01 18:18:25,876 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-03-01 17:18:25.877545+00:00 : INFO.00.005 Argument task='f_n_a'.
Progress update 2025-03-01 17:18:25.877545+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:18:25.878545+00:00 : INFO.00.086 Find the nearest airports.
Progress update 2025-03-01 17:18:25.878545+00:00 : --------------------------------------------------------------------------------
2025-03-01 18:18:25,878 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
2025-03-01 18:18:25,999 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-03-01 17:18:51.936158+00:00 : Number of rows so far read : 10000.
Progress update 2025-03-01 17:19:16.337249+00:00 : Number of rows so far read : 20000.
Progress update 2025-03-01 17:19:40.847937+00:00 : Number of rows so far read : 30000.
Progress update 2025-03-01 17:20:05.873931+00:00 : Number of rows so far read : 40000.
Progress update 2025-03-01 17:20:30.609141+00:00 : Number of rows so far read : 50000.
Progress update 2025-03-01 17:20:30.881992+00:00 : ERROR.00.942 Event '20220711105442': issue with the Haversine algorithm: 'Longitude -894627.0 is out of range [-180, 180]'.
Progress update 2025-03-01 17:20:54.610198+00:00 : Number of rows so far read : 60000.
Progress update 2025-03-01 17:21:19.079048+00:00 : Number of rows so far read : 70000.
Progress update 2025-03-01 17:21:21.380306+00:00 : ERROR.00.942 Event '20210419102938': issue with the Haversine algorithm: 'Latitude 4603.0 is out of range [-90, 90]'.
Progress update 2025-03-01 17:21:21.380306+00:00 : ERROR.00.942 Event '20221027106211': issue with the Haversine algorithm: 'Latitude 36940.21 is out of range [-90, 90]'.
Progress update 2025-03-01 17:21:21.380306+00:00 : ERROR.00.942 Event '20221108106263': issue with the Haversine algorithm: 'Latitude 390408.0 is out of range [-90, 90]'.
Progress update 2025-03-01 17:21:21.380306+00:00 : ERROR.00.942 Event '20220803105651': issue with the Haversine algorithm: 'Latitude 41370104.0 is out of range [-90, 90]'.
Progress update 2025-03-01 17:21:21.381305+00:00 : ERROR.00.942 Event '20221108106264': issue with the Haversine algorithm: 'Latitude 43511185.0 is out of range [-90, 90]'.
Progress update 2025-03-01 17:21:21.403775+00:00 : Number rows selected : 71013.
Progress update 2025-03-01 17:21:21.403775+00:00 : Number rows updated : 71007.
Progress update 2025-03-01 17:21:21.405279+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:21:21.405279+00:00 : 175 s - Total time launcher.
Progress update 2025-03-01 17:21:21.405279+00:00 : INFO.00.006 End Launcher.
Progress update 2025-03-01 17:21:21.405279+00:00 : ===============================================================================.
2025-03-01 18:21:22,607 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-03-01 18:21:22,607 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-03-01 18:21:22,607 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-03-01 18:21:22,607 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-03-01 17:21:23.863576+00:00 : ===============================================================================.
Progress update 2025-03-01 17:21:23.864576+00:00 : INFO.00.004 Start Launcher.
2025-03-01 18:21:23,864 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'v_n_d']
2025-03-01 18:21:23,864 [root] [launcher.py ] INFO Start launcher.py
2025-03-01 18:21:23,875 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-03-01 17:21:23.876622+00:00 : INFO.00.005 Argument task='v_n_d'.
Progress update 2025-03-01 17:21:23.876622+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:21:23.876622+00:00 : INFO.00.043 Verify selected NTSB data.
Progress update 2025-03-01 17:21:23.876622+00:00 : --------------------------------------------------------------------------------
2025-03-01 18:21:23,876 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-03-01 17:21:25.946051+00:00 : INFO.00.063 Processed data source 'events'.
Progress update 2025-03-01 17:21:25.946051+00:00 : Number cols deleted : 91517.
Progress update 2025-03-01 17:21:25.946051+00:00 : --------------------------------------------------------------------------------
2025-03-01 18:21:25,946 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-03-01 17:21:26.012100+00:00 : INFO.00.064 Verification of table 'events' column(s) 'latitude & longitude'.
Progress update 2025-03-01 17:21:26.013100+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:21:28.117707+00:00 : Number of rows so far read : 10000.
Progress update 2025-03-01 17:21:29.793035+00:00 : Number of rows so far read : 20000.
Progress update 2025-03-01 17:21:31.442129+00:00 : Number of rows so far read : 30000.
Progress update 2025-03-01 17:21:33.200181+00:00 : Number of rows so far read : 40000.
Progress update 2025-03-01 17:21:35.232683+00:00 : Number of rows so far read : 50000.
Progress update 2025-03-01 17:21:38.606805+00:00 : Number of rows so far read : 60000.
Progress update 2025-03-01 17:21:42.155670+00:00 : Number of rows so far read : 70000.
Progress update 2025-03-01 17:21:44.518301+00:00 : Number rows errors : 28014.
Progress update 2025-03-01 17:21:44.518301+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:21:44.518301+00:00 : INFO.00.064 Verification of table 'events' column(s) 'ev_city'.
Progress update 2025-03-01 17:21:44.919270+00:00 : Number rows errors : 6256.
Progress update 2025-03-01 17:21:44.920271+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:21:44.920271+00:00 : INFO.00.064 Verification of table 'events' column(s) 'ev_city & ev_site_zipcode'.
Progress update 2025-03-01 17:21:45.524724+00:00 : Number rows errors : 16966.
Progress update 2025-03-01 17:21:45.524724+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:21:45.524724+00:00 : INFO.00.064 Verification of table 'events' column(s) 'ev_state'.
Progress update 2025-03-01 17:21:45.559782+00:00 : Number rows errors : 177.
Progress update 2025-03-01 17:21:45.559782+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:21:45.559782+00:00 : INFO.00.064 Verification of table 'events' column(s) 'ev_site_zipcode'.
Progress update 2025-03-01 17:21:45.781709+00:00 : Number rows errors : 5141.
Progress update 2025-03-01 17:21:45.781709+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:21:45.781709+00:00 : Number rows selected : 76862.
Progress update 2025-03-01 17:21:45.782711+00:00 : Number rows updated : 56554.
Progress update 2025-03-01 17:21:45.782711+00:00 : Number rows errors : 56554.
Progress update 2025-03-01 17:21:45.785213+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:21:45.785213+00:00 : 21 s - Total time launcher.
Progress update 2025-03-01 17:21:45.785213+00:00 : INFO.00.006 End Launcher.
Progress update 2025-03-01 17:21:45.785213+00:00 : ===============================================================================.
2025-03-01 18:21:46,937 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-03-01 18:21:46,937 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-03-01 18:21:46,937 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-03-01 18:21:46,938 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-03-01 17:21:48.153606+00:00 : ===============================================================================.
Progress update 2025-03-01 17:21:48.154605+00:00 : INFO.00.004 Start Launcher.
2025-03-01 18:21:48,154 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'r_d_s']
2025-03-01 18:21:48,154 [root] [launcher.py ] INFO Start launcher.py
2025-03-01 18:21:48,169 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-03-01 17:21:48.170172+00:00 : INFO.00.005 Argument task='r_d_s'.
Progress update 2025-03-01 17:21:48.170172+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:21:48.170172+00:00 : INFO.00.071 Refreshing the database schema.
Progress update 2025-03-01 17:21:48.171170+00:00 : --------------------------------------------------------------------------------
2025-03-01 18:21:48,171 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-03-01 17:21:48.227788+00:00 :
Progress update 2025-03-01 17:21:48.227788+00:00 : Database table : io_md_codes_eventsoe <-----------------------------------.
Progress update 2025-03-01 17:21:48.253170+00:00 : Number rows deleted : 13.
Progress update 2025-03-01 17:21:48.313786+00:00 : Number rows selected : 1559.
Progress update 2025-03-01 17:21:50.728196+00:00 : Number rows inserted : 96.
Progress update 2025-03-01 17:21:50.729196+00:00 :
Progress update 2025-03-01 17:21:50.729196+00:00 : Database table : io_md_codes_phase <-----------------------------------.
Progress update 2025-03-01 17:21:50.753920+00:00 : Number rows deleted : 12.
Progress update 2025-03-01 17:21:50.809920+00:00 : Number rows selected : 1559.
Progress update 2025-03-01 17:21:52.086607+00:00 : Number rows inserted : 48.
Progress update 2025-03-01 17:21:52.086607+00:00 :
Progress update 2025-03-01 17:21:52.086607+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:21:52.086607+00:00 : INFO.00.084 Database table io_md_codes_phase: Load description_main_phase from file 'data/Main_Phases_of_Flight/main_phases_of_flight.xlsx'.
Progress update 2025-03-01 17:21:52.087603+00:00 : --------------------------------------------------------------------------------
Progress update 2025-03-01 17:21:53.311134+00:00 : Number rows selected : 48.
Progress update 2025-03-01 17:21:53.311134+00:00 : Number rows updated : 48.
Progress update 2025-03-01 17:21:53.312137+00:00 :
Progress update 2025-03-01 17:21:53.312137+00:00 : Database table : io_md_codes_category <-----------------------------------.
Progress update 2025-03-01 17:21:53.344532+00:00 : Number rows deleted : 4.
Progress update 2025-03-01 17:21:53.786898+00:00 : Number rows selected : 7633.
Progress update 2025-03-01 17:21:53.911490+00:00 : Number rows inserted : 5.
Progress update 2025-03-01 17:21:53.911490+00:00 :
Progress update 2025-03-01 17:21:53.911490+00:00 : Database table : io_md_codes_subcategory <-----------------------------------.
Progress update 2025-03-01 17:21:54.237015+00:00 : Number rows selected : 7633.
Progress update 2025-03-01 17:21:55.275221+00:00 : Number rows inserted : 21.
Progress update 2025-03-01 17:21:55.276227+00:00 :
Progress update 2025-03-01 17:21:55.276227+00:00 : Database table : io_md_codes_section <-----------------------------------.
Progress update 2025-03-01 17:21:55.531301+00:00 : Number rows selected : 7633.
Progress update 2025-03-01 17:22:00.759856+00:00 : Number rows inserted : 129.
Progress update 2025-03-01 17:22:00.760856+00:00 :
Progress update 2025-03-01 17:22:00.760856+00:00 : Database table : io_md_codes_subsection <-----------------------------------.
Progress update 2025-03-01 17:22:01.024728+00:00 : Number rows selected : 7633.
Progress update 2025-03-01 17:22:26.576926+00:00 : Number rows inserted : 777.
Progress update 2025-03-01 17:22:26.577931+00:00 :
Progress update 2025-03-01 17:22:26.577931+00:00 : Database table : io_md_codes_modifier <-----------------------------------.
Progress update 2025-03-01 17:22:26.643804+00:00 : Number rows deleted : 8.
Progress update 2025-03-01 17:22:26.883613+00:00 : Number rows selected : 7633.
Progress update 2025-03-01 17:22:29.526623+00:00 : Number rows inserted : 74.
Progress update 2025-03-01 17:25:06.851949+00:00 : INFO.00.069 Materialized database view is refreshed: io_app_ae1982.
Progress update 2025-03-01 17:25:06.852949+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-03-01 17:25:06.852949+00:00 : 198 s - Total time launcher.
Progress update 2025-03-01 17:25:06.852949+00:00 : INFO.00.006 End Launcher.
Progress update 2025-03-01 17:25:06.852949+00:00 : ===============================================================================.
---------------------------------------------------------------------------
The current time is: 18:25:07.36
Enter the new time:
---------------------------------------------------------------------------
End run_io_avstats_dev
===========================================================================