===========================================================================
Start run_io_avstats_dev
---------------------------------------------------------------------------
IO-AVSTATS - Aviation Event Statistics.
---------------------------------------------------------------------------
ENV_FOR_DYNACONF : prod
PYTHONPATH : .
---------------------------------------------------------------------------
TASK : l_n_a
APPLICATION :
COMPOSE_TASK :
MSACCESS : avall
MSEXCEL :
---------------------------------------------------------------------------
The current time is: 16:19:42.76
Enter the new time:
===========================================================================
Traceback (most recent call last):
File "D:\SoftDevelopment\Projects\IO-Aero\io-avstats\scripts\launcher.py", line 14, in <module>
import tomli
ModuleNotFoundError: No module named 'tomli'
Processing of the script run_io_avstats_dev was aborted
D:\SoftDevelopment\Projects\IO-Aero\io-avstats>conda activate ioavstats
(ioavstats) D:\SoftDevelopment\Projects\IO-Aero\io-avstats>run_io_avstats_dev
'export' is not recognized as an internal or external command,
operable program or batch file.
=======================================================================
r_s_a - Run the IO-AVSTATS application
-----------------------------------------------------------------------
u_p_d - Complete processing of a modifying MS Access file
l_n_a - Load NTSB MS Access database data into PostgreSQL
-----------------------------------------------------------------------
c_p_d - Cleansing PostgreSQL data
c_l_l - Correct decimal US latitudes and longitudes
f_n_a - Find the nearest airports
-----------------------------------------------------------------------
l_a_p - Load airport data into PostgreSQL
a_o_c - Load aviation occurrence categories into PostgreSQL
l_c_s - Load country and state data into PostgreSQL
l_c_d - Load data from a correction file into PostgreSQL
l_s_e - Load sequence of events data into PostgreSQL
l_s_d - Load simplemaps data into PostgreSQL
l_z_d - Load ZIP Code Database data into PostgreSQL
-----------------------------------------------------------------------
s_d_c - Set up the PostgreSQL database container
c_d_s - Create the PostgreSQL database schema
u_d_s - Update the PostgreSQL database schema
r_d_s - Refresh the PostgreSQL database schema
-----------------------------------------------------------------------
c_f_z - Zip the files for the cloud
c_d_i - Create or update an application Docker image
c_d_c - Run Docker Compose tasks - Cloud
c_d_l - Run Docker Compose tasks - Local
-----------------------------------------------------------------------
version - Show the IO-AVSTATS version
-----------------------------------------------------------------------
Enter the desired task [default: r_s_a] l_n_a
=========================================================
avall - Data from January 1, 2008 to today
Pre2008 - Data from January 1, 1982 to December 31, 2007
upDDMON - New additions and updates until DD day in the month MON
---------------------------------------------------------
Enter the stem name of the desired MS Access database file avall
Script run_io_avstats_dev is now running
Please wait ...
===========================================================================
Start run_io_avstats_dev
---------------------------------------------------------------------------
IO-AVSTATS - Aviation Event Statistics.
---------------------------------------------------------------------------
ENV_FOR_DYNACONF : prod
PYTHONPATH : .
---------------------------------------------------------------------------
TASK : l_n_a
APPLICATION :
COMPOSE_TASK :
MSACCESS : avall
MSEXCEL :
---------------------------------------------------------------------------
The current time is: 16:20:13.24
Enter the new time:
===========================================================================
2025-01-01 16:20:15,178 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-01-01 16:20:15,179 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-01-01 16:20:15,179 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-01-01 16:20:15,179 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-01-01 15:20:17.560612+00:00 : ===============================================================================.
Progress update 2025-01-01 15:20:17.560612+00:00 : INFO.00.004 Start Launcher.
2025-01-01 16:20:17,560 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'd_n_a', '-m', 'avall']
2025-01-01 16:20:17,560 [root] [launcher.py ] INFO Start launcher.py
2025-01-01 16:20:17,571 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-01-01 15:20:17.573612+00:00 : INFO.00.008 Arguments task='d_n_a' msaccess='avall'.
Progress update 2025-01-01 15:20:17.573612+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 15:20:17.573612+00:00 : INFO.00.047 Download NTSB MS Access database file 'avall'.
Progress update 2025-01-01 15:20:17.573612+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:20:18.017005+00:00 : INFO.00.013 The connection to the MS Access database file 'avall.zip' on the NTSB download page was successfully established.
Progress update 2025-01-01 15:20:20.040260+00:00 : INFO.00.014 From the file 'avall.zip' 168 chunks were downloaded.
Progress update 2025-01-01 15:20:21.095610+00:00 : INFO.00.015 The file 'avall.zip' was successfully unpacked.
Progress update 2025-01-01 15:20:21.312493+00:00 : INFO.00.051 msaccess_file='D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\IO-AVSTATS.mdb'.
Progress update 2025-01-01 15:20:21.313161+00:00 : INFO.00.051 msaccess_file='D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\avall.sql'.
Progress update 2025-01-01 15:20:21.313161+00:00 : INFO.00.052 razorsql_jar_file='C:\Program Files\RazorSQL\razorsql.jar'.
Progress update 2025-01-01 15:20:21.313683+00:00 : INFO.00.053 razorsql_java_path='C:\Program Files\RazorSQL\jre11\bin\java'.
1735744822774: launching RazorSQL . . .
1735744822774: args . . .
-backup
IO-AVSTATS
null
null
;
null
D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\avall.sql
NO
tables
YES
null
NO
NO
1735744822810: userName: walte
1735744822810: libraryPath: C:\Program Files\RazorSQL\jre11\bin;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\ProgramData\miniconda3\envs\ioavstats;C:\ProgramData\miniconda3\envs\ioavstats\Library\mingw-w64\bin;C:\ProgramData\miniconda3\envs\ioavstats\Library\usr\bin;C:\ProgramData\miniconda3\envs\ioavstats\Library\bin;C:\ProgramData\miniconda3\envs\ioavstats\Scripts;C:\ProgramData\miniconda3\envs\ioavstats\bin;C:\ProgramData\miniconda3\condabin;C:\Program Files\Python313\Scripts;C:\Program Files\Python313;C:\Program Files (x86)\infogridpacific\AZARDI;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\dotnet;C:\Program Files\Git LFS;C:\Program Files\Microsoft SQL Server\110\Tools\Binn;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Software\GnuWin32\bin;C:\WINDOWS;C:\WINDOWS\System32;C:\WINDOWS\System32\OpenSSH;C:\WINDOWS\System32\wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;C:\Users\walte\.nimble\bin;\bin;\bin;\bin;C:\ProgramData\miniconda3\condabin;C:\Program Files\PostgreSQL\16\bin;C:\Software\jdk-20.0.1\bin;C:\Program Files\PuTTY;C:\Software\LAStools\bin;C:\Software\GnuPG\bin;C:\Program Files\nodejs;C:\Program Files\Calibre2;C:\Program Files\TortoiseGit\bin;C:\Program Files\Go\bin;C:\Program Files\Git\cmd;C:\Program Files\Amazon\AWSCLIV2;C:\Program Files\Zero Install;C:\Program Files\GitHub CLI;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;C:\WINDOWS\System32\OpenSSH;C:\Program Files\Docker\Docker\resources\bin;C:\Users\walte\.cargo\bin;C:\Users\walte\AppData\Local\Microsoft\WindowsApps;C:\Software\Microsoft VS Code\bin;c:\users\walte\.local\bin;C:\Users\walte\AppData\Local\JetBrains\Toolbox\scripts;C:\Users\walte\AppData\Local\Pandoc;C:\Users\walte\AppData\Local\GitHubDesktop\bin;C:\Users\walte\AppData\Roaming\npm;C:\Users\walte\AppData\Local\Microsoft\WinGet\Links;D:\Batch;C:\Program Files\Redis;C:\ProgramData\miniconda3\condabin;C:\Program Files\JetBrains\JetBrains Gateway 2024.3\bin;.;C:\Users\walte\AppData\Local\Microsoft\WindowsApps;C:\Users\walte\AppData\Local\Programs\Windsurf\bin;.
1735744822811: javaVersion: 17.0.7
1735744822811:
1735744822811: Verifying RazorSQL resources location.
1735744822811:
1735744822811: testing base url: / = file:/C:/Program%20Files/RazorSQL/
1735744822811:
1735744822811: testString1: file:/C:/Program%20Files/RazorSQL/razorsql.jar
1735744822811: testString2: file:/C:/Program%20Files/RazorSQL/data/base.ssql
1735744822812: testFile1: C:\Program Files\RazorSQL\razorsql.jar
1735744822812: testFile2: C:\Program Files\RazorSQL\data\base.ssql
1735744822812: both test file exists. Base URL found.
1735744822812: resource directory: file:/C:/Program%20Files/RazorSQL/
1735744822812: user home: C:\Users\walte
1735744822813: user profile: C:\Users\walte
1735744822813: app data: C:\Users\walte\AppData\Roaming
1735744822813: checking write access to: C:\Users\walte\AppData\Roaming
1735744822813: write dir: C:\Users\walte\AppData\Roaming\RichardsonSoftware
1735744822814: can write to C:\Users\walte\AppData\Roaming
1735744822814: user.home: C:\Users\walte\AppData\Roaming
1735744822814: RazorSQL Scratch Directory: C:\Users\walte\AppData\Roaming\RazorSQL
1735744822814: RazorSQL Scratch Directory exists
1735744822814: checking for sub directories
1735744822815: razorsql launch log: C:\Users\walte\AppData\Roaming\RazorSQL\razorsql_launch_log.txt
1735744822815: launch log file = C:\Users\walte\AppData\Roaming\RazorSQL\razorsql_launch_log.txt
1735744822815: Checking for graphics properties
1735744822815: graphics properties file: C:\Users\walte\AppData\Roaming\RazorSQL\data\graphics_properties.txt
1735744822815: gOverride: null
1735744822816: not disabling advanced graphics
1735744822816: path0: file:/C:/Program%20Files/RazorSQL/data/run.ssql
1735744822816: path1: file:/C:/Program%20Files/RazorSQL/razorsql.jar
1735744822816: runArgs: true
1735744822816: showScreen: false
1735744822816: args[0]: -backup
1735744822816: args[1]: IO-AVSTATS
1735744822816: args[2]: null
1735744822816: args[3]: null
1735744822816: args[4]: ;
1735744822816: args[5]: null
1735744822816: args[6]: D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\avall.sql
1735744822817: args[7]: NO
1735744822817: args[8]: tables
1735744822817: args[9]: YES
1735744822817: args[10]: null
1735744822817: args[11]: NO
1735744822817: args[12]: NO
1735744822817: Command: -backup
1735744822817: Running -backup
h: name = C:\Program Files\RazorSQL\data\run.ssql
h: name = C:\Program Files\RazorSQL\razorsql.jar
1735744822824: Attempting to load . . .
command found
uOne: file:/C:/Program%20Files/RazorSQL/
h: name = C:\Program Files\RazorSQL\data\run.ssql
1735744822833reading file . . .C:\Program Files\RazorSQL\data\base.ssql
1735744822855done reading . . .
1735744822864done converting
1735744822865starting lib load.
1735744822873lib load complete.
In command line processor
Max Memory: 30688.0
Current Total Memory: 2048.0
Free Memory: 1916.1443405151367
1735744822940: r init
1735744822940: d init
1735744822940: get default file encoding
1735744822940: end d init
custom home directory: null
Checking for user data from old versions
1735744822942: user home: C:\Users\walte
1735744822942: user profile: C:\Users\walte
1735744822942: app data: C:\Users\walte\AppData\Roaming
1735744822942: checking write access to: C:\Users\walte\AppData\Roaming
1735744822942: write dir: C:\Users\walte\AppData\Roaming\RichardsonSoftware
1735744822943: can write to C:\Users\walte\AppData\Roaming
newHome: C:\Users\walte\AppData\Roaming\RazorSQL
dataHome: C:\Users\walte\AppData\Roaming/RazorSQL/data/
preferences file: C:\Users\walte\AppData\Roaming\RazorSQL\data\preferences.txt
Profiles Exist
1735744822953: loading icons
1735744823373: done r init
Getting connection data from: IO-AVSTATS
1735744823374: r init
1735744823374: d init
1735744823374: get default file encoding
1735744823374: end d init
custom home directory: null
Checking for user data from old versions
newHome: C:\Users\walte\AppData\Roaming\RazorSQL
dataHome: C:\Users\walte\AppData\Roaming/RazorSQL/data/
preferences file: C:\Users\walte\AppData\Roaming\RazorSQL\data\preferences.txt
Profiles Exist
1735744823374: loading icons
1735744823384: done r init
getting connection . . .
Not using SSH Tunnel
driver: sun.jdbc.odbc.JdbcOdbcDriver
classLocation: C:\Program Files\RazorSQL\drivers\common\odbc.jar
loadedCommonJars: false
commonURL: file:/C:/Program%20Files/RazorSQL/drivers/common/
commonDir: C:\Program Files\RazorSQL\drivers\common
commonFiles[0]: file:/C:/Program%20Files/RazorSQL/drivers/common/activation.jar
commonFiles[1]: file:/C:/Program%20Files/RazorSQL/drivers/common/common.jar
commonFiles[2]: file:/C:/Program%20Files/RazorSQL/drivers/common/jaxb-api.jar
commonFiles[3]: file:/C:/Program%20Files/RazorSQL/drivers/common/jaxb-core.jar
commonFiles[4]: file:/C:/Program%20Files/RazorSQL/drivers/common/jaxb-impl.jar
commonFiles[6]: file:/C:/Program%20Files/RazorSQL/drivers/common/odbc.jar
connection type: ODBC
final classLocation: C:\Program Files\RazorSQL\drivers\common\odbc.jar
classLocation file: C:\Program Files\RazorSQL\drivers\common\odbc.jar
building sql manager
Loading driver
Done loading driver
Getting connection with no login info
JdbcOdbcDriver: in initialize
OdbcApi == null
Creating new OdbcApi, nativePrefix:
JdbcOdbc constructor
Attempting to load JdbcOdbc library
Got OdbcApi: sun.jdbc.odbc.JdbcOdbc@77846d2c
Getting charset
JdbcOdbcDriver.OdbcApi.charSet: Cp1252
Connection obtained
obtained connection
database major version = 2
database product name: ACCESS
multiValueInsert: false
includeIdentifyColumns: false
Calling backup . . .
Retrieving Tables . . .
Generating Table DDL . . .
1 of 20
number of columns 93
column map size: 93
foundNull: false
2 of 20
number of columns 2
column map size: 2
foundNull: false
3 of 20
number of columns 11
column map size: 11
foundNull: false
4 of 20
number of columns 2
column map size: 2
foundNull: false
5 of 20
number of columns 6
column map size: 6
foundNull: false
6 of 20
number of columns 5
column map size: 5
foundNull: false
7 of 20
number of columns 7
column map size: 7
foundNull: false
8 of 20
number of columns 13
column map size: 13
foundNull: false
9 of 20
number of columns 17
column map size: 17
foundNull: false
10 of 20
number of columns 73
column map size: 73
foundNull: false
11 of 20
number of columns 10
column map size: 10
foundNull: false
12 of 20
number of columns 14
column map size: 14
foundNull: false
13 of 20
number of columns 33
column map size: 33
foundNull: false
14 of 20
number of columns 8
column map size: 8
foundNull: false
15 of 20
number of columns 7
column map size: 7
foundNull: false
16 of 20
number of columns 8
column map size: 8
foundNull: false
17 of 20
number of columns 5
column map size: 5
foundNull: false
18 of 20
number of columns 8
column map size: 8
foundNull: false
19 of 20
number of columns 11
column map size: 11
foundNull: false
20 of 20
number of columns 3
column map size: 3
foundNull: false
Generating Alter Table DDL . . .
1 of 20
2 of 20
3 of 20
4 of 20
5 of 20
6 of 20
7 of 20
8 of 20
9 of 20
10 of 20
11 of 20
12 of 20
13 of 20
14 of 20
15 of 20
16 of 20
17 of 20
18 of 20
19 of 20
20 of 20
backup finished
closing connection . . .
connection closed.
Shutting down logging streams
Done shutting down logging streams
Exiting . . .
Progress update 2025-01-01 15:20:24.568913+00:00 : INFO.00.011 The DDL script for the MS Access database 'avall.mdb' was created successfully.
Progress update 2025-01-01 15:20:24.587457+00:00 : INFO.00.012 The DDL script for the MS Access database 'avall.mdb' is identical to the reference script.
Progress update 2025-01-01 15:20:24.588457+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 15:20:24.588457+00:00 : 7 s - Total time launcher.
Progress update 2025-01-01 15:20:24.589461+00:00 : INFO.00.006 End Launcher.
Progress update 2025-01-01 15:20:24.589461+00:00 : ===============================================================================.
2025-01-01 16:20:26,183 [root] [io_logger.py ] INFO You are using io-aero's iocommon version 1.2.63 logger (Copyright (c) 2022-2024 IO-Aero)
2025-01-01 16:20:26,184 [root] [io_settings.py ] INFO Starting the configuration management system.
2025-01-01 16:20:26,184 [root] [io_settings.py ] INFO Running in a source (non-compiled) environment. Configuration loading from: D:\SoftDevelopment\Projects\IO-Aero\io-avstats
2025-01-01 16:20:26,184 [root] [io_settings.py ] INFO Dynaconf settings loaded successfully.
Progress update 2025-01-01 15:20:27.625239+00:00 : ===============================================================================.
Progress update 2025-01-01 15:20:27.625239+00:00 : INFO.00.004 Start Launcher.
2025-01-01 16:20:27,625 [root] [launcher.py ] INFO param argv=['scripts\\launcher.py', '-t', 'l_n_a', '-m', 'avall']
2025-01-01 16:20:27,625 [root] [launcher.py ] INFO Start launcher.py
2025-01-01 16:20:27,637 [root] [launcher.py ] INFO locale=('en_US', 'UTF-8')
Progress update 2025-01-01 15:20:27.638242+00:00 : INFO.00.008 Arguments task='l_n_a' msaccess='avall'.
Progress update 2025-01-01 15:20:27.638242+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 15:20:27.638242+00:00 : INFO.00.049 Load NTSB MS Access database data from file 'avall'.
Progress update 2025-01-01 15:20:27.638242+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:20:27.639244+00:00 : INFO.00.054 ODBC driver='DRIVER={Microsoft Access Driver (*.mdb, *.accdb)};DBQ=D:\SoftDevelopment\Projects\IO-Aero\io-avstats\data\download\avall.mdb;'.
2025-01-01 16:20:27,996 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-01-01 15:20:28.094078+00:00 : INFO.00.021 The following database table is not processed: 'MSysAccessObjects'.
Progress update 2025-01-01 15:20:28.094078+00:00 : INFO.00.021 The following database table is not processed: 'MSysACEs'.
Progress update 2025-01-01 15:20:28.094078+00:00 : INFO.00.021 The following database table is not processed: 'MSysIMEXColumns'.
Progress update 2025-01-01 15:20:28.094078+00:00 : INFO.00.021 The following database table is not processed: 'MSysIMEXSpecs'.
Progress update 2025-01-01 15:20:28.094078+00:00 : INFO.00.021 The following database table is not processed: 'MSysModules2'.
Progress update 2025-01-01 15:20:28.094078+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneGroupCategories'.
Progress update 2025-01-01 15:20:28.094078+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneGroups'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneGroupToObjects'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'MSysNavPaneObjectIDs'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'MSysObjects'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'MSysQueries'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'MSysRelationships'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'Country'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'ct_iaids'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'ct_seqevt'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'eADMSPUB_DataDictionary'.
Progress update 2025-01-01 15:20:28.095080+00:00 : INFO.00.021 The following database table is not processed: 'states'.
Progress update 2025-01-01 15:20:28.095080+00:00 :
Progress update 2025-01-01 15:20:28.095080+00:00 : Database table : events <-----------------------------------.
Progress update 2025-01-01 15:20:37.115590+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:20:44.388762+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:20:50.469344+00:00 : Number rows selected : 28332.
Progress update 2025-01-01 15:20:50.470346+00:00 : Number rows inserted : 28332.
Progress update 2025-01-01 15:20:50.505067+00:00 :
Progress update 2025-01-01 15:20:50.505594+00:00 : Database table : aircraft <-----------------------------------.
Progress update 2025-01-01 15:21:00.801003+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:21:09.323438+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:21:16.888375+00:00 : Number rows selected : 28795.
Progress update 2025-01-01 15:21:16.888375+00:00 : Number rows inserted : 28795.
Progress update 2025-01-01 15:21:16.936401+00:00 :
Progress update 2025-01-01 15:21:16.937407+00:00 : Database table : dt_events <-----------------------------------.
Progress update 2025-01-01 15:21:22.786416+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:21:28.277052+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:21:33.908262+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 15:21:39.432011+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 15:21:44.872524+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 15:21:50.212464+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 15:21:55.828142+00:00 : Number of rows so far read : 70000.
Progress update 2025-01-01 15:22:01.243533+00:00 : Number of rows so far read : 80000.
Progress update 2025-01-01 15:22:06.608161+00:00 : Number of rows so far read : 90000.
Progress update 2025-01-01 15:22:11.957098+00:00 : Number of rows so far read : 100000.
Progress update 2025-01-01 15:22:13.106995+00:00 : Number rows selected : 102093.
Progress update 2025-01-01 15:22:13.106995+00:00 : Number rows inserted : 102093.
Progress update 2025-01-01 15:22:13.116511+00:00 :
Progress update 2025-01-01 15:22:13.116511+00:00 : Database table : ntsb_admin <-----------------------------------.
Progress update 2025-01-01 15:22:18.812925+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:22:24.195199+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:22:25.429551+00:00 : ERROR.00.946 The ev_id '20210527103155' is missing in database table events.
Progress update 2025-01-01 15:22:26.172502+00:00 : ERROR.00.946 The ev_id '20220328104839' is missing in database table events.
Progress update 2025-01-01 15:22:28.669631+00:00 : Number rows selected : 28332.
Progress update 2025-01-01 15:22:28.669631+00:00 : Number rows inserted : 28330.
Progress update 2025-01-01 15:22:28.671628+00:00 :
Progress update 2025-01-01 15:22:28.671628+00:00 : Database table : dt_aircraft <-----------------------------------.
Progress update 2025-01-01 15:22:35.292050+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:22:41.015323+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:22:46.531458+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 15:22:52.130126+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 15:22:57.636177+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 15:23:03.067617+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 15:23:08.499789+00:00 : Number of rows so far read : 70000.
Progress update 2025-01-01 15:23:13.973911+00:00 : Number of rows so far read : 80000.
Progress update 2025-01-01 15:23:19.422545+00:00 : Number of rows so far read : 90000.
Progress update 2025-01-01 15:23:24.862165+00:00 : Number of rows so far read : 100000.
Progress update 2025-01-01 15:23:30.285814+00:00 : Number of rows so far read : 110000.
Progress update 2025-01-01 15:23:35.776509+00:00 : Number of rows so far read : 120000.
Progress update 2025-01-01 15:23:41.366814+00:00 : Number of rows so far read : 130000.
Progress update 2025-01-01 15:23:46.797687+00:00 : Number of rows so far read : 140000.
Progress update 2025-01-01 15:23:52.205655+00:00 : Number of rows so far read : 150000.
Progress update 2025-01-01 15:23:57.604123+00:00 : Number of rows so far read : 160000.
Progress update 2025-01-01 15:24:03.052788+00:00 : Number of rows so far read : 170000.
Progress update 2025-01-01 15:24:08.368018+00:00 : Number of rows so far read : 180000.
Progress update 2025-01-01 15:24:13.708173+00:00 : Number of rows so far read : 190000.
Progress update 2025-01-01 15:24:19.065498+00:00 : Number of rows so far read : 200000.
Progress update 2025-01-01 15:24:24.405229+00:00 : Number of rows so far read : 210000.
Progress update 2025-01-01 15:24:29.761049+00:00 : Number of rows so far read : 220000.
Progress update 2025-01-01 15:24:35.535302+00:00 : Number of rows so far read : 230000.
Progress update 2025-01-01 15:24:41.392290+00:00 : Number of rows so far read : 240000.
Progress update 2025-01-01 15:24:42.924682+00:00 : Number rows selected : 242688.
Progress update 2025-01-01 15:24:42.925364+00:00 : Number rows inserted : 242688.
Progress update 2025-01-01 15:24:42.951369+00:00 :
Progress update 2025-01-01 15:24:42.952369+00:00 : Database table : engines <-----------------------------------.
Progress update 2025-01-01 15:24:49.273901+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:24:55.055519+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:24:58.404093+00:00 : Number rows selected : 25871.
Progress update 2025-01-01 15:24:58.404093+00:00 : Number rows inserted : 25871.
Progress update 2025-01-01 15:24:58.410096+00:00 :
Progress update 2025-01-01 15:24:58.410096+00:00 : Database table : events_sequence <-----------------------------------.
Progress update 2025-01-01 15:25:04.560844+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:25:10.134140+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:25:15.716672+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 15:25:21.356300+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 15:25:26.976943+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 15:25:32.845391+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 15:25:33.803165+00:00 : Number rows selected : 60980.
Progress update 2025-01-01 15:25:33.803165+00:00 : Number rows inserted : 60980.
Progress update 2025-01-01 15:25:33.809836+00:00 :
Progress update 2025-01-01 15:25:33.809836+00:00 : Database table : findings <-----------------------------------.
Progress update 2025-01-01 15:25:40.159975+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:25:45.924933+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:25:51.648358+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 15:25:57.307395+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 15:26:03.003610+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 15:26:08.720642+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 15:26:12.484955+00:00 : Number rows selected : 66532.
Progress update 2025-01-01 15:26:12.484955+00:00 : Number rows inserted : 66532.
Progress update 2025-01-01 15:26:12.496041+00:00 :
Progress update 2025-01-01 15:26:12.496041+00:00 : Database table : flight_crew <-----------------------------------.
Progress update 2025-01-01 15:26:19.049604+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:26:24.815042+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:26:30.048543+00:00 : Number rows selected : 29195.
Progress update 2025-01-01 15:26:30.048543+00:00 : Number rows inserted : 29195.
Progress update 2025-01-01 15:26:30.058054+00:00 :
Progress update 2025-01-01 15:26:30.058054+00:00 : Database table : injury <-----------------------------------.
Progress update 2025-01-01 15:26:36.545530+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:26:42.018847+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:26:47.575342+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 15:26:53.406394+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 15:26:59.047444+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 15:27:04.603970+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 15:27:10.079037+00:00 : Number of rows so far read : 70000.
Progress update 2025-01-01 15:27:15.576165+00:00 : Number of rows so far read : 80000.
Progress update 2025-01-01 15:27:21.198103+00:00 : Number of rows so far read : 90000.
Progress update 2025-01-01 15:27:26.773660+00:00 : Number of rows so far read : 100000.
Progress update 2025-01-01 15:27:32.482796+00:00 : Number of rows so far read : 110000.
Progress update 2025-01-01 15:27:38.495043+00:00 : Number of rows so far read : 120000.
Progress update 2025-01-01 15:27:44.102492+00:00 : Number of rows so far read : 130000.
Progress update 2025-01-01 15:27:49.716471+00:00 : Number of rows so far read : 140000.
Progress update 2025-01-01 15:27:55.315828+00:00 : Number of rows so far read : 150000.
Progress update 2025-01-01 15:27:59.888690+00:00 : Number rows selected : 157773.
Progress update 2025-01-01 15:27:59.888690+00:00 : Number rows inserted : 157773.
Progress update 2025-01-01 15:27:59.902062+00:00 :
Progress update 2025-01-01 15:27:59.902592+00:00 : Database table : narratives <-----------------------------------.
Progress update 2025-01-01 15:29:46.295800+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:31:28.750864+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:32:07.548182+00:00 : Number rows selected : 26424.
Progress update 2025-01-01 15:32:07.549405+00:00 : Number rows inserted : 26424.
Progress update 2025-01-01 15:32:07.596635+00:00 :
Progress update 2025-01-01 15:32:07.596635+00:00 : Database table : occurrences <-----------------------------------.
Progress update 2025-01-01 15:32:07.597633+00:00 : Number rows selected : 0.
Progress update 2025-01-01 15:32:07.597633+00:00 :
Progress update 2025-01-01 15:32:07.597633+00:00 : Database table : dt_flight_crew <-----------------------------------.
Progress update 2025-01-01 15:32:17.138374+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:32:23.572838+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:32:30.276362+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 15:32:37.061196+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 15:32:43.397422+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 15:32:49.212116+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 15:32:55.971713+00:00 : Number of rows so far read : 70000.
Progress update 2025-01-01 15:33:03.100706+00:00 : Number of rows so far read : 80000.
Progress update 2025-01-01 15:33:09.823457+00:00 : Number of rows so far read : 90000.
Progress update 2025-01-01 15:33:16.588824+00:00 : Number of rows so far read : 100000.
Progress update 2025-01-01 15:33:22.137530+00:00 : Number of rows so far read : 110000.
Progress update 2025-01-01 15:33:28.385263+00:00 : Number of rows so far read : 120000.
Progress update 2025-01-01 15:33:33.917145+00:00 : Number of rows so far read : 130000.
Progress update 2025-01-01 15:33:39.449228+00:00 : Number of rows so far read : 140000.
Progress update 2025-01-01 15:33:45.014155+00:00 : Number of rows so far read : 150000.
Progress update 2025-01-01 15:33:50.588074+00:00 : Number of rows so far read : 160000.
Progress update 2025-01-01 15:33:51.746084+00:00 : Number rows selected : 161971.
Progress update 2025-01-01 15:33:51.746084+00:00 : Number rows inserted : 161971.
Progress update 2025-01-01 15:33:51.758084+00:00 :
Progress update 2025-01-01 15:33:51.759084+00:00 : Database table : flight_time <-----------------------------------.
Progress update 2025-01-01 15:33:59.826691+00:00 : Number of rows so far read : 10000.
Progress update 2025-01-01 15:34:05.425756+00:00 : Number of rows so far read : 20000.
Progress update 2025-01-01 15:34:11.006818+00:00 : Number of rows so far read : 30000.
Progress update 2025-01-01 15:34:16.539290+00:00 : Number of rows so far read : 40000.
Progress update 2025-01-01 15:34:22.279420+00:00 : Number of rows so far read : 50000.
Progress update 2025-01-01 15:34:27.811127+00:00 : Number of rows so far read : 60000.
Progress update 2025-01-01 15:34:33.326298+00:00 : Number of rows so far read : 70000.
Progress update 2025-01-01 15:34:38.958550+00:00 : Number of rows so far read : 80000.
Progress update 2025-01-01 15:34:44.456600+00:00 : Number of rows so far read : 90000.
Progress update 2025-01-01 15:34:50.030611+00:00 : Number of rows so far read : 100000.
Progress update 2025-01-01 15:34:55.578918+00:00 : Number of rows so far read : 110000.
Progress update 2025-01-01 15:35:01.302825+00:00 : Number of rows so far read : 120000.
Progress update 2025-01-01 15:35:06.958600+00:00 : Number of rows so far read : 130000.
Progress update 2025-01-01 15:35:12.557915+00:00 : Number of rows so far read : 140000.
Progress update 2025-01-01 15:35:18.081763+00:00 : Number of rows so far read : 150000.
Progress update 2025-01-01 15:35:23.646086+00:00 : Number of rows so far read : 160000.
Progress update 2025-01-01 15:35:29.303327+00:00 : Number of rows so far read : 170000.
Progress update 2025-01-01 15:35:34.968159+00:00 : Number of rows so far read : 180000.
Progress update 2025-01-01 15:35:40.625290+00:00 : Number of rows so far read : 190000.
Progress update 2025-01-01 15:35:46.173645+00:00 : Number of rows so far read : 200000.
Progress update 2025-01-01 15:35:51.797532+00:00 : Number of rows so far read : 210000.
Progress update 2025-01-01 15:35:57.320987+00:00 : Number of rows so far read : 220000.
Progress update 2025-01-01 15:36:02.877483+00:00 : Number of rows so far read : 230000.
Progress update 2025-01-01 15:36:08.401521+00:00 : Number of rows so far read : 240000.
Progress update 2025-01-01 15:36:13.941414+00:00 : Number of rows so far read : 250000.
Progress update 2025-01-01 15:36:19.448943+00:00 : Number of rows so far read : 260000.
Progress update 2025-01-01 15:36:24.979562+00:00 : Number of rows so far read : 270000.
Progress update 2025-01-01 15:36:30.512327+00:00 : Number of rows so far read : 280000.
Progress update 2025-01-01 15:36:35.993421+00:00 : Number of rows so far read : 290000.
Progress update 2025-01-01 15:36:41.467833+00:00 : Number of rows so far read : 300000.
Progress update 2025-01-01 15:36:46.957343+00:00 : Number of rows so far read : 310000.
Progress update 2025-01-01 15:36:52.473091+00:00 : Number of rows so far read : 320000.
Progress update 2025-01-01 15:36:57.979737+00:00 : Number of rows so far read : 330000.
Progress update 2025-01-01 15:37:03.670184+00:00 : Number of rows so far read : 340000.
Progress update 2025-01-01 15:37:09.167777+00:00 : Number of rows so far read : 350000.
Progress update 2025-01-01 15:37:14.700009+00:00 : Number of rows so far read : 360000.
Progress update 2025-01-01 15:37:18.017896+00:00 : Number rows selected : 366014.
Progress update 2025-01-01 15:37:18.017896+00:00 : Number rows inserted : 366014.
Progress update 2025-01-01 15:37:18.053307+00:00 :
Progress update 2025-01-01 15:37:18.053307+00:00 : Database table : seq_of_events <-----------------------------------.
Progress update 2025-01-01 15:37:18.054343+00:00 : Number rows selected : 0.
Progress update 2025-01-01 15:37:18.449569+00:00 : INFO.00.065 Cleansing PostgreSQL data.
Progress update 2025-01-01 15:37:18.449569+00:00 : --------------------------------------------------------------------------------
2025-01-01 16:37:18,449 [root] [db_utils.py ] INFO INFO.00.080 Admin connect request host=localhost port=5432 dbname=io_aero_db user=io_aero
Progress update 2025-01-01 15:37:18.505186+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'acft_category'.
Progress update 2025-01-01 15:37:19.432026+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:19.433028+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'dest_country'.
Progress update 2025-01-01 15:37:20.032300+00:00 : Number cols trimmed : 1587.
Progress update 2025-01-01 15:37:20.489166+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:20.489166+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'dprt_country'.
Progress update 2025-01-01 15:37:21.023820+00:00 : Number cols trimmed : 1658.
Progress update 2025-01-01 15:37:21.457299+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:21.457299+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'far_part'.
Progress update 2025-01-01 15:37:22.293538+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:22.293538+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'oper_country'.
Progress update 2025-01-01 15:37:22.798742+00:00 : Number cols trimmed : 1611.
Progress update 2025-01-01 15:37:23.216327+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:23.216327+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'owner_country'.
Progress update 2025-01-01 15:37:23.706081+00:00 : Number cols trimmed : 1542.
Progress update 2025-01-01 15:37:24.100789+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:24.100789+00:00 : INFO.00.066 Cleansing table 'aircraft' column 'regis_no'.
Progress update 2025-01-01 15:37:24.530419+00:00 : Number cols trimmed : 38.
Progress update 2025-01-01 15:37:24.911051+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:24.911051+00:00 : INFO.00.066 Cleansing table 'events' column 'ev_city'.
Progress update 2025-01-01 15:37:25.272807+00:00 : Number cols trimmed : 6.
Progress update 2025-01-01 15:37:25.323453+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:25.323453+00:00 : INFO.00.066 Cleansing table 'events' column 'ev_site_zipcode'.
Progress update 2025-01-01 15:37:25.372907+00:00 : Number cols trimmed : 2.
Progress update 2025-01-01 15:37:25.387759+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:25.388764+00:00 : INFO.00.066 Cleansing table 'events' column 'latitude'.
Progress update 2025-01-01 15:37:25.428799+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:25.428799+00:00 : INFO.00.066 Cleansing table 'events' column 'longitude'.
Progress update 2025-01-01 15:37:25.470408+00:00 : --------------------------------------------------------------------------------
Progress update 2025-01-01 15:37:25.470408+00:00 : INFO.00.066 Cleansing table 'events_sequence' column 'occurrence_code'.
Progress update 2025-01-01 15:37:25.839437+00:00 : Number cols trimmed : 1799.
Progress update 2025-01-01 15:37:25.850411+00:00 : -------------------------------------------------------------------------------.
Progress update 2025-01-01 15:37:25.850411+00:00 : 1,018 s - Total time launcher.
Progress update 2025-01-01 15:37:25.850411+00:00 : INFO.00.006 End Launcher.
Progress update 2025-01-01 15:37:25.851417+00:00 : ===============================================================================.
---------------------------------------------------------------------------
The current time is: 16:37:26.41
Enter the new time:
---------------------------------------------------------------------------
End run_io_avstats_dev
===========================================================================