Natural Earth

Introduction

Natural Earth is a public domain map dataset providing high-resolution vector and raster data at a 1:10m scale. We utilize three essential datasets from Natural Earth’s GitHub repository cultural vector data themes: country boundaries, state boundaries, and populated places. The country boundaries offer precise national borders critical for accurate flight planning and navigation. State boundaries define administrative regions, aiding in regional airspace management. The populated places dataset includes capitals, major cities and towns, vital for routing and logistics. Access these datasets through the Natural Earth website and the GitHub repository.

Data Source Characteristics

Data Target Characteristics

  • Database management system: PostgreSQL

  • Database name: io_xpa_db

  • Database tables:

    • io_ne_country

    • io_ne_place

    • io_ne_state

Data Processing

  • Repository: io-xpa-core

  • Script: run_io_xpa_core_aws

  • Task: l_n_e (Load all Natural Earth data)

Processing Steps:

  1. Download the countries shape file from url .../10m_cultural/ne_10m_admin_0_boundary_lines_land.

  2. Update database table io_ne_country.

  3. Download the places shape file from url .../10m_cultural/ne_10m_populated_places_simple.

  4. Update database table io_ne_place.

  5. Create a S3 bucket JSON file with all data from the io_ne_place table: io_ne_place_full_<yyyy-mm-ddThh:mi:ss.mseZ>.json.gz

  6. Download the states and provinces shape file from url .../10m_cultural/ne_10m_admin_1_states_provinces_lines.

  7. Update database table io_ne_state.

  8. Create a S3 bucket JSON file with all data from the tables io_ne_country and io_ne_state: io_ne_country_state_full_<yyyy-mm-ddThh:mi:ss.mseZ>.json.gz

For detailed processing steps, refer to the external repository: io-xpa-core

Configuration Parameters:

natural_earth_data_debug = false
natural_earth_data_s3_aws_region = "us-east-2"
natural_earth_data_s3_bucket = "data/temp_test"
natural_earth_data_s3_file_country_state = "io_ne_country_state"
natural_earth_data_s3_file_place = "io_ne_place"
natural_earth_data_timeout = 10
natural_earth_data_url_countries = "https://github.com/nvkelso/natural-earth-vector/raw/master/10m_cultural/ne_10m_admin_0_boundary_lines_land"
natural_earth_data_url_places = "https://github.com/nvkelso/natural-earth-vector/raw/master/10m_cultural/ne_10m_populated_places_simple"
natural_earth_data_url_states = "https://github.com/nvkelso/natural-earth-vector/raw/master/10m_cultural/ne_10m_admin_1_states_provinces_lines"
natural_earth_data_work_dir = "data/temp/natural_earth"

Contact Information