zensus

The central module containing all code dealing with importing Zensus data.

class ZensusMiscellaneous(dependencies)

Bases: egon.data.datasets.Dataset

name: str

The name of the Dataset

version: str

The Dataset’s version. Can be anything from a simple semantic versioning string like “2.1.3”, to a more complex string, like for example “2021-01-01.schleswig-holstein.0” for OpenStreetMap data. Note that the latter encodes the Dataset’s date, region and a sequential number in case the data changes without the date or region changing, for example due to implementation changes.

class ZensusPopulation(dependencies)

Bases: egon.data.datasets.Dataset

name: str

The name of the Dataset

version: str

The Dataset’s version. Can be anything from a simple semantic versioning string like “2.1.3”, to a more complex string, like for example “2021-01-01.schleswig-holstein.0” for OpenStreetMap data. Note that the latter encodes the Dataset’s date, region and a sequential number in case the data changes without the date or region changing, for example due to implementation changes.

adjust_zensus_misc()

Delete unpopulated cells in zensus-households, -buildings and -apartments

Some unpopulated zensus cells are listed in: - egon_destatis_zensus_household_per_ha - egon_destatis_zensus_building_per_ha - egon_destatis_zensus_apartment_per_ha

This can be caused by missing population information due to privacy or other special cases (e.g. holiday homes are listed as buildings but are not permanently populated.) In the following tasks of egon-data, only data of populated cells is used.

Returns

None.

create_combined_zensus_table()

Create combined table with buildings, apartments and population per cell

Only apartment and building data with acceptable data quality (quantity_q<2) is used, all other data is dropped. For more details on data quality see Zensus docs: https://www.zensus2011.de/DE/Home/Aktuelles/DemografischeGrunddaten.html

If there’s no data on buildings or apartments for a certain cell, the value for building_count resp. apartment_count contains NULL.

create_zensus_misc_tables()

Create tables for zensus data in postgres database

create_zensus_pop_table()

Create tables for zensus data in postgres database

download_and_check(url, target_file, max_iteration=5)

Download file from url (http) if it doesn’t exist and check afterwards. If bad zip remove file and re-download. Repeat until file is fine or reached maximum iterations.

download_zensus_misc()

Download Zensus csv files on data per hectare grid cell.

download_zensus_pop()

Download Zensus csv file on population per hectare grid cell.

filter_zensus_misc(filename, dataset)

This block filters lines in the source CSV file and copies the appropriate ones to the destination based on grid_id values.

Parameters

• filename (str) – Path to input csv-file

• dataset (str, optional) – Toggles between production (dataset=’Everything’) and test mode e.g. (dataset=’Schleswig-Holstein’). In production mode, data covering entire Germany is used. In the test mode a subset of this data is used for testing the workflow.

Returns

str – Path to output csv-file

filter_zensus_population(filename, dataset)

This block filters lines in the source CSV file and copies the appropriate ones to the destination based on geometry.

Parameters

• filename (str) – Path to input csv-file

• dataset (str, optional) – Toggles between production (dataset=’Everything’) and test mode e.g. (dataset=’Schleswig-Holstein’). In production mode, data covering entire Germany is used. In the test mode a subset of this data is used for testing the workflow.

Returns

str – Path to output csv-file

population_to_postgres()

Import Zensus population data to postgres database

select_geom()

Select the union of the geometries of Schleswig-Holstein from the database, convert their projection to the one used in the CSV file, output the result to stdout as a GeoJSON string and read it into a prepared shape for filtering.

target(source, dataset)

Generate the target path corresponding to a source path.

Parameters

dataset (str) – Toggles between production (dataset=’Everything’) and test mode e.g. (dataset=’Schleswig-Holstein’). In production mode, data covering entire Germany is used. In the test mode a subset of this data is used for testing the workflow.

Returns

Path – Path to target csv-file

zensus_misc_to_postgres()

Import data on buildings, households and apartments to postgres db