OVERVIEW: NAs / Nones found in the DB? Backtracking the source of the issue
CURRENT STATUS 16.03.2023 16:28
OK:
- foreigner_quota
- arriages_citizenship
- religion_catholics
- top_baby_names_favorite_firstname_rank_boy
- top_baby_names_favorite_firstname_rank_girl
- stillbirth_death_babies_gender_demographic_characteristics (NAs in values should be OK)
- top_baby_names_favorite_firstname_amount_boy
- top_baby_names_favorite_firstname_amount_girl
- civil_unions_marital_status_citizenship_age_class
- deaths_gender_citizenships_marital_status_age
- divorces_duration_of_marriage_age_classes
- marriages_ageclass_citizenship_marital_status (FIXED!)
SHOULD BE OK BUT STILL TO BE INGESTED:
- ALL OF THE STOCK VEHICLES (7 datasets) ->NAs in spatialunit names
- resident_population_type_citizenship_category_gender_age -> NAs in spatialunit names -> BS
- nativity_gender_citizenship_category_age_class_mother -> Nas in spatialunit names and values (values could be OK) -> BS
- unemployed_amount -> NAs in spatialunit names -> Maybe the new matching with spatialunits table corrected it
NOT OK:
- household_size -> NAs in spatialunit names? ---> Depends on cantonal items coded as districts
- divorces_duration_of_marriage_citizenship_categories -> NAs in spatialunit names ---> Depends on cantonal items coded as districts
BROKEN (OWN ISSUE FOR THESE - see also the other gitlab issue - the reason is found, as the english text is not provided in the dim table): empty_dwellings_quote empty_dwellings_amount_number_living_spaces_type_dwelling
THE FOLLOWING IS AN OLD OUTPUT:
[1] "----- Checking empty_dwellings_quote -----"
[1] "nrows 1000000"
[1] "Col value found NAs: 905205"
[1] "Col n_living_spaces found NAs: 1000000"
[1] "Col empty_dwelling_type found NAs: 1000000"
[1] "Col spatialunit_name found NAs: 3051"
[1] "----- Checking foreigner_quota -----"
[1] "nrows 7656"
[1] "----- Checking household_size -----"
[1] "nrows 163310"
[1] "Col spatialunit_name found NAs: 630"
[1] "----- Checking marriages_citizenship -----"
[1] "nrows 1000000"
[1] "Col spatialunit_name found NAs: 3877"
[1] "----- Checking nativity_gender_citizenship_category_age_class_mother -----"
[1] "nrows 1000000"
[1] "Col value found NAs: 1091"
[1] "Col spatialunit_name found NAs: 6558"
[1] "----- Checking religion_catholics -----"
[1] "nrows 5524"
[1] "----- Checking resident_population_type_citizenship_category_gender_age -----"
[1] "nrows 1000000"
[1] "Col spatialunit_name found NAs: 50596"
[1] "----- Checking top_baby_names_favorite_firstname_rank_boy -----"
[1] "nrows 1000000"
[1] "----- Checking top_baby_names_favorite_firstname_rank_girl -----"
[1] "nrows 1000000"
[1] "----- Checking unemployed_amount -----"
[1] "nrows 5315"
[1] "Col value found NAs: 127"
[1] "----- Checking stock_cargo_transportation_vehicles -----"
[1] "nrows 308220"
[1] "Col spatialunit_name found NAs: 1584"
[1] "----- Checking marriages_ageclass_citizenship_marital_status -----"
[1] "nrows 0"
[1] "----- Checking stillbirth_death_babies_gender_demographic_characteristics -----"
[1] "nrows 6570"
[1] "Col value found NAs: 2566"
[1] "----- Checking stock_agricultural_vehicles -----"
[1] "nrows 308220"
[1] "Col spatialunit_name found NAs: 1584"
[1] "----- Checking stock_industrial_vehicles -----"
[1] "nrows 308220"
[1] "Col spatialunit_name found NAs: 1584"
[1] "----- Checking stock_motorcycles -----"
[1] "nrows 308220"
[1] "Col spatialunit_name found NAs: 1584"
[1] "----- Checking stock_passenger_cars -----"
[1] "nrows 308220"
[1] "Col spatialunit_name found NAs: 1584"
[1] "----- Checking stock_passenger_transportation_vehicles -----"
[1] "nrows 308220"
[1] "Col spatialunit_name found NAs: 1584"
[1] "----- Checking stock_trailers -----"
[1] "nrows 308220"
[1] "Col spatialunit_name found NAs: 1584"
[1] "----- Checking top_baby_names_favorite_firstname_amount_boy -----"
[1] "nrows 1000000"
[1] "----- Checking top_baby_names_favorite_firstname_amount_girl -----"
[1] "nrows 1000000"
[1] "----- Checking civil_unions_marital_status_citizenship_age_class -----"
[1] "nrows 1000000"
[1] "----- Checking deaths_gender_citizenships_marital_status_age -----"
[1] "nrows 1000000"
[1] "----- Checking divorces_duration_of_marriage_age_classes -----"
[1] "nrows 858600"
[1] "----- Checking divorces_duration_of_marriage_citizenship_categories -----"
[1] "nrows 1000000"
[1] "Col value found NAs: 212737"
[1] "Col spatialunit_name found NAs: 3910"
[1] "----- Checking empty_dwellings_amount_number_living_spaces_type_dwelling -----"
[1] "nrows 1000000"
[1] "Col value found NAs: 107831"
[1] "Col n_living_spaces found NAs: 1000000"
[1] "Col empty_dwelling_type found NAs: 1000000"
[1] "Col spatialunit_name found NAs: 3052"