Description
The countries table (introduced in this branch) has no OFC/Oceania entries. The countries.json source file only contains records for 4 confederations: Afrika, Amerika, Asien, Europa — all scraped from Transfermarkt's confederation pages.
However, 2 OFC national teams exist in national_teams (e.g. New Zealand, Papua New Guinea), so the join to countries works for those teams (via the national_teams parent data), but the countries table itself is incomplete.
Root Cause
The acquire_countries pipeline uses tfmkt confederations to discover parent pages, but the confederations crawler may not return an OFC entry, or Transfermarkt does not have an OFC confederation page in the same structure.
Fix
Investigate whether Transfermarkt has an OFC confederation page and extend the acquire_countries pipeline to cover it, or manually add OFC countries to the source data.
Description
The
countriestable (introduced in this branch) has no OFC/Oceania entries. Thecountries.jsonsource file only contains records for 4 confederations: Afrika, Amerika, Asien, Europa — all scraped from Transfermarkt's confederation pages.However, 2 OFC national teams exist in
national_teams(e.g. New Zealand, Papua New Guinea), so the join tocountriesworks for those teams (via the national_teams parent data), but thecountriestable itself is incomplete.Root Cause
The
acquire_countriespipeline usestfmkt confederationsto discover parent pages, but the confederations crawler may not return an OFC entry, or Transfermarkt does not have an OFC confederation page in the same structure.Fix
Investigate whether Transfermarkt has an OFC confederation page and extend the
acquire_countriespipeline to cover it, or manually add OFC countries to the source data.