Big changes to airtable importer into torque
The main script got a completely overhaul, with some more rearchitecting of the airtable scripts directory. Not only that, but now fields that were previously unused by competitions needed to be added int he etl pipeline.
Showing
- competitions/100Change2017/etl/compose-and-upload 1 addition, 0 deletionscompetitions/100Change2017/etl/compose-and-upload
- competitions/100Change2020/etl/compose-and-upload 1 addition, 0 deletionscompetitions/100Change2020/etl/compose-and-upload
- competitions/BaWoP22/etl/compose-and-upload 1 addition, 0 deletionscompetitions/BaWoP22/etl/compose-and-upload
- competitions/BaWoP22/etl/deploy 0 additions, 9 deletionscompetitions/BaWoP22/etl/deploy
- competitions/ChicagoPrize/etl/compose-and-upload 1 addition, 0 deletionscompetitions/ChicagoPrize/etl/compose-and-upload
- competitions/Climate2030/etl/compose-and-upload 1 addition, 0 deletionscompetitions/Climate2030/etl/compose-and-upload
- competitions/Democracy22/etl/compose-and-upload 1 addition, 0 deletionscompetitions/Democracy22/etl/compose-and-upload
- competitions/ECW2020/etl/compose-and-upload 1 addition, 0 deletionscompetitions/ECW2020/etl/compose-and-upload
- competitions/EO2020/etl/compose-and-upload 1 addition, 0 deletionscompetitions/EO2020/etl/compose-and-upload
- competitions/LLIIA2020/etl/compose-and-upload 1 addition, 0 deletionscompetitions/LLIIA2020/etl/compose-and-upload
- competitions/LoneStar2020/etl/compose-and-upload 1 addition, 0 deletionscompetitions/LoneStar2020/etl/compose-and-upload
- competitions/MIHA/etl/compose-and-upload 1 addition, 0 deletionscompetitions/MIHA/etl/compose-and-upload
- competitions/RacialEquity2030/etl/compose-and-upload 1 addition, 0 deletionscompetitions/RacialEquity2030/etl/compose-and-upload
- competitions/template/etl/compose-and-upload 1 addition, 0 deletionscompetitions/template/etl/compose-and-upload
- etl/etl/competition.py 47 additions, 1 deletionetl/etl/competition.py
- etl/etl/field_allowlist.py 5 additions, 0 deletionsetl/etl/field_allowlist.py
- scripts/airtable/airtable_to_torque.py 419 additions, 70 deletionsscripts/airtable/airtable_to_torque.py
- scripts/airtable/config.py.tmpl 0 additions, 1 deletionscripts/airtable/config.py.tmpl
- scripts/airtable/torque_to_airtable.py 23 additions, 13 deletionsscripts/airtable/torque_to_airtable.py
- scripts/airtable/utils.py 130 additions, 13 deletionsscripts/airtable/utils.py
Loading
Please register or sign in to comment