Skip to content
Snippets Groups Projects
  1. Apr 05, 2022
  2. Apr 07, 2021
  3. Oct 12, 2020
    • Frank Duncan's avatar
      Add Central ETL Pipeline, version 1 · 126cc0bd
      Frank Duncan authored
      This adds a centralized, refactored, etl pipeline that all competitions
      can depend on.  This prevents the rampant copying and pasting of etl
      pipelines as new competitions are created, and prevents the coderot from
      modifying later etl pipelines that don't make it back into the original
      ones.
      
      Version 1 because this is based on the Climate2030 pipeline that doesn't
      have a number of features that older, more complete pipelines have.
      Those will get added incrementally.
      
      Issue #53: Refactor ETL code to create central utilities
      126cc0bd
  4. Oct 01, 2020
  5. Apr 14, 2020
  6. Mar 31, 2020
  7. Mar 26, 2020
  8. Mar 24, 2020
  9. Feb 28, 2020
  10. Feb 18, 2020
  11. Aug 23, 2019
    • Frank Duncan's avatar
      Large updates to wiki-refresh for 2019 dataset · 0b76d1f4
      Frank Duncan authored
      The updates in this include:
      
      * Move fix-csv to compose-csvs
      * Move csv munging code out of wiki-refresh base script into python, now
        located in compose-csvs
      * Call csv2wiki via python3 module loading
      * Update macfound-internal-csv2wiki-config.tmpl to include judge data
      * Update macfound-internal-csv2wiki-config.tmpl to do embed youtube
        formatting
      
      More generally, this update takes three different csvs and puts them
      together into one set of data that's culled by which proposals have been
      reviewed favorably, then adds judge review data to those proposals to
      output to the wiki instance.  This work is all done in one place, with
      wiki-refresh now being a small combiner script with variables about data
      placement.
      0b76d1f4
  12. Nov 24, 2018
  13. Aug 12, 2017
    • Karl Fogel's avatar
      Finalize deliverable name & improve documentation · ebbe293f
      Karl Fogel authored
      After all CSV processing, copy the deliverable CSV to a final name,
      "processed-100andchangeExport-all-judges.csv", that will not change if
      we add more processing stages in the future.  Also, update and improve
      documentation in README.md and comments in wiki-refresh.
      ebbe293f
  14. Jul 18, 2017
  15. May 26, 2017
  16. May 02, 2017
  17. May 01, 2017
  18. Apr 27, 2017
  19. Apr 24, 2017
  20. Apr 21, 2017
  21. Apr 17, 2017
  22. Apr 16, 2017
Loading