PAWS Data Pipeline Update #2
After several discussions between PAWS and our wonderful Code for Philly volunteer team, coding is underway! The work is focused on building the initial infrastructure to host the data pipeline (setting up containers for the data processing scripts and for the database), as well as processing scripts to ingest data from 3 sources (donors, volunteers and adopters) and fuzzy-match them across the datasets. Additionally, we are setting up proof-of-concept APIs to allow end users to upload and download datasets. The current project focus and tasks can be found here.