We designed two open-source data engineering libraries that together comprise a powerful solution for creating, scheduling and maintaining data processing pipelines via a web UI.
While true design, contribute to, and maintain a number of well-adopted, open-source libraries for working with data. Dataflows and DGP were built and maintained with open source methodologies and are the main power tools behind most of our data processing projects. From a simple solution for a small dataset up to a complete data ingestion platform for cleaning, mapping and publishing datasets, these two libraries are field-proven to provide a reliable and quick solution.
We offer free 45 minute consultations, so if you want to brainstorm an idea, or if you have a project that we can help you with, let’s talk.