We designed two open-source data engineering libraries that together comprise a powerful solution for creating, scheduling and maintaining data processing pipelines via a web UI.
While true design, contribute to, and maintain a number of well-adopted, open-source libraries for working with data. Dataflows and DGP were built and maintained with open source methodologies and are the main power tools behind most of our data processing projects. From a simple solution for a small dataset up to a complete data ingestion platform for cleaning, mapping and publishing datasets, these two libraries are field-proven to provide a reliable and quick solution.
Drop us a message or an email, and we see how we can work together.