Introducing the Data Genus Processor (DGP) & Dataflows Libraries

While true design, contribute to, and maintain a number of well-adopted, open-source libraries for working with data. Dataflows and DGP were built and maintained with open source methodologies and are the main power tools behind most of our data processing projects. From a simple solution for a small dataset up to a complete data ingestion platform for cleaning, mapping and publishing datasets, these two libraries are field-proven to provide a reliable and quick solution.

A complete solution to running CKAN infrastructure in the cloud.

CKAN Cloud is ideal for large organizations managing multiple data catalogs for a number of sub-organizations, or multi-stage data warehouses with unique processing and access control requirements, reducing the complexity and cost of managing multiple distinct CKAN installations.

Ideal for

• Government agencies providing data catalogs for a number of administrations
• Corporation providing a internal data registries with distinct access control requirements
• Multi-stage data warehouses for data science and business analyst teams

Core features

• Multi-tenant CKAN architecture that leverages Kubernetes to its fullest.
• Custom administration interface to provision, configure, upgrade and decommission CKAN and supporting services with ease
• Runs in public and private clouds leveraging cloud-native permissions and access control
• Seamless integration with cloud provider APIs and services for scalable object storage, database servers, and cloud-native data processing tooling

Used by

• The Public Knowledge Workshop runs CKAN Cloud to provide CKAN services to a range of government and non-profit entities in Israel.