The latest from Silectis.

Data lineage can be a tremendously useful tool for data engineering and analytics, but is often treated as an afterthought both because of the challenges in implementation and the fact that it has not been broadly available within organizations. Many practitioners have… Read more: Knowing Your Data Starts with Data Lineage

If you’re new to data engineering or are a practitioner of a related field, such as data science, or business intelligence, we thought it might be helpful to have a handy list of commonly used terms available for you to get up… Read more: Data Engineering Glossary

We recently published a new report: The Case for the Holistic Data Engineering Platform, which outlines why piecemeal tooling isn’t sustainable for most modern companies. In today’s world, it’s well understood that the best businesses make data-driven decisions to push their organizations… Read more: The Case for the Holistic Data Engineering Platform

At CARFAX, a data services company that supplies vehicle history reports to individuals and businesses, accuracy and trustworthiness in their data is paramount, and a modern data architecture is their vehicle for sound decision-making across the company. Karen White, Director of Business… Read more: How CARFAX Uses Magpie to Modernize Its Data Architecture

At Silectis, we deploy Magpie clusters across AWS, Google Cloud, and Azure. But because some of our internal infrastructure resides only on AWS, we need to establish private connections between these environments so that clusters on Google Cloud and Azure can access… Read more: Tutorial: Creating a Multi-Cloud VPN with Terraform between AWS, GCP, and Azure

One of the things that we often wrestle with in building data lakes is how to best architect the infrastructure to support different analytical use cases, and more specifically, what storage mechanism might yield the best performance.

This blog post gives a brief overview of the importance of metadata in today’s world… with a nod to our school days. HOW THE DEWEY DECIMAL SYSTEM IS KIND OF LIKE METADATA The Dewey Decimal System is an often forgotten example of… Read more: Want to be Data-Driven? Start with Metadata