Overview: Build Your Data Architecture to Enable Use Cases One of the things that we often wrestle with in building out data lake architecture is how to best lay out the infrastructure to support different analytical use cases, and more specifically, what storage mechanism might yield the best performance. One of the virtues of data lakes is … [Read more...] about Data Lake Architecture Guide: Choosing the Right Storage Tool
Magpie
Watch: Silectis Magpie Data Engineering Platform Demo
Interested in understanding why Silectis Magpie is the premiere way to simplify data engineering? In this recorded demo, we use real data to demonstrate how an organization might create and use a centralized analytics capability, all from scratch! SILECTIS MAGPIE HELPS YOU SIMPLIFY DATA ENGINEERING WITHIN YOUR ORGANIZATION Silectis Magpie … [Read more...] about Watch: Silectis Magpie Data Engineering Platform Demo
Want to be Data-Driven? Start with Metadata
This blog post gives a brief overview of the importance of metadata in today’s world… with a nod to our school days. HOW THE DEWEY DECIMAL SYSTEM IS KIND OF LIKE METADATA The Dewey Decimal System is an often forgotten example of the value of metadata. Though increasingly arcane, the system gave a library visitor information about a … [Read more...] about Want to be Data-Driven? Start with Metadata
Data Profiling: A Step-by-Step Introduction
EXAMINING NYC TRANSPORTATION DATA THROUGH MAGPIE’S ONE-CLICK RAPID DATA PROFILING In our first data-centric blog post, we provide a step-by-step introduction to the immediate value generated by Magpie’s ability to show users what is in a dataset before analysis begins. Below, we use publicly available data from New York City's Open Data … [Read more...] about Data Profiling: A Step-by-Step Introduction
Automate Data Exploration with Silectis Magpie
As the first step in the data engineering process, data exploration is crucial. Our data engineering platform, Magpie, makes it simple, fast, and ensures accuracy. GETTING TO KNOW YOUR DATASET Whether as a new employee, a consultant or contractor, or as someone tasked with working on a new project, most data professionals have experienced the … [Read more...] about Automate Data Exploration with Silectis Magpie
Introducing Magpie: The Data Engineering Platform
As some of you are aware, we have been working on something pretty big for the last few years. We have been helping clients to build their data and analytics infrastructure, but that isn’t the entire story… MAGPIE: THE DATA ENGINEERING PLATFORM We are finally ready to lift the curtain on our cloud data engineering platform, Magpie. Magpie … [Read more...] about Introducing Magpie: The Data Engineering Platform