EXAMINING NYC TRANSPORTATION DATA THROUGH MAGPIE’S ONE-CLICK RAPID DATA PROFILING In our first data-centric blog post, we provide a step-by-step introduction to the immediate value generated by Magpie’s ability to show users what is in a dataset before analysis begins. Below, we use publicly available data from New York City's Open Data … [Read more...] about Data Profiling: A Step-by-Step Introduction
Diving In to the Technology Behind Data Lakes
The previous post in this series established a non-technical basis for understanding data lakes and why they might be important. In this post, the focus will be on providing a more technical take on data lakes. This will not be a detailed technical primer so much as a review of the architectural dynamics that underly data lakes and some of their … [Read more...] about Diving In to the Technology Behind Data Lakes
Automate Data Exploration with Silectis Magpie
As the first step in the data engineering process, data exploration is crucial. Our data engineering platform, Magpie, makes it simple, fast, and ensures accuracy. GETTING TO KNOW YOUR DATASET Whether as a new employee, a consultant or contractor, or as someone tasked with working on a new project, most data professionals have experienced the … [Read more...] about Automate Data Exploration with Silectis Magpie
What is a Data Lake?
If you are new to the underlying data lake technology that supports advanced analytics, or just unfamiliar with some of the key concepts associated with data lakes, this blog post is for you. It is intended to be a short primer for both technical and non-technical audiences. This is the first of two posts, with the Part 2 focused on some of the … [Read more...] about What is a Data Lake?
Enabling Effective Insight Delivery: Read the White Paper
Here at Silectis, we spend a good deal of time thinking about how the landscape for analytics is changing. As a technology-focused company, the lion’s share of our energy goes to making the technology work effectively and giving data engineering and data science practitioners tools that make their lives easier. However, we realize that our … [Read more...] about Enabling Effective Insight Delivery: Read the White Paper
Introducing Magpie: The Data Engineering Platform
As some of you are aware, we have been working on something pretty big for the last few years. We have been helping clients to build their data and analytics infrastructure, but that isn’t the entire story… MAGPIE: THE DATA ENGINEERING PLATFORM We are finally ready to lift the curtain on our cloud data engineering platform, Magpie. Magpie … [Read more...] about Introducing Magpie: The Data Engineering Platform