The Latest from Silectis
Knowing Your Data Starts with Data Lineage
Data lineage can be a tremendously useful tool for data engineering and analytics, but is often treated as an afterthought both because of the challenges in implementation and the fact that it has not been broadly available within organizations. Many practitioners have never had access to data lineage information and may not know what they…
Want to be Data-Driven? Start with Metadata
This blog post gives a brief overview of the importance of metadata in today’s world… with a nod to our school days. HOW THE DEWEY DECIMAL SYSTEM IS KIND OF LIKE METADATA The Dewey Decimal System is an often forgotten…
Why the Notebook Interface is Preferred by Data Engineers and Data Scientists
This blog post takes a look at how the popular notebook interface has gotten traction as the go-to front-end for data professionals and data companies alike. Notebooks can make data teams more productive by obscuring cumbersome configurations. How will the…
Magpie in Action: Job Management
A quick explainer on why we built we job management directly into Magpie, our data engineering platform. Plus, a step-by-step tutorial on how to use it. SETTING THE STAGE When first setting up a data lake, it is common for…
Data Profiling: A Step-by-Step Introduction
EXAMINING NYC TRANSPORTATION DATA THROUGH MAGPIE’S ONE-CLICK RAPID DATA PROFILING In our first data-centric blog post, we provide a step-by-step introduction to the immediate value generated by Magpie’s ability to show users what is in a dataset before analysis begins.…
Technical Tutorial: Random Forest Models With Python and Spark ML
In our first code-centric blog post, we provide a step-by-step introduction to Spark’s machine learning library. This post is intended for a more technical audience that has a solid grasp of Python, understands the basics of machine learning, and has…
CATEGORIES
- Data Analytics
- Data Engineering
- Data Lakes
- Data Science
- Magpie
- Magpie in Action
- Management Insight
- Silectis News
- Tutorials
- Uncategorized
SUBSCRIBE
Join our mailing list to get updates from Silectis.