In this blog post, we’ll walk you through how data science and data engineering are complementary disciplines. We’ll also delineate a third category: data analysis. We’ll explore how both data engineering and data science should be marshaled to make better decisions. Organizations often struggle to strike the right balance between engineering, … [Read more...] about Reframing “Data Engineering vs Data Science”
For those using a robust analytics database, such as the Snowflake® Data Cloud, adding the power of a data engineering platform can help maximize the value you’re getting out of that database. In this demo, we’ll show you how native tools in the Magpie data engineering platform play well with Snowflake, ultimately, allowing your team to do more in … [Read more...] about Demo: Supercharging Data Engineering with Magpie for Snowflake®
If you’re new to data engineering or are a practitioner of a related field, such as data science, or business intelligence, we thought it might be helpful to have a handy list of commonly used terms available for you to get up to speed. This data engineering glossary is by no means exhaustive, but should provide some foundational context and … [Read more...] about Data Engineering Glossary
The "gaps and islands" problem is a scenario in which you need to identify groups of continuous data (“islands”) and groups where the data is missing (“gaps”) across a particular sequence. The problem may sound arcane at first glance but knowing how to solve this type of problem is critical for advanced SQL practitioners. These starting and … [Read more...] about Improve Your SQL Skills: Master the Gaps and Islands Problem
Today’s advanced analytics space is filled with tools to help users become more data driven. However, every use case is different, and there is not a single tool that is ready for each unique situation. The best solutions for a given organization usually lie in a combinations of software platforms. This blog post outlines why Silectis Magpie and … [Read more...] about Magpie and Looker Partner to Supercharge Your Data Analytics & Visualizations
In this blog post, we explore how a data analyst can know when to trust data and when to be skeptical. Using data integrity features in your modern data engineering platform should help you sort this quickly, and move on to empowering decision-making across the company. DATA INTEGRITY: JUST THE FACTS People say you can trust data. “Let … [Read more...] about Data Integrity Issues Holding You Back?