The Latest from Silectis
Watch: Generating Data for Story-Driven Demos
At a recent DC Data Engineering Meetup, a community group Silectis created and sponsors, we had the pleasure of having Tim Tutt, CEO of Night Shift Development as our guest speaker. Through Tim’s presentation about using data engineering to enable data analytics through the masses, our teams started to notice how complementary our products are.…
Continue Reading Watch: Generating Data for Story-Driven Demos
Apache Spark: A Beginner’s Guide to Optimizing Spark Scripts
This blog post covers Apache Spark basics and teaches readers why optimizing Spark scripts is important, and how to do it for both memory and runtime efficiency. This blog post is best suited for data analysts and data scientists looking…
Setting Up Your Data Engineering Team for Success: Building Future-Proof Data Architecture
Yesterday’s data is predictable and easy. Our challenge as data engineers is getting ready for tomorrow’s unpredictable new data. With the push toward more flexible solutions, let’s discuss how you can set up your data engineering team for success by…
Tutorial: Creating a Multi-Cloud VPN with Terraform between AWS, GCP, and Azure
At Silectis, we deploy Magpie clusters across AWS, Google Cloud, and Azure. But because some of our internal infrastructure resides only on AWS, we need to establish private connections between these environments so that clusters on Google Cloud and Azure…
Improve Your SQL Skills: Master the Gaps and Islands Problem
The “gaps and islands” problem is a scenario in which you need to identify groups of continuous data (“islands”) and groups where the data is missing (“gaps”) across a particular sequence. The problem may sound arcane at first glance but…
Magpie Supports Google Cloud Platform
MAGPIE IS THE EASIEST WAY TO SETUP YOUR DATA LAKE ON GOOGLE CLOUD PLATFORM Today, Silectis is excited to announce our data engineering platform, Magpie, supports Google Cloud. Silectis Magpie brings together Google Cloud’s Big Data components so that organizations…
CATEGORIES
- Data Analytics
- Data Engineering
- Data Lakes
- Data Science
- Magpie
- Magpie in Action
- Management Insight
- Silectis News
- Tutorials
- Uncategorized
SUBSCRIBE
Join our mailing list to get updates from Silectis.