In this blog post, we’ll walk you through how data science and data engineering are complementary disciplines. We’ll also delineate a third category: data analysis. We’ll explore how both data engineering and data science should be marshaled to make better decisions. Organizations often struggle to strike the right balance between engineering, … [Read more...] about Reframing “Data Engineering vs Data Science”
Technical Tutorial: Machine Learning Model in R Using Spark
In this installment of Silectis Technical Tutorials, we provide a step-by-step introduction to building a machine learning model in R using Apache Spark. This post is intended for R users who understand the basics of machine learning and have an interest in learning about Spark’s machine learning capabilities. OVERVIEW – CLASSIFYING DOCUMENTS … [Read more...] about Technical Tutorial: Machine Learning Model in R Using Spark
Setting Up Your Data Engineering Team for Success: Building Future-Proof Data Architecture
Yesterday's data is predictable and easy. Our challenge as data engineers is getting ready for tomorrow's unpredictable new data. With the push toward more flexible solutions, let's discuss how you can set up your data engineering team for success by implementing flexible, scalable, and future-proof data architecture. DATA IS BIG AND GROWING IN … [Read more...] about Setting Up Your Data Engineering Team for Success: Building Future-Proof Data Architecture
Magpie Supports Google Cloud Platform
MAGPIE IS THE EASIEST WAY TO SETUP YOUR DATA LAKE ON GOOGLE CLOUD PLATFORM Today, Silectis is excited to announce our data engineering platform, Magpie, supports Google Cloud. Silectis Magpie brings together Google Cloud’s Big Data components so that organizations can get value from their data engineering operations right away, providing a … [Read more...] about Magpie Supports Google Cloud Platform
Magpie and Looker Partner to Supercharge Your Data Analytics & Visualizations
Today’s advanced analytics space is filled with tools to help users become more data driven. However, every use case is different, and there is not a single tool that is ready for each unique situation. The best solutions for a given organization usually lie in a combinations of software platforms. This blog post outlines why Silectis Magpie and … [Read more...] about Magpie and Looker Partner to Supercharge Your Data Analytics & Visualizations
Magpie in Action: Analyzing the Future of Solar Power in Washington, DC
This blog post was written in conjunction with UrbanTurf, the authority on real estate in the Nation’s Capital, and can be found here. SOLAR POWER IS COMING TO DC… BUT NOT WHERE YOU WOULD THINK Silectis used public building permit data from DC’s open data portal to determine which neighborhoods in Washington DC really care about the future of … [Read more...] about Magpie in Action: Analyzing the Future of Solar Power in Washington, DC