Sat.Jan 20, 2024

article thumbnail

How to learn data engineering

Christophe Blefari

Learn data engineering, all the references ( credits ) This is a special edition of the Data News. But right now I'm in holidays finishing a hiking week in Corsica 🥾 So I wrote this special edition about: how to learn data engineering in 2024. The aim of this post is to create a repository of important links and concepts we should care about when we do data engineering.

article thumbnail

A Guide to Data Engineering Infrastructure

Towards Data Science

Automate resource provisioning with modern tools Continue reading on Towards Data Science »

article thumbnail

Data News — Week 24.03

Christophe Blefari

Walking in the street be like recently ( credits ) Hey I hope this new edition finds you well. We are deep in the winter, it's time for comfy Data News to read near the fire 🔥 This week, on Monday, I started my annual university lecture. It's been 9 years since I started teaching and this year something was different. The students were incredibly calm, obviously my course is a bit difficult at the beginning because it touches on concepts that they are not used to—cloud,

Data 130
article thumbnail

The Future of Business Intelligence

Monte Carlo

The future of business intelligence (BI) is inextricably linked to the future of data. As the amount of data companies create and consume grows exponentially, the speed and ease with which you can access and rely upon that data is going to be more important than ever before. From artificial intelligence to tools that foster collaboration and self-service , below we’ll be looking at several different developments and approaches that reflect the changing face of data analytics, as well as how they

article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.