Confessions of a Data Guy

JANUARY 26, 2024

Well, I hate to break the news to you. I was the same when I first started, writing code that is. I was a zealot. I was zealous for every new thing I learned, every new language, every new approach, I would find the preacher who was preaching the message I wanted to hear … […] The post The Difficulties of Senior Engineer … are not Engineering appeared first on Confessions of a Data Guy.

Engineering 113

Engineering Coding Data Data Engineer 113

KDnuggets

JANUARY 26, 2024

Data Engineering ZoomCamp offers free access to reading materials, video tutorials, assignments, homeworks, projects, and workshops.

Data Engineer 156

Data Engineer Data Engineering Engineering Data 156

Christophe Blefari

JANUARY 26, 2024

Hey ( credits ) Hey, new week new email. This is already end of January but I took time to travel and see people I did not see for a long time so I'm super happy how this new year is starting. Next week, I'll be wrapping up my DataOps lecture by incorporating how to deploy machine learning models. This is a fun part where students learn how to serve a simple classifier in production.

Algorithm 130

Algorithm Google Cloud Data Java 130

KDnuggets

JANUARY 26, 2024

Learn how to write SQL queries that are not just code but clear, modular, and reusable work.

SQL 141

SQL Coding 141

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Pinterest Engineering

JANUARY 26, 2024

Jeremy Krach | Staff Security Engineer, Platform Security Background Several years ago, Pinterest had a short incident due to oversights in the policy delivery engine. This engine is the technology that ensures a policy document written by a developer and checked into source control is fully delivered to the production system evaluating that policy, similar to OPAL.

Engineering 93

Engineering Architecture Systems Metadata 93

Snowflake

JANUARY 26, 2024

A key benefit of the Snowflake Data Cloud is the elimination of data silos. Fundamental to this outcome is the ability of customers to operate and collaborate globally. To support this, the Data Cloud was designed to provide customers with the same product experience—including security and governance capabilities — across multiple cloud regions with the three major cloud providers: AWS, Azure, and Google Cloud.

Google Cloud 91

Google Cloud AWS Cloud Government 91

Towards Data Science

JANUARY 26, 2024

The way you retrieve variables from Airflow can impact the performance of your DAGs Continue reading on Towards Data Science »

Data Science 71

Data Science Data Machine Learning Programming 71

The Modern Data Company

JANUARY 26, 2024

Gain the power of data management with data products. Learn how to make the most of your data to grow your business.

Data Management 65

Data Management Management Data 65