KDnuggets

DECEMBER 30, 2021

Avoid headaches when debugging in one line of code.

Coding 160

Coding Python Programming 160

Data Engineering Podcast

DECEMBER 26, 2021

Summary The data mesh is a thesis that was presented to address the technical and organizational challenges that businesses face in managing their analytical workflows at scale. Zhamak Dehghani introduced the concepts behind this architectural patterns in 2019, and since then it has been gaining popularity with many companies adopting some version of it in their systems.

BI 130

BI Data Warehouse Data Engineer Data Engineering 130

Confluent

DECEMBER 28, 2021

Many leading lights of the Apache Kafka® community have appeared as guests on Streaming Audio at one time or another in the past three years. But some of its episodes […].

Kafka 129

Kafka IT Systems Architecture 129

Rock the JVM

DECEMBER 30, 2021

Wrap up 2021 with us as we review the year's highlights and achievements at Rock the JVM

52

52

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

KDnuggets

DECEMBER 30, 2021

This list of best data science companies aims to go beyond the usual and expected. Some great and perhaps underrated options to get a job as a data scientist.

Data Science 160

Data Science Data 160

ProjectPro

DECEMBER 28, 2021

The digital economy is driven by data disrupting industries across the globe with increasing number of companies wanting to glean valuable insights from real-time data. Allied Market Research estimated the global big data and business analytics market to be valued at $198.08 billion in 2020 and expected to grow at a CAGR of 13% from 2021-2030, reaching $684.12 billion by 2030.

Architecture 52

Architecture Kafka Java Scala 52

Rock the JVM

DECEMBER 27, 2021

JDBC struggles with side effects in functional programming: doobie offers a higher-level, effectful API through Cats and Cats Effect

Programming 52

Programming 52

KDnuggets

DECEMBER 29, 2021

It's time to learn: machine learning is not a Swiss Army knife.

Machine Learning 160

Machine Learning IT 160

Grouparoo

DECEMBER 26, 2021

For data storage, the database is one of the fundamental building blocks. They provide a method for storing information in an organized manner that ensures it remains accessible while providing the mechanisms to protect the integrity, confidentiality, and availability of the information they hold. There are many kinds of databases available, each with its strengths and weaknesses.

Database 52

Database NoSQL Relational Database Data Storage 52

RudderStack

DECEMBER 28, 2021

We recently helped a customer overcome the challenge of sending 5 million users/day from Snowflake to Iterable. This post details how we did it.

IT 40

IT 40

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Data Engineering Podcast

DECEMBER 26, 2021

Summary Data Engineering is still a relatively new field that is going through a continued evolution as new technologies are introduced and new requirements are understood. In this episode Maxime Beauchemin returns to revisit what it means to be a data engineer and how the role has changed over the past 5 years. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projec

Data Engineer 100

Data Engineer Data Engineering Engineering Data Warehouse 100

KDnuggets

DECEMBER 29, 2021

AI/ML systems have a wide range of applications in a variety of industries and sectors, and this article highlights the top ways AI/ML will impact your small business in 2022.

Technology 160

Technology Systems Machine Learning 160

KDnuggets

DECEMBER 28, 2021

Continue your learning journey in Reinforcement Learning with this second of two part tutorial that covers the foundations of the technique with examples and Python code.

Python 160

Python Coding 160

KDnuggets

DECEMBER 31, 2021

In this blog, we will discuss what makes Python so popular, its features, and why you should consider Python as a programming language for your startup.

Programming Language 159

Programming Language Programming Python IT 159

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

KDnuggets

DECEMBER 27, 2021

Learn how to improve ML reproducibility by treating experiments as code.

Machine Learning 160

Machine Learning Coding 160

KDnuggets

DECEMBER 28, 2021

Check out these one-liner interactive visualization with Pandas in Python.

Python 159

Python Data 159

KDnuggets

DECEMBER 27, 2021

Review this detailed tutorial with code and revisit the decades-long old problem using a democratized and interpretable AI framework of how precisely can we anticipate the future and understand its causal factors?

Coding 149

Coding IT Engineering Data 149