KDnuggets

JULY 29, 2024

Learn to build the end-to-end data science pipelines from data ingestion to data visualization using Pandas pipe method.

Data Science 153

Data Science Building Data Ingestion Data 153

Confluent

JULY 29, 2024

Apache Kafka 3.8 adds 17 new KIPs (13 for Core, 3 for Streams & 1 for Connect). Highlights include 2 new Docker images, the ability to set task assignors, and more!

Kafka 131

Kafka 131

KDnuggets

JULY 29, 2024

Let's learn how to perform memory-efficient operations in pandas with large dataset.

Datasets 143

Datasets Python 143

ArcGIS

JULY 29, 2024

More small-scale projected basemaps to add to the set I built in 2023

Project 105

Project 105

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

databricks

JULY 29, 2024

Financial Valuations & Comparative Analysis Financial institutions specialized in capital markets such as hedge funds, market makers and pension funds have long been.

103

103

KDnuggets

JULY 29, 2024

Forget about going to university and become a machine learning professional with these 5 top certifications.

Machine Learning 94

Machine Learning Certification 94

Towards Data Science

JULY 29, 2024

Containerising and running dbt projects with Artifact Registry, Cloud Composer, GitHub Actions and dbt-airflow Continue reading on Towards Data Science »

Google Cloud 63

Google Cloud Cloud Project Data Science 63

Precisely

JULY 29, 2024

Key Takeaways Machine data created by your IBM Z and IBM i is critical for flagging anomalies that may exist in your business and meeting regulatory compliance requirements Automated discovery and integration tools, like a CMDB, streamline processes, reduce risks, and enhance decision-making. Precisely Ironstream ensures real-time updates and a holistic approach to IT service management, optimizing your operations by integrating IBM Z and IBM i machine data into ServiceNow.

IT 52

IT Data Systems Utilities 52

The Modern Data Company

JULY 29, 2024

There’s no denying the importance of data in today’s business world. Done right, it is the backbone of organizational success, driving innovation, unlocking new revenue models, and delivering a competitive edge. However, data leaders worldwide are grappling with a challenging question: “Why aren’t our data initiatives delivering the expected ROI?

Data Architecture 52

Data Architecture Architecture Building Pipeline-centric 52

Elder Research

JULY 29, 2024

The post Balancing AI Power with Human Insight: A Humorous Dive into Text Analytics appeared first on Elder Research.

52

52

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Towards Data Science

JULY 29, 2024

Automate your Fabric capacity state with Azure Logic Apps Continue reading on Towards Data Science »

Data Science 50

Data Science Data Data Engineer Data Engineering 50

Lyft Engineering

JULY 29, 2024

Building Lyfts Next EmblemGlow By: Avneet Oberoi , Michael Vernier , Phoenix Li , MasroorAhmed Introduction Long time riders might remember the original fuzzy, pink Carstache emblem that made Lyft universally recognizable. Over the years, the emblem dropped the fuzz for pink lights in the Glowstache and later evolved with more colors as the beloved Amp , which has been in active use for over seven years!

Building 40

Building Manufacturing Metadata Systems 40

Cloudera

JULY 29, 2024

Cloudera’s data-in-motion architecture is a comprehensive set of scalable, modular, re-composable capabilities that help organizations deliver smart automation and real-time data products with maximum efficiency while remaining agile to meet changing business needs. In this blog, we will examine the “why” behind streaming data and review some high-level guidelines for how organizations should build their data-in-motion architecture of the future.

Architecture 74

Architecture Manufacturing Data Architecture Utilities 74