Snowflake

JANUARY 8, 2025

Though AI is (still) the hottest technology topic, its not the overriding issue for enterprise security in 2025. Advanced AI will open up new attack vectors and also deliver new tools for protecting an organizations data. But the underlying challenge is the sheer quantity of data that overworked cybersecurity teams face as they try to answer basic questions such as, Are we under attack?

Data Lake 105

Data Lake Data Security Machine Learning Technology 105

Confessions of a Data Guy

JANUARY 8, 2025

You know, for all the hoards of content, books, and videos produced in the “Data Space” over the last few years, famous or others, it seems I find there are volumes of information on the pieces and parts of working in Data. It could be Data Quality, Data Modeling, Data Pipelines, Data Storage, Compute, and […] The post What is a Data Platform?

Data Storage 124

Data Storage Data Pipeline Data IT 124

Data Engineering Weekly

JANUARY 8, 2025

What if your data lake could do more than just store information—what if it could think like a database? As data lakehouses evolve, they transform how enterprises manage, store, and analyze their data. To explore this future, I recently sat down with Vinoth Chandar, founder of Onehouse and creator of Apache Hudi, for a fireside chat about the trends shaping the data landscape.

Data Lake 62

Data Lake Datasets Retail Data Ingestion 62

KDnuggets

JANUARY 8, 2025

Element-wise operations are a crucial part of data preprocessing in Pandas. Learn how to perform them with practical examples using the DataFrame.map() function.

Data 122

Data 122

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline

Confluent

JANUARY 8, 2025

GenAI thrives on real-time contextual data: In a modern system, LLMs should be designed to engage, synthesize, and contribute, rather than to simply serve as queryable data stores.

Database 72

Database Designing Systems Data 72

KDnuggets

JANUARY 8, 2025

This article shows how to use Great Expectations to check data quality in data science projects.

Data Science 108

Data Science Data Project 108

KDnuggets

JANUARY 8, 2025

In this article, Im going to share data science project ideas that will actually help you stand out. These are creative projects that solve problems with data, and Ive included source code and tutorials to help you replicate them.

Data Science 102

Data Science Project Data Coding 102

Hevo

JANUARY 8, 2025

In today’s data-driven world, data lakes have emerged as the data architecture of choice when storing and analyzing large volumes of data. However, implementing a successful data lake requires diligent planning and design, as it can quickly become a data swamp with no additional value.

Data Lake 40

Data Lake Data Architecture Architecture Data 40

The Pragmatic Engineer

JANUARY 8, 2025

The Pragmatic Engineer Podcast covers software engineering at Big Tech and startups, from the inside. We do deepdives with experienced engineers and tech professionals who share their hard-earned lessons, interesting stories and advice they have on building software. After each episode, you’ll walk away with pragmatic approaches you can use to build stuff – whether you are a software engineer, or a manager of engineers.

Engineering 138

Engineering Software Engineer Software Engineering Building 138

Precisely

JANUARY 8, 2025

While women make up nearly half of the global workforce, there remains a gender gap in several industries, including technology. Empowering women to pursue and thrive in technology is a priority for Precisely as it paves the way for a more inclusive industry now and in the years to come. To support this initiative, the Precisely Women in Technology (PWIT) program was developed.

Technology 59

Technology Computer Science Programming Designing 59

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

Ascend.io

JANUARY 8, 2025

We are thrilled to announce that Ascend.io has been recognized as one of Built Ins Best Places to Work for 2025 in the San Francisco Bay Area! This milestone marks our third consecutive year earning this incredible honor, and its all thanks to our amazing team and the shared values that define who we are as a company. Winning this award is more than a badge of honorits a celebration of the culture weve built together and the guiding principles that make Ascend a place where people can thrive, gr

Data Pipeline 52

Data Pipeline Building Technology IT 52

Striim

JANUARY 8, 2025

Recent studies highlight the critical role of data in business success and the challenges organizations face in leveraging it effectively. A 2023 Salesforce study revealed that 80% of business leaders consider data essential for decision-making. However, a Seagate report found that 68% of available enterprise data goes unleveraged, signaling significant untapped potential for operational analytics to transform raw data into actionable insights.

BI 52

BI Business Analyst Retail Raw Data 52