Wed.Jan 08, 2025

article thumbnail

How to Use dataframe.map() for Element-wise Operations in Pandas

KDnuggets

Element-wise operations are a crucial part of data preprocessing in Pandas. Learn how to perform them with practical examples using the DataFrame.map() function.

Data 97
article thumbnail

Predictions 2025: AI As Cybersecurity Tool and Target

Snowflake

Though AI is (still) the hottest technology topic, its not the overriding issue for enterprise security in 2025. Advanced AI will open up new attack vectors and also deliver new tools for protecting an organizations data. But the underlying challenge is the sheer quantity of data that overworked cybersecurity teams face as they try to answer basic questions such as, Are we under attack?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

What is a Data Platform?

Confessions of a Data Guy

You know, for all the hoards of content, books, and videos produced in the “Data Space” over the last few years, famous or others, it seems I find there are volumes of information on the pieces and parts of working in Data. It could be Data Quality, Data Modeling, Data Pipelines, Data Storage, Compute, and […] The post What is a Data Platform?

article thumbnail

7 Data Science Projects to Land a 6 Figure Job

KDnuggets

In this article, Im going to share data science project ideas that will actually help you stand out. These are creative projects that solve problems with data, and Ive included source code and tutorials to help you replicate them.

article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

The Future of Data Lakehouses: A Fireside Chat with Vinoth Chandar - Founder CEO Onehouse & PMC Chair of Apache Hudi

Data Engineering Weekly

What if your data lake could do more than just store information—what if it could think like a database? As data lakehouses evolve, they transform how enterprises manage, store, and analyze their data. To explore this future, I recently sat down with Vinoth Chandar, founder of Onehouse and creator of Apache Hudi, for a fireside chat about the trends shaping the data landscape.

article thumbnail

Implementing Data Quality Assurance in Data Science Pipelines with Great Expectations

KDnuggets

This article shows how to use Great Expectations to check data quality in data science projects.

More Trending

article thumbnail

How to Connect to Oracle DB: 3 Easy Methods

Hevo

The Oracle Database is used by many companies around the world as the basis for the storage and processing of information. It is well adopted across all markets, including the financial sector and healthcare, where data security and management is critical.

article thumbnail

Where to find to The Pragmatic Engineer Podcast

The Pragmatic Engineer

The Pragmatic Engineer Podcast covers software engineering at Big Tech and startups, from the inside. We do deepdives with experienced engineers and tech professionals who share their hard-earned lessons, interesting stories and advice they have on building software. After each episode, you’ll walk away with pragmatic approaches you can use to build stuff – whether you are a software engineer, or a manager of engineers.

article thumbnail

Data Lake Best Practices: The Do’s and Don’ts

Hevo

In today’s data-driven world, data lakes have emerged as the data architecture of choice when storing and analyzing large volumes of data. However, implementing a successful data lake requires diligent planning and design, as it can quickly become a data swamp with no additional value.

article thumbnail

Precisely Women in Technology: Meet Varada

Precisely

While women make up nearly half of the global workforce, there remains a gender gap in several industries, including technology. Empowering women to pursue and thrive in technology is a priority for Precisely as it paves the way for a more inclusive industry now and in the years to come. To support this initiative, the Precisely Women in Technology (PWIT) program was developed.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Ascend Named One of the Best Places to Work for the Third Consecutive Year!

Ascend.io

We are thrilled to announce that Ascend.io has been recognized as one of Built Ins Best Places to Work for 2025 in the San Francisco Bay Area! This milestone marks our third consecutive year earning this incredible honor, and its all thanks to our amazing team and the shared values that define who we are as a company. Winning this award is more than a badge of honorits a celebration of the culture weve built together and the guiding principles that make Ascend a place where people can thrive, gr

article thumbnail

A Comprehensive Guide to Operational Analytics

Striim

Recent studies highlight the critical role of data in business success and the challenges organizations face in leveraging it effectively. A 2023 Salesforce study revealed that 80% of business leaders consider data essential for decision-making. However, a Seagate report found that 68% of available enterprise data goes unleveraged, signaling significant untapped potential for operational analytics to transform raw data into actionable insights.

BI 52