Mon.Nov 18, 2024

article thumbnail

A Guide to Data Analysis in Python with DuckDB

KDnuggets

Learn how to perform data analysis in Python using DuckDB.

article thumbnail

From IC to Data Leader: Key Strategies for Managing and Growing Data Teams

Seattle Data Guy

There are plenty of statistics about the speed at which we are creating data in today’s modern world. On the flip side of all that data creation is a need to manage all of that data and thats where data teams come in. But leading these data teams is challenging and yet many new data… Read more The post From IC to Data Leader: Key Strategies for Managing and Growing Data Teams appeared first on Seattle Data Guy.

article thumbnail

Develop the Right AI Skills for Job Security

KDnuggets

Don’t get left behind - start learning AI with 5-course tracks by DataCamp with 50% on Black Friday deal!

127
127
article thumbnail

Automating Unity Catalog Upgrade Workflows with UCX

databricks

As organizations increasingly leverage the Databricks Data Intelligence Platform for data and AI needs, upgrading to Unity Catalog is a key step in.

Data 105
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Exploring Python’s Ellipsis (…) : More than Just Syntax Sugar

KDnuggets

Ever wondered what the three dots (.) in Python are used for? Discover how this powerful operator can simplify your code!

Python 127
article thumbnail

Databricks training invests in closing the data + AI skills gap across enterprises

databricks

The Data + AI Skills Gap The “skills gap” has been a concern for CEOs and leaders for many years, and the gap.

Data 105

More Trending

article thumbnail

From Data Warehousing to Data Intelligence: How Data Took Over

databricks

While GenAI is the focus today, most enterprises have been working for a decade or longer to make data intelligence a reality within.

Data 98
article thumbnail

Expert Insights for Your 2025 Data, Analytics, and AI Initiatives

Precisely

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. A long-term approach to your data strategy is key to success as business environments and technologies continue to evolve. The rapid pace of technological change has made data-driven initiatives more crucial than ever within modern business strategies.

article thumbnail

DuckDB … reading from s3 … with AWS Credentials and more.

Confessions of a Data Guy

In my never-ending quest to plumb the most boring depths of every single data tool on the market, I found myself annoyed when recently using DuckDB for a benchmark that was reading parquet files from s3. What was not clear, or easy, was trying to figure out how DuckDB would LIKE to read default AWS […] The post DuckDB … reading from s3 … with AWS Credentials and more. appeared first on Confessions of a Data Guy.

AWS 113
article thumbnail

Expert Insights for Your 2025 Data, Analytics, and AI Initiatives

Precisely

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. A long-term approach to your data strategy is key to success as business environments and technologies continue to evolve. The rapid pace of technological change has made data-driven initiatives more crucial than ever within modern business strategies.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Change Data Capture at Pinterest

Pinterest Engineering

Liang Mou; Staff Software Engineer, Logging Platform | Elizabeth (Vi) Nguyen; Software Engineer I, Logging Platform | In today’s data-driven world, businesses need to process and analyze data in real-time to make informed decisions. Change Data Capture (CDC) is a crucial technology that enables organizations to efficiently track and capture changes in their databases.

Kafka 46
article thumbnail

Snowflake Will Automatically Disable Passwords Detected on the Dark Web

Snowflake

Security has been an integral part of Snowflake’s platform since the company was founded. Through the security capabilities of Snowflake Horizon Catalog , we empower security admins and CISO’s to better protect their environments. As part of our continued efforts to help customers secure their accounts, and in line with our pledge to align with CISA’s Secure By Design principles, we are announcing the general availability of Snowflake Leaked Password Protection (LPP).

Systems 78