KDnuggets

JUNE 10, 2024

Machine Learning model is an exciting project. Learn how to develop your first model that the company would want to use.

Machine Learning 148

Machine Learning Building Project 148

Snowflake

JUNE 10, 2024

Discovering and surfacing telemetry traditionally can be a tedious and challenging process, especially when it comes to pinpointing specific issues for debugging. However, as applications and pipelines grow in complexity, understanding what’s happening beneath the surface becomes increasingly crucial. A lack of visibility hinders the development and maintenance of high-quality applications and pipelines, ultimately impacting customer experience.

Python 122

Python Java Hadoop Coding 122

KDnuggets

JUNE 10, 2024

Learn SQL and databases through free courses, tutorials, tools, guides, books, practice exercises, projects, awesome lists, and other resources.

SQL 146

SQL Database Project 146

Snowflake

JUNE 10, 2024

Today’s data-driven world requires an agile approach. Modern data teams are constantly under pressure to deliver innovative solutions faster than ever before. Fragmented tooling across data engineering, application development and AI/ML development creates a significant bottleneck, hindering the speed of value delivery required to stay competitive.

Python 119

Python Data Pipeline SQL Database 119

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

KDnuggets

JUNE 10, 2024

This short tutorial will guide you through the process of converting JSON data into a Pandas DataFrame.

Data 130

Data Process Python 130

databricks

JUNE 10, 2024

In the dynamic, innovative landscape of the San Francisco Bay Area, Databricks stands out not just for our groundbreaking data and AI solutions.

Data 111

Data 111

databricks

JUNE 10, 2024

We're excited to announce the General Availability of Databricks Predictive Optimization. This capability intelligently optimizes your table data layouts for faster queries and.

Data 110

Data 110

Engineering at Meta

JUNE 10, 2024

At Meta, Bento , our internal Jupyter notebooks platform, is a popular tool that allows our engineers to mix code, text, and multimedia in a single document. Use cases run the entire spectrum from what we call “lite” workloads that involve simple prototyping to heavier and more complex machine learning workflows. However, even though the lite workflows require limited compute, users still have to go through the same process of reserving and provisioning remote compute – a process that takes time

SQL 106

SQL Python Coding Machine Learning 106

databricks

JUNE 10, 2024

The Databricks Partner Ecosystem, comprising over 3,800 partners worldwide, plays a pivotal role in building and delivering premier data and AI solutions globally.

Building 107

Building Data 107

Data Engineering Weekly

JUNE 10, 2024

Experience Enterprise-Grade Apache Airflow Astro augments Airflow with enterprise-grade features to enhance productivity, meet scalability and availability demands across your data pipelines, and more. Learn More → Cube Research: Crystallizing Snowflake Summit 2024 We should officially call the first week of June the data engineering week, as two major data companies are running their developer conference.

Data Engineering 103

Data Engineering Data Engineer Engineering Kafka 103

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems

databricks

JUNE 10, 2024

Generative AI fever shows no signs of cooling off. As pressure and excitement build to execute strong GenAI strategies, data leaders and practitioners.

Data 98

Data Building 98

Robinhood

JUNE 10, 2024

Robinhood was founded on a simple idea: that our financial markets should be accessible to all. With customers at the heart of our decisions, Robinhood is lowering barriers and providing greater access to financial information and investing. Together, we are building products and services that help create a financial system everyone can participate in. … The Robinhood team is incredibly excited to welcome Katelyn Perna as Crypto Chief Information Security Officer.

Finance 91

Finance Portfolio Accessible Accessibility 91

Towards Data Science

JUNE 10, 2024

What they are and how you use them Continue reading on Towards Data Science »

SQL 75

SQL Data Science Data Programming 75

Confluent

JUNE 10, 2024

This is the second part of our series that explains how to create a graph that updates in real time with Streamlit, Kafka, and Flink SQL.

Kafka 69

Kafka SQL 69

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing

Ascend.io

JUNE 10, 2024

Snowflake Summit 2024 has set the stage for exciting changes in the data landscape. As a data enthusiast and a leader in data engineering, I’m eager to share my reflections on these innovations and their implications for Ascend. Here are my top five takeaways from our week at Moscone Center. #1 - AI and Machine Learning Continue to Be The New Frontier For me, the most exciting development from the Snowflake Summit 2024 was the enhanced focus on AI and machine learning.

Data Engineering 52

Data Engineering Data Engineer Engineering High Quality Data 52

Striim

JUNE 10, 2024

Macy’s, a leading American department store chain, embarked on a transformative journey to modernize its platform, streamline operations, and enhance customer experiences. Partnering with Striim and Google Cloud, Macy’s leveraged advanced data integration and cloud technologies to overcome significant challenges and achieve remarkable results.

Google Cloud 52

Google Cloud Retail Data Consolidation Cloud 52

Knowledge Hut

JUNE 10, 2024

As a seasoned data scientist, I understand the pivotal role data plays in our field. Handling vast amounts of data is essential for maximizing career opportunities. The exponential growth of data, with 55-65 percent being unstructured, as reported by Forbes.com, poses significant challenges for analysis. Raw Python can be cumbersome and time-consuming to work with, underscoring the necessity for Python frameworks.

Data Science 52

Data Science Python Deep Learning Machine Learning 52

Knowledge Hut

JUNE 10, 2024

Data has become a crucial part of our work life as we need data for managing everything, and it is not a bad thing to have when it has affected many people and companies in a good way and helped them make a fortune. But everything comes down to how we visualize it. There are many ways in which data can be visualized - tubular, pie chart, etc., and one has to be very careful which type he chooses as it can even complicate things.

Designing 52

Designing Coding Certification Project 52

Advertisement

With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you

Data Engineering