ProjectPro

JUNE 6, 2025

Data Engineering is gradually becoming a popular career option for young enthusiasts. That's why we've created a comprehensive data engineering roadmap for 2023 to guide you through the essential skills and tools needed to become a successful data engineer. Let's dive into ProjectPro's Data Engineer Roadmap!

Data Engineering 94

Data Engineering Data Engineer Engineering Amazon Web Services 94

Seattle Data Guy

JANUARY 18, 2025

Because they can preserve the visual layout of documents and are compatible with a wide range of devices and operating systems, PDFs are used for everything from business forms and educational material to creative designs.

IT 130

IT Education Data Designing 130

Simon Späti

MARCH 28, 2025

The database landscape has reached 394 ranked systems across multiple categoriesrelational, document, key-value, graph, search engine, time series, and the rapidly emerging vector databases. As AI applications multiply quickly, vector technologies have become a frontier that data engineers must explore.

Technology 130

Technology PostgreSQL MySQL Database 130

Engineering at Meta

APRIL 28, 2025

Managing and understanding large-scale data ecosystems is a significant challenge for many organizations, requiring innovative solutions to efficiently safeguard user data. Meta’s vast and diverse systems make it particularly challenging to comprehend its structure, meaning, and context at scale.

Metadata 83

Metadata Data Utilities Data Warehouse 83

DataKitchen

JUNE 6, 2025

Data Quality Testing: A Shared Resource for Modern Data Teams In today’s AI-driven landscape, where data is king, every role in the modern data and analytics ecosystem shares one fundamental responsibility: ensuring that incorrect data never reaches business customers. Each role touches data differently.

Data Ingestion 73

Data Ingestion Data Governance Data Government 73

Snowflake

NOVEMBER 26, 2024

Many of our customers — from Marriott to AT&T — start their journey with the Snowflake AI Data Cloud by migrating their data warehousing workloads to the platform. Today we’re focusing on customers who migrated from a cloud data warehouse to Snowflake and some of the benefits they saw. million in cost savings annually.

Data Warehouse 105

Data Warehouse Cloud PostgreSQL Data Lake 105

databricks

JUNE 11, 2025

Events Data + AI Summit Data + AI World Tour Data Intelligence Days Event Calendar Blog and Podcasts Databricks Blog Explore news, product announcements, and more Databricks Mosaic Research Blog Discover the latest in our Gen AI research Data Brew Podcast Let’s talk data! REGISTER Ready to get started?

Entertainment 75

Entertainment Manufacturing Retail Consulting 75

Precisely

OCTOBER 31, 2024

Key Takeaways: Data mesh is a decentralized approach to data management, designed to shift creation and ownership of data products to domain-specific teams. Data fabric is a unified approach to data management, creating a consistent way to manage, access, and share data across distributed environments.

Data Architecture 69

Data Architecture Architecture Metadata Government 69

Cloudera

NOVEMBER 13, 2024

We are excited to announce the acquisition of Octopai , a leading data lineage and catalog platform that provides data discovery and governance for enterprises to enhance their data-driven decision making. This dampens confidence in the data and hampers access, in turn impacting the speed to launch new AI and analytic projects.

Metadata 90

Metadata Management Data Governance Government 90

Monte Carlo

NOVEMBER 12, 2024

A data engineering architecture is the structural framework that determines how data flows through an organization – from collection and storage to processing and analysis. It’s the big blueprint we data engineers follow in order to transform raw data into valuable insights. How Does Uber Know Where to Go?

Architecture 96

Architecture Data Engineering Data Engineer Engineering 96

Towards Data Science

DECEMBER 10, 2024

Three Zero-Cost Solutions That Take Hours, NotMonths A data quality certified pipeline. Source: unsplash.com In my career, data quality initiatives have usually meant big changes. Whats more, fixing the data quality issues this way often leads to new problems. Create a custom dashboard for your specific data qualityproblem.

PostgreSQL 75

PostgreSQL Data SQL Python 75

dbt Developer Hub

APRIL 20, 2025

dbt is the standard for creating governed, trustworthy datasets on top of your structured data. We expect that over the coming years, structured data is going to become heavily integrated into AI workflows and that dbt will play a key role in building and provisioning this data. What is MCP? Why does this matter?

Structured Data 98

Structured Data SQL BI Metadata 98

Engineering at Meta

FEBRUARY 4, 2025

Were sharing how Meta built support for data logs, which provide people with additional data about how they use our products. Here we explore initial system designs we considered, an overview of the current architecture, and some important principles Meta takes into account in making data accessible and easy to understand.

Accessibility 89

Accessibility Accessible Raw Data Data Warehouse 89

Snowflake

APRIL 13, 2025

Managing and utilizing data effectively is crucial for organizational success in today's fast-paced technological landscape. The vast amounts of data generated daily require advanced tools for efficient management and analysis. Enter agentic AI, a type of artificial intelligence set to transform enterprise data management.

Data Management 93

Data Management Management Consulting Unstructured Data 93

KDnuggets

MAY 27, 2025

Develop a data system that every business user wants to use.

Data 93

Data Systems 93

Towards Data Science

JANUARY 7, 2025

How CDC tools use MySQL Binlog and PostgreSQL WAL with logical decoding for real-time data streaming Photo by Matoo.Studio on Unsplash CDC (Change Data Capture) is a term that has been gaining significant attention over the past few years. You might already be familiar with it (if not, dont worrytheres a quick introduction below ).

PostgreSQL 84

PostgreSQL MySQL Bytes Data Lake 84

DataKitchen

NOVEMBER 5, 2024

The Race For Data Quality In A Medallion Architecture The Medallion architecture pattern is gaining traction among data teams. It is a layered approach to managing and transforming data. By systematically moving data through these layers, the Medallion architecture enhances the data structure in a data lakehouse environment.

Architecture 78

Architecture Raw Data Pipeline-centric Data Ingestion 78

DataKitchen

NOVEMBER 27, 2024

A Guide to the Six Types of Data Quality Dashboards Poor-quality data can derail operations, misguide strategies, and erode the trust of both customers and stakeholders. Data quality dashboards have emerged as indispensable tools, offering a clear window into the health of their data and enabling targeted actionable improvements.

Banking 86

Banking Data Pharmaceutical Retail 86

Snowflake

DECEMBER 4, 2024

Together with a dozen experts and leaders at Snowflake, I have done exactly that, and today we debut the result: the “ Snowflake Data + AI Predictions 2024 ” report. When you’re running a large language model, you need observability into how the model may change as it ingests new data. The next evolution in data is making it AI ready.

Unstructured Data 97

Unstructured Data Data Lake Deep Learning Metadata 97

Snowflake

JANUARY 15, 2025

Over the last three geospatial-centric blog posts, weve covered the basics of what geospatial data is, how it works in the broader world of data and how it specifically works in Snowflake based on our native support for GEOGRAPHY , GEOMETRY and H3. But there is so much more you can do with geospatial data in your Snowflake account!

Transportation 97

Transportation BI Database-centric Metadata 97

KDnuggets

JUNE 11, 2025

By Nate Rosidi , KDnuggets Market Trends & SQL Content Specialist on June 11, 2025 in Language Models Image by Author | Canva If you work in a data-related field, you should update yourself regularly. Data scientists use different tools for tasks like data visualization, data modeling, and even warehouse systems.

Data Science 97

Data Science Machine Learning Python SQL 97

Snowflake

FEBRUARY 12, 2025

AI agents, autonomous systems that perform tasks using AI, can enhance business productivity by handling complex, multi-step operations in minutes. Agents need to access an organization's ever-growing structured and unstructured data to be effective and reliable.

Unstructured Data 88

Unstructured Data Government SQL Structured Data 88

KDnuggets

JUNE 11, 2025

By KDnuggets on June 11, 2025 in Partners Sponsored Content Recommender systems rely on data, but access to truly representative data has long been a challenge for researchers. It joins a growing list of resources helping to close the research-to-production gap in recommender systems.

Datasets 125

Datasets Metadata Machine Learning Data Science 125

ProjectPro

JUNE 6, 2025

Data is often referred to as the new oil, and just like oil requires refining to become useful fuel, data also needs a similar transformation to unlock its true value. This transformation is where data warehousing tools come into play, acting as the refining process for your data. Why Choose a Data Warehousing Tool?

Data Storage 58

Data Storage PostgreSQL Data Warehouse AWS 58

Snowflake

JUNE 10, 2025

Data transformations are the engine room of modern data operations — powering innovations in AI, analytics and applications. As the core building blocks of any effective data strategy, these transformations are crucial for constructing robust and scalable data pipelines. This puts data engineers in a critical position.

Data Pipeline 83

Data Pipeline SQL Python Building 83

Precisely

APRIL 7, 2025

We often use different terms when were talking about the same thing in this case, data appending vs. data enrichment. Ive noticed that “data appending” is more commonly used in industries like marketing and telecommunications, while data enrichment seems to be the preferred term in financial services and retail.

Retail 75

Retail Datasets Data Portfolio 75

Snowflake

APRIL 2, 2025

Data storage has been evolving, from databases to data warehouses and expansive data lakes, with each architecture responding to different business and data needs. Traditional databases excelled at structured data and transactional workloads but struggled with performance at scale as data volumes grew.

Data Lake 97

Data Lake Cloud Storage Metadata Data Warehouse 97

Data Engineering Weekly

JUNE 1, 2025

Dagster for MLOps: Deep Dive into AI Orchestration Learn what it really takes to run production-grade ML systems—without breaking your architecture or compliance efforts. Data Engineering Weekly recently published a reference architecture for a composable data architecture.

Data Engineering 70

Data Engineering Data Engineer Engineering Relational Database 70

ProjectPro

JUNE 6, 2025

Are you a data science enthusiast looking to enhance your Python Flask skills? Check out these exciting python flask projects that will help you apply your Flask knowledge to solve real-world data science challenges. Here is the list of the best Python Flask projects ideal for data experts. This is where Python Flask comes in.

Data Science 69

Data Science Python Project Google Cloud 69

Snowflake

MARCH 12, 2025

In todays data-driven world, organizations depend on high-quality data to drive accurate analytics and machine learning models. But poor data quality gaps, inconsistencies and errors can undermine even the most sophisticated data and AI initiatives.

Unstructured Data 93

Unstructured Data High Quality Data Banking Machine Learning 93

ProjectPro

JUNE 6, 2025

With wide applications in various sectors like healthcare , education, retail, transportation, media, and banking -data science applications are at the core of pretty much every industry out there. How do you prepare a data science case study? petabytes of data every hour! petabytes of data every hour!

Data Science 67

Data Science Project Food Pharmaceutical 67

ProjectPro

JUNE 6, 2025

In the thought process of making a career transition from ETL developer to data engineer job roles? Read this blog to know how various data-specific roles, such as data engineer, data scientist, etc., differ from ETL developer and the additional skills you need to transition from ETL developer to data engineer job roles.

Data Engineering 59

Data Engineering Data Engineer Engineering ETL Tools 59