Data Engineering Podcast

OCTOBER 2, 2022

Enter Metaplane, the industry’s only self-serve data observability tool. Data leaders at Imperfect Foods, Drift, and Vendr love Metaplane because it helps them catch, investigate, and fix data quality issues before their stakeholders ever notice they exist. Setup takes 30 minutes. Setup takes 30 minutes.

IT 100

IT Food PostgreSQL MongoDB 100

Data Engineering Podcast

OCTOBER 9, 2022

Enter Metaplane, the industry’s only self-serve data observability tool. Data leaders at Imperfect Foods, Drift, and Vendr love Metaplane because it helps them catch, investigate, and fix data quality issues before their stakeholders ever notice they exist. Setup takes 30 minutes. Setup takes 30 minutes.

Food 100

Food MongoDB MySQL Scala 100

Data Engineering Weekly

MARCH 3, 2024

Editor’s Note: Chennai, India Meetup - March-08 Update We are thankful to Ideas2IT to host our first Data Hero’s meetup. There will be food, networking, and real-world talks around data engineering. Visit rudderstack.com to learn more.

Data Engineering 67

Data Engineering Data Engineer Engineering Pipeline-centric 67

Monte Carlo

DECEMBER 29, 2022

Building Spark Lineage For Data Lakes Everyone writes about the successful projects, but you learn more from the failures. Our engineering team at Monte Carlo describes why developing Spark lineage for data lakes is so much harder than for data warehouses.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Lake 52

Cloudera

MAY 12, 2021

Use cases could include but are not limited to: optimizing healthcare processes to save lives, data analysis for emergency resource management, building smarter cities with data science, using data and analytics to fight climate change, tackle the food crisis or prioritize actions against poverty, and more.

Food 70

Food Healthcare Government Medical 70

ProjectPro

MARCH 1, 2017

(Source : [link] ​ANZ bank to move 'quaint' data ponds into single Hadoop-based data lake.Zdnet.com, February 21, 2017 Australia and New Zealand Banking Group is working on a project to build an enterprise wide data lake so that it can capitalise on the most strategic assets. Source - [link] ) Attunity Wins $1.8

Hadoop 40

Hadoop Food Data Lake Banking 40

Precisely

MARCH 27, 2023

Transforming Go-to-Market After years of acquiring and integrating smaller companies, a $37 billion multinational manufacturer of confectionery, pet food, and other food products was struggling with complex and largely disparate processes, systems, and data models that needed to be normalized.

Consulting 52

Consulting Food Pharmaceutical Data Lake 52

Data Engineering Weekly

APRIL 28, 2024

This initiative demonstrates how advanced AI technologies can empower data engineering efforts to create more intelligent and user-centric systems in the food delivery industry. link] Grab: Ensuring data reliability and observability in risk systems.

Data Engineering 52

Data Engineering Data Engineer Engineering Hospitality 52

Monte Carlo

AUGUST 10, 2023

However, another way to think about it is that solving for data quality requires you to think beyond a point in time, and consider how the quality changes over time in a variety of real-world conditions. That is true data reliability.

Data Pipeline 98

Data Pipeline Software Engineer Software Engineering Machine Learning 98

Monte Carlo

FEBRUARY 21, 2023

These include: Seamless integration A data fabric’s ability to integrate seamlessly with various APIs and software-delivery kits (SDKs) truly differentiates this framework from another type of data management: the ubiquitous data lake. Frequent customer communication and personalization are key to Domino’s success.

Data Architecture 52

Data Architecture Architecture Metadata Unstructured Data 52

Monte Carlo

FEBRUARY 21, 2023

These include: Seamless integration A data fabric’s ability to integrate seamlessly with various APIs and software-delivery kits (SDKs) truly differentiates this framework from another type of data management: the ubiquitous data lake. Frequent customer communication and personalization are key to Domino’s success.

Data Architecture 52

Data Architecture Architecture Metadata Unstructured Data 52

Rockset

AUGUST 26, 2022

Every predetermined time period, the agents would scan the applications for newly-entered or uploaded data -- everything from highly-compressed herd genetic data, to dimensional models. When a change is detected, the data is ingested into a data lake hosted on Amazon S3.

IT 52

IT Food Aggregated Data Data Lake 52

Grouparoo

DECEMBER 7, 2021

Also, where the data relates to living individuals within the European Union, the General Data Protection Regulations (GDPR) requires similar assurance, and non-compliance carries severe financial penalties and potential prosecution.

Data Integration 52

Data Integration Manufacturing ETL Tools Transportation 52

Knowledge Hut

MARCH 19, 2024

Background: McDonald's Corporation, a global fast-food giant, has embraced digital transformation to redefine its operations and enhance customer experiences. AWS Data Lake Integration: To effectively manage and analyze large volumes of data, Yulu utilized AWS data lake capabilities, providing a scalable and secure infrastructure.

Cloud Computing 52

Cloud Computing Cloud Amazon Web Services AWS 52

Monte Carlo

JUNE 14, 2022

The welcome happy hour in the exhibitor hall was packed with thousands of data leaders enjoying drinks, Chinese food, and vendor elevator pitches. It’s essentially the early days of the Apple app store but for data applications, and that model seemed to work out OK for Apple.

Cloud 52

Cloud Python Data Ingestion Government 52

DareData

JULY 29, 2020

They can keep their nutritionist updated with their daily weight, their exercise regimen and their food macros; they can also use a wearable device to track their heart rate during an exercise session.

Data Pipeline 52

Data Pipeline Healthcare Medical Pipeline-centric 52

Monte Carlo

JANUARY 12, 2023

For Freshly, food isn’t the only thing that needs to be delivered fresh and fast; our data also needs to be reliable, timely, and most importantly, accurate. We are also using Fivetran to parse and load data from dozens of Google Sheets into Snowflake. Editor’s Note: Nestle acquired Freshly in October 2020.

Architecture 52

Architecture Building Data Warehouse BI 52

ProjectPro

MAY 23, 2015

After knowing that consumers were increasingly concerned about the freshness of food, Walmart trained personnel to evaluate the quality of produce and showed food items to the customers before packing them. Walmart repurposed 200 of its existing outlets to provide grocery pickup in 30 cities.

Big Data 52

Big Data Data Analysis Hadoop Retail 52

ProjectPro

JULY 23, 2021

Food Panda, a food delivery app, is another famous example that implements this. AWS S3 allows you to store the dataset (CSV file) in S3 buckets for further processing, and CloudWatch keeps track of your data's log files and lets you analyze them as needed. Source Code- AWS Athena Big Data Project for Querying COVID-19 Data 25.

AWS 52

AWS Project Amazon Web Services Cloud Computing 52

Rockset

JUNE 2, 2020

4 Catch Your Data Easily and Quickly with MongoDB Atlas Data Lake Check out the power of MongoDB queries on massive-scale data in your data lake with real-world use cases from a self-proclaimed bald nerd. Understanding how the optimizer is powered is a key start to avoiding sluggish query performance.

MongoDB 52

MongoDB Data Lake Kafka NoSQL 52

Christophe Blefari

NOVEMBER 18, 2023

GoDaddy, layered architecture for a data lake — Naming conventions ideas and 5 data layers: source, raw, clean, enterprise and analytical. A few food for thought articles about data concepts and roles.

Food 147

Food Data Data Lake Retail 147

Christophe Blefari

NOVEMBER 8, 2024

Food for thoughts Docker for data products. Why Agile and Product Management fail with Data & AI? Lightdash raises $11m — I really like Lightdash, it's a promising great mix between a BI tool, a semantic layer, as code. Who’s really responsible for team failures?

Data 130

Data Kafka Food Data Preparation 130