Data Engineering Podcast

FEBRUARY 27, 2022

Summary There are a wealth of options for managing structured and textual data, but unstructured binary data assets are not as well supported across the ecosystem. Contact Info LinkedIn @cloudKrishna on Twitter Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Unstructured Data 100

Unstructured Data Cloud Management Metadata 100

Cloudera

FEBRUARY 7, 2023

By providing access to financial services, banks can help underserved communities save for the future, invest in education and business opportunities, and build financial resilience. Cloudera Data Platform (CDP) has also been instrumental in helping banks solve the issue of financial inclusion in underserved communities.

Banking 81

Banking Technology Insurance Unstructured Data 81

Data Engineering Podcast

JUNE 26, 2022

In this episode Isaac Brodsky explains how the Unfolded platform is architected, their experience joining the team at Foursquare, and how you can start using it for analyzing your spatial data today. Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows.

Datasets 130

Datasets Unstructured Data Metadata MongoDB 130

Snowflake

MARCH 19, 2024

Since the explosion of interest in generative AI and large language models (LLMs), that is more true than ever, with business leaders discussing how quickly they should adopt these technologies to stay competitive. Strong data governance is essential to meet security and compliance obligations, but it is often regarded as a hindrance.

Data Governance 122

Data Governance Government Unstructured Data Programming Language 122

Cloudera

JUNE 11, 2024

By leveraging an organization’s proprietary data, GenAI models can produce highly relevant and customized outputs that align with the business’s specific needs and objectives. Structured data is highly organized and formatted in a way that makes it easily searchable in databases and data warehouses.

Unstructured Data 98

Unstructured Data Pharmaceutical Banking Manufacturing 98

AltexSoft

MAY 12, 2022

But acoustic signals can tell us even more if analyze them using modern technologies. Aiming at understanding sound data, it applies a range of technologies, including state-of-the-art deep learning algorithms. Audio data file formats. Building an app for snore and teeth grinding detection. Voice recognition.

Machine Learning 122

Machine Learning Building Deep Learning Healthcare 122

Towards Data Science

FEBRUARY 9, 2024

How to build a modern, scalable data platform to power your analytics and data science projects (updated) Table of Contents: What’s changed? The Platform Integration Data Store Transformation Orchestration Presentation Transportation Observability Closing What’s changed?

Building 76

Building Transportation Data Lake Metadata 76

Data Engineering Podcast

JUNE 19, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Metadata 130

Metadata Unstructured Data MongoDB MySQL 130

Snowflake

APRIL 8, 2024

In 2020, Snowflake announced a new global competition to recognize the work of early-stage startups building their apps — and their businesses — on Snowflake, offering up to $250,000 in investment as the top prize. In fact, 8 of the 10 startups in our semi-finalist list plan to use one or both of these technologies in their offerings.

Pipeline-centric 129

Pipeline-centric Food Healthcare Unstructured Data 129

Snowflake

NOVEMBER 1, 2023

That’s why we created Snowflake Cortex (in private preview), Snowflake’s new, intelligent, fully managed service that enables organizations to quickly analyze data and build AI applications — all within Snowflake. This means anyone who knows Python can securely build powerful LLM apps in minutes or hours, not days or weeks.

Unstructured Data 111

Unstructured Data SQL Python Accessible 111

Rockset

APRIL 18, 2023

Join me and Rockset VP of Engineering Louis Brandy for a tech talk, From Spam Fighting at Facebook to Vector Search at Rockset: How to Build Real-Time Machine Learning at Scale , on May 17th at 9am PT/ 12pm ET. Due to these difficulties, unstructured data has remained largely underutilized. Why use vector search?

Unstructured Data 105

Unstructured Data Metadata Machine Learning SQL 105

Snowflake

JUNE 5, 2024

Enterprises can utilize gen AI to extract more value from their data and build conversational interfaces for customer and employee applications. Snowflake Cortex AI is a fully managed service designed to unlock the potential of the technology for everyone within an organization, regardless of their technical expertise.

Coding 93

Coding Building Management Government 93

Snowflake

JULY 25, 2024

Snowflake Cortex Search, a fully managed search service for documents and other unstructured data, is now in public preview. Solving the challenges of building high-quality RAG applications From the beginning, Snowflake’s mission has been to empower customers to extract more value from their data.

Unstructured Data 115

Unstructured Data Metadata Government SQL 115

Snowflake

NOVEMBER 11, 2024

At Snowflake BUILD , we are introducing powerful new features designed to accelerate building and deploying generative AI applications on enterprise data, while helping you ensure trust and safety. Customers such as Avios, CHG Healthcare and Keysight Technologies are already developing container-based models in Snowflake ML.

Unstructured Data 82

Unstructured Data SQL AWS Healthcare 82

Team Data Science

FEBRUARY 23, 2021

If you ever have to explain to friends or colleagues why data capabilities are crucial to navigating the future of work and innovation, try this storytelling tactic. Briefly narrate the modern history of digital technology in these few easy steps. This is digitalization in the making [ , 7 ]. 22 , , 23 , , 24 , , 25 ].

Business Intelligence 130

Business Intelligence Food Unstructured Data Relational Database 130

Snowflake

SEPTEMBER 19, 2023

With all the hoopla around AI, there’s a lot to get up to speed on—especially the implications this technology has for data analytics. Ahmad has not only witnessed the emergence of AI in the data space but helped shape it throughout his career. AI unlocks new data use cases. Some takeaways?

Machine Learning 101

Machine Learning Unstructured Data Data Analytics Government 101

Data Engineering Weekly

OCTOBER 11, 2024

This next phase, the AI-Native Data Stack , will fundamentally alter how we build, maintain, and scale data systems. The Monolithic Era: Giants of Steel and Data Think of iconic structures like the Empire State Building , the Golden Gate Bridge , and the Hoover Dam. All rights reserved ProtoGrowth Inc, India.

Manufacturing 111

Manufacturing Transportation Data Warehouse Unstructured Data 111

Cloudera

MAY 14, 2024

Hybrid cloud plays a central role in many of today’s emerging innovations—most notably artificial intelligence (AI) and other emerging technologies that create new business value and improve operational efficiencies. But getting there requires data, and a lot of it. Data comes in many forms.

Cloud 104

Cloud Data Governance Unstructured Data Data Architecture 104

Snowflake

JULY 10, 2023

“California Air Resources Board has been exploring processing atmospheric data delivered from four different remote locations via instruments that produce netCDF files. Previously, working with these large and complex files would require a unique set of tools, creating data silos. ” U.S.

Unstructured Data 40

Unstructured Data Python Process Scala 40

Data Engineering Podcast

JUNE 12, 2022

Summary Building a well rounded and effective data team is an iterative process, and the first hire can set the stage for future success or failure. Trupti Natu has been the first data hire multiple times and gone through the process of building teams across the different stages of growth.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Cloudera

DECEMBER 11, 2020

These include the use of more data sources to gain insights and how cloud technologies can assist with digital transformation goals to be more agile and achieve objectives more quickly. Data Variety. Insurance and finance are two industries that rely on measuring risk with historical data models.

Insurance 100

Insurance Unstructured Data Finance Machine Learning 100

Cloudera

JULY 26, 2021

Once we have identified those capabilities, the second article explores how the Cloudera Data Platform delivers those prerequisite capabilities and has enabled organizations such as IQVIA to innovate in Healthcare with the Human Data Science Cloud. . Business and Technology Forces Shaping Data Product Development.

Generalist 120

Generalist Telecommunication Healthcare Data Science 120

Snowflake

NOVEMBER 2, 2023

Over the years, the technology landscape for data management has given rise to various architecture patterns, each thoughtfully designed to cater to specific use cases and requirements. Use cases change, needs change, technology changes – and therefore data infrastructure should be able to scale and evolve with change.

Data Lake 97

Data Lake Data Warehouse Cloud Unstructured Data 97

Data Engineering Podcast

FEBRUARY 24, 2019

Summary Deep learning is the latest class of technology that is gaining widespread interest. As data engineers we are responsible for building and managing the platforms that power these models. What is involved in building a data pipeline and production infrastructure for a deep learning product?

Deep Learning 100

Deep Learning Data Engineering Data Engineer Engineering 100

Cloudera

JUNE 7, 2022

In the past decade, the amount of structured data created, captured, copied, and consumed globally has grown from less than 1 ZB in 2011 to nearly 14 ZB in 2020. Impressive, but dwarfed by the amount of unstructured data, cloud data, and machine data – another 50 ZB. The future is hybrid data, embrace it.

IT 118

IT Unstructured Data Data Architecture Government 118

Monte Carlo

NOVEMBER 26, 2024

Operational use cases were rising to the surface, technology was reducing barriers to entry, and general artificial intelligence was obviously right around the corner. Small data is the future of AI (Tomasz) 7. The lines are blurring for analysts and data engineers (Barr) 8. The unstructured data stack will emerge (Barr) 10.

Data Engineering 59

Data Engineering Data Engineer Engineering Unstructured Data 59

Snowflake

MAY 9, 2024

From its start with efficient batch processing with data warehouses for descriptive analytics, and the inclusion of streaming data in real time to build recommendations, we find ourselves at the forefront of a new stage of evolution: generative AI (gen AI). It’s already having a real-world impact. “It’s

Unstructured Data 100

Unstructured Data Manufacturing Retail Data Warehouse 100

Snowflake

JANUARY 18, 2024

A robust, flexible architecture Snowflake’s unique architecture is designed to handle the full volume, velocity and variety of data without making manufacturers deal with downtime for upgrades or compute changes. Built-in automation eliminates the need for customers to build indexes or do housekeeping.

Manufacturing 93

Manufacturing Unstructured Data Cloud Architecture 93

Data Engineering Podcast

SEPTEMBER 14, 2020

I’m working with O’Reilly on a project to collect the 97 things that every data engineer should know, and I need your help. When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Process 100

Process Unstructured Data Metadata Data Engineering 100

Edureka

JUNE 7, 2024

In this article, we will take a closer look at two of the most talked about and widely used AI technologies of 2024 – generative AI and predictive AI. Table of Contents Generative AI vs Predictive AI – Comparison Table Generative AI 101: A Revolutionary Cocktail of Technology and Art How Does Generative AI Work?

Deep Learning 114

Deep Learning Media Manufacturing Algorithm 114

Cloudera

OCTOBER 28, 2020

To start, they look to traditional financial services data, combining and correlating account activity, borrowing history, core banking, investments, and call center data. While Rabobank has always had access to this data, drawing meaningful insight from it was a different matter. .

Unstructured Data 76

Unstructured Data Banking Machine Learning Media 76

Snowflake

JANUARY 25, 2024

It’s essential for organizations to leverage vast amounts of structured and unstructured data for effective generative AI (gen AI) solutions that deliver a clear return on investment. Introducing new technologies is integral to solving these staffing and operational inefficiency challenges.

Healthcare 94

Healthcare Hospitality Electronics Medical 94

Monte Carlo

OCTOBER 31, 2024

AI data engineers tend to focus primarily on AI, generative AI (GenAI), and machine learning (ML)-specific needs, like handling unstructured data and supporting real-time analytics. The ability and skills to build scalable, automated data pipelines. Let’s dive into what that means.

Data Engineering 52

Data Engineering Data Engineer Engineering Unstructured Data 52

Data Engineering Podcast

JULY 31, 2022

In this episode Ernie Ostic shares the approach that he and his team at Manta are taking to build a complete view of data lineage across the various data systems in your organization and the useful applications of that information in the work of every data stakeholder. Can you describe how Manta is implemented?

IT 100

IT Metadata MongoDB MySQL 100

DataKitchen

APRIL 13, 2021

Airflow — An open-source platform to programmatically author, schedule, and monitor data pipelines. DBT (Data Build Tool) — A command-line tool that enables data analysts and engineers to transform data in their warehouse more effectively. Genie — Distributed big data orchestration service by Netflix.

Consulting 124

Consulting Machine Learning Data Science Data Pipeline 124

Cloudera

OCTOBER 5, 2023

Using data effectively is the key to competing in today’s world as customer expectations continue to rise. Moving from a best guess mindset to a data driven organization requires a significant shift throughout the organization in terms of technology, processes, and culture.

Data Governance 89

Data Governance Unstructured Data Government High Quality Data 89

Snowflake

SEPTEMBER 21, 2023

The marketing technology landscape has exploded in the last decade. In this post, we’ll take a look at how leading vendors in the 2023 Modern Marketing Data Stack are differentiating their products in a crowded market. The data driving the provider’s application is stored and processed in the provider’s own Snowflake account.

Google Cloud 91

Google Cloud Unstructured Data Technology Data 91