Data Engineering Podcast

JUNE 26, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Datasets 130

Datasets Unstructured Data Metadata MongoDB 130

Snowflake

MAY 21, 2024

As Snowflake operates on the tables and writes data, OneLake will automatically convert the Iceberg metadata to Delta Lake format, without rewriting the Parquet files, so that Fabric engines can query the same tables. Similarly, Fabric OneLake enables Snowflake to read all OneLake data in Iceberg format, for consumption by Snowflake’s engine.

Metadata 136

Metadata Cloud Accessible Accessibility 136

Data Engineering Podcast

JULY 17, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Data Management 130

Data Management Management Metadata MongoDB 130

Snowflake

JANUARY 23, 2024

Snowpark ML Operations: Model management The path to production from model development starts with model management, which is the ability to track versioned model artifacts and metadata in a scalable, governed manner. The Snowpark Model Registry API provides simple catalog and retrieval operations on models.

Machine Learning 137

Machine Learning Metadata Python Telecommunication 137

Precisely

NOVEMBER 14, 2023

This journey must include a strong data governance framework to align people, processes, and technology, and enable them to understand and trust their data and metadata to achieve their business objectives. Does our organization’s data governance service include visibility and transparency of our spatial data and their metadata?

Data Governance 119

Data Governance Government Metadata Retail 119

Snowflake

JULY 25, 2024

It supports “fuzzy” search — the service takes in natural language queries and returns the most relevant text results, along with associated metadata. For document- or chunk-level access controls, you can use metadata filtering to ensure that the service only returns the results that the client is authorized to view.

Unstructured Data 131

Unstructured Data Metadata Government SQL 131

Snowflake

APRIL 11, 2024

Not only do we have a unique vantage point into the challenges faced by data analysts, we also possess rich metadata that feeds into Snowflake’s dedicated text-to-SQL model that Copilot leverages in combination with Mistral’s technology. Or, experience Copilot firsthand at our free Dev Day event on June 6th in the Demo Zone!

SQL 140

SQL Data Analysis AWS High Quality Data 140

The Pragmatic Engineer

NOVEMBER 3, 2022

Printing it loses all this metadata. On 29 Oct, Saturday morning, a new project kicked off, with the first demo due on Monday morning. The first demo was scheduled for Monday, 31 October, in the morning: only two days later. He indirectly mandated working over the weekend by setting a Monday morning demo deadline, on a Saturday.

Software Engineer 130

Software Engineer Software Engineering Coding Media 130

Data Engineering Podcast

DECEMBER 16, 2019

The solution to discoverability and tracking of data lineage is to incorporate a metadata repository into your data platform. The metadata repository serves as a data catalog and a means of reporting on the health and status of your datasets when it is properly integrated into the rest of your tools.

Metadata 100

Metadata PostgreSQL Datasets Data Warehouse 100

Snowflake

JUNE 21, 2024

Metadata and evolution support : We’ve added structured-type schema evolution for flexibility as source systems or business reporting needs change. Get better Iceberg ecosystem interoperability with Primary Key information added to Iceberg table metadata. In the meantime, you can get hands-on with Iceberg today!

Data Lake 124

Data Lake BI Business Intelligence Metadata 124

Data Engineering Podcast

JUNE 12, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking all of that information into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Go to dataengineeringpodcast.com/atlan today to learn more about how you can take advantage of active metadata and escape the chaos.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Christophe Blefari

JULY 13, 2024

kyutai released Moshi — Moshi is a "voice-enabled AI" The team as kyutai developed the model with an audio interface-first with an audio language model, which make the conversation with the AI more real (demo at 5:00 min) as it can interrupt you or kinda "think" (meaning for predict the next audio segment) while it speaks.

Kafka 130

Kafka AWS Data Database 130

Data Engineering Podcast

JULY 10, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Metadata 100

Metadata MongoDB MySQL Machine Learning 100

Snowflake

AUGUST 31, 2023

Catalog Integration: Our newly developed Catalog Integration feature allows you to seamlessly plug Snowflake into other Iceberg catalogs tracking table metadata. For metadata management, you can configure Snowflake to manage your Iceberg data or use an external Iceberg catalog. Have a Snowflake account and want to try this out?

Metadata 104

Metadata AWS Data Lake Datasets 104

Data Engineering Podcast

MAY 18, 2021

If you need to deliver unprecedented speed, cost savings, and simplified access to large scale, real-time data, visit dataengineeringpodcast.com/molecula and request a demo. What is the current state of the ecosystem for generating and sharing metadata between systems? What are your goals for the OpenLineage effort?

Metadata 100

Metadata Kafka Data Warehouse Hadoop 100

Data Engineering Podcast

JULY 3, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Architecture 100

Architecture Metadata MongoDB MySQL 100

Confluent

APRIL 11, 2019

For this demo, I’ll use one of my favorite public feeds: real-time reservations in Meetup groups around the world. Given that events are produced in real time and at a reasonable pace, the Meetup feed is pretty handy for demos with real data. How about we take it for a spin? Try it yourself!

Kafka 110

Kafka AWS Metadata Architecture 110

Snowflake

FEBRUARY 12, 2025

Additionally, Cortex Search supports date-range filtering on metadata columns. Watch the demo: See Cortex Agents in action. Improved customizability Cortex Search now provides the ability to select the vector embedding model for semantic search. This includes two multilingual models, snowflake-arctic-embed-l-v2.0 ai and Seek AI.

Unstructured Data 80

Unstructured Data Government SQL Structured Data 80

Confluent

APRIL 10, 2019

For example, when Confluent Monitoring Interceptors are configured on Kafka clients, they write metadata to a Kafka topic called _confluent-monitoring. In one command, this demo environment brings up an active-active multi-datacenter environment with Confluent Replicator copying data bidirectionally. Try it out yourself.

Kafka 87

Kafka Java Metadata Cloud 87

Data Engineering Podcast

NOVEMBER 20, 2022

Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. What are some of the data modeling considerations that need to be considered when pushing metadata to Sifflet? Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Lake 130

Data Lake Data Ingestion MongoDB MySQL 130

Snowflake

NOVEMBER 1, 2023

It consists of Python APIs accessible through the Snowpark ML library, and SQL interfaces for defining, managing and retrieving features, along with managed infrastructure for feature metadata management and continuous feature processing. Check out the Snowpark ML demo from Snowday to see the latest launches in action.

Building 119

Building Python SQL Programming Language 119

The Modern Data Company

JANUARY 22, 2024

Data products contain data and its metadata, code, and infrastructure so that each product is self-contained and usable independently. These features elevate the data integration process, leveraging extensive metadata, AI, and ML algorithms. Operational data integration leadership DataOS supports a broad spectrum of use cases.

Data Integration 98

Data Integration Metadata Government Unstructured Data 98

Netflix Tech

MARCH 10, 2021

Access the AWS console ( docs , talk , demo ) ConsoleMe allows users to access the AWS console through the use of temporary IAM role credentials. Utilize ConsoleMe’s native policy editors for advanced requests ( docs , talk , demo ) ConsoleMe offers a native policy editor for popular resource types. Where can I learn more?

AWS 105

AWS Accessible Accessibility Cloud 105

Data Engineering Podcast

JUNE 5, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking all of that information into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Go to dataengineeringpodcast.com/atlan today to learn more about how you can take advantage of active metadata and escape the chaos.

Data Security 100

Data Security Metadata MongoDB MySQL 100

Rockset

APRIL 18, 2023

To highlight these new capabilities, we built a search demo using OpenAI to create embeddings for Amazon product descriptions and Rockset to generate relevant search results. In the demo, you’ll see how Rockset delivers search results in 15 milliseconds over thousands of documents. What does this mean for search?

Unstructured Data 105

Unstructured Data Metadata Machine Learning SQL 105

Striim

MARCH 21, 2025

Schedule a demo and well give you a personalized walkthrough or try Striim at production-scale for free! This would potentially require you to change your database log parsing logic with each new database release. Small data volumes or hoping to get hands on quickly? At Striim we also offer a free developer version.

IT 52

IT Data Lake Relational Database Data Warehouse 52

Snowflake

JUNE 5, 2024

Governed internal collaboration with better discoverability and AI-powered object metadata The Internal Marketplace (private preview) introduces a new way for customers to boost secure collaboration, through a single directory of all data products specifically curated for use within an organization.

Government 115

Government Accessibility Accessible Cloud 115

Christophe Blefari

JUNE 16, 2023

Malloy's Near Term Roadmap — I've shared recently Malloy demo , which was awesome. Masthead does not run SQL on your data—which generate costs uplift—but reading logs and metadata to identify anomalies. You can put space in BigQuery column names — The editors of blef.fr (me) have no comment.

Programming Language 130

Programming Language SQL PostgreSQL Data 130

Data Engineering Podcast

SEPTEMBER 23, 2018

Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science. Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science.

Data Lake 100

Data Lake Data Warehouse Data Architecture Architecture 100

The Modern Data Company

JANUARY 22, 2024

Data products contain data and its metadata, code, and infrastructure so that each product is self-contained and usable independently. Augmented data integration, self-service data preparation, metadata support, and data governance are key strengths. Operational data integration leadership DataOS supports a broad spectrum of use cases.

Data Integration 87

Data Integration Metadata Government Unstructured Data 87

ThoughtSpot

JANUARY 31, 2024

Not only does ThoughtSpot not store your sample data or metadata, or use this information for model training, but we are also investing in bring-your-own and host-your-own model capabilities for both generative AI and machine learning models.

BI 106

BI Machine Learning Business Intelligence Metadata 106

Striim

MARCH 4, 2025

It logs each event with AI-enhanced metadata for effective tracking and auditing, while its adaptive design accommodates evolving data sources through schema evolution. Try Striim today with a free trial or book a demo to see it in action. Start Your Free Trial | Schedule a Demo

Data Governance 40

Data Governance Government Healthcare NoSQL 40

Cloudera

FEBRUARY 8, 2024

The snapshotId of the source tables involved in the materialized view are also maintained in the metadata. A Note on Iceberg materialized view specification Currently, the metadata needed for materialized views is maintained in Hive Metastore and it builds upon the materialized views metadata previously supported for Hive ACID tables.

Metadata 91

Metadata Data Warehouse BI AWS 91

Cloudera

SEPTEMBER 15, 2022

Apache Ozone achieves this significant capability through the use of some novel architectural choices by introducing bucket type in the metadata namespace server. Provides high performance namespace metadata operations similar to HDFS. BucketLayout Feature Demo , describes the ozone shell, ozoneFS and aws cli operations.

Systems 87

Systems Hadoop Metadata Telecommunication 87

Snowflake

OCTOBER 2, 2023

To achieve a viable customer 360 solution at scale, a data team must: Build and maintain an identity graph Compute complex user traits Represent funnels as part of the journey Maintain metadata for predictive traits that change over time This work is complex and laborious. Click here to request a demo of Profiles.

Cloud 115

Cloud Building Insurance Data Engineering 115

Cloudera

JULY 13, 2023

In this blog, we will discuss performance improvement that Cloudera has contributed to the Apache Iceberg project in regards to Iceberg metadata reads, and we’ll showcase the performance benefit using Apache Impala as the query engine. Impala can access Hive table metadata fast because HMS is backed by RDBMS, such as mysql or postgresql.

Java 70

Java Metadata PostgreSQL Data Warehouse 70

Snowflake

MARCH 12, 2024

It also provides metadata on what assumptions and fixes were used to inform the address match. Use our Quickstart to learn how to geocode address data with Mapbox’s native app, or watch a quick two-minute demo to see how Mapbox used the Snowflake Native App Framework to create its native app.

Business Analyst 115

Business Analyst Retail Data Analysis Business Intelligence 115