Christophe Blefari

JULY 13, 2024

kyutai released Moshi — Moshi is a "voice-enabled AI" The team as kyutai developed the model with an audio interface-first with an audio language model, which make the conversation with the AI more real (demo at 5:00 min) as it can interrupt you or kinda "think" (meaning for predict the next audio segment) while it speaks.

Kafka 130

Kafka AWS Data Database 130

Data Engineering Podcast

JUNE 26, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Datasets 130

Datasets Unstructured Data Metadata MongoDB 130

Data Engineering Podcast

JULY 17, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Data Management 130

Data Management Management Metadata MongoDB 130

Snowflake

MAY 21, 2024

As Snowflake operates on the tables and writes data, OneLake will automatically convert the Iceberg metadata to Delta Lake format, without rewriting the Parquet files, so that Fabric engines can query the same tables. Similarly, Fabric OneLake enables Snowflake to read all OneLake data in Iceberg format, for consumption by Snowflake’s engine.

Metadata 123

Metadata Cloud Accessible Accessibility 123

Snowflake

JULY 25, 2024

It supports “fuzzy” search — the service takes in natural language queries and returns the most relevant text results, along with associated metadata. For document- or chunk-level access controls, you can use metadata filtering to ensure that the service only returns the results that the client is authorized to view.

Unstructured Data 111

Unstructured Data Metadata Government SQL 111

Snowflake

JANUARY 23, 2024

Snowpark ML Operations: Model management The path to production from model development starts with model management, which is the ability to track versioned model artifacts and metadata in a scalable, governed manner. The Snowpark Model Registry API provides simple catalog and retrieval operations on models.

Machine Learning 120

Machine Learning Metadata Python Telecommunication 120

Data Engineering Podcast

JUNE 12, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking all of that information into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Go to dataengineeringpodcast.com/atlan today to learn more about how you can take advantage of active metadata and escape the chaos.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Data Engineering Podcast

JULY 10, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

RandomTrees

APRIL 18, 2024

By leveraging Python’s capabilities, we can create scripts that analyze Informatica workflows, extract relevant metadata, and generate equivalent Talend jobs. Analysing Informatica Workflows : The first step in the conversion process is to analyze Informatica workflows to extract essential metadata and transformation logic.

Coding 52

Coding Retail Metadata Python 52

Monte Carlo

JULY 22, 2024

Maintaining metadata about each version. Implement Robust Metadata Management : Effective metadata management is crucial for our data versioning. We ensure that each version is accompanied by comprehensive metadata describing the changes and context, including details of which ETL processes were applied.

Metadata 52

Metadata Datasets ETL Tools Data 52

Data Engineering Podcast

JULY 3, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Architecture 100

Architecture Metadata MongoDB MySQL 100

Snowflake

JUNE 21, 2024

Metadata and evolution support : We’ve added structured-type schema evolution for flexibility as source systems or business reporting needs change. Get better Iceberg ecosystem interoperability with Primary Key information added to Iceberg table metadata. In the meantime, you can get hands-on with Iceberg today!

Data Lake 114

Data Lake BI Business Intelligence Metadata 114

The Pragmatic Engineer

NOVEMBER 3, 2022

Printing it loses all this metadata. On 29 Oct, Saturday morning, a new project kicked off, with the first demo due on Monday morning. The first demo was scheduled for Monday, 31 October, in the morning: only two days later. He indirectly mandated working over the weekend by setting a Monday morning demo deadline, on a Saturday.

Software Engineering 130

Software Engineering Software Engineer Coding Media 130

Data Engineering Podcast

JUNE 5, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking all of that information into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Go to dataengineeringpodcast.com/atlan today to learn more about how you can take advantage of active metadata and escape the chaos.

Data Security 100

Data Security Metadata MongoDB Scala 100

Snowflake

AUGUST 31, 2023

Catalog Integration: Our newly developed Catalog Integration feature allows you to seamlessly plug Snowflake into other Iceberg catalogs tracking table metadata. For metadata management, you can configure Snowflake to manage your Iceberg data or use an external Iceberg catalog. Have a Snowflake account and want to try this out?

Metadata 86

Metadata AWS Data Lake Datasets 86

Monte Carlo

AUGUST 30, 2024

Dremio is a true lakehouse platform with features that bring structure and governance to virtual datasets with defined schema, metadata storage, semantic layer and more. Get in touch for a personalized demo today. The Next Step In Your Lakehouse Journey If you’re using Dremio, it’s time to start safeguarding your data quality.

SQL 40

SQL Engineering Data Lake High Quality Data 40

Cloudera

JULY 13, 2023

In this blog, we will discuss performance improvement that Cloudera has contributed to the Apache Iceberg project in regards to Iceberg metadata reads, and we’ll showcase the performance benefit using Apache Impala as the query engine. Impala can access Hive table metadata fast because HMS is backed by RDBMS, such as mysql or postgresql.

Java 70

Java Metadata PostgreSQL Data Warehouse 70

Data Engineering Podcast

MAY 18, 2021

If you need to deliver unprecedented speed, cost savings, and simplified access to large scale, real-time data, visit dataengineeringpodcast.com/molecula and request a demo. What is the current state of the ecosystem for generating and sharing metadata between systems? What are your goals for the OpenLineage effort?

Metadata 100

Metadata Kafka Data Warehouse Hadoop 100

ThoughtSpot

JANUARY 31, 2024

Not only does ThoughtSpot not store your sample data or metadata, or use this information for model training, but we are also investing in bring-your-own and host-your-own model capabilities for both generative AI and machine learning models.

BI 105

BI Business Intelligence Machine Learning Metadata 105

Rockset

APRIL 18, 2023

To highlight these new capabilities, we built a search demo using OpenAI to create embeddings for Amazon product descriptions and Rockset to generate relevant search results. In the demo, you’ll see how Rockset delivers search results in 15 milliseconds over thousands of documents. What does this mean for search?

Unstructured Data 105

Unstructured Data Metadata Machine Learning SQL 105

Snowflake

NOVEMBER 1, 2023

It consists of Python APIs accessible through the Snowpark ML library, and SQL interfaces for defining, managing and retrieving features, along with managed infrastructure for feature metadata management and continuous feature processing. Check out the Snowpark ML demo from Snowday to see the latest launches in action.

Building 108

Building Python SQL Programming Language 108

Cloudera

FEBRUARY 8, 2024

The snapshotId of the source tables involved in the materialized view are also maintained in the metadata. A Note on Iceberg materialized view specification Currently, the metadata needed for materialized views is maintained in Hive Metastore and it builds upon the materialized views metadata previously supported for Hive ACID tables.

Metadata 90

Metadata Data Warehouse BI AWS 90

Data Engineering Podcast

NOVEMBER 20, 2022

Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. What are some of the data modeling considerations that need to be considered when pushing metadata to Sifflet? Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Lake 130

Data Lake Data Ingestion MongoDB Google Cloud 130

Cloudyard

DECEMBER 13, 2022

Moreover, We will use the below architecture to showcase the Demo where convert the existing Data Lake to Snowflake Deployment. DMS For this Demo we launched RDS service for ORACLE in AWS and created some tables. How customer has migrated On Premises EDW to Snowflake to leverage snowflake Data Lake capabilities.

Data Lake 52

Data Lake AWS Metadata Data 52

Data Engineering Weekly

OCTOBER 6, 2024

link] Sponsored: Monte Carlo Demo - October You want to deliver reliable business insights to your organization, but that probably means you’re spending a whole lotta time writing a whole lotta of rules. It updates the popular Pirate metrics (AARRR) framework by adding concepts like Attention and Adoption.

Data Engineer 62

Data Engineer Data Engineering Engineering Data Warehouse 62

Data Engineering Podcast

DECEMBER 16, 2019

The solution to discoverability and tracking of data lineage is to incorporate a metadata repository into your data platform. The metadata repository serves as a data catalog and a means of reporting on the health and status of your datasets when it is properly integrated into the rest of your tools.

Metadata 100

Metadata PostgreSQL Datasets Data Warehouse 100

Rockset

NOVEMBER 7, 2023

As a result, indexing of newly ingested vectors and metadata does not negatively impact search performance. Rockset supports streaming updates to metadata and vectors in an efficient way. Being built for search and analytics, Rockset treats metadata as a first-class citizen and supports documents up to 40MB in size.

Cloud 64

Cloud Metadata Database SQL 64

Christophe Blefari

JUNE 16, 2023

Malloy's Near Term Roadmap — I've shared recently Malloy demo , which was awesome. Masthead does not run SQL on your data—which generate costs uplift—but reading logs and metadata to identify anomalies. You can put space in BigQuery column names — The editors of blef.fr (me) have no comment.

Programming Language 130

Programming Language SQL PostgreSQL Data 130

Snowflake

JULY 25, 2024

It supports “fuzzy” search — the service takes in natural language queries and returns the most relevant text results, along with associated metadata. For document- or chunk-level access controls, you can use metadata filtering to ensure that the service only returns the results that the client is authorized to view.

Unstructured Data 52

Unstructured Data Metadata Government Database 52

Snowflake

JUNE 5, 2024

Governed internal collaboration with better discoverability and AI-powered object metadata The Internal Marketplace (private preview) introduces a new way for customers to boost secure collaboration, through a single directory of all data products specifically curated for use within an organization.

Government 101

Government Accessible Accessibility Cloud 101

Databand.ai

SEPTEMBER 12, 2022

Databand helps fix this problem by capturing the metadata from your datasets and then alerting you when dataset operations change unexpectedly. Wrapping it up For more information on how Databand can help you analyze and resolve dataset performance, check out our demo center or book a demo.

Datasets 52

Datasets Metadata Data Engineer Data Engineering 52

Cloudera

JULY 14, 2023

They simply read the underlying data (not even full read, they just read the parquet headers) and create corresponding Iceberg metadata files. Query engines (Impala, Hive, Spark) might mitigate some of these problems by using Iceberg’s metadata files. Hive creates Iceberg’s metadata files for the same exact table.

Metadata 69

Metadata Data Warehouse Big Data Ecosystem Java 69

The Modern Data Company

MARCH 7, 2023

A data taxonomy uses a system of unambiguous metadata terms (such as a filename or tags attached to a file) that allow an enterprise to classify a file or dataset into important business categories. For various reasons, the data sometimes can’t be re-tagged to provide consistent metadata. How Does Taxonomy Aid Data Governance?

Data Governance 52

Data Governance Government Metadata Datasets 52

Datakin

SEPTEMBER 13, 2021

Datakin observes your jobs as they run, collecting metadata that helps you understand how data flows through your ecosystem. View our instant demo system right now, or sign up for Datakin to see it with your own datasets and jobs. Blog Datakin in 104 seconds Written by Ross Turk on Sep 13, 2021 Hi!

Metadata 52

Metadata Datasets Data Pipeline Systems 52

Monte Carlo

AUGUST 6, 2024

Implement these best practices to enhance your data integrity: Clear Documentation and Metadata Management : Ensure all your data assets and transformations are well-documented. Enter your email below to schedule a demo today and learn more about how Monte Carlo can protect and optimize your data warehouse.

Data Warehouse 52

Data Warehouse Raw Data BI Machine Learning 52

The Modern Data Company

APRIL 15, 2024

It’s a combination of the data itself, the metadata (information about the data), code (the set of instructions on how to process or analyze the data), and infrastructure (the technological framework that supports it all). This “metadata” acts as the soul of your data, enriching it and making it more valuable.

Government 52

Government Metadata Data Data Management 52

Netflix Tech

MARCH 10, 2021

Access the AWS console ( docs , talk , demo ) ConsoleMe allows users to access the AWS console through the use of temporary IAM role credentials. Utilize ConsoleMe’s native policy editors for advanced requests ( docs , talk , demo ) ConsoleMe offers a native policy editor for popular resource types. Where can I learn more?

AWS 102

AWS Accessibility Accessible Cloud 102