Snowflake

JANUARY 23, 2024

Snowpark ML Operations: Model management The path to production from model development starts with model management, which is the ability to track versioned model artifacts and metadata in a scalable, governed manner. The Snowpark Model Registry API provides simple catalog and retrieval operations on models.

Machine Learning 132

Machine Learning Metadata Python Telecommunication 132

Snowflake

JULY 25, 2024

It supports “fuzzy” search — the service takes in natural language queries and returns the most relevant text results, along with associated metadata. For document- or chunk-level access controls, you can use metadata filtering to ensure that the service only returns the results that the client is authorized to view.

Unstructured Data 124

Unstructured Data Metadata Government SQL 124

The Pragmatic Engineer

NOVEMBER 3, 2022

Printing it loses all this metadata. On 29 Oct, Saturday morning, a new project kicked off, with the first demo due on Monday morning. The first demo was scheduled for Monday, 31 October, in the morning: only two days later. He indirectly mandated working over the weekend by setting a Monday morning demo deadline, on a Saturday.

Software Engineer 130

Software Engineer Software Engineering Coding Media 130

Data Engineering Podcast

DECEMBER 16, 2019

The solution to discoverability and tracking of data lineage is to incorporate a metadata repository into your data platform. The metadata repository serves as a data catalog and a means of reporting on the health and status of your datasets when it is properly integrated into the rest of your tools.

Metadata 100

Metadata PostgreSQL Datasets Data Warehouse 100

Data Engineering Podcast

JUNE 12, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking all of that information into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Go to dataengineeringpodcast.com/atlan today to learn more about how you can take advantage of active metadata and escape the chaos.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Snowflake

JUNE 21, 2024

Metadata and evolution support : We’ve added structured-type schema evolution for flexibility as source systems or business reporting needs change. Get better Iceberg ecosystem interoperability with Primary Key information added to Iceberg table metadata. In the meantime, you can get hands-on with Iceberg today!

Data Lake 123

Data Lake BI Business Intelligence Metadata 123

Christophe Blefari

JULY 13, 2024

kyutai released Moshi — Moshi is a "voice-enabled AI" The team as kyutai developed the model with an audio interface-first with an audio language model, which make the conversation with the AI more real (demo at 5:00 min) as it can interrupt you or kinda "think" (meaning for predict the next audio segment) while it speaks.

Kafka 130

Kafka AWS Data Database 130

Data Engineering Podcast

JULY 10, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

Data Engineering Podcast

MAY 18, 2021

If you need to deliver unprecedented speed, cost savings, and simplified access to large scale, real-time data, visit dataengineeringpodcast.com/molecula and request a demo. What is the current state of the ecosystem for generating and sharing metadata between systems? What are your goals for the OpenLineage effort?

Metadata 100

Metadata Kafka Data Warehouse Hadoop 100

Data Engineering Podcast

JULY 3, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Atlan is the metadata hub for your data ecosystem.

Architecture 100

Architecture Metadata MongoDB MySQL 100

Confluent

APRIL 11, 2019

For this demo, I’ll use one of my favorite public feeds: real-time reservations in Meetup groups around the world. Given that events are produced in real time and at a reasonable pace, the Meetup feed is pretty handy for demos with real data. How about we take it for a spin? Try it yourself!

Kafka 110

Kafka AWS Metadata Architecture 110

Confluent

APRIL 10, 2019

For example, when Confluent Monitoring Interceptors are configured on Kafka clients, they write metadata to a Kafka topic called _confluent-monitoring. In one command, this demo environment brings up an active-active multi-datacenter environment with Confluent Replicator copying data bidirectionally. Try it out yourself.

Kafka 87

Kafka Java Metadata Cloud 87

Data Engineering Podcast

NOVEMBER 20, 2022

Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. What are some of the data modeling considerations that need to be considered when pushing metadata to Sifflet? Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Lake 130

Data Lake Data Ingestion MongoDB Google Cloud 130

Snowflake

NOVEMBER 1, 2023

It consists of Python APIs accessible through the Snowpark ML library, and SQL interfaces for defining, managing and retrieving features, along with managed infrastructure for feature metadata management and continuous feature processing. Check out the Snowpark ML demo from Snowday to see the latest launches in action.

Building 117

Building Python SQL Programming Language 117

Data Engineering Podcast

JUNE 5, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking all of that information into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Go to dataengineeringpodcast.com/atlan today to learn more about how you can take advantage of active metadata and escape the chaos.

Data Security 100

Data Security Metadata MongoDB MySQL 100

Snowflake

AUGUST 31, 2023

Catalog Integration: Our newly developed Catalog Integration feature allows you to seamlessly plug Snowflake into other Iceberg catalogs tracking table metadata. For metadata management, you can configure Snowflake to manage your Iceberg data or use an external Iceberg catalog. Have a Snowflake account and want to try this out?

Metadata 98

Metadata AWS Data Lake Datasets 98

Rockset

APRIL 18, 2023

To highlight these new capabilities, we built a search demo using OpenAI to create embeddings for Amazon product descriptions and Rockset to generate relevant search results. In the demo, you’ll see how Rockset delivers search results in 15 milliseconds over thousands of documents. What does this mean for search?

Unstructured Data 105

Unstructured Data Metadata Machine Learning SQL 105

Netflix Tech

MARCH 10, 2021

Access the AWS console ( docs , talk , demo ) ConsoleMe allows users to access the AWS console through the use of temporary IAM role credentials. Utilize ConsoleMe’s native policy editors for advanced requests ( docs , talk , demo ) ConsoleMe offers a native policy editor for popular resource types. Where can I learn more?

AWS 102

AWS Accessibility Accessible Cloud 102

Confluent

SEPTEMBER 13, 2019

Consumer rebalance demo. Specifically, it nominates one of the members as the leader and replies to the leader with encoded membership and subscription metadata. The leader shall complete the assignment based on membership and topic metadata information, and reply to the coordinator with the assignment information. or higher.

Kafka 21

Kafka Cloud Metadata Process 21

DataKitchen

FEBRUARY 20, 2025

Better Metadata Management Add Descriptions and Data Product tags to tables and columns in the Data Catalog for improved governance. Watch the Launch Webinar Here: [link] Download Now Request Demo Smarter Profiling & Test Generation Improved logic reduces false positives , making test results more accurate and actionable.

Datasets 78

Datasets Metadata Data Government 78

Christophe Blefari

JUNE 16, 2023

Malloy's Near Term Roadmap — I've shared recently Malloy demo , which was awesome. Masthead does not run SQL on your data—which generate costs uplift—but reading logs and metadata to identify anomalies. You can put space in BigQuery column names — The editors of blef.fr (me) have no comment.

Programming Language 130

Programming Language SQL PostgreSQL Data 130

Data Engineering Podcast

SEPTEMBER 23, 2018

Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science. Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science.

Data Lake 100

Data Lake Data Warehouse Data Architecture Architecture 100

Snowflake

JUNE 5, 2024

Governed internal collaboration with better discoverability and AI-powered object metadata The Internal Marketplace (private preview) introduces a new way for customers to boost secure collaboration, through a single directory of all data products specifically curated for use within an organization.

Government 112

Government Accessible Accessibility Cloud 112

ThoughtSpot

JANUARY 31, 2024

Not only does ThoughtSpot not store your sample data or metadata, or use this information for model training, but we are also investing in bring-your-own and host-your-own model capabilities for both generative AI and machine learning models.

BI 105

BI Machine Learning Business Intelligence Metadata 105

Cloudera

DECEMBER 10, 2020

These techniques range from distributing concurrent query for overall throughput to metadata caching, data caching, and results caching. CDW saves time and resources for end-user workloads but does not compromise metadata availability. 700 / month for security and metadata service . $90 These techniques directly reduce costs. .

Data Warehouse 98

Data Warehouse Cloud Storage Metadata Data 98

Cloudera

FEBRUARY 8, 2024

The snapshotId of the source tables involved in the materialized view are also maintained in the metadata. A Note on Iceberg materialized view specification Currently, the metadata needed for materialized views is maintained in Hive Metastore and it builds upon the materialized views metadata previously supported for Hive ACID tables.

Metadata 91

Metadata Data Warehouse BI AWS 91

Cloudera

SEPTEMBER 15, 2022

Apache Ozone achieves this significant capability through the use of some novel architectural choices by introducing bucket type in the metadata namespace server. Provides high performance namespace metadata operations similar to HDFS. BucketLayout Feature Demo , describes the ozone shell, ozoneFS and aws cli operations.

Systems 87

Systems Hadoop Metadata Telecommunication 87

Ascend.io

APRIL 22, 2024

A unified platform that combines a powerful metadata core, an extensible plugin architecture, DataAware automation, and multiple AI Assistants. Plus, we’ll offer a teaser of what’s to come: an exclusive live demo that you simply cannot miss. Let’s dive in!

Project 52

Project Metadata Data Pipeline Data Engineering 52

Cloudera

JULY 13, 2023

In this blog, we will discuss performance improvement that Cloudera has contributed to the Apache Iceberg project in regards to Iceberg metadata reads, and we’ll showcase the performance benefit using Apache Impala as the query engine. Impala can access Hive table metadata fast because HMS is backed by RDBMS, such as mysql or postgresql.

Java 70

Java Metadata PostgreSQL Data Warehouse 70

Snowflake

OCTOBER 2, 2023

To achieve a viable customer 360 solution at scale, a data team must: Build and maintain an identity graph Compute complex user traits Represent funnels as part of the journey Maintain metadata for predictive traits that change over time This work is complex and laborious. Click here to request a demo of Profiles.

Cloud 114

Cloud Building Insurance Data Engineering 114

Precisely

JULY 18, 2024

Data management recommendations and data products emerge dynamically from the fabric through automation, activation, and AI/ML analysis of metadata. A data product is a reusable set of data, metadata, semantics, and templates that are curated and maintained to be immediately useful for specific business objectives.

Data Management 52

Data Management Management Metadata Database-centric 52

Cloudera

NOVEMBER 23, 2021

Atlas provides open metadata management and governance capabilities to build a catalog of all assets, and also classify and govern these assets. Security and governance policies are set once and applied across all data and workloads. The SDX layer of CDP leverages the full spectrum of Atlas to automatically track and control all data assets.

Database 91

Database Non-relational Database NoSQL Government 91

Cloudera

AUGUST 4, 2021

The data is profiled and enhanced with rich metadata—including operational, social, and business context—creating trusted and reusable data assets and making them discoverable. Putting metadata to work here is like using an automated roadmap to locate the right information more quickly than having to scan large data loads from top to bottom.

Data Governance 86

Data Governance Government Metadata Data Security 86

Databand.ai

JUNE 28, 2023

Request a demo from one of our experts. centralizes your pipeline metadata so you can get end-to-end observability into your data pipelines, identify the root cause of health issues quickly, and fix the problem fast. To learn more about Databand and how our platform helps data engineers with their data pipelines, request a demo !

Data Pipeline 98

Data Pipeline Data Engineering Data Engineer Engineering 98

Snowflake

FEBRUARY 29, 2024

This grid, along with the metadata that represents the details of how the grid is constructed and used, is referred to as a spatial index. Caption: A demo Streamlit app visualizes H3 hexagons at different resolutions for the same data. There are 16 layers, or levels, of resolution in H3.

Insurance 100

Insurance SQL BI Consulting 100

Towards Data Science

JULY 8, 2024

I have used Colab for this demo, as it is much easier (and faster) to configure the environment. This process also creates a sqlite database for storing the metadata of the pipeline process. Every record and its metadata are stored in dictionary format. Have a look at this article to gain better understanding of this article.

Data Preparation 70

Data Preparation Datasets Metadata Data Ingestion 70

RandomTrees

APRIL 18, 2024

By leveraging Python’s capabilities, we can create scripts that analyze Informatica workflows, extract relevant metadata, and generate equivalent Talend jobs. Analysing Informatica Workflows : The first step in the conversion process is to analyze Informatica workflows to extract essential metadata and transformation logic.

Coding 52

Coding Retail Metadata Python 52