Netflix Tech

NOVEMBER 28, 2018

Even with detection capabilities, there is a risk that exposed credentials can provide access to sensitive data and/or the ability to cause damage in our environment. Today, we would like to share two additional layers of security: API enforcement and metadata protection.

AWS 97

AWS Metadata Amazon Web Services Cloud 97

The Pragmatic Engineer

OCTOBER 17, 2024

The startup was able to start operations thanks to getting access to an EU grant called NGI Search grant. Results are stored in git and their database, together with benchmarking metadata. Benchmarking results for each instance type are stored in sc-inspector-data repo, together with the benchmarking task hash and other metadata.  There

Cloud 273

Cloud Metadata AWS Cloud Computing 273

Precisely

OCTOBER 31, 2024

Data fabric is a unified approach to data management, creating a consistent way to manage, access, and share data across distributed environments. Both approaches empower your organization to be more agile, data-driven, and responsive so you can make informed decisions in real time. Which approach is best for your business use case?

Data Architecture 69

Data Architecture Architecture Metadata Government 69

Netflix Tech

MARCH 10, 2021

ConsoleMe: A Central Control Plane for AWS Permissions and Access By Curtis Castrapel , Patrick Sanders , and Hee Won Kim At AWS re:Invent 2020, we open sourced two new tools for managing multi-account AWS permissions and access. They are the one-stop-shop for cloud permissions and access. This happened for us at Netflix.

AWS 102

AWS Accessibility Accessible Cloud 102

Confluent

MAY 7, 2019

Although it is the simplest way to subscribe to and access events from Kafka, behind the scenes, Kafka consumers handle tricky distributed systems challenges like data consistency, failover and load balancing. Additionally, the PartitionAssignor interface exposes a metadata() method. they’re basically a short window of unavailability.

Kafka 111

Kafka Accessible Accessibility Metadata 111

ThoughtSpot

NOVEMBER 5, 2024

In the realm of modern analytics platforms, where rapid and efficient processing of large datasets is essential, swift metadata access and management are critical for optimal system performance. Any delays in metadata retrieval can negatively impact user experience, resulting in decreased productivity and satisfaction.

Metadata 52

Metadata PostgreSQL Java Database 52

ThoughtSpot

OCTOBER 9, 2023

How ThoughtSpot builds trust with data catalog connectors For many, the data catalog is still the primary home for metadata enrichment and governance. Our data catalog integrations allow you to tap into this metadata wealth and surface it in the context where it’s needed most—when conducting business analytics.

Metadata 105

Metadata Data Government Data Governance 105

Netflix Tech

SEPTEMBER 18, 2024

Second, developers had to constantly re-learn new data modeling practices and common yet critical data access patterns. This abstraction simplifies data access, enhances the reliability of our infrastructure, and enables us to support the broad spectrum of use cases that Netflix demands with minimal developer effort.

Bytes 99

Bytes Metadata Database Data 99

Cloudera

NOVEMBER 15, 2024

By leveraging Apache Iceberg, an open table format designed for high-performance analytics on massive volumes of data, cyber defenders can access all of their data and conduct investigations with greater speed and efficiency. Whether they need to query data from today or from years past, the system scales up or down to meet their needs.

Metadata 76

Metadata Unstructured Data Data Lake Government 76

Data Engineering Weekly

JUNE 16, 2024

[link] Yousry Mohamed: Delta Lake Liquid Clustering — A visual explanation Liquid clustering liberates the hive-style static partitioning and organizes the data layout from the accessing pattern. Apply for early access and achieve effective data orchestration in under 10 minutes! link] All rights reserved ProtoGrowth Inc, India.

Data Engineer 104

Data Engineer Data Engineering Engineering Kafka 104

Snowflake

NOVEMBER 2, 2023

Snowflake Horizon is Snowflake’s built-in governance solution with a unified set of compliance, security, privacy, interoperability, and access capabilities. Snowflake continues to advance Snowflake Horizon with additional capabilities for compliance, security, privacy, interoperability, and access.

Metadata 107

Metadata Government AWS Medical 107

Snowflake

NOVEMBER 29, 2023

In medicine, lower sequencing costs and improved clinical access to NGS technology has been shown to increase diagnostic yield for a range of diseases, from relatively well-understood Mendelian disorders, including muscular dystrophy and epilepsy , to rare diseases such as Alagille syndrome.

Metadata 88

Metadata Healthcare Medical Data Storage 88

phData: Data Engineering

NOVEMBER 1, 2024

It serves as a vital protective measure, ensuring proper data access while managing risks like data breaches and unauthorized use. Chief Technology Officer, Information Technology Industry The impact on data governance due to GenAI/LLM is that these technologies can spot trends much faster than humans or other applications.

Government 52

Government Data Governance Finance Metadata 52

Data Engineering Podcast

NOVEMBER 13, 2022

Shane Gibson co-founded AgileData to make analytics accessible to companies of all sizes. Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities.

Building 130

Building Metadata MongoDB MySQL 130

Precisely

JULY 18, 2024

Key Takeaways Data Fabric is a modern data architecture that facilitates seamless data access, sharing, and management across an organization. Data management recommendations and data products emerge dynamically from the fabric through automation, activation, and AI/ML analysis of metadata.

Data Management 52

Data Management Management Metadata Database-centric 52

Ascend.io

JULY 23, 2024

AI Implementation Framework #1- Levels of Access The first framework focuses on defining levels of access for AI and automation tools. Organizations must determine the extent of access to data and code they are willing to grant these systems.

Data Engineer 52

Data Engineer Data Engineering Engineering Metadata 52

Snowflake

JUNE 5, 2024

At the same time, organizations must ensure the right people have access to the right content, while also protecting sensitive and/or Personally Identifiable Information (PII) and fulfilling a growing list of regulatory requirements.

Government 103

Government Accessibility Accessible Cloud 103

Data Engineering Podcast

OCTOBER 30, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. For more information on Prefect, visit dataengineeringpodcast.com/prefect. Atlan is the metadata hub for your data ecosystem.

Business Intelligence 130

Business Intelligence Metadata MongoDB MySQL 130

Snowflake

JULY 25, 2024

It supports “fuzzy” search — the service takes in natural language queries and returns the most relevant text results, along with associated metadata. Governed : Cortex Search services are schema-level objects in Snowflake and integrate with existing role-based access control (RBAC) policies in a Snowflake account.

Unstructured Data 113

Unstructured Data Metadata Government SQL 113

Data Engineering Podcast

DECEMBER 4, 2022

The typical conception of how it is accessed is through a web or desktop application running on a powerful laptop. This opens the door for busy employees to access and analyze their company information away from their desk, but it has the more powerful effect of bringing first-class support to companies operating in mobile-first economies.

Business Intelligence 100

Business Intelligence Metadata BI MongoDB 100

Data Engineering Podcast

JULY 31, 2022

In this episode Ernie Ostic shares the approach that he and his team at Manta are taking to build a complete view of data lineage across the various data systems in your organization and the useful applications of that information in the work of every data stakeholder. Atlan is the metadata hub for your data ecosystem.

IT 100

IT Metadata MongoDB MySQL 100

Data Engineering Podcast

NOVEMBER 20, 2022

Summary The majority of blog posts and presentations about data engineering and analytics assume that the consumers of those efforts are internal business users accessing an environment controlled by the business. Atlan is the metadata hub for your data ecosystem. What do you have planned for the future of the data stack at Riot Games?

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Snowflake

NOVEMBER 12, 2024

Managing application state and metadata Use Hybrid Tables as the system of record for application configuration, user profiles, workflow state and other metadata that needs to be accessed with high concurrency. Customers such as Siemens and PowerSchool are leveraging Hybrid Tables to track state for a wide variety of use cases.

Food 73

Food Metadata Education AWS 73

Snowflake

JUNE 21, 2024

Zero Ingest with Zero Silos : Iceberg data already managed in a data lake can be accessed directly by Snowflake via an Iceberg catalog integration. You can quickly and easily access Iceberg data in Snowflake without the additional latency that comes with ingesting or copying data.

Data Lake 116

Data Lake BI Business Intelligence Metadata 116

Pinterest Engineering

OCTOBER 2, 2024

Catalog/Metadata Management , which is responsible for storing and serving table metadata, including ownership, schemas, SLAs, etc., and also providing runtime metadata about the platform Security and Auditability , which ensures GDPR compliance, advanced levels of auditability, security, AAA, etc.

Data Management 56

Data Management Management Metadata SQL 56

dbt Developer Hub

SEPTEMBER 29, 2024

How to build a Hybrid Mesh ​ Enabling a Hybrid Mesh is as simple as a few additional steps to import the metadata from your Core project into dbt Cloud. Step 1: Prepare your Core project for access through dbt Mesh ​ Configure public models to serve as stable interfaces for downstream dbt Projects.

Metadata 52

Metadata Cloud Project Accessibility 52

Cloudera

NOVEMBER 15, 2024

By leveraging Apache Iceberg, an open table format designed for high-performance analytics on massive volumes of data, cyber defenders can access all of their data and conduct investigations with greater speed and efficiency. Whether they need to query data from today or from years past, the system scales up or down to meet their needs.

Metadata 52

Metadata Unstructured Data Data Lake Government 52

Engineering at Meta

MARCH 18, 2024

Users can query using regular expressions on log lines, arbitrary metadata fields attached to logs, and across log files of hosts and services. Each log line can have zero or more metadata key-value pairs attached to it. The extracted key-value pairs are added to the log line’s metadata. in PyTorch). Multimodal data (e.g.,

Engineering 94

Engineering Metadata Architecture Designing 94

Netflix Tech

OCTOBER 8, 2024

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Bytes 94

Bytes Datasets Metadata Data 94

ThoughtSpot

JUNE 28, 2023

Getting started with version control APIs To begin, ensure that the following prerequisites are met: You have admin access (can administer Thoughtspot privilege) to connect ThoughtSpot to a Git repository and deploy commits. For more information, explore our developer documentation on the new version control REST APIs for Git.

Metadata 97

Metadata Accessibility Accessible Coding 97

Monte Carlo

MAY 14, 2024

Depending on the quantity of data flowing through an organization’s pipeline — or the format the data typically takes — the right modern table format can help to make workflows more efficient, increase access, extend functionality, and even offer new opportunities to activate your unstructured data.

Data Lake 52

Data Lake Metadata Hadoop Data Governance 52

dbt Developer Hub

DECEMBER 19, 2023

Because those conversations often start out at the same place, I decided to create this guide so I’m no longer the blocker to fundamental information. Integration points ​ Discovery API (formerly referred to as Metadata API) Overview — This GraphQL API allows you to query the metadata that dbt Cloud generates every time you run a dbt project.

Metadata 52

Metadata Cloud Accessibility Accessible 52

Precisely

NOVEMBER 18, 2024

Ultimately, they are trying to serve data in their marketplace and make it accessible to business and data consumers,” Yoğurtçu says. With the rise of cloud-based data management, many organizations face the challenge of accessing both on-premises and cloud-based data. Focus on metadata management.

Data Analytics 72

Data Analytics Data Integration Data Governance Government 72

Cloudera

APRIL 2, 2024

We understand the importance of protecting sensitive government data from unauthorized access, and we have implemented robust security measures to safeguard this information. Purpose Built for Security Here at Cloudera, we focus on ensuring that our platform meets the highest standards of security and regulatory compliance.

Designing 100

Designing Process Government Metadata 100

Precisely

OCTOBER 17, 2024

Learn more about Chamberlain Group’s success story:  NZ Super Fund Winner: Business Impact Award Watch Geoff Smith, Head of Data Services at NZ Super Fund, share the company’s journey to instate data governance, improve data quality, and optimize spending on market information. What Can Your Business Accomplish with Data Integrity?

Data Integration 69

Data Integration Data Governance Government Metadata 69

Precisely

AUGUST 22, 2024

Both architectures tackle significant data management challenges such as integrating disparate data sources, improving data accessibility, automating management processes, and ensuring data governance and security. Data fabric centralizes data governance and security to ensure privacy, secure access, and high-quality data.

Data Governance 69

Data Governance Government High Quality Data Metadata 69

ThoughtSpot

MAY 31, 2023

This includes services that: Manage and monitor the tenant-specific resources—this does not include access to tenant data Maintains indexed data to serve as your application home page. This multi-tenant service isolates the tenant metadata index, authorizing and filtering the search answer requests from every tenant.

Data Security 98

Data Security Metadata Transportation Data Warehouse 98