Cloudera

JANUARY 20, 2021

In this last installment, we’ll discuss a demo application that uses PySpark.ML to make a classification model based off of training data stored in both Cloudera’s Operational Database (powered by Apache HBase) and Apache HDFS. As a result, I decided to use an open-source Occupancy Detection Data Set to build this application.

Machine Learning 115

Machine Learning Database Data Science Building 115

Engineering at Meta

FEBRUARY 7, 2023

We’re Meta now, but our mission remains the same: Giving people the power to build community and bring the world closer together. This new data schema was born partly out of our cartographic tiling logic, and it includes everything necessary to make a map of the world. Icon versus icon Our initial basemaps eschewed icons.

Entertainment 143

Entertainment Transportation Data Schemas AWS 143

Snowflake

OCTOBER 22, 2024

Welcome to Snowflake’s Startup Spotlight, where we ask startup founders about the problems they’re solving, the apps they’re building, and the lessons they’ve learned during their startup journey. It’s basically an “easy button” for synthetic data. You can even train ML models on our synthetic data, or use it for data sharing purposes.

Data 93

Data Data Schemas Datasets Machine Learning 93

Workfall

SEPTEMBER 18, 2023

Pre-filter and pre-aggregate data at the source level to optimize the data pipeline’s efficiency. Adapt to Changing Data Schemas: Data sources aren’t static; they evolve. Account for potential changes in data schemas and structures.

Data Pipeline 93

Data Pipeline Raw Data Data Schemas Healthcare 93

Striim

SEPTEMBER 11, 2024

In this guide, we’ll dive into everything you need to know about data pipelines—whether you’re just getting started or looking to optimize your existing setup. We’ll answer the question, “What are data pipelines?” Then, we’ll dive deeper into how to build data pipelines and why it’s imperative to make your data pipelines work for you.

Data Pipeline 98

Data Pipeline Designing Data Lake Data Warehouse 98

Confluent

MAY 28, 2019

Therefore, not restricting access to the Schema Registry might allow an unauthorized user to mess with the service in such a way that client applications can no longer be served schemas to deserialize their data. Allow end user REST API calls to Schema Registry over HTTPS instead of the default HTTP.

Management 85

Management Kafka Java Certification 85

Confluent

APRIL 30, 2019

When building a topology with the Processor API, you explicitly name each processing node in the topology, and also provide the name(s) of all of its parent nodes (the only exception are source nodes, which do not have any parents). .< build(properties); final KafkaStreams streams = new KafkaStreams(topology, properties); streams.

Kafka 91

Kafka Coding Process Bytes 91