Data Engineering Podcast

JANUARY 21, 2024

In this episode Tasso Argyros, CEO of ActionIQ, gives a summary of the major epochs in database technologies and how he is applying the capabilities of cloud data warehouses to the challenge of building more comprehensive experiences for end-users through a modern customer data platform (CDP).

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

Monte Carlo

OCTOBER 31, 2024

They still take on the responsibilities of a traditional data engineer, like building and managing pipelines and maintaining data quality, but they are tasked with delivering AI data products, rather than traditional data products. The ability and skills to build scalable, automated data pipelines.

Data Engineering 52

Data Engineering Data Engineer Engineering Unstructured Data 52

Pinterest Engineering

MAY 13, 2024

Overview of HBase at Pinterest Introduced in 2013, HBase was Pinterest’s first NoSQL datastore. Along with the rising popularity of NoSQL, HBase quickly became one of the most widely used storage backends at Pinterest. Missing functionalities HBase was designed to provide a relatively simple NoSQL interface.

NoSQL 95

NoSQL MySQL Database Systems 95

Cloudera

OCTOBER 6, 2020

It offers multi-modal client access with NoSQL key-value using Apache HBase APIs and relational SQL with JDBC (via Apache Phoenix). The latter makes COD accessible to developers who are used to building applications that use MySQL, Postgres, etc. Auto-heal – resolve operational problems automatically (coming soon). .

Database 81

Database Building Bytes NoSQL 81

Rockset

JULY 21, 2022

They rely on our cloud-native service to easily build no-code interactive experiences such as video quizzes, calculators and listicles for their websites without the need for developers. . - Jeremy Evans, Co-founder and CTO, Savvy At Savvy , we have a lot of responsibility when it comes to data.

NoSQL 52

NoSQL IT MongoDB SQL 52

Data Engineering Podcast

FEBRUARY 11, 2018

What has been the most challenging aspect of building and marketing Timescale? What has been the most challenging aspect of building and marketing Timescale? What are the axes for scaling Timescale and what are the points where that scalability breaks down? When is Timescale the wrong tool to use for time series data?

PostgreSQL 100

PostgreSQL NoSQL Google Cloud MongoDB 100

Data Engineering Podcast

JUNE 10, 2018

Preamble Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline you’ll need somewhere to deploy it, so check out Linode. What was the motivation for creating CockroachDB and building a business around it?

PostgreSQL 100

PostgreSQL NoSQL Relational Database SQL 100

Rockset

OCTOBER 26, 2021

NoSQL Data Barrier The interactive dashboards include everything from basic KPIs such as Daily Active Users and Monthly Active Users (DAUs and MAUs), to advanced context interpretation for each individual patient’s progress. However, the challenge was serving Redash with SQL queries from data stored in our NoSQL database.

NoSQL 52

NoSQL Building Hospitality Education 52

Data Engineering Podcast

MARCH 18, 2018

Preamble Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline you’ll need somewhere to deploy it, so check out Linode. Links Elastic Vienna – Capital of Austria What Is Developer Advocacy?

MongoDB 100

MongoDB NoSQL Machine Learning Data Engineering 100

Data Engineering Podcast

JANUARY 7, 2018

Why did you start with Postgres vs. building something from the ground up? What have been some of the most challenging aspects of building the Citus extension? Why did you start with Postgres vs. building something from the ground up? What have been some of the most challenging aspects of building the Citus extension?

PostgreSQL 100

PostgreSQL Big Data NoSQL Data 100

Data Engineering Podcast

AUGUST 19, 2018

In addition he talks about the challenges of building a distributed, consistent database and the tradeoffs that were made to make DGraph a reality. Quilt is an open source platform for building a sane workflow around your data that works for your whole team, including version history, metatdata management, and flexible hosting.

Database 100

Database PostgreSQL NoSQL Transportation 100

Data Engineering Podcast

JULY 16, 2021

Summary There is a wealth of tools and systems available for processing data, but the user experience of integrating them and building workflows is still lacking. Raj Bains founded Prophecy to address this need by creating a UI first platform for building and executing data engineering workflows that orchestrates Airflow and Spark.

High Quality Data 100

High Quality Data Data Engineering Data Engineer Coding 100

Data Engineering Podcast

FEBRUARY 9, 2020

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Lake 100

Data Lake Data Warehouse Hadoop NoSQL 100

Rockset

AUGUST 29, 2019

We will demonstrate how you can build an interactive dashboard with Tableau, using SQL on data from DynamoDB, in a series of easy steps, with no ETL involved. Tableau, also widely popular, is a tool for building live, interactive charts and dashboards. DynamoDB is a widely popular transactional primary data store.

NoSQL 40

NoSQL SQL Building Unstructured Data 40

Edureka

AUGUST 26, 2024

These are basically a collection of technologies used together to build web applications. MongoDB is a NoSQL database where data are stored in a flexible way that is similar to JSON format. MongoDB is a NoSQL database where data are stored in a flexible way that is similar to JSON format. Express.js

MongoDB 97

MongoDB Programming Language MySQL Certification 97

Data Engineering Podcast

APRIL 22, 2019

It is definitely worth a good look for anyone building a platform that needs a simple to manage data layer that will scale with your business. What have been some of the most interesting/unexpected/challenging aspects of building the Fauna database and company? What do you have in store for the future of Fauna?

Database 100

Database Cloud NoSQL Scala 100

Cloudera

OCTOBER 13, 2020

CDP Data Hub: a VM/Instance-based service that allows IT and developers to build custom business applications for a diverse set of use cases with secure, self-service access to enterprise data. . CDP Operational Database (2) – an autonomous, multimodal, autoscaling database environment supporting both NoSQL and SQL.

Cloud 97

Cloud Data Warehouse Machine Learning AWS 97

Data Engineering Podcast

MAY 6, 2019

FoundationDB is a distributed key-value store that provides the primitives that you need to build a custom database platform. FoundationDB is a distributed key-value store that provides the primitives that you need to build a custom database platform. But what happens if you need something customized to your application?

Systems 100

Systems MongoDB NoSQL Database 100

Towards Data Science

JANUARY 16, 2024

Result: Hadoop & NoSQL frameworks emerged. This builds my case to justify the existence of the decentralised data architecture popularly known as the Data Mesh. Image by the author 2004 to 2010 — The elephant enters the room New wave of applications emerged — Social Media, Software observability, etc.

Data Warehouse 95

Data Warehouse Data Architecture Relational Database NoSQL 95

Cloudera

NOVEMBER 23, 2021

Atlas provides open metadata management and governance capabilities to build a catalog of all assets, and also classify and govern these assets. Build and run the applications. It leverages the basic features of HDFS and builds upon it to provide scalability by handling a large volume of the read and write requests in real-time.

Database 91

Database Non-relational Database NoSQL Government 91

Confluent

MAY 22, 2019

A scalable, distributed, peer-to-peer NoSQL database, Scylla is a perfect fit for consuming the variety, velocity, and volume of data (often time-series) coming directly from users, devices, and sensors spread across geographic locations. What is Scylla?

Kafka 98

Kafka Google Cloud NoSQL Entertainment 98

AltexSoft

MAY 14, 2021

Besides, it is not just business users and analysts who can use this data for advanced analytics but also data science teams that can apply Big Data to build predictive ML projects. NoSQL databases. NoSQL databases, also known as non-relational or non-tabular databases, use a range of data models for data to be accessed and managed.

Big Data 78

Big Data Data Analytics IT NoSQL 78

Knowledge Hut

DECEMBER 26, 2023

It helps gain fundamental understanding of Java programming and builds a foundation in Java and other general programming concepts. MongoDB Certified Developer Associate Exam MongoDB is a NoSQL, document-based high-volume heterogeneous database system. It is the preliminary and most basic certification provided by Oracle for Java.

Certification 98

Certification Programming MongoDB R (Programming) 98

Data Engineering Podcast

AUGUST 3, 2020

When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. I’m working with O’Reilly on a project to collect the 97 things that every data engineer should know, and I need your help.

NoSQL 100

NoSQL Database Algorithm Relational Database 100

Knowledge Hut

DECEMBER 26, 2023

To build these necessary skills, a comprehensive course from a reputed source is a great place to start. Without understanding the data and the business, it is difficult to build an accurate data analysis model, which in turn could hurt the business’s growth. In other words, they develop, maintain, and test Big Data solutions.

Data Science 97

Data Science BI Machine Learning Business Intelligence 97

ProjectPro

FEBRUARY 25, 2022

Efficient Scheduling and Runtime Increased Adaptability and Scope Faster Analysis and Real-Time Prediction Introduction to the Machine Learning Pipeline Architecture How to Build an End-to-End a Machine Learning Pipeline? This makes it easier for machine learning pipelines to fit into any model-building application.

Machine Learning 52

Machine Learning Building Amazon Web Services AWS 52

Edureka

AUGUST 18, 2024

HTML/CSS First and foremost, the basic skills of a full-stack web developer are HTML and CSS because they are the building blocks of web development, including developing and styling multiple web pages. This enables developers to build high-quality applications quickly and efficiently. What is a full-stack development course?

Programming Language 98

Programming Language Java Non-relational Database Database 98

Cloudera

SEPTEMBER 24, 2021

Suddenly, it was possible to build a data model of the network and create both a historical and predictive view of its behaviour. They were using R and Python, with NoSQL and other open source ad hoc data stores, running on small dedicated servers and occasionally for small jobs in the public cloud.

Data Architect 96

Data Architect Government NoSQL Big Data 96

Rockset

SEPTEMBER 2, 2022

Raghavendra Prabhu (RVP) is Head of Engineering and Research at Covariant , a Series C startup building an universal AI platform for robotics starting in the logistics industry. Nikhil Garg is CEO and co-founder of Fennel AI , a startup working on building the future of real-time machine learning infrastructure.

Systems 52

Systems Building Machine Learning NoSQL 52

Workfall

MARCH 21, 2023

This allows you to quickly and cheaply build secure and performant apps. SurrealDB is a NoSQL database, which eliminates the need for the majority of server-side components and layers that are typically required when using other types of database systems. For this blog, we shall use the nightly build. src/main.rs(1):

PostgreSQL 68

PostgreSQL NoSQL Database Unstructured Data 68

AltexSoft

DECEMBER 23, 2022

Whether your goal is data analytics or machine learning , success relies on what data pipelines you build and how you do it. One of the ways to overcome challenges and gain more opportunities in terms of data integration is to build an ELT (Extract, Load, Transform) pipeline. Tools to build an ELT pipeline. What is ELT?

Process 52

Process Building Raw Data Data Lake 52

Rockset

MAY 17, 2019

Creating the static page Keeping with the spirit of simplicity, we'll use vanilla HTML/CSS/JS with a bit of jQuery to build the app's frontend. In fact, if we were instrumenting an existing web app instead of building from scratch, we would just start at this step. Spoiler alert: you can view the results here.)

Building 52

Building SQL NoSQL Data 52

Rockset

JUNE 7, 2022

On the other hand, non-relational databases (commonly referred to as NoSQL databases) are flexible databases for big data and real-time web applications. NoSQL databases don't always offer the same data integrity guarantees as a relational database, but they're much easier to scale out across multiple servers.

MongoDB 52

MongoDB NoSQL Relational Database Non-relational Database 52

Confluent

MARCH 4, 2019

With careful consideration, one of the startups was selected to build the first release of Genesis in the cloud, due to their experience in creating cloud-native applications using Java—the same programming language used to create Genesis. CTO of CloudBank.

Cloud 89

Cloud Banking Kafka NoSQL 89

U-Next

MARCH 1, 2023

A good Data Engineer will also have experience working with NoSQL solutions such as MongoDB or Cassandra, while knowledge of Hadoop or Spark would be beneficial. They build scalable data processing pipelines and provide analytical insights to business users. In 2022, data engineering will hold a share of 29.8%

Data Engineering 75

Data Engineering Data Engineer Non-relational Database Engineering 75

Rockset

MAY 10, 2022

DynamoDB is a popular NoSQL database available in AWS. However, DynamoDB, like many other NoSQL databases, is great for scalable data storage and single row retrieval but leaves a lot to be desired when it comes to analytics. A Flexible and Future-Proofed Solution It is clear that AWS DynamoDB is a great NoSQL database offering.

NoSQL 52

NoSQL AWS MongoDB Database 52

AltexSoft

OCTOBER 30, 2021

Data scientists today are business-oriented analysts who know how to shape data into answers, often building complex machine learning models. Regardless of the structure they eventually build, it’s usually composed of two types of specialists: builders, who use data in production, and analysts, who know how to make sense of data.

Data Engineering 98

Data Engineering Data Engineer Engineering Machine Learning 98