Hevo

SEPTEMBER 3, 2024

In this tutorial, you’ll learn how to create an Apache Airflow MongoDB connection to extract data from a REST API that records flood data daily, transform the data, and load it into a MongoDB database. Why […]

MongoDB 52

MongoDB Data Ingestion Database Data 52

Data Engineering Podcast

SEPTEMBER 11, 2022

Summary Any business that wants to understand their operations and customers through data requires some form of pipeline. Building reliable data pipelines is a complex and costly undertaking with many layered requirements. Data stacks are becoming more and more complex. Sifflet also offers a 2-week free trial.

Data Pipeline 130

Data Pipeline Building MongoDB MySQL 130

Hevo

AUGUST 17, 2023

Are you looking to migrate your data from MongoDB Atlas to MySQL? Migrating data from MongoDB Atlas to MySQL can be a complex process, especially when handling large datasets and different database structures. However, moving data from MongoDB Atlas to MySQL can help you leverage SQL querying […]

MongoDB 52

MongoDB MySQL Datasets SQL 52

Hevo

AUGUST 15, 2023

MongoDB Atlas excels at storing and processing unstructured and semi-structured data, while PostgreSQL offers scalability and advanced analytics. MongoDB Atlas to PostgreSQL integration forms a robust ecosystem that addresses the technical challenges associated with data management and analysis. Let’s […]

MongoDB 52

MongoDB PostgreSQL Structured Data Data 52

Hevo

AUGUST 16, 2023

In today’s data-driven world, organizations face numerous challenges while managing and analyzing vast amounts of data. It becomes more complex to handle large volumes of semi-structured data while integrating data from multiple sources.

MongoDB 52

MongoDB Structured Data Data Management 52

Data Engineering Podcast

NOVEMBER 13, 2022

Summary Building data products is an undertaking that has historically required substantial investments of time and talent. With the rise in cloud platforms and self-serve data technologies the barrier of entry is dropping. Atlan is the metadata hub for your data ecosystem.

Building 130

Building Metadata MongoDB MySQL 130

Knowledge Hut

JANUARY 23, 2024

As a NoSQL solution, MongoDB is specifically designed to adeptly handle substantial volumes of data. To get the most out of MongoDB, take a close look at its features and capabilities. Please check out MongoDB professional certification. What is MongoDB Projection? How Does MongoDB Projection Works?

MongoDB 52

MongoDB Project Database-centric NoSQL 52

Hevo

APRIL 30, 2024

MongoDB is a popular NoSQL database that requires data to be modeled in JSON format. If your application’s data model has a natural fit to MongoDB’s recommended data model, it can provide good performance, flexibility, and scalability for transaction types of workloads.

MongoDB 52

MongoDB NoSQL Database Data 52

Hevo

MAY 26, 2023

As a data engineer, you hold all the cards to make data easily accessible to your business teams. Your team just requested a MongoDB to Databricks connection on priority. We know you don’t wanna keep your data scientists and business analysts waiting to get critical business insights.

MongoDB 52

MongoDB Business Analyst Data Engineering Data Engineer 52

Knowledge Hut

MARCH 22, 2024

I am here to discuss MongoDB job opportunities for you in 2024 and the wide spectrum of options that it provides. But first, let’s discuss MongoDB a bit. MongoDB is the fourth most popular Database Management System (DBMS). Significantly, MongoDB has witnessed an influencing growth of 163% in the last two years!

MongoDB 52

MongoDB Amazon Web Services Computer Science Education 52

Hevo

MAY 29, 2023

Most enterprises collect vast volumes of data over time. This data usually contains important information regarding the business, customers, etc. Storing this data in a stable database is advisable to ensure data security and integrity. Given the vast amount of data stored […]

MongoDB 52

MongoDB Data Security Database Data 52

Data Engineering Podcast

NOVEMBER 6, 2022

Summary Despite the best efforts of data engineers, data is as messy as the real world. Entity resolution and fuzzy matching are powerful utilities for cleaning up data from disconnected sources, but it has typically required custom development and training machine learning models.

MongoDB 130

MongoDB MySQL Scala Machine Learning 130

Monte Carlo

OCTOBER 31, 2024

The rise of AI and GenAI has brought about the rise of new questions in the data ecosystem – and new roles. One job that has become increasingly popular across enterprise data teams is the role of the AI data engineer. Demand for AI data engineers has grown rapidly in data-driven organizations.

Data Engineering 52

Data Engineering Data Engineer Engineering Unstructured Data 52

Knowledge Hut

JANUARY 23, 2024

MongoDB : An Overview Setting up MongoDB on Ubuntu turned out to be more challenging than I expected. If you're like me and still searching for a detailed guide on installing MongoDB on Ubuntu, you're in the right spot. MongoDB Version In this guide, we will install MongoDB 6.0 on x86_64 MongoDB 5.0

MongoDB 52

MongoDB NoSQL Non-relational Database Database 52

Data Engineering Podcast

NOVEMBER 6, 2022

Summary A lot of the work that goes into data engineering is trying to make sense of the "data exhaust" from other applications and services. Atlan is the metadata hub for your data ecosystem. Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day.

Building 130

Building IT Metadata MongoDB 130

Knowledge Hut

JANUARY 23, 2024

As an expert, I highly recommend MongoDB as an open-source and widely adopted document-oriented NoSQL database designed for efficiently storing large-scale data. Installing and using MongoDB has become essential for web developers due to its growing popularity and the seamless manner in which it allows efficient data management.

MongoDB 52

MongoDB Database NoSQL Architecture 52

Data Engineering Podcast

JUNE 12, 2022

Summary Unstructured data takes many forms in an organization. From a data engineering perspective that often means things like JSON files, audio or video recordings, images, etc. Another category of unstructured data that every business deals with is PDFs, Word documents, workstation backups, and countless other types of information.

Unstructured Data 130

Unstructured Data MongoDB MySQL Scala 130

Data Engineering Podcast

JUNE 19, 2022

Summary Metadata is the lifeblood of your data platform, providing information about what is happening in your systems. In order to level up their value a new trend of active metadata is being implemented, allowing use cases like keeping BI reports up to date, auto-scaling your warehouses, and automated data governance.

Metadata 130

Metadata MongoDB MySQL Scala 130

Data Engineering Podcast

JANUARY 22, 2023

Summary The most interesting and challenging bugs always happen in production, but recreating them is a constant challenge due to differences in the data that you are working with. Building your own scripts to replicate data from production is time consuming and error-prone. Can you describe what Tonic is and the story behind it?

PostgreSQL 130

PostgreSQL MongoDB MySQL Machine Learning 130

Data Engineering Podcast

NOVEMBER 20, 2022

Sifflet is a platform that brings your entire data stack into focus to improve the reliability of your data assets and empower collaboration across your teams. In this episode CEO and founder Salma Bakouk shares her views on the causes and impacts of "data entropy" and how you can tame it before it leads to failures.

Data Lake 130

Data Lake Data Ingestion MongoDB MySQL 130

Christophe Blefari

FEBRUARY 3, 2024

Anyway this week will be a mixed Data News with links, stuff and ideas and a small wrap-up of the DuckCon + the stuff I presented on Wed. to a Modern Data Stack meetup in Paris about DuckDB WASM. State of the French data market 2 benchmarks have been published recently about the French data market. conference.

MongoDB 130

MongoDB SQL Data Data Warehouse 130

Data Engineering Podcast

JUNE 19, 2022

Summary Data analysis is a valuable exercise that is often out of reach of non-technical users as a result of the complexity of data systems. Atlan is the metadata hub for your data ecosystem. Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code.

Metadata 130

Metadata Unstructured Data MongoDB MySQL 130

Data Engineering Podcast

AUGUST 21, 2022

Summary Data has permeated every aspect of our lives and the products that we interact with. In this episode Shruti Bhat gives her view on the state of the ecosystem for real-time data and the work that she and her team at Rockset is doing to make it easier for engineers to build those experiences.

Lambda Architecture 100

Lambda Architecture MongoDB MySQL Scala 100

Data Engineering Podcast

AUGUST 28, 2022

For data engineers, this is a monumental undertaking. With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Atlan is the metadata hub for your data ecosystem.

Data Engineering 100

Data Engineering Data Engineer MongoDB Metadata 100

Data Engineering Podcast

DECEMBER 18, 2022

Summary One of the reasons that data work is so challenging is because no single person or team owns the entire process. This introduces friction in the process of collecting, processing, and using data. In order to reduce the potential for broken pipelines some teams have started to adopt the idea of data contracts.

Metadata 130

Metadata Business Intelligence Data Lake BI 130

Knowledge Hut

DECEMBER 26, 2023

Most Popular Programming Certifications C & C++ Certifications Oracle Certified Associate Java Programmer OCAJP Certified Associate in Python Programming (PCAP) MongoDB Certified Developer Associate Exam R Programming Certification Oracle MySQL Database Administration Training and Certification (CMDBA) CCA Spark and Hadoop Developer 1.

Certification 98

Certification Programming MongoDB R (Programming) 98

Data Engineering Podcast

OCTOBER 23, 2022

Applying those same practices to data can prove challenging due to the number of systems that need to be included to implement a complete feature. Atlan is the metadata hub for your data ecosystem. Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day.

Project 130

Project Metadata MongoDB MySQL 130

Data Engineering Podcast

JULY 17, 2022

Summary There are extensive and valuable data sets that are available outside the bounds of your organization. Whether that data is public, paid, or scraped it requires investment and upkeep to acquire and integrate it with your systems. Atlan is the metadata hub for your data ecosystem.

Data Management 130

Data Management Management Metadata MongoDB 130

Edureka

AUGUST 26, 2024

MEAN MEAN stands for MongoDB, Express.js, Angular, and Node.js. MongoDB is a NoSQL database where data are stored in a flexible way that is similar to JSON format. MERN MERN stands for MongoDB, Express.js, React, and Node.js. MongoDB is a NoSQL database used in web development. as a framework.

MongoDB 97

MongoDB Programming Language MySQL Certification 97

Hevo

JUNE 19, 2024

When it comes to migrating data from MongoDB to PostgreSQL, I’ve had my fair share of trying different methods and even making rookie mistakes, only to learn from them.

MongoDB 40

MongoDB PostgreSQL Data Process 40

Data Engineering Podcast

NOVEMBER 20, 2022

Summary The majority of blog posts and presentations about data engineering and analytics assume that the consumers of those efforts are internal business users accessing an environment controlled by the business. Atlan is the metadata hub for your data ecosystem.

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Hevo

MAY 10, 2024

Being a cross-platform document-first NoSQL database program, MongoDB operates on JSON-like documents. Using JDBC, you can seamlessly access any data source from any relational database in spreadsheet format or a flat file.

MongoDB 40

MongoDB NoSQL Relational Database Java 40

Data Engineering Podcast

AUGUST 5, 2019

Summary Data is only valuable if you use it for something, and the first step is knowing that it is available. As organizations grow and data sources proliferate it becomes difficult to keep track of everything, particularly for analysts and data scientists who are not involved with the collection and management of that information.

PostgreSQL 100

PostgreSQL MongoDB Metadata Media 100

Data Engineering Podcast

MAY 27, 2018

In this episode CTO and co-founder of Alooma, Yair Weinberger, explains how the platform addresses the common needs of data collection, manipulation, and storage while allowing for flexible processing. What are some of the complexities introduced by processing data from multiple customers with various compliance requirements?

Data Pipeline 100

Data Pipeline MongoDB Google Cloud Scala 100

Data Engineering Podcast

DECEMBER 28, 2022

Summary With all of the messaging about treating data as a product it is becoming difficult to know what that even means. Vishal Singh is the head of products at Starburst which means that he has to spend all of his time thinking and talking about the details of product thinking and its application to data.

Data Lake 130

Data Lake Data Warehouse Data Pipeline MongoDB 130

Knowledge Hut

APRIL 25, 2024

Big data in information technology is used to improve operations, provide better customer service, develop customized marketing campaigns, and take other actions to increase revenue and profits. It is especially true in the world of big data. It is especially true in the world of big data. What Are Big Data T echnologies?

Big Data 98

Big Data Technology Hadoop NoSQL 98

Data Engineering Podcast

JULY 31, 2022

Summary Exploratory data analysis works best when the feedback loop is fast and iterative. The Arkouda project is a Python interface built on top of the Chapel compiler to bring back those interactive speeds for exploratory analysis on horizontally scalable compute that parallelizes operations on large volumes of data.

Data Analysis 100

Data Analysis MongoDB Algorithm MySQL 100