Remove Data Lake Remove MongoDB Remove Pharmaceutical
article thumbnail

Developing Global Labor Market Intelligence at SkyHive Using Rockset and Databricks

Rockset

SkyHive platform Challenges with MongoDB for Analytical Queries 16 TB of raw text data from our web crawlers and other data feeds is dumped daily into our S3 data lake. That data was processed and then loaded into our analytics and serving database, MongoDB.

MongoDB 59
article thumbnail

The Top 25 Data Engineering Influencers and Content Creators on LinkedIn

Databand.ai

Bob also hosts The Engineering Side of Data podcast , which is dedicated to discussions around data engineering and features a variety of guests from the data engineering space. His specialties include Microsoft SQL Server, Azure Databricks, Azure Data Factory, SQL Server Integration Services (SSIS), and Azure Data Lake.

article thumbnail

Data Virtualization: Process, Components, Benefits, and Available Tools

AltexSoft

If the transformation step comes after loading (for example, when data is consolidated in a data lake or a data lakehouse ), the process is known as ELT. You can learn more about how such data pipelines are built in our video about data engineering. Popular data virtualization tools.

Process 69