Remove 2022 Remove Data Storage Remove Technology
article thumbnail

How to get started with dbt

Christophe Blefari

This switch has been lead by modern data stack vision. In terms of paradigms before 2012 we were doing ETL because storage was expensive, so it became a requirement to transform data before the data storage—mainly a data warehouse, to have the most optimised data for querying.

article thumbnail

Upgrade your Modern Data Stack

Christophe Blefari

Let's go through the current state of data to understand what you should do next. Big Data is really dead Although the term Big Data is no longer very popular, London probably counted over 10,000 visitors and more than 160 vendors (2022 figures). Tip: data needs are rarely a technology name.

Big Data 147
article thumbnail

Snowflake’s Performance Optimizations Help ESO Reduce Costs by 60%

Snowflake

As a result, ESO needed a data platform that could flex to support high availability and scalability, and that also helped the company to manage and optimize its spend. ESO’s data analytics platform was previously based on Cloudera running Scala and Spark. The median execution time for analytical reporting decreased by 60%.

Medical 94
article thumbnail

Building Meta’s GenAI Infrastructure

Engineering at Meta

While we’ve had a long history of building AI infrastructure, we first shared details on our AI Research SuperCluster (RSC) , featuring 16,000 NVIDIA A100 GPUs, in 2022. Storage Storage plays an important role in AI training, and yet is one of the least talked-about aspects. An open approach to AI is not new for Meta.

Building 145
article thumbnail

Data Engineer Roles And Responsibilities 2022

U-Next

Introduction to 2022 Data Engineer Roles and Responsibilities. Companies and enterprises, large and small, are built on data. Data Engineer roles and responsibilities include aiding in the collection of issues and the delivery of remedies addressing customer demand and product accessibility.

article thumbnail

Data News — Week 22.45

Christophe Blefari

Kovid wrote an article that tries to explain what are the ingredients of a data warehouse. A data warehouse is a piece of technology that acts on 3 ideas: the data modeling, the data storage and processing engine. Graph databases are a key piece of technology that provide an unified view over relationships.

BI 130
article thumbnail

Does Cost Reduction Play a Role in Digital Transformation?

Cloudera

Accenture : “Digital transformation is the process by which companies embed technologies across their businesses to drive fundamental change.”. Wikipedia : “ Digital transformation (DX ) is the adoption of digital technology by an organization.”. We see this consistently in the data platform/data storage space. .