Pinterest Engineering

APRIL 7, 2025

Jia Zhan, Senior Staff Software Engineer, Pinterest Sachin Holla, Principal Solution Architect, AWS Summary Pinterest is a visual search engine and powers over 550 million monthly active users globally. Pinterests infrastructure runs on AWS and leverages Amazon EC2 instances for its compute fleet. 4xl with up to 12.5 4xl with up to 12.5

AWS 66

AWS Bytes Data Ingestion Database 66

Cloudera

DECEMBER 4, 2024

But now AWS customers will gain more flexibility, data utility, and complexity, supporting the modern data architecture. For example: An AWS customer using Cloudera for hybrid workloads can now extend analytics workflows to Snowflake, gaining deeper insights without moving data across infrastructures.

AWS 89

AWS Raw Data Relational Database Government 89

ProjectPro

JUNE 6, 2025

This is where AWS data engineering tools come into the scenario. AWS data engineering tools make it easier for data engineers to build AWS data pipelines, manage data transfer, and ensure efficient data storage. In other words, these tools allow engineers to level-up data engineering with AWS.

AWS 52

AWS Data Engineering Data Engineer Engineering 52

ProjectPro

JUNE 6, 2025

This blog introduces you to AWS DevOps and the various AWS services it offers for cloud computing. If you’re curious to learn why you should leverage these AWS DevOps tools and how different businesses benefit, this blog is for you. What is AWS? What is AWS DevOps? AWS DevOps Architecture AWS DevOps tools 1.

AWS 65

AWS Architecture Amazon Web Services Programming Language 65

ProjectPro

JUNE 6, 2025

This blog presents some of the most unique and exciting AWS projects from beginner to advanced levels. These AWS project ideas will provide you with a better understanding of various AWS tools and their business applications. You can work on these AWS sample projects to expand your skills and knowledge.

AWS 60

AWS Project Food Cloud Computing 60

ProjectPro

JUNE 6, 2025

Ability to demonstrate expertise in database management systems. Experience with using cloud services providing platforms like AWS/GCP/Azure. You may skip chapters 11 and 12 as they are less useful for a database engineer. These softwares allow editing and querying databases easily.

Data Engineering 94

Data Engineering Data Engineer Engineering Amazon Web Services 94

ProjectPro

JUNE 6, 2025

Amazon Web Services (AWS) provides a wide range of tools and services for handling enormous amounts of data. The two most popular AWS data engineering services for processing data at scale for analytics operations are Amazon EMR and AWS Glue. Executing ETL tasks in the cloud is fast and simple with AWS Glue.

Big Data 52

Big Data AWS Amazon Web Services Project 52

The Pragmatic Engineer

OCTOBER 17, 2024

There is an increasing number of cloud providers offering the ability to rent virtual machines, the largest being AWS, GCP, and Azure. A startup called Spare Cores attempts to help compare prices between AWS, GCP, Azure and Hetzner by monitoring offerings in close to realtime. Each benchmarking task is evaluated sequentially.

Cloud 330

Cloud Metadata AWS Cloud Computing 330

ProjectPro

JUNE 6, 2025

With 33 percent global market share , Amazon Web Services (AWS) is a top-tier cloud service provider that offers its clients access to a wide range of services to promote business agility while maintaining security and reliability. AWS Glue supports Amazon Athena , Amazon EMR, and Redshift Spectrum. Libraries No.

ETL Tools 40

ETL Tools AWS Data Pipeline Amazon Web Services 40

ProjectPro

JUNE 6, 2025

AWS vs. GCP blog compares the two major cloud platforms to help you choose the best one. So, are you ready to explore the differences between two cloud giants, AWS vs. google cloud? Amazon and Google are the big bulls in cloud technology, and the battle between AWS and GCP has been raging on for a while. Let’s get started!

AWS 49

AWS Amazon Web Services Google Cloud Cloud Storage 49

ProjectPro

JUNE 6, 2025

Traditional databases often need help to capture these intricate relationships, leaving you with a fragmented view of your data. This is where graph databases come in— they’re like having a high-definition map that reveals every connection. Table of Contents What is a Graph Database? Why Graph Databases?

Database 40

Database Database-centric Relational Database MongoDB 40

ProjectPro

JUNE 6, 2025

Amazon RDS and Aurora Serverless are two relational database services provided by AWS. RDS is a fully-managed service that sets up and manages cloud-based database servers, while Aurora Serverless is a relational database engine with a more advanced deployment process that does not require manual management of database servers.

Database 40

Database PostgreSQL MySQL Relational Database 40

ProjectPro

JUNE 6, 2025

With a 31% market share, Amazon Web Services (AWS) dominates the cloud services industry while making it user-friendly. With over 175 full features service offerings, organizations are head hunting for AWS data engineers who can help them build and maintain the entire AWS cloud infrastructure to keep the applications up and running.

AWS 45

AWS Data Engineering Data Engineer Amazon Web Services 45

Teradata

MAY 30, 2025

Register now Home Insights Artificial Intelligence Article Build a Data Mesh Architecture Using Teradata VantageCloud on AWS Explore how to build a data mesh architecture using Teradata VantageCloud Lake as the core data platform on AWS.

AWS 52

AWS Architecture Building Amazon Web Services 52

ProjectPro

JUNE 6, 2025

Say goodbye to database downtime, and hello to Amazon Aurora! A detailed study report by Market Research Future (MRFR) projects that the cloud database market value will likely reach USD 38.6 A detailed study report by Market Research Future (MRFR) projects that the cloud database market value will likely reach USD 38.6

Database 40

Database Technology Cloud PostgreSQL 40

ProjectPro

JUNE 6, 2025

With a CAGR of 30%, the NoSQL Database Market is likely to surpass USD 36.50 Two of the most popular NoSQL database services available in the industry are AWS DynamoDB and MongoDB. This blog compares these two popular databases- DynamoDB vs. MongoDB- to help you choose the best one for your data engineering projects.

NoSQL 40

NoSQL MongoDB Database Amazon Web Services 40

ProjectPro

JUNE 6, 2025

Becoming a successful aws data engineer demands you to learn AWS for data engineering and leverage its various services for building efficient business applications. Amazon Web Services, or AWS, remains among the Top cloud computing services platforms with a 34% market share as of 2022. What is AWS for Data Engineering?

AWS 40

AWS Data Engineering Data Engineer Engineering 40

ProjectPro

JUNE 6, 2025

Want to enter the world of AWS Machine Learning and discover the power of data-driven innovation? It's time for you to explore the power of AWS services, essential tools, and the path to becoming an AWS ML Engineer with our comprehensive guide on AWS Machine Learning! Table of Contents What is AWS Machine Learning?

Machine Learning 40

Machine Learning AWS Amazon Web Services Deep Learning 40

ProjectPro

JUNE 6, 2025

A survey by Data Warehousing Institute TDWI found that AWS Glue and Azure Data Factory are the most popular cloud ETL tools with 69% and 67% of the survey respondents mentioning that they have been using them. Azure Data Factory and AWS Glue are powerful tools for data engineers who want to perform ETL on Big Data in the Cloud.

AWS 40

AWS Cloud Amazon Web Services ETL Tools 40

ProjectPro

JUNE 6, 2025

This blog will provide you with valuable insights, exam preparation tips, and a step-by-step roadmap to ace the AWS Data Analyst Certification exam. So if you are ready to master the world of data analysis with AWS, then keep reading. Table of Contents Is AWS Data Analytics Certification Worth It?

AWS 52

AWS Certification Data Analytics Big Data 52

ProjectPro

JUNE 6, 2025

Over 200 Amazon Web Services (AWS) products and services are available today that help you build highly scalable and secure Big Data applications. Most big data professionals use AWS Glue and AWS Athena when working on their data engineering projects since they are two of the most popular and efficient AWS services.

AWS 40

AWS Amazon Web Services Scala ETL Tools 40

The Pragmatic Engineer

NOVEMBER 21, 2023

After Zynga, he rejoined Amazon, and was the General Manager (GM) for Compute services at AWS, and later chief of staff, and advisor to AWS executives like Charlie Bell and Andy Jassy (Amazon’s current CEO.) We dabbled in network engineering, database management, and system administration. were in english only.

Engineering 334

Engineering Bytes Cloud Computing AWS 334

ProjectPro

JUNE 6, 2025

ETL is a critical component of success for most data engineering teams, and with teams harnessing it with the power of AWS, the stakes are higher than ever. Data Engineers and Data Scientists require efficient methods for managing large databases, which is why centralized data warehouses are in high demand.

AWS 40

AWS Data Management ETL Tools Management 40

ProjectPro

JUNE 6, 2025

Let’s assume you are a data engineer who wants to create an AWS Lambda function that ingests data from an Amazon S3 bucket, processes it using an Amazon Glue job, and stores the results in an Amazon Redshift data warehouse. Table of Contents What is AWS CDK? How Does AWS CDK Work?

AWS 40

AWS Cloud Management Programming Language 40

ProjectPro

JUNE 6, 2025

A study by Flexera found that , 80% of organisations have migrated some of their workloads to the cloud, with most of those migrations taking place on AWS. AWS is a popular choice among organisations for cloud migrations, and hence having an efficient AWS Cloud Migration Project plan is crucial for a smooth and successful migration.

AWS 40

AWS Cloud Project Big Data 40

ProjectPro

JUNE 6, 2025

AWS Lambda, a powerful compute service that allows you to run code without the need to provision or manage servers. This is where AWS Lambda comes in. With AWS Lambda, you can run code in response to events such as changes to data in an Amazon S3 bucket, updates to a DynamoDB table, or even HTTP requests.

AWS 40

AWS Amazon Web Services Programming Language Big Data 40

ProjectPro

JUNE 6, 2025

There are abundant options available in the cloud technology market, with AWS and Openstack as the two trendy choices. AWS scores better on security aspects due to its secure interface for cloud management through Amazon’s infrastructure. AWS - Overview AWS , Amazon Web Services is the on-demand cloud computing framework.

AWS 40

AWS Amazon Web Services Cloud Computing Big Data 40

ProjectPro

JUNE 6, 2025

Did you know over 5140 businesses worldwide started using AWS Glue as a big data tool in 2023? This increases the demand for big data processing tools such as AWS Glue. AWS Glue is a serverless platform that makes acquiring, managing, and integrating data for analytics, machine learning, and application development easier.

AWS 40

AWS IT Data Lake BI 40

The Pragmatic Engineer

MAY 11, 2023

The company racked up huge bills for the likes of AWS, Snowflake, and also Datadog. A quick summary of these technologies: Prometheus : a time series database. A fast and open-source column-oriented database management system, which is a popular choice for log management. And so, the $65M bill was for Datadog, for 2021.

AWS 335

AWS Software Engineer Software Engineering Google Cloud 335

ProjectPro

JUNE 6, 2025

“AWS Lambda is a game changer. A survey by RightScale found that , 70% of organizations use AWS Lambda for serverless computing. Cloudability’s survey found that on average the AWS Lambda Function is invoked every second with number of AWS Lambda functions invocations grow to 400% in 2021.

AWS 40

AWS Retail Big Data MySQL 40

Edureka

APRIL 22, 2025

Understanding the AWS Shared Responsibility Model is essential for aligning security and compliance obligations. The model delineates the division of labor between AWS and its customers in securing cloud infrastructure and applications. Let us begin by defining the Shared Responsibility Model and its core purpose in the AWS ecosystem.

Amazon Web Services 40

Amazon Web Services AWS Data Governance Cloud 40

ProjectPro

JUNE 6, 2025

The AWS Big Data Analytics Certification exam holds immense significance for professionals aspiring to demonstrate their expertise in designing and implementing big data solutions on the AWS platform. Additionally, as per a survey conducted by KDnuggets, AWS stood out at the top in terms of popularity among Indians and Americans.

Big Data 40

Big Data AWS Certification Hadoop 40

ProjectPro

JUNE 6, 2025

That’s where AWS Cloudwatch comes into picture. AWS CloudWatch is the ideal monitoring and logging tool for all your data, applications, and resources deployed on AWS or any other platform! AWS CloudWatch seamlessly integrates with over 70 AWS services for efficient monitoring and scalability.

AWS 40

AWS Amazon Web Services Big Data Utilities 40

ProjectPro

JUNE 6, 2025

In any ETL workflow, Amazon AWS ETL tools are essential. This blog will explore the three best AWS ETL tools—AWS Kinesis, AWS Glue, and AWS Data Pipeline- and some of their significant features. You can add streaming data to your Redshift cluster using AWS Kinesis.

ETL Tools 40

ETL Tools AWS Data Engineering Data Engineer 40

Snowflake

NOVEMBER 12, 2024

Today we're thrilled to announce the general availability of Hybrid Tables in all AWS commercial regions (with a few exceptions ). As part of Snowflake Unistore , Hybrid Tables unify both transactional and analytical workloads on a single database to simplify architectures as well as governance and security.

Food 97

Food Metadata Education Data Architect 97

ProjectPro

JUNE 6, 2025

As of 2021, Amazon Web Services (AWS) is the most popular vendor controlling 32% of the cloud infrastructure market share. AWS Cloud provides a wide range of on-demand solutions for data storage and movement, allowing companies to scale instantly and pay only for resources they use. How do I create an AWS Architecture?

AWS 40

AWS Architecture Amazon Web Services Cloud Computing 40

ProjectPro

JUNE 6, 2025

Explore the full potential of AWS Kafka with this ultimate guide. For instance, Airbnb utilizes AWS Kafka to handle data from diverse sources such as property listings, user searches, and bookings, enabling them to adjust pricing and maximize revenue dynamically. Why Kafka on AWS? billion in 2023 at a CAGR of 26.9%.

Kafka 40

Kafka AWS Amazon Web Services Data Pipeline 40