Confessions of a Data Guy

DECEMBER 6, 2024

Well, everyone is abuzz with the recently announced S3 Tables that came out of AWS reinvent this year. I tried them out, in real life that is, not just some marketing buzz, and it will leave most people, not all, be […] The post AWS S3 Tables. I’m going to call fools gold on this one right out of the gate.

AWS 130

AWS Data IT Big Data 130

databricks

DECEMBER 11, 2024

For Databricks and AWS, its not just about building togetherits about helping businesses succeed together. At AWS re:Invent. What makes a great partnership?

AWS 98

AWS Building IT 98

DoorDash Engineering

MARCH 7, 2023

As backend developers, we needed to stay unblocked while the infrastructure — in this case AWS resources — was being created. It was fair to assume that we would use other AWS services, particularly SQS and AWS Secrets Manager. Use LocalStack to enable locally running AWS resources.

AWS 119

AWS PostgreSQL Database SQL 119

Knowledge Hut

NOVEMBER 16, 2023

There is a clear shortage of professionals certified with Amazon Web Services (AWS). As far as AWS certifications are concerned, there is always a certain debate surrounding them. AWS certification helps you reach new heights in your career with improved pay and job opportunities. What is AWS?

AWS 98

AWS Certification IT Amazon Web Services 98

Seattle Data Guy

NOVEMBER 8, 2024

Recently, I’ve encountered a few projects that used AWS DMS, which is almost like an ELT solution. It was interesting to see AWS DMS used in this manner. As… Read more The post What Is AWS DMS And Why You Shouldn’t Use It As An ELT appeared first on Seattle Data Guy. But it’s not what DMS was built for.

AWS 130

AWS IT Data Storage Database 130

Knowledge Hut

JANUARY 11, 2024

Are you planning to appear for the AWS Cloud Practitioner Certification in 2023? Here is a complete and comprehensive guide of all the things you can expect from the AWS exams and how to best prepare for them! Amazon Web Services (AWS) is the global leader in cloud computing. Looking for some guidance in the right direction?

AWS 96

AWS Amazon Web Services Cloud Cloud Computing 96

Confessions of a Data Guy

NOVEMBER 14, 2023

“Of what use is, and what good does the best and most advanced architecture […] The post Fleetclusters for Databricks + AWS to reduce Costs. Here is my question, riddle me this all you hobbits. appeared first on Confessions of a Data Guy.

AWS 113

AWS Architecture Data IT 113

Analytics Vidhya

MARCH 5, 2023

Introduction S3 is Amazon Web Services cloud-based object storage service (AWS). It stores and retrieves large amounts of data, including photos, movies, documents, and other files, in a durable, accessible, and scalable manner.

Amazon Web Services 261

Amazon Web Services AWS Cloud Accessible 261

Cloudera

DECEMBER 4, 2024

But now AWS customers will gain more flexibility, data utility, and complexity, supporting the modern data architecture. For example: An AWS customer using Cloudera for hybrid workloads can now extend analytics workflows to Snowflake, gaining deeper insights without moving data across infrastructures.

AWS 95

AWS Raw Data Relational Database Government 95

The Pragmatic Engineer

OCTOBER 17, 2024

There is an increasing number of cloud providers offering the ability to rent virtual machines, the largest being AWS, GCP, and Azure. How the product works: they currently monitor four cloud providers (AWS, GCP, Hetzner Cloud, Azure.) We envision building something comparable to AWS Fargate , or Google Cloud Run.

Cloud 278

Cloud AWS Metadata Cloud Computing 278

Snowflake

DECEMBER 5, 2023

We had a jam-packed week alongside more than 60,000 attendees at Amazon Web Services (AWS) re:Invent, one of the largest hands-on conferences in the cloud computing industry. To learn more about these recent developments on generative AI and integrations with AWS, tune in to BUILD, Snowflake’s upcoming virtual conference for developers.

AWS 107

AWS Amazon Web Services Government Cloud Computing 107

databricks

NOVEMBER 15, 2024

Databricks is turning up the heat at AWS re:Invent 2024 , and we’re bringing more than just data and AI solutions to the.

AWS 105

AWS Data 105

Analytics Vidhya

MARCH 5, 2023

Introduction Amazon Athena is an interactive query tool supplied by Amazon Web Services (AWS) that allows you to use conventional SQL queries to evaluate data stored in Amazon S3. Athena is a serverless service. Thus there are no servers to operate, and you pay for the queries you perform.

Amazon Web Services 239

Amazon Web Services AWS SQL Data Analysis 239

The Pragmatic Engineer

MAY 11, 2023

The company racked up huge bills for the likes of AWS, Snowflake, and also Datadog. Prometheus can be self-hosted, but several cloud providers also offer managed Prometheus services: both Google Cloud and AWS have this service in production, while Azure has it in preview. We hit an all time high in our monthly transacting users of 11.4

AWS 318

AWS Software Engineer Software Engineering Google Cloud 318

Snowflake

JANUARY 31, 2024

Today, we’re excited to announce the general availability of the Snowflake Native App Framework on AWS and Azure! The post Snowflake Native App Framework Now Generally Available on AWS and Azure appeared first on Snowflake. We’ve seen incredible momentum around Snowflake Native Apps.

AWS 105

AWS Government Programming Data Science 105

Knowledge Hut

NOVEMBER 17, 2023

When we talk of top cloud computing providers, there are 2 names that are ruling the markets right now- AWS and Google Cloud. Hosting sites at AWS and Google Cloud has become fairly easy. When it comes to public cloud adoption, AWS is still the leader. All the traffic between the data centers is now encrypted by default.

Google Cloud 98

Google Cloud AWS Cloud Cloud Computing 98

databricks

NOVEMBER 28, 2023

We’re thrilled to share that Databricks has won the AWS ISV Partner of the Year award for North America. This award recognizes top I.

AWS 111

AWS 111

Analytics Vidhya

FEBRUARY 8, 2023

Introduction Amazon Redshift is a fully managed, petabyte-scale data warehousing Amazon Web Services (AWS). It allows users to easily set up, operate, and scale a data warehouse in the cloud. Redshift uses columnar storage techniques to store data efficiently and supports data warehousing workloads intelligence, reporting, and analytics.

Amazon Web Services 221

Amazon Web Services AWS Data Warehouse Cloud 221

Confessions of a Data Guy

NOVEMBER 18, 2024

What was not clear, or easy, was trying to figure out how DuckDB would LIKE to read default AWS […] The post DuckDB … reading from s3 … with AWS Credentials and more. appeared first on Confessions of a Data Guy.

AWS 113

AWS Data Big Data SQL 113

KDnuggets

DECEMBER 7, 2021

A lot of missing values in the dataset can affect the quality of prediction in the long run. Several methods can be used to fill the missing values and Datawig is one of the most efficient ones.

Deep Learning 158

Deep Learning AWS Datasets Data Preparation 158

KDnuggets

SEPTEMBER 19, 2022

This scholarship program aims to help people who are underserved and that were underrepresented during high school and college - to then help them learn the foundations and concepts of Machine Learning and build a careers in AI and ML.

Programming 139

Programming AWS Machine Learning Building 139

Start Data Engineering

MAY 11, 2022

AWS Infrastructure costs 4.3 Introduction 2. Objective 3. Prerequisite 4.2 Data lake structure 5. Code walkthrough 5.1 Loading user purchase data into the data warehouse 5.2 Loading classified movie review data into the data warehouse 5.3 Generating user behavior metric 5.4. Checking results 6. Tear down infra 7. Design considerations 8.

Data Engineering 246

Data Engineering Data Engineer Project Data Lake 246

Cloudera

DECEMBER 19, 2024

AWS re:Invent is one of my favorite trade shows. Cloudera is proud to partner with AWS to help mutual customers deploy sustainable AI solutions by leveraging AWS Graviton processors, reducing consumption and costs while improving performance for AI workloads. You can read more about the partnership and its implications here.

AWS 56

AWS Metadata Government Machine Learning 56

Cloudera

NOVEMBER 3, 2023

The post EMEA Summit Partner Awards for AWS, Accenture, IBM, Talend a Qlik Company, Tech Data, and Dell Technologies appeared first on Cloudera Blog. Thank you for a tremendous year, and we look forward to even greater success together in the years ahead!

AWS 106

AWS Technology Amazon Web Services Insurance 106

Cloudera

DECEMBER 2, 2024

To that end, we’re collaborating with Amazon Web Services (AWS) to deliver a high-performance, energy-efficient, and cost-effective solution by supporting many data services on AWS Graviton. And AWS is a crucial ally for Cloudera in enabling companies to scale AI operations responsibly.

AWS 94

AWS Amazon Web Services Cloud Computing Utilities 94

The Pragmatic Engineer

NOVEMBER 21, 2023

After Zynga, he rejoined Amazon, and was the General Manager (GM) for Compute services at AWS, and later chief of staff, and advisor to AWS executives like Charlie Bell and Andy Jassy (Amazon’s current CEO.) The AWS re:invent conference in 2022 hosted a good in-depth overview of Amazon’s COE process.

Engineering 302

Engineering Bytes Cloud Computing AWS 302

The Pragmatic Engineer

OCTOBER 10, 2024

We have seen other similar stories play out recently: In 2021, Elastisearch faced a similar “freerider” challenge from AWS. In response, AWS, GCP, Oracle, Snap and others are backing – and migrating to – the Valkey fork, which remains open source. In response, Elasticsearch ceased  being open source.

Consulting 306

Consulting AWS Engineering Software Engineer 306

Precisely

OCTOBER 3, 2024

In reviewing best practices for your AWS cloud migration, it’s crucial to define your business case first, and work from there. Migrating to AWS can unlock incredible value for your business, but it requires careful planning, risk management, and the right technical and organizational strategies.

AWS 64

AWS Cloud Amazon Web Services Data Integration 64

databricks

DECEMBER 11, 2024

Were excited to announce the Public Preview of Hive Metastore (HMS) and AWS Glue Federation in Unity Catalog! This new capability enables Unity.

AWS 72

AWS 72

The Pragmatic Engineer

JUNE 29, 2023

” Other registrars Other providers which several developers recommended, in order of popularity: AWS Route 53 : the obvious choice for those already on AWS. AWS uses Gandi under the hood for many of its domains. We see ourselves in the industry and reinforce that we as a registrar are not going away anytime soon!”

AWS 59

AWS Software Engineer Software Engineering Engineering 59

KDnuggets

JANUARY 23, 2023

JupyterHub is a multi-user, container-friendly version of the Jupyter Notebook. However, it can be difficult to setup. This blog post will make you less likely to run into issues in this 15+ step process.

AWS 116

AWS Process IT 116

KDnuggets

MAY 10, 2024

Master AI with these free courses from Harvard, Google, AWS, and more.

AWS 150

AWS 150

KDnuggets

AUGUST 23, 2024

Learn large language models with these free resources from Deeplearning.AI, Microsoft, AWS, and more.

AWS 150

AWS 150

The Pragmatic Engineer

SEPTEMBER 26, 2023

AWS launched in 2006, Azure in 2010, and GCP launched its first region in 2015. The segment really took off around 2018, although Cloud9 – which AWS acquired in 2017 – was founded in 2010. But the most recent 10 years suggest this is no longer the case. The Cloud is spreading and offering more capabilities.

Cloud 258

Cloud Software Engineer Software Engineering Cloud Computing 258

The Pragmatic Engineer

MAY 25, 2023

Exclusive Early warning of recent layoffs at AWS. In what was probably an oversight, affected AWS employees got a few days’ notice that the axe was going to fall, which helped many people prepare. To remedy things, the company froze all deploys for six weeks. What can we learn from this incident?

Software Engineer 316

Software Engineer Software Engineering AWS Engineering 316

databricks

OCTOBER 8, 2024

Summary Databricks Apps, a new way to build and deploy internal data and AI applications, is now available in Public Preview on AWS.

AWS 144

AWS Building Data 144

Data Engineering Podcast

FEBRUARY 18, 2024

Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262