Analytics Vidhya

MARCH 12, 2025

In this article, we will explore the evolution of Iceberg, its key features like ACID transactions, partition evolution, and time travel, and how it integrates with modern data lakes. Well also dive into […] The post How to Use Apache Iceberg Tables?

Data Lake 134

Data Lake Designing IT Data 134

The Pragmatic Engineer

APRIL 21, 2024

See a longer version of this article here: Scaling ChatGPT: Five Real-World Engineering Challenges. ” This was an expert from the article Scaling ChatGPT: Five Real-World Engineering Challenges. Read that article for more details on the engineering challenges behind building (and scaling) ChatGPT, as explained by Evan.

Engineering 363

Engineering Software Engineer Software Engineering Programming 363

The Pragmatic Engineer

NOVEMBER 21, 2023

In this article, we cover thee out of nine topics from today’s subscriber-only issue: The Past and Future of Modern Backend Practices. “The more things change, the more they stay the same,” is one theme of this article. 👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter.

Engineering 345

Engineering Bytes Cloud Computing AWS 345

The Pragmatic Engineer

MARCH 12, 2024

In this article, we cover one out of five topics from today’s subscriber-only article What Changed in 50 Years of Computing. This was one out of the five topics covered in the article What Changed in 50 Years of Computing. If you’re been forwarded this email, you can subscribe here.

Engineering 329

Engineering Programming Language Hospitality Programming 329

Simon Späti

FEBRUARY 25, 2023

As I sit down to write this article, I’m filled with a sense of vulnerability and excitement. You see, this is a story that only I can tell. It’s a tale of finding my Pathless Path and discovering who I am in the process.

Process 289

Process IT 289

The Pragmatic Engineer

SEPTEMBER 26, 2023

In this article, we cover a fresh industry trends: Cloud Developent Environments — which is analysis full subscribers have received 3 weeks ago. Here is a summary of all the vendors and products mentioned in this article: The number of cloud development environment product launches seem to be increasing since 2021.

Cloud 316

Cloud Software Engineer Software Engineering Cloud Computing 316

Analytics Vidhya

SEPTEMBER 20, 2023

This article presents the top 20 data engineering project ideas with their source code. Data engineering plays a pivotal role in the vast data ecosystem by collecting, transforming, and delivering data essential for analytics, reporting, and machine learning.

Data Engineering 273

Data Engineering Data Engineer Coding Project 273

Analytics Vidhya

OCTOBER 6, 2023

This article will explore the key features and benefits, identify the ideal users for this solution, and guide you on when and how to […] The post Introduction of Microsoft Fabric appeared first on Analytics Vidhya. Enter Microsoft Fabric, a cutting-edge solution designed to revolutionize how we interact with technology.

Designing 268

Designing Technology Data Lake Business Intelligence 268

The Pragmatic Engineer

OCTOBER 31, 2023

In this article, we cover three out of seven topics from today’s subscriber-only issue Three Cloud Providers, Three Outages: Three Different Responses. We’ll also learn how this article contributed to AWS publishing its first public postmortem in two years! Silence of AWS (until this article was about to publish) 1.

AWS 290

AWS Google Cloud Cloud Engineering 290

Analytics Vidhya

MARCH 21, 2023

You will study top 11 azure interview questions in this article which will discuss different data services like Azure Cosmos […] The post Top 11 Azure Data Services Interview Questions in 2023 appeared first on Analytics Vidhya. Organizations are using various cloud platforms like Azure, GCP, etc.,

Data 247

Data Cloud Data Lake Database 247

The Pragmatic Engineer

DECEMBER 21, 2023

Occasionally, there was a bonus article on Wednesdays, too, such as about  the book, Tidy First? Today’s issue is a look back at 2023, with pointers to articles you may want to reread, or discover for the first time. This year, 102 newsletter issues were published, and this is number 103.

Engineering 212

Engineering Software Engineer Software Engineering Project 212

Christophe Blefari

MARCH 1, 2023

This article is meant to be a resource hub in order to understand dbt basics and to help get started your dbt journey. In these articles there are a lot of cool presentations you should watch to understand deeper how dbt works. A rant against dbt ref — A great article to make you think about dbt principles.

Data Warehouse 278

Data Warehouse SQL Metadata Raw Data 278

The Pragmatic Engineer

JUNE 22, 2023

In this article, we cover one out of five topics from today’s subscriber-only The Scoop issue. 👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers.

Google Cloud 304

Google Cloud Media Cloud Engineering 304

Analytics Vidhya

AUGUST 4, 2024

This article discusses […] The post Neo4j vs. Amazon Neptune: Graph Databases in Data Engineering appeared first on Analytics Vidhya. Traditional databases, while still valuable, often falter when it comes to handling highly connected data. Enter the unsung heroes of the data world: graph databases.

Database 219

Database Data Engineering Data Engineer Engineering 219

The Pragmatic Engineer

JANUARY 12, 2023

I covered the collapse of the company at the time in the article Inside Pollen’s collapse: “$200M raised” but staff unpaid - exclusive. It remains my most in-depth investigative article. The complete article additionally covers: The pay transparency report. Read the full article here.

Software Engineer 219

Software Engineer Software Engineering Engineering Raw Data 219

Analytics Vidhya

FEBRUARY 28, 2023

This article explains to you the idea […] The post Understanding Dimensional Modeling appeared first on Analytics Vidhya. This data is used by an organization to find valuable insights which help in improving an organization’s growth and strategies and give them an upper hand over its competitors.

Data Warehouse 236

Data Warehouse IT Data Database 236

The Pragmatic Engineer

MAY 1, 2024

This article was published on 14 March 2024 in The Pragmatic Engineer, for subscribers. Some articles about Cognition AI’s product launch. The full article covers these additional topics: Industry pulse.  Read the full article here. The company broke through to mainstream media – no small feat!

Software Engineer 246

Software Engineer Software Engineering Programming Language Media 246

The Pragmatic Engineer

MAY 25, 2023

To get full articles twice a week, subscribe here. In the article “ I'm an employer. In every issue, I cover topics related to Big Tech and high-growth startups through the lens of engineering managers and senior engineers. In this issue, we cover one out of six topics from today’s subscriber-only The Scoop issue.

Software Engineer 354

Software Engineer Software Engineering AWS Engineering 354

Analytics Vidhya

JUNE 12, 2023

In this article, we explore Tajinder’s inspiring success story. Introduction Meet Tajinder, a seasoned Senior Data Scientist and ML Engineer who has excelled in the rapidly evolving field of data science.

Machine Learning 235

Machine Learning Engineering Raw Data Data Science 235

Scott Logic

MARCH 6, 2025

Vibe Coding Just a few weeks ago Andrej Karpathy (a founding member of OpenAI) coined a term, vibe coding , which has taken the tech world by storm, triggering articles in the popular press, such as this one from New York Times a few days ago. Bolt knows none of this and proudly presents its Word Game as though it were the finished article.

Coding 104

Coding Building Utilities Programming 104

The Pragmatic Engineer

AUGUST 1, 2023

This issue looks at two companies from the 15 covered in those articles: we cover Wise and Amazon. We cover more about Amazon’s engineering levels in the article, Inside Amazon’s engineering culture. Wise Wise – formerly Transferwise – is a publicly traded Fintech, valued at $6.5B at time of publication.

Software Engineer 246

Software Engineer Software Engineering Engineering Designing 246

The Pragmatic Engineer

SEPTEMBER 19, 2024

This is a follow-up to the article Paying down tech debt , written by industry veteran Lou Franco. For more tactics on how to deal with tech debt, see the article Paying down tech debt , published in The Pragmatic Engineer. Lou has been in the software business for over 30 years as an engineer, EM, and executive.

Recruitment 297

Recruitment Java Coding Project 297

The Pragmatic Engineer

OCTOBER 17, 2024

In this article, we cover one section from this week’s from last week’s The Pulse issue. In this article, we cover: Funding and team size. Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. To get full issues twice a week, subscribe here. Tech stack.

Cloud 332

Cloud AWS Metadata Cloud Computing 332

Analytics Vidhya

APRIL 17, 2023

This article will give you a glimpse of Kedro framework using news classification tasks. Introduction Kedro is an open-source Python framework for creating reproducible, maintainable, and modular data science code. It uses best practices of software engineering to build production-ready data science pipelines.

Data Science 226

Data Science Software Engineer Software Engineering Machine Learning 226

The Pragmatic Engineer

DECEMBER 18, 2023

See advice on various approaches in my article Developers mentoring other developers: practices I've seen work well. See a list of paid coaches and engineering managers based on both people I know personally; and recommendations from engineering managers who worked with them.

Software Engineer 265

Software Engineer Software Engineering Engineering Management 265

Analytics Vidhya

MARCH 7, 2023

In this article, we will discuss about Apache Flume, […] The post A Dive into Apache Flume: Installation, Setup, and Configuration appeared first on Analytics Vidhya. Flume is a tool that is very dependable, distributed, and customizable. einsteinerupload of.

Data Ingestion 223

Data Ingestion Data Storage Hadoop Data 223

The Pragmatic Engineer

JUNE 13, 2023

To get articles like this every week, subscribe here. To show the complexity of this choice and the ways tech businesses approach it, this article brings the inside story of one large tech company that’s decided against onboarding to the cloud – at least for now. Read the full article series here.

Cloud 251

Cloud Database Utilities BI 251

The Pragmatic Engineer

OCTOBER 18, 2024

Because of this intertwined nature, in the rest of the article I will refer to Automattic as the “actor,” including when actions are by WordPress.org, or the WordPress Foundation. I have zero affiliation with Automattic, WP Engine, WordPress, or any other companies mentioned in this article.

Engineering 357

Engineering Government Project AWS 357

The Pragmatic Engineer

JULY 20, 2023

In this article, we cover one out of five topics from today’s subscriber-only deepdive on Advice on how to sell a startup. This was one out of the five topics we covered in the article How to Sell an Early Stage Startup: Lessons from Akita Software. The full article additionally covers: Jean’s background.

Building 235

Building Programming Language Programming Python 235

The Pragmatic Engineer

MARCH 19, 2024

In this article, we cover one out of three topics from last week’s subscriber-only The Pulse issue. Some articles about Cognition AI’s product launch. 👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. The company broke through to mainstream media – no small feat!

Software Engineer 327

Software Engineer Software Engineering Programming Language Media 327

The Pragmatic Engineer

APRIL 11, 2024

In this article, we cover one out of four topics from today’s subscriber-only The Pulse issue. As related reading, here are past articles touching on the topic of migrations and tricky outages: Why it took Roblox 73 hours to get their systems back online in 2021. To get full issues twice a week, subscribe here.

Banking 271

Banking Utilities Database Engineering 271

The Pragmatic Engineer

AUGUST 22, 2023

In this article, we cover one out of for topics from the past newsletter issue Game Development Basics. In this article, my focus is on providing a high-level overview of how game development works, and how software engineers fit into that space. This was one out of the four topics covered in the article Game Development Basics.

Software Engineer 235

Software Engineer Software Engineering Consulting Entertainment 235

The Pragmatic Engineer

OCTOBER 10, 2023

In this article, we cover three out of eight topics from today’s deepdive into tech scaleup Chronosphere. We covered more on this topic in the article How Uber built its observability platform. We previously covered the building of M3 in the article How Uber Built its Observability Platform.

Software Engineer 327

Software Engineer Software Engineering Architecture Media 327

Analytics Vidhya

FEBRUARY 4, 2023

Introduction This article will explain the difference between ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) when data transformation occurs. In ETL, data is extracted from multiple locations to meet the requirements of the target data file and then placed into the file.

Data 201

Data Process Cloud Computing Data Analysis 201

Christophe Blefari

MARCH 15, 2024

Forward thinking Dataviz is hierarchical — Malloy, once again, provides an excellent article about a new way to see data visualisations. In the article Joseph explains how MotherDuck extended DuckDB to add time travel, zero-copy snapshots opening the door for more collaboration and concurrency. It's inspirational.

Metadata 272

Metadata Data Data Warehouse Software Engineer 272

The Pragmatic Engineer

OCTOBER 24, 2023

In this article, we cover two out of seven topics from today’s full issue on The Man Behind the Big Tech Comics. In the article Turmoil at Twitter , we covered both how engineers were told to print out code on paper (!!) Read the full article here. To get full issues twice a week, subscribe here.

Coding 236

Coding Software Engineer Software Engineering Media 236

Analytics Vidhya

AUGUST 22, 2023

In this article, we will discuss ELT vs ETL, comparing their characteristics, benefits, and suitability for various use cases. […] The post ELT vs ETL: Unveiling the Differences and Similarities appeared first on Analytics Vidhya.

Data Integration 187

Data Integration Process Datasets Data 187