Meltano

JANUARY 25, 2023

SQL Jinja isn’t enough SQL + Jinja isn’t enough – why we need dataframes by Furcy Pin “In October 2021, Max Beauchemin, creator of Apache Airflow, wrote an excellent article about 12 trends that are currently affecting data engineers.

Pipeline-centric 52

Pipeline-centric Database-centric SQL Data Warehouse 52

Monte Carlo

DECEMBER 28, 2022

This article examines the overall trend toward embedded, decentralized data teams and the advantage of maintaining a center of excellence. This is a great article for those looking for a straightforward introduction to data mesh.

Retail 52

Retail Consulting Architecture Data 52

Monte Carlo

DECEMBER 27, 2022

, and those conversations often serve as inspiration for new articles. Here’s a few of my favorite articles this year, in no particular order. The common thread: pay attention or pay the consequences Looking back, the theme across these articles is that data reliability isn’t something you can ignore.

Data Engineering 52

Data Engineering Data Engineer Cloud Machine Learning 52

Monte Carlo

DECEMBER 27, 2022

It definitely holds true for our Data Downtime blog with these five articles driving a majority of our traffic in 2022. There are a few characteristics that separate these articles from the chaff, namely: They were among the first to describe or even define a nascent concept. The concept they examine is transformative.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Warehouse 52

U-Next

DECEMBER 16, 2022

If you have not already read them or read about them, then this is your perfect chance to redeem yourself and gear up for cozy, enlightening, and enriching reading sessions with these splendid pieces of articles on various emerging curated for tech-savvy avid readers just like you. Take a look: . Important Functions Of HRM In 2022 .

Technology 52

Technology Cloud Computing Java Cloud Storage 52

Monte Carlo

DECEMBER 23, 2022

Data Stewards Have The Worst Seat At The Table Maxime Beuchemin’s other famous article, The downfall of the data engineer, explored how data engineers might have the worst seat at the table. In fact, many data teams have already started to successfully create and deploy data reliability engineers.

Software Engineer 52

Software Engineer Software Engineering Data Engineering Data Engineer 52

DataKitchen

FEBRUARY 21, 2023

On 24 January 2023, Gartner released the article “ 5 Ways to Enhance Your Data Engineering Practices.” Our recent Blog post: “ Plumbing Wisdom for Data Pipelines.” Blog Post: How to succeed as a DataOps Engineer The post A summary of Gartner’s recent DataOps-driven data engineering best practices article first appeared on DataKitchen.

Data Engineering 52

Data Engineering Data Engineer Engineering Pipeline-centric 52

KDnuggets

JANUARY 5, 2023

Register now for this webinar on Jan. 12 to learn how to simplify the process of using scientific literature within your AI, machine learning, and text mining projects.

Machine Learning 108

Machine Learning Project Process 108

The Pragmatic Engineer

APRIL 21, 2024

See a longer version of this article here: Scaling ChatGPT: Five Real-World Engineering Challenges. ” This was an expert from the article Scaling ChatGPT: Five Real-World Engineering Challenges. Read that article for more details on the engineering challenges behind building (and scaling) ChatGPT, as explained by Evan.

Engineering 348

Engineering Software Engineer Software Engineering Programming 348

ProjectPro

FEBRUARY 4, 2016

We know that big data professionals are far too busy to searching the net for articles on Hadoop and Big Data which are informative and factually accurate. We have taken the time and listed 10 best Hadoop articles for you. To read the complete article, click here 2) How much Java is required to learn Hadoop?

Hadoop 40

Hadoop Java Retail Big Data 40

Zalando Engineering

SEPTEMBER 1, 2015

This week the blog/e-newsletter Data Science Weekly released their list of the “Most Read Data Science Articles of 2015.” We were pretty excited to see that our very own Mikio Braun topped the list with his article, “Three Things About Data Science You Won’t Find In the Books.” You can read Mikio’s full article here.

Data Science 40

Data Science Data Systems Machine Learning 40

Analytics Vidhya

AUGUST 4, 2024

This article discusses […] The post Neo4j vs. Amazon Neptune: Graph Databases in Data Engineering appeared first on Analytics Vidhya. Traditional databases, while still valuable, often falter when it comes to handling highly connected data. Enter the unsung heroes of the data world: graph databases.

Database 213

Database Data Engineering Data Engineer Engineering 213

The Pragmatic Engineer

DECEMBER 21, 2023

Occasionally, there was a bonus article on Wednesdays, too, such as about  the book, Tidy First? Today’s issue is a look back at 2023, with pointers to articles you may want to reread, or discover for the first time. This year, 102 newsletter issues were published, and this is number 103.

Engineering 177

Engineering Software Engineer Software Engineering Project 177

KDnuggets

OCTOBER 16, 2024

I’ve selected ten to talk about in this article. Where can you find projects dealing with advanced ML topics? GitHub is a perfect source with its many repositories.

Machine Learning 152

Machine Learning Project IT 152

Simon Späti

OCTOBER 16, 2024

In this article, we’ll discuss five key use cases, categorize them, and highlight the unique advantages of an enterprise using DuckDB. What about scaling out and sharing it with others in the organization? Isn’t it only a database file? And why would anyone in a large enterprise adopt DuckDB?

IT 130

IT Database Data Engineering Data Engineer 130

Analytics Vidhya

OCTOBER 6, 2023

This article will explore the key features and benefits, identify the ideal users for this solution, and guide you on when and how to […] The post Introduction of Microsoft Fabric appeared first on Analytics Vidhya. Enter Microsoft Fabric, a cutting-edge solution designed to revolutionize how we interact with technology.

Designing 262

Designing Technology Data Lake Business Intelligence 262

Analytics Vidhya

SEPTEMBER 20, 2023

This article presents the top 20 data engineering project ideas with their source code. Data engineering plays a pivotal role in the vast data ecosystem by collecting, transforming, and delivering data essential for analytics, reporting, and machine learning.

Data Engineering 268

Data Engineering Data Engineer Coding Project 268

The Pragmatic Engineer

MARCH 12, 2024

In this article, we cover one out of five topics from today’s subscriber-only article What Changed in 50 Years of Computing. This was one out of the five topics covered in the article What Changed in 50 Years of Computing. If you’re been forwarded this email, you can subscribe here.

Engineering 269

Engineering Programming Language Hospitality Programming 269

Christophe Blefari

SEPTEMBER 13, 2024

Bloomberg reported that OpenAI seeks to raise $11,5b more at $150b valuation , making it the third private company in terms on valuation [paywall article]. The articles contains a lot of code snippets to understand what's under the hood. This article shows how data teams are becoming larger and larger in the clubs.

Pipeline-centric 100

Pipeline-centric Data Python Data Science 100

The Pragmatic Engineer

NOVEMBER 21, 2023

In this article, we cover thee out of nine topics from today’s subscriber-only issue: The Past and Future of Modern Backend Practices. “The more things change, the more they stay the same,” is one theme of this article. 👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter.

Engineering 297

Engineering Bytes Cloud Computing AWS 297

KDnuggets

OCTOBER 25, 2024

This article is an attempt to amend this by suggesting ten (and some more, as a bonus) libraries that are an absolute must in data science. The richness of Python’s ecosystem has one downside: it makes it difficult to decide which libraries are the best for your needs.

Data Science 125

Data Science Python Data IT 125

Simon Späti

FEBRUARY 25, 2023

As I sit down to write this article, I’m filled with a sense of vulnerability and excitement. You see, this is a story that only I can tell. It’s a tale of finding my Pathless Path and discovering who I am in the process.

Process 289

Process IT 289

KDnuggets

NOVEMBER 6, 2024

In this article, we will learn how to navigate the fine balance building AI regulation while simultaneously fostering innovation.

Building 117

Building 117

Waitingforcode

AUGUST 9, 2024

Although the transformation (the WHAT from the previous article) is similar in both cases, more complete validation tests on the job logic are not. Testing batch jobs is not the same as testing streaming ones. After all, streaming jobs often iteratively build the final outcome while the batch ones generate it in a single pass.

Building 130

Building IT 130

KDnuggets

NOVEMBER 1, 2024

In this article, the author proposes a new phrase: "If Data is the New Oil, then Generative AI is the new Rocket Fuel," to emphasize GAI's role in enhancing data's value.

Data 106

Data 106

KDnuggets

OCTOBER 31, 2024

This article presents a comprehensive discussion of when to choose which approach for your LLM and potential hybrid solutions.

120

120

KDnuggets

NOVEMBER 15, 2024

In this article, we’ll look at how to build ETL pipelines for data science projects.

Data Science 113

Data Science Project Data Building 113

KDnuggets

OCTOBER 21, 2024

In this article, we will explore how to find and remove missing values in R. Missing data can cause problems in data analysis, so it's important to handle it correctly.

Data Analysis 103

Data Analysis Data IT 103

KDnuggets

NOVEMBER 1, 2024

This article highlights how data science is being used for social good, and making a meaningful impact on society.

Data Science 105

Data Science Project Data 105

Zalando Engineering

SEPTEMBER 17, 2024

We are building tools that streamline the content creation journey - from photo shooting, copyrighting to submission articles in Zalando shop in compliant way. After QA is completed, the article is published in the shop. Yet, the content creation stage of the product onboarding is largely a manual process.

Machine Learning 73

Machine Learning Metadata Architecture Designing 73

Picnic Engineering

OCTOBER 14, 2024

This so-called Master Planning Process (MPP) represents the planning of the Picnic supply chain path for every ordered article from the Fulfilment Centre to the customer’s door. For example, when assigning articles to totes, the goal is to distribute the articles in a way that minimises the number of totes needed.

Algorithm 75

Algorithm Datasets Java Coding 75

KDnuggets

OCTOBER 2, 2024

This article walks through the basics of using R for text mining, from data preparation to analysis. Text mining in R helps you explore large text data to find patterns and insights.

Data Preparation 102

Data Preparation Data 102

KDnuggets

SEPTEMBER 16, 2024

Preparation We would need the Pandas and Numpy packages installed, so we can install them using the following code: pip install pandas numpy With the packages installed, let’s jump into the article. Time Series.

Data 111

Data Coding 111

KDnuggets

SEPTEMBER 19, 2024

This article will help you learn how to use ggplot2 to create visualizations. ggplot2 is a tool in R for making charts. You can create charts with dots, bars, or lines. You can also add layers to show more details. Getting started with ggplot2 Before using ggplot2, you need to install it and.

Data 108

Data IT 108

U-Next

DECEMBER 21, 2022

Every piece of article on this list is a must-read and will help you be updated with the latest ongoings in the industry. Do not miss out on reading this article and learning how to identify if your phone has ever been hacked. . We hope you enjoyed our pick of the best Cybersecurity articles in 2022. Cybersecurity enthusiasts?

Education 105

Education Government Project Engineering 105

KDnuggets

OCTOBER 14, 2024

For developers working with LLMs, Intel’s article serves as a practical guide to navigating the complexities of fine-tuning and inference, offering valuable insights and techniques for optimizing both the development and deployment phases.

89

89

KDnuggets

OCTOBER 17, 2024

This article will discuss how to set up and streamline data science projects using Monday.com for project management among teams.

Data Science 98

Data Science Project Data Management 98