Analytics Vidhya

JUNE 12, 2023

Introduction Meet Tajinder, a seasoned Senior Data Scientist and ML Engineer who has excelled in the rapidly evolving field of data science. Tajinder’s passion for unraveling hidden patterns in complex datasets has driven impactful outcomes, transforming raw data into actionable intelligence.

Machine Learning 235

Machine Learning Engineering Raw Data Data Science 235

WeCloudData

FEBRUARY 6, 2025

We live in a highly data oriented world, thus it’s important to understand the key roles of the data ecosystem. Data scientists and engineers are two of the most important data professions and it is important to understand the difference between data engineering vs data science.

Data Science 52

Data Science Data Engineering Data Engineer Engineering 52

Netflix Tech

DECEMBER 17, 2024

This article is the first in a multi-part series sharing a breadth of Analytics Engineering work at Netflix, recently presented as part of our annual internal Analytics Engineering conference. Subsequent posts will detail examples of exciting analytic engineering domain applications and aspects of the technical craft.

Engineering 88

Engineering Entertainment Amazon Web Services Utilities 88

The Pragmatic Engineer

JANUARY 12, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one and a half out of eight topics in today’s subscriber-only issue, Inside Pollen's Transparent Compensation Data. Here are a few details from the data points, focusing on software engineering compensation.

Software Engineering 219

Software Engineering Software Engineer Engineering Raw Data 219

WeCloudData

FEBRUARY 27, 2025

In the era of data-driven decision-making, terms like Business Intelligence (BI), Data Science (DS), and Data Engineering (DE) often surface in conversations. While all three play a crucial role in utilizing data to drive business outcomes, their functions, tools, and objectives differ significantly.

Business Intelligence 52

Business Intelligence BI Data Science Data Engineering 52

Simon Späti

MARCH 9, 2021

This post focuses on practical data pipelines with examples from web-scraping real-estates, uploading them to S3 with MinIO, Spark and Delta Lake, adding some Data Science magic with Jupyter Notebooks, ingesting into Data Warehouse Apache Druid, visualising dashboards with Superset and managing everything with Dagster.

Data Engineering 189

Data Engineering Data Engineer Engineering Project 189

KDnuggets

DECEMBER 6, 2022

SQL is the essential language for developers, engineers, and data professionals. Intermediate knowledge in SQL gives you an edge in your data science career.

SQL 153

SQL Data Science Data Engineering 153

Analytics Vidhya

JUNE 12, 2023

Introduction Meet Tajinder, a seasoned Senior Data Scientist and ML Engineer who has excelled in the rapidly evolving field of data science. Tajinder’s passion for unraveling hidden patterns in complex datasets has driven impactful outcomes, transforming raw data into actionable intelligence.

Machine Learning 185

Machine Learning Engineering Raw Data Data Science 185

KDnuggets

FEBRUARY 14, 2023

Docker is dependency management on steroids, helping to ensure both reproducibility and collaboration, making it an important tool for data science. Our latest cheat sheet serves as a handy Docker reference. Check it out now!

Data Science 155

Data Science Data Management IT 155

KDnuggets

NOVEMBER 5, 2024

Enhance your data science portfolio with these seven engaging Python projects that demonstrate essential programming and software engineering skills.

Portfolio 129

Portfolio Data Science Python Project 129

KDnuggets

DECEMBER 8, 2021

Take the first step towards your machine learning engineering career and explore the UC San Diego Extension Machine Learning Engineering Bootcamp today. Those with prior software engineering or data science experience are encouraged to apply.

Engineering 160

Engineering Machine Learning Software Engineering Software Engineer 160

Analytics Vidhya

JUNE 24, 2023

He is an experienced data engineer with a passion for problem-solving and a drive for continuous growth. Thus, providing valuable insights into the field of data engineering. Throughout the conversation, Mr. Pavan shares his journey, inspirations, challenges, and accomplishments.

Data Engineering 209

Data Engineering Data Engineer Engineering Data 209

KDnuggets

MARCH 2, 2023

The latest KDnuggets cheat sheet covers using ChatGPT to your advantage as a data scientist. It's time to master prompt engineering, and here is a handy reference for helping you along the way.

Data Science 160

Data Science Data Engineering IT 160

Analytics Vidhya

APRIL 17, 2023

Introduction Kedro is an open-source Python framework for creating reproducible, maintainable, and modular data science code. It uses best practices of software engineering to build production-ready data science pipelines. This article will give you a glimpse of Kedro framework using news classification tasks.

Data Science 226

Data Science Software Engineering Software Engineer Machine Learning 226

KDnuggets

DECEMBER 9, 2022

As more people are entering the field of Data Science and more companies are hiring for data-centric roles, what type of jobs are currently in highest demand?

Engineering 160

Engineering Data Engineering Data Engineer Data Science 160

Analytics Vidhya

JULY 25, 2023

In the world of data, two crucial roles play a significant part in unlocking the power of information: Data Scientists and Data Engineers. But what sets these wizards of data apart? Welcome to the ultimate showdown of Data Scientist vs Data Engineer! appeared first on Analytics Vidhya.

Data Engineering 202

Data Engineering Data Engineer Engineering Data 202

Towards Data Science

JANUARY 19, 2025

Make the right choice for YOU Continue reading on Towards Data Science

Data Science 90

Data Science Data Analytics Engineering Data Engineering 90

Data Engineering Podcast

FEBRUARY 5, 2023

In that time there have been a number of generational shifts in how data engineering is done. Go to [dataengineeringpodcast.com/materialize]([link] Support Data Engineering Podcast Summary This podcast started almost exactly six years ago, and the technology landscape was much different than it is now.

Data Engineering 147

Data Engineering Data Engineer Engineering PostgreSQL 147

KDnuggets

FEBRUARY 28, 2024

Begin your data professional journey from the basics of statistics to building a production-grade AI application.

Machine Learning 160

Machine Learning Data Science Data Engineering Data Engineer 160

KDnuggets

NOVEMBER 7, 2023

No, they’re not the same jobs! Learn what responsibilities, skills, and tools used make them different. Then, choose the right career path for you.

Data Science 156

Data Science Data Engineering Data Engineer Engineering 156

KDnuggets

MAY 19, 2022

Read the best books on Programming, Statistics, Data Engineering, Web Scraping, Data Analytics, Business Intelligence, Data Applications, Data Management, Big Data, and Cloud Architecture.

Data Science 160

Data Science Business Intelligence Big Data Architecture 160

Data Engineering Podcast

FEBRUARY 18, 2024

In this episode Dain Sundstrom, CTO of Starburst, explains how the combination of the Trino query engine and the Iceberg table format offer the ease of use and execution speed of data warehouses with the infinite storage and scalability of data lakes. Data lakes are notoriously complex. Your first 30 days are free!

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Jesse Anderson

JANUARY 29, 2024

The premier of my latest talk covering The State of Data Engineering. This starts with data warehousing and goes into data science. I finish off by showing how data engineering can avoid the same fate as data warehousing and data science.

Data Engineering 130

Data Engineering Data Engineer Engineering Data Science 130

KDnuggets

MARCH 29, 2023

The second part covers the list of Machine Learning, Deep Learning, Computer Vision, Natural Language Processing, Data Engineering, and MLOps.

Data Science 160

Data Science Deep Learning Machine Learning Data Engineering 160

Data Engineering Weekly

APRIL 20, 2025

[link] Jing Ge: Context Matters — The Vision of Data Analytics and Data Science Leveraging MCP and A2A All aspects of software engineering are rapidly being automated with various coding AI tools, as seen in the AI technology radar. Data engineering is one aspect where I see a few startups starting to disrupt.

Data Engineering 67

Data Engineering Data Engineer Engineering Kafka 67

KDnuggets

DECEMBER 27, 2023

Discover a collection of top courses to launch your dream career or master a new skill, all for free!

Machine Learning 149

Machine Learning Data Science Data Engineering Data Engineer 149

Towards Data Science

JANUARY 30, 2025

With MNISTs 60,000 training examples, we were in the abundant data regime where selecting diverse, challenging examples proved most beneficial. As people start sounding the alarm that we are running out of data, I cant help but wonder if less data is actually the key to useful, cost-effective models. References LeCun, Y.,

Database-centric 106

Database-centric Datasets Data Architecture 106

Data Engineering Weekly

JULY 21, 2024

Editor’s Note: A New Series on Data Engineering Tools Evaluation There are plenty of data tools and vendors in the industry. Data Engineering Weekly is launching a new series on software evaluation focused on data engineering to better guide data engineering leaders in evaluating data tools.

Data Engineering 117

Data Engineering Data Engineer Engineering Generalist 117

Confessions of a Data Guy

MARCH 4, 2025

Context and Motivation dbt (Data Build Tool): A popular open-source framework that organizes SQL transformations in a modular, version-controlled, and testable way. Databricks: A platform that unifies data engineering and data science pipelines, typically with Spark (PySpark, Scala) or SparkSQL.

Scala 100

Scala Data Science SQL Data Engineering 100

KDnuggets

AUGUST 18, 2022

If you’re considering a career in data science, it’s important to understand how these two fields differ, and which one might be more appropriate for someone with your skills and interests.

Data Engineering 159

Data Engineering Data Engineer Engineering Data Science 159

KDnuggets

FEBRUARY 20, 2025

Whatever role is best for youdata scientist, data engineer, or technology managerNorthwestern University's MS in Data Science program will help you to prepare for the jobs of today and the jobs of the future.

Technology 126

Technology Data Engineering Data Engineer Engineering 126

Data Engineering Weekly

JULY 28, 2024

link] Chip Huyan: Building A Generative AI Platform We can’t deny that Gen-AI is becoming an integral part of product strategy, pushing the need for platform engineering. Switching from Apache Spark to Ray improves compact 12X larger datasets than Apache Spark, improves cost efficiency by 91%, and processes 13X more data per hour.

Data Engineering 109

Data Engineering Data Engineer Engineering Database-centric 109

Analytics Vidhya

FEBRUARY 6, 2023

Introduction The demand for data to feed machine learning models, data science research, and time-sensitive insights is higher than ever thus, processing the data becomes complex. To make these processes efficient, data pipelines are necessary.

Amazon Web Services 219

Amazon Web Services Data Pipeline Machine Learning Data Science 219

Knowledge Hut

JUNE 25, 2024

Many aspiring data scientists are working hard to earn a Certificate in Data Science with Python since Python is widely used in artificial intelligence for robots and voice assistants like Alexa, Siri, and Google Assistant, among others. This is the best-selling programming language data science python handbook in the world.

Data Science 97

Data Science Python Hadoop Machine Learning 97

KDnuggets

APRIL 19, 2024

The collection includes free courses on Python, SQL, Data Analytics, Business Intelligence, Data Engineering, Machine Learning, Deep Learning, Generative AI, and MLOps.

Data Science 153

Data Science Deep Learning Business Intelligence Machine Learning 153

Snowflake

APRIL 23, 2025

In our fast-paced data- and AI-driven world, teaching students the skills they need to succeed in the industry is more critical than ever. Free comprehensive teaching resources and a no-hassle setup: Teaching AI/ML, data science, apps and data cloud technologies shouldnt be bogged down by logistical challenges.

Education 97

Education Certification Portfolio Retail 97

Edureka

APRIL 22, 2025

Data engineering can help with it. It is the force behind seamless data flow, enabling everything from AI-driven automation to real-time analytics. Key Trends in Data Engineering for 2025 In the fast-paced world of technology, data engineering services keep companies that focus on data running.

Data Engineering 52

Data Engineering Data Engineer Engineering Consulting 52