Analytics Vidhya

JUNE 24, 2023

He is an experienced data engineer with a passion for problem-solving and a drive for continuous growth. Thus, providing valuable insights into the field of data engineering. Introduction We had an amazing opportunity to learn from Mr. Pavan.

Data Engineering 204

Data Engineering Data Engineer Engineering Data 204

KDnuggets

JULY 13, 2022

Linear Algebra for Data Science; 10 Modern Data Engineering Tools; Python String Processing Cheatsheet; Simple Salary Guide for Tech Experts 2022; 16 Essential DVC Commands for Data Science.

Data Science 127

Data Science Data Engineering Data Engineer Engineering 127

Data Engineering Podcast

FEBRUARY 18, 2024

Summary A data lakehouse is intended to combine the benefits of data lakes (cost effective, scalable storage and compute) and data warehouses (user friendly SQL interface). Data lakes are notoriously complex. Join in with the event for the global data community, Data Council Austin.

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

KDnuggets

JANUARY 17, 2022

In this article, I will describe three of the most promising career options within the data industry? — data analytics, data science, and data engineering.

Data Engineering 147

Data Engineering Data Engineer Engineering Data 147

Jesse Anderson

JANUARY 29, 2024

The premier of my latest talk covering The State of Data Engineering. This starts with data warehousing and goes into data science. I finish off by showing how data engineering can avoid the same fate as data warehousing and data science.

Data Engineering 130

Data Engineering Data Engineer Engineering Data Science 130

KDnuggets

FEBRUARY 28, 2024

Begin your data professional journey from the basics of statistics to building a production-grade AI application.

Machine Learning 160

Machine Learning Data Science Data Engineering Data Engineer 160

KDnuggets

FEBRUARY 14, 2023

Docker is dependency management on steroids, helping to ensure both reproducibility and collaboration, making it an important tool for data science. Our latest cheat sheet serves as a handy Docker reference. Check it out now!

Data Science 156

Data Science Data Management IT 156

Jesse Anderson

SEPTEMBER 14, 2023

There has been quite a bit of writing covering GPT and LLMs from data science and business perspectives. I haven’t seen much from the data engineering side. Let me share my perspective, having been in data and AI for a while and using LLMs before they became popular. How can we use LLMs in data engineering?

Data Engineering 147

Data Engineering Data Engineer Engineering NoSQL 147

Data Engineering Podcast

FEBRUARY 5, 2023

In that time there have been a number of generational shifts in how data engineering is done. Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Materialize]([link] Looking for the simplest way to get the freshest data possible to your teams?

Data Engineering 147

Data Engineering Data Engineer Engineering PostgreSQL 147

Data Engineering Weekly

JULY 21, 2024

Editor’s Note: A New Series on Data Engineering Tools Evaluation There are plenty of data tools and vendors in the industry. Data Engineering Weekly is launching a new series on software evaluation focused on data engineering to better guide data engineering leaders in evaluating data tools.

Data Engineering 119

Data Engineering Data Engineer Engineering Generalist 119

Jesse Anderson

DECEMBER 12, 2022

They were the first companies to commercialize open source big data technologies and pushed the marketing and commercialization of Hadoop. With an immutable file system like HDFS, we needed scalable databases to read and write data randomly. Apache Kafka came in 2011 and gave the industry a much better way to move real-time data.

Data Engineering 130

Data Engineering Data Engineer Engineering Hadoop 130

KDnuggets

DECEMBER 27, 2023

Discover a collection of top courses to launch your dream career or master a new skill, all for free!

Machine Learning 152

Machine Learning Data Science Data Engineering Data Engineer 152

KDnuggets

NOVEMBER 7, 2023

No, they’re not the same jobs! Learn what responsibilities, skills, and tools used make them different. Then, choose the right career path for you.

Data Science 157

Data Science Data Engineering Data Engineer Engineering 157

KDnuggets

DECEMBER 9, 2022

As more people are entering the field of Data Science and more companies are hiring for data-centric roles, what type of jobs are currently in highest demand?

Engineering 160

Engineering Data Engineering Data Engineer Data Science 160

KDnuggets

AUGUST 18, 2022

If you’re considering a career in data science, it’s important to understand how these two fields differ, and which one might be more appropriate for someone with your skills and interests.

Data Engineering 159

Data Engineering Data Engineer Engineering Data Science 159

Seattle Data Guy

AUGUST 9, 2023

Learning about how to data models from basic star schemas on the internet is like learning data science using the IRIS data set. Data modeling in real life requires you fully understand the data sources and your business use cases.… It works great as a toy example.

Data Science 246

Data Science Data Consulting IT 246

Analytics Vidhya

FEBRUARY 6, 2023

Introduction The demand for data to feed machine learning models, data science research, and time-sensitive insights is higher than ever thus, processing the data becomes complex. To make these processes efficient, data pipelines are necessary. appeared first on Analytics Vidhya.

Amazon Web Services 218

Amazon Web Services Data Pipeline Machine Learning Data Science 218

Seattle Data Guy

MAY 20, 2023

Starting new data engineering projects can be challenging. Data engineers can get stuck on finding the right data for their data engineering project or picking the right tools.

Data Engineering 147

Data Engineering Data Engineer Project Engineering 147

Data Engineering Weekly

JULY 28, 2024

Switching from Apache Spark to Ray improves compact 12X larger datasets than Apache Spark, improves cost efficiency by 91%, and processes 13X more data per hour. Adopting LLM in SQL-centric workflow is particularly interesting since companies increasingly try text-2-SQL to boost data usage.

Data Engineering 111

Data Engineering Data Engineer Engineering Database-centric 111

KDnuggets

MAY 19, 2022

Read the best books on Programming, Statistics, Data Engineering, Web Scraping, Data Analytics, Business Intelligence, Data Applications, Data Management, Big Data, and Cloud Architecture.

Data Science 160

Data Science Business Intelligence Big Data Architecture 160

KDnuggets

FEBRUARY 27, 2023

5 SQL Visualization Tools for Data Engineers • Free TensorFlow 2.0 Complete Course • The Importance of Probability in Data Science • 4 Ways to Rename Pandas Columns • 5 Statistical Paradoxes Data Scientists Should Know

SQL 137

SQL Data Engineering Data Engineer Engineering 137

KDnuggets

APRIL 19, 2024

The collection includes free courses on Python, SQL, Data Analytics, Business Intelligence, Data Engineering, Machine Learning, Deep Learning, Generative AI, and MLOps.

Data Science 155

Data Science Deep Learning Business Intelligence Machine Learning 155

Confessions of a Data Guy

DECEMBER 29, 2022

Data engineering is a vital field within the realm of data science that focuses on the practical aspects of collecting, storing, and processing large amounts of data. appeared first on Confessions of a Data Guy. Here it is.

Data Engineering 130

Data Engineering Data Engineer Engineering IT 130

KDnuggets

MARCH 29, 2023

The second part covers the list of Machine Learning, Deep Learning, Computer Vision, Natural Language Processing, Data Engineering, and MLOps.

Data Science 160

Data Science Deep Learning Machine Learning Data Engineering 160

Analytics Vidhya

APRIL 17, 2023

Are you a data enthusiast looking to break into the world of analytics? The field of data science and analytics is booming, with exciting career opportunities for those with the right skills and expertise. So, let’s […] The post Data Scientist vs Data Analyst: Which is a Better Career Option to Pursue in 2023?

Data Science 238

Data Science Data Data Mining Data Analysis 238

KDnuggets

FEBRUARY 21, 2022

A collection of cheat sheets that will help you prepare for a technical interview on Data Structures & Algorithms, Machine learning, Deep Learning, Natural Language Processing, Data Engineering, Web Frameworks.

Data Science 154

Data Science Deep Learning Algorithm Machine Learning 154

KDnuggets

MARCH 10, 2023

Mastering the most-used commands will allow you to become a productive of a data science, data engineering, or machine learning engineering development team. The GitHub CLI is a tool that allows for interaction with the GitHub platform with the command line interface.

Data Science 108

Data Science Machine Learning Data Data Engineering 108

Analytics Vidhya

MARCH 10, 2023

Introduction DataHour sessions are an excellent opportunity for aspiring individuals looking to launch a career in the data-tech industry, including students and freshers. In this blog post, we […] The post Explore the World of Data-Tech with DataHour appeared first on Analytics Vidhya.

Data Science 241

Data Science Data MySQL Machine Learning 241

Knowledge Hut

JANUARY 18, 2024

Most organizations are still in the initial stages of learning how to apply data science to gain business benefits and healthy returns. People working as full stack data scientists are responsible for implementing the project from start to finish. What is Data Science? Who Is a Full-Stack Data Scientist?

Data Science 96

Data Science Computer Science Programming Language Machine Learning 96

Knowledge Hut

SEPTEMBER 6, 2023

Nowadays, I often hear people saying they aspire to become data scientists or they want to work with data, but they don’t know the path to do so. I myself have faced this problem and data science certifications come as a rescue for this problem. What is Data Science Certification?

Data Science 97

Data Science Certification Business Analyst Machine Learning 97

KDnuggets

OCTOBER 12, 2022

10 Cheat Sheets You Need To Ace Data Science Interview • NLP Interview Questions • A Day in the Life of a Machine Learning Engineer • 11 Questions About Data Engineers: What's the profession about, and where's it heading? • The ABCs of NLP, From A to Z.

Data Science 134

Data Science Machine Learning Data Engineering Data Engineer 134

Jesse Anderson

NOVEMBER 2, 2022

My guest this week is Erick Webbe , Head of Data Science at bol.com. Applying this mindset to data scientists, he continues, “every data scientist will be familiar with experimentation. Erick has a Master’s degree in Applied Physics. His background in physics forms a basis for his philosophy on life and work.

Generalist 130

Generalist Data Science Building Retail 130

Knowledge Hut

JANUARY 18, 2024

I’ve often noticed that people use terms like Data Science and Artificial Intelligence ( AI ) interchangeably. The key connection between Data Science and AI is data. Understanding  Data Science course eligibility  can help you understand more about Data Science. What is Data Science?

Data Science 98

Data Science Deep Learning Business Analyst Data Mining 98

Knowledge Hut

DECEMBER 29, 2023

The market for analytics is flourishing, as is the usage of the phrase Data Science. Professionals from a variety of disciplines use data in their day-to-day operations and feel the need to understand cutting-edge technology to get maximum insights from the data, therefore contributing to the growth of the organization.

Data Science 98

Data Science Data Mining Deep Learning Programming Language 98

Snowflake

APRIL 17, 2024

In today’s data-driven world, developer productivity is essential for organizations to build effective and reliable products, accelerate time to value, and fuel ongoing innovation. This allows your applications to handle large data sets and complex workflows efficiently.

Data Pipeline 113

Data Pipeline Python Data Engineering Data Engineer 113

Towards Data Science

MAY 13, 2024

Engineers, scientists, and analysts have the potential to greatly reduce carbon emissions by introducing sustainable, efficient, and… Continue reading on Towards Data Science »

Data Engineering 97

Data Engineering Data Engineer Engineering Data Science 97

KDnuggets

AUGUST 15, 2022

The second part covers the list of Machine Learning, Deep Learning, Computer Vision, Natural Language Processing, Data Engineering, and MLOps.

Data Science 139

Data Science Project Deep Learning Machine Learning 139