Analytics Vidhya

MAY 22, 2023

Introduction Join us in this interview as Sumeet shares his background, journey as a former Data Scientist to a software engineer, and learn the captivating aspects of his current job. He provides insights into the future of data science and software engineering and offers valuable advice for career transitioners.

Software Engineer 46

Software Engineer Software Engineering Engineering Data Science 46

Simon Späti

MARCH 9, 2021

This post focuses on practical data pipelines with examples from web-scraping real-estates, uploading them to S3 with MinIO, Spark and Delta Lake, adding some Data Science magic with Jupyter Notebooks, ingesting into Data Warehouse Apache Druid, visualising dashboards with Superset and managing everything with Dagster.

Data Engineering 189

Data Engineering Data Engineer Engineering Project 189

Data Engineering Podcast

FEBRUARY 18, 2024

Summary A data lakehouse is intended to combine the benefits of data lakes (cost effective, scalable storage and compute) and data warehouses (user friendly SQL interface). Data lakes are notoriously complex. Join in with the event for the global data community, Data Council Austin.

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

KDnuggets

DECEMBER 6, 2022

SQL is the essential language for developers, engineers, and data professionals. Intermediate knowledge in SQL gives you an edge in your data science career.

SQL 155

SQL Data Science Data Engineering 155

Knowledge Hut

JANUARY 18, 2024

Speaking of job vacancies, the two careers have high demands till date and in upcoming years are Data Scientist and a Software Engineer. Per the BLS, the expected growth rate of job vacancies for data scientists and software engineers is around 22% by 2030. What is Data Science? What is Software Engineering?

Software Engineer 97

Software Engineer Software Engineering Data Science Engineering 97

Analytics Vidhya

JUNE 12, 2023

Introduction Meet Tajinder, a seasoned Senior Data Scientist and ML Engineer who has excelled in the rapidly evolving field of data science. Tajinder’s passion for unraveling hidden patterns in complex datasets has driven impactful outcomes, transforming raw data into actionable intelligence.

Machine Learning 183

Machine Learning Engineering Raw Data Data Science 183

KDnuggets

FEBRUARY 14, 2023

Docker is dependency management on steroids, helping to ensure both reproducibility and collaboration, making it an important tool for data science. Our latest cheat sheet serves as a handy Docker reference. Check it out now!

Data Science 156

Data Science Data Management IT 156

KDnuggets

NOVEMBER 5, 2024

Enhance your data science portfolio with these seven engaging Python projects that demonstrate essential programming and software engineering skills.

Portfolio 139

Portfolio Data Science Python Project 139

Analytics Vidhya

JULY 25, 2023

In the world of data, two crucial roles play a significant part in unlocking the power of information: Data Scientists and Data Engineers. But what sets these wizards of data apart? Welcome to the ultimate showdown of Data Scientist vs Data Engineer! appeared first on Analytics Vidhya.

Data Engineering 200

Data Engineering Data Engineer Engineering Data 200

Analytics Vidhya

JUNE 24, 2023

He is an experienced data engineer with a passion for problem-solving and a drive for continuous growth. Thus, providing valuable insights into the field of data engineering. Throughout the conversation, Mr. Pavan shares his journey, inspirations, challenges, and accomplishments.

Data Engineering 204

Data Engineering Data Engineer Engineering Data 204

KDnuggets

FEBRUARY 28, 2024

Begin your data professional journey from the basics of statistics to building a production-grade AI application.

Machine Learning 160

Machine Learning Data Science Data Engineering Data Engineer 160

KDnuggets

DECEMBER 9, 2022

As more people are entering the field of Data Science and more companies are hiring for data-centric roles, what type of jobs are currently in highest demand?

Engineering 160

Engineering Data Engineering Data Engineer Data Science 160

KDnuggets

MARCH 2, 2023

The latest KDnuggets cheat sheet covers using ChatGPT to your advantage as a data scientist. It's time to master prompt engineering, and here is a handy reference for helping you along the way.

Data Science 160

Data Science Data Engineering IT 160

Jesse Anderson

JANUARY 29, 2024

The premier of my latest talk covering The State of Data Engineering. This starts with data warehousing and goes into data science. I finish off by showing how data engineering can avoid the same fate as data warehousing and data science.

Data Engineering 130

Data Engineering Data Engineer Engineering Data Science 130

Seattle Data Guy

AUGUST 9, 2023

Learning about how to data models from basic star schemas on the internet is like learning data science using the IRIS data set. Data modeling in real life requires you fully understand the data sources and your business use cases.… It works great as a toy example.

Data Science 246

Data Science Data Consulting IT 246

The Pragmatic Engineer

JANUARY 12, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one and a half out of eight topics in today’s subscriber-only issue, Inside Pollen's Transparent Compensation Data. Here are a few details from the data points, focusing on software engineering compensation.

Software Engineer 187

Software Engineer Software Engineering Engineering Raw Data 187

KDnuggets

DECEMBER 27, 2023

Discover a collection of top courses to launch your dream career or master a new skill, all for free!

Machine Learning 152

Machine Learning Data Science Data Engineering Data Engineer 152

KDnuggets

NOVEMBER 7, 2023

No, they’re not the same jobs! Learn what responsibilities, skills, and tools used make them different. Then, choose the right career path for you.

Data Science 157

Data Science Data Engineering Data Engineer Engineering 157

Data Engineering Podcast

FEBRUARY 5, 2023

In that time there have been a number of generational shifts in how data engineering is done. Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Materialize]([link] Looking for the simplest way to get the freshest data possible to your teams?

Data Engineering 147

Data Engineering Data Engineer Engineering PostgreSQL 147

Jesse Anderson

SEPTEMBER 14, 2023

There has been quite a bit of writing covering GPT and LLMs from data science and business perspectives. I haven’t seen much from the data engineering side. Let me share my perspective, having been in data and AI for a while and using LLMs before they became popular. How can we use LLMs in data engineering?

Data Engineering 147

Data Engineering Data Engineer Engineering NoSQL 147

KDnuggets

MAY 19, 2022

Read the best books on Programming, Statistics, Data Engineering, Web Scraping, Data Analytics, Business Intelligence, Data Applications, Data Management, Big Data, and Cloud Architecture.

Data Science 160

Data Science Business Intelligence Big Data Architecture 160

Analytics Vidhya

FEBRUARY 6, 2023

Introduction The demand for data to feed machine learning models, data science research, and time-sensitive insights is higher than ever thus, processing the data becomes complex. To make these processes efficient, data pipelines are necessary. appeared first on Analytics Vidhya.

Amazon Web Services 218

Amazon Web Services Data Pipeline Machine Learning Data Science 218

Data Engineering Weekly

JULY 21, 2024

Editor’s Note: A New Series on Data Engineering Tools Evaluation There are plenty of data tools and vendors in the industry. Data Engineering Weekly is launching a new series on software evaluation focused on data engineering to better guide data engineering leaders in evaluating data tools.

Data Engineering 119

Data Engineering Data Engineer Engineering Generalist 119

Analytics Vidhya

APRIL 17, 2023

Are you a data enthusiast looking to break into the world of analytics? The field of data science and analytics is booming, with exciting career opportunities for those with the right skills and expertise. So, let’s […] The post Data Scientist vs Data Analyst: Which is a Better Career Option to Pursue in 2023?

Data Science 238

Data Science Data Data Mining Data Analysis 238

KDnuggets

APRIL 19, 2024

The collection includes free courses on Python, SQL, Data Analytics, Business Intelligence, Data Engineering, Machine Learning, Deep Learning, Generative AI, and MLOps.

Data Science 155

Data Science Deep Learning Business Intelligence Machine Learning 155

KDnuggets

MARCH 29, 2023

The second part covers the list of Machine Learning, Deep Learning, Computer Vision, Natural Language Processing, Data Engineering, and MLOps.

Data Science 160

Data Science Deep Learning Machine Learning Data Engineering 160

KDnuggets

DECEMBER 8, 2021

Take the first step towards your machine learning engineering career and explore the UC San Diego Extension Machine Learning Engineering Bootcamp today. Those with prior software engineering or data science experience are encouraged to apply.

Engineering 160

Engineering Machine Learning Software Engineer Software Engineering 160

KDnuggets

NOVEMBER 29, 2024

This is a collection of the 10 most frequently used Conda commands that every data scientist, machine learning engineer, or Python developer should have at their fingertips.

Data Science 122

Data Science Machine Learning Python Data 122

KDnuggets

AUGUST 18, 2022

If you’re considering a career in data science, it’s important to understand how these two fields differ, and which one might be more appropriate for someone with your skills and interests.

Data Engineering 159

Data Engineering Data Engineer Engineering Data Science 159

Knowledge Hut

JANUARY 18, 2024

Most organizations are still in the initial stages of learning how to apply data science to gain business benefits and healthy returns. People working as full stack data scientists are responsible for implementing the project from start to finish. What is Data Science? Who Is a Full-Stack Data Scientist?

Data Science 96

Data Science Computer Science Programming Language Machine Learning 96

Analytics Vidhya

APRIL 17, 2023

Introduction Kedro is an open-source Python framework for creating reproducible, maintainable, and modular data science code. It uses best practices of software engineering to build production-ready data science pipelines. This article will give you a glimpse of Kedro framework using news classification tasks.

Data Science 221

Data Science Software Engineer Software Engineering Machine Learning 221

Knowledge Hut

JANUARY 18, 2024

I’ve often noticed that people use terms like Data Science and Artificial Intelligence ( AI ) interchangeably. The key connection between Data Science and AI is data. Understanding  Data Science course eligibility  can help you understand more about Data Science. What is Data Science?

Data Science 98

Data Science Deep Learning Business Analyst Data Mining 98

Analytics Vidhya

MARCH 10, 2023

Introduction DataHour sessions are an excellent opportunity for aspiring individuals looking to launch a career in the data-tech industry, including students and freshers. In this blog post, we […] The post Explore the World of Data-Tech with DataHour appeared first on Analytics Vidhya.

Data Science 241

Data Science Data MySQL Machine Learning 241

Jesse Anderson

DECEMBER 12, 2022

They were the first companies to commercialize open source big data technologies and pushed the marketing and commercialization of Hadoop. With an immutable file system like HDFS, we needed scalable databases to read and write data randomly. Apache Spark came in 2009 and gave a unified batch and streaming engine.

Data Engineering 130

Data Engineering Data Engineer Engineering Hadoop 130

KDnuggets

FEBRUARY 21, 2022

A collection of cheat sheets that will help you prepare for a technical interview on Data Structures & Algorithms, Machine learning, Deep Learning, Natural Language Processing, Data Engineering, Web Frameworks.

Data Science 154

Data Science Deep Learning Algorithm Machine Learning 154

Data Engineering Weekly

JULY 28, 2024

link] Chip Huyan: Building A Generative AI Platform We can’t deny that Gen-AI is becoming an integral part of product strategy, pushing the need for platform engineering. Switching from Apache Spark to Ray improves compact 12X larger datasets than Apache Spark, improves cost efficiency by 91%, and processes 13X more data per hour.

Data Engineering 111

Data Engineering Data Engineer Engineering Database-centric 111

KDnuggets

OCTOBER 12, 2022

10 Cheat Sheets You Need To Ace Data Science Interview • NLP Interview Questions • A Day in the Life of a Machine Learning Engineer • 11 Questions About Data Engineers: What's the profession about, and where's it heading? • The ABCs of NLP, From A to Z.

Data Science 134

Data Science Machine Learning Data Engineering Data Engineer 134