KDnuggets

SEPTEMBER 6, 2019

Instead of focusing on skills thought to be required of data scientists, we can look at what they have actually done before.

Data 123

Data Data Science 123

Confluent

SEPTEMBER 6, 2019

First, what is event sourcing? Here’s an example. Consider your bank account: viewing it online, the first thing you notice is often the current balance. How many of us drill down to see how we got there? We probably all ask similar questions such as: What payments have cleared? Did my direct deposit hit yet? Why am I spending so much money at Sephora?

Kafka 22

Kafka MySQL Banking Java 22

Data Engineering Podcast

SEPTEMBER 2, 2019

Summary Data professionals are working in a domain that is rapidly evolving. In order to stay current we need access to deeply technical presentations that aren’t burdened by extraneous marketing. To fulfill that need Pete Soderling and his team have been running the Data Council series of conferences and meetups around the world. In this episode Pete discusses his motivation for starting these events, how they serve to bring the data community together, and the observations that he has ma

Building 100

Building Data Database Design Media 100

Teradata

SEPTEMBER 5, 2019

4D analytics combines geospatial, temporal and time series data to do advanced analysis of time and space. Learn how to uncover new insights today.

Data 56

Data 56

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

KDnuggets

SEPTEMBER 5, 2019

This blog summarizes the career advice/reading research papers lecture in the CS230 Deep learning course by Stanford University on YouTube, and includes advice from Andrew Ng on how to read research papers.

Machine Learning 123

Machine Learning Deep Learning Building 123

Confluent

SEPTEMBER 5, 2019

TL;DR. Following on from How to Work with Apache Kafka in Your Spring Boot Application , which shows how to get started with Spring Boot and Apache Kafka ® , here I will demonstrate how to enable usage of Confluent Schema Registry and Avro serialization format in your Spring Boot applications. Using Avro schemas, you can establish a data contract between your microservices applications.

Kafka 20

Kafka Java Food Cloud 20

Teradata

SEPTEMBER 2, 2019

Companies are increasingly exploring opportunities to apply reinforcement learning to their most challenging problems. Learn what applications work the best.

56

56

KDnuggets

SEPTEMBER 5, 2019

This is an interview between Rosaria Silipo and data scientists Paolo Tamagnini, Simon Schmid and Christian Dietz, asking a few questions on the topic of automated machine learning from their point of view, and some interesting examples of its practical use.

Machine Learning 123

Machine Learning IT Data 123

Rockset

SEPTEMBER 6, 2019

"A fast-moving technology field where new tools, technologies and platforms are introduced very frequently and where it is very hard to keep up with new trends." I could be describing either the VR space or Data Engineering, but in fact this post is about the intersection of both. Virtual Reality – The Next Frontier in Media I work as a Data Engineer at a leading company in the VR space, with a mission to capture and transmit reality in perfect fidelity.

Metadata 40

Metadata Kafka Data Cleanse SQL 40

Pandora Engineering

SEPTEMBER 5, 2019

Credit: Sally Anscombe An Android Apprentice’s journey to understand Pandora’s migration from AsyncTask to newer APIs During my second month as an Android Engineer Apprentice, I was tasked with migrating AsyncTask to newer APIs. Early on, I was asked, “Do you know why we are migrating from AsyncTask?” I wracked my brain and answered shyly, “It has something to do with memory leaks?

Computer Science 52

Computer Science Java Software Engineering Software Engineer 52

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems

Teradata

SEPTEMBER 5, 2019

4D analytics combines geospatial, temporal and time series data to do advanced analysis of time and space. Learn how to uncover new insights today.

Data 40

Data 40

KDnuggets

SEPTEMBER 4, 2019

In the following post, I am going to give a brief guide to four of the most established packages for interpreting and explaining machine learning models.

Machine Learning 123

Machine Learning Python 123

KDnuggets

SEPTEMBER 4, 2019

A recurring subject in NLP is to understand large corpus of texts through topics extraction. Whether you analyze users’ online reviews, products’ descriptions, or text entered in search bars, understanding key topics will always come in handy.

Python 123

Python 123

KDnuggets

SEPTEMBER 4, 2019

Recommender systems are an important class of machine learning algorithms that offer "relevant" suggestions to users. Categorized as either collaborative filtering or a content-based system, check out how these approaches work along with implementations to follow from example code.

Machine Learning 123

Machine Learning Systems Algorithm Coding 123

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing

KDnuggets

SEPTEMBER 3, 2019

These three deep learning frameworks are your go-to tools for NLP, so which is the best? Check out this comparative analysis based on the needs of NLP, and find out where things are headed in the future.

Deep Learning 123

Deep Learning 123

KDnuggets

SEPTEMBER 3, 2019

In this tutorial, you will learn how to run task scheduler to web scrape data from Lazada (eCommerce) website and dump it into SQLite RDBMS Database.

Python 123

Python Database Data IT 123

KDnuggets

SEPTEMBER 2, 2019

In this article, we will consider the most vivid data science use cases in the industry of energy and utilities.

Utilities 122

Utilities Data Science Data 122

KDnuggets

SEPTEMBER 6, 2019

Hone your practical speech recognition application skills with this overview of building a voice assistant using Python.

Building 113

Building Python Machine Learning 113

Advertisement

With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you

Data Engineering

KDnuggets

SEPTEMBER 6, 2019

From asking the best questions about data to answering those questions with certainty, understanding the value of these two seemingly different professions is clarified when you see how they should work together.

Data 106

Data 106

KDnuggets

SEPTEMBER 2, 2019

Without a well-defined approach for collecting and structuring training data, launching an AI initiative becomes an uphill battle. These six recommendations will help you craft a successful strategy.

Machine Learning 106

Machine Learning Building Data 106

KDnuggets

SEPTEMBER 5, 2019

Managing human bias is an important part of the analytics process. Learn about three areas to watch out for to ensure your models as unbiased as possible.

Process 104

Process Management 104

KDnuggets

SEPTEMBER 3, 2019

The quest for recreating cognitive capabilities of the brain in deep neural networks remains one of the elusive goals of AI. Let’s explore some human cognitive skills that are serving as inspiration to a new generation of AI techniques.

100

100

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

KDnuggets

SEPTEMBER 4, 2019

Save 40% on Get Programming with Python, Data Science with Python and Dask, and Learn Quantum Computing with Python and Q# with code nlpython40.

Python 98

Python Data Science Programming Coding 98

KDnuggets

SEPTEMBER 3, 2019

DataScienceGO returns to San Diego Sep 27-29, for a three-day career-focused conference designed to unite newcomers, practitioners, managers and executives under one umbrella, speakers weigh in on how to forge the best teams, increase your hiring chances, and prepare for the future.

Data Science 90

Data Science Designing Data Management 90

KDnuggets

SEPTEMBER 4, 2019

Also: The secret sauce for growing from a data analyst to a data scientist; 4 Tips for Advanced Feature Engineering and Preprocessing; R Users’ Salaries from the 2019 Stackoverflow Survey; Emoji Analytics.

Architecture 86

Architecture Engineering Data 86

KDnuggets

SEPTEMBER 6, 2019

See how creating a system of purpose-specific displays enables users to quickly get answers to their data-related questions.

Designing 65

Designing Systems Data 65

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m

Software Engineer

KDnuggets

SEPTEMBER 2, 2019

KDnuggets cartoon looks at how AI will impact Labor Day in the year 2050.

63

63

KDnuggets

SEPTEMBER 4, 2019

This week: Object-oriented programming for data scientists; Deep Learning Next Step: Transformers and Attention Mechanism; R Users' Salaries from the 2019 Stackoverflow Survey; Types of Bias in Machine Learning; 4 Tips for Advanced Feature Engineering and Preprocessing; and much more!

Programming 62

Programming Deep Learning Data Science Machine Learning 62

KDnuggets

SEPTEMBER 5, 2019

In this TensorFlow tutorial, you’ll learn the impact of optimizing both operators and entire graphs, how to efficiently organize data in training and testing datasets to minimize data shuffling, and how to identify a well-optimized model using Anaconda and ActivePython.

Datasets 61

Datasets Data 61

KDnuggets

SEPTEMBER 2, 2019

Also: Types of Bias in Machine Learning; Deep Learning Next Step: Transformers and Attention Mechanism; New Poll: Data Science Skills; R Users Salaries from the 2019 Stackoverflow Survey; How to Sell Your Boss on the Need for Data Analytics.

Deep Learning 51

Deep Learning Programming Machine Learning Data Science 51

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud