Data Engineering Podcast

SEPTEMBER 2, 2019

Summary Data professionals are working in a domain that is rapidly evolving. In order to stay current we need access to deeply technical presentations that aren’t burdened by extraneous marketing. To fulfill that need Pete Soderling and his team have been running the Data Council series of conferences and meetups around the world. In this episode Pete discusses his motivation for starting these events, how they serve to bring the data community together, and the observations that he has ma

Building 100

Building Data Database Design Media 100

KDnuggets

SEPTEMBER 3, 2019

These three deep learning frameworks are your go-to tools for NLP, so which is the best? Check out this comparative analysis based on the needs of NLP, and find out where things are headed in the future.

Deep Learning 119

Deep Learning 119

Pandora Engineering

SEPTEMBER 6, 2019

When embarking on the journey of developing a new application, a team must establish the foundational technologies upon which their… Continue reading on Algorithm and Blues »

Programming 52

Programming Algorithm Technology 52

Teradata

SEPTEMBER 2, 2019

Companies are increasingly exploring opportunities to apply reinforcement learning to their most challenging problems. Learn what applications work the best.

56

56

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Confluent

SEPTEMBER 6, 2019

First, what is event sourcing? Here’s an example. Consider your bank account: viewing it online, the first thing you notice is often the current balance. How many of us drill down to see how we got there? We probably all ask similar questions such as: What payments have cleared? Did my direct deposit hit yet? Why am I spending so much money at Sephora?

Kafka 22

Kafka MySQL Banking Java 22

KDnuggets

SEPTEMBER 5, 2019

This blog summarizes the career advice/reading research papers lecture in the CS230 Deep learning course by Stanford University on YouTube, and includes advice from Andrew Ng on how to read research papers.

Machine Learning 119

Machine Learning Deep Learning Building 119

Teradata

SEPTEMBER 5, 2019

4D analytics combines geospatial, temporal and time series data to do advanced analysis of time and space. Learn how to uncover new insights today.

Data 56

Data 56

Confluent

SEPTEMBER 5, 2019

TL;DR. Following on from How to Work with Apache Kafka in Your Spring Boot Application , which shows how to get started with Spring Boot and Apache Kafka ® , here I will demonstrate how to enable usage of Confluent Schema Registry and Avro serialization format in your Spring Boot applications. Using Avro schemas, you can establish a data contract between your microservices applications.

Kafka 20

Kafka Java Food Cloud 20

KDnuggets

SEPTEMBER 4, 2019

A recurring subject in NLP is to understand large corpus of texts through topics extraction. Whether you analyze users’ online reviews, products’ descriptions, or text entered in search bars, understanding key topics will always come in handy.

Python 114

Python 114

Rockset

SEPTEMBER 6, 2019

"A fast-moving technology field where new tools, technologies and platforms are introduced very frequently and where it is very hard to keep up with new trends." I could be describing either the VR space or Data Engineering, but in fact this post is about the intersection of both. Virtual Reality – The Next Frontier in Media I work as a Data Engineer at a leading company in the VR space, with a mission to capture and transmit reality in perfect fidelity.

Metadata 40

Metadata Kafka Data Cleanse SQL 40

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Teradata

SEPTEMBER 5, 2019

4D analytics combines geospatial, temporal and time series data to do advanced analysis of time and space. Learn how to uncover new insights today.

Data 40

Data 40

KDnuggets

SEPTEMBER 4, 2019

Recommender systems are an important class of machine learning algorithms that offer "relevant" suggestions to users. Categorized as either collaborative filtering or a content-based system, check out how these approaches work along with implementations to follow from example code.

Machine Learning 112

Machine Learning Systems Algorithm Coding 112

KDnuggets

SEPTEMBER 4, 2019

In the following post, I am going to give a brief guide to four of the most established packages for interpreting and explaining machine learning models.

Machine Learning 120

Machine Learning Python 120

KDnuggets

SEPTEMBER 5, 2019

This is an interview between Rosaria Silipo and data scientists Paolo Tamagnini, Simon Schmid and Christian Dietz, asking a few questions on the topic of automated machine learning from their point of view, and some interesting examples of its practical use.

Machine Learning 110

Machine Learning IT Data 110

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

KDnuggets

SEPTEMBER 3, 2019

In this tutorial, you will learn how to run task scheduler to web scrape data from Lazada (eCommerce) website and dump it into SQLite RDBMS Database.

Python 105

Python Database Data IT 105

KDnuggets

SEPTEMBER 6, 2019

Instead of focusing on skills thought to be required of data scientists, we can look at what they have actually done before.

Data 114

Data Data Science 114

KDnuggets

SEPTEMBER 6, 2019

From asking the best questions about data to answering those questions with certainty, understanding the value of these two seemingly different professions is clarified when you see how they should work together.

Data 88

Data 88

KDnuggets

SEPTEMBER 2, 2019

Without a well-defined approach for collecting and structuring training data, launching an AI initiative becomes an uphill battle. These six recommendations will help you craft a successful strategy.

Machine Learning 88

Machine Learning Building Data 88

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

KDnuggets

SEPTEMBER 3, 2019

DataScienceGO returns to San Diego Sep 27-29, for a three-day career-focused conference designed to unite newcomers, practitioners, managers and executives under one umbrella, speakers weigh in on how to forge the best teams, increase your hiring chances, and prepare for the future.

Data Science 83

Data Science Designing Data Management 83

KDnuggets

SEPTEMBER 5, 2019

Managing human bias is an important part of the analytics process. Learn about three areas to watch out for to ensure your models as unbiased as possible.

Process 86

Process Management 86

KDnuggets

SEPTEMBER 2, 2019

In this article, we will consider the most vivid data science use cases in the industry of energy and utilities.

Utilities 102

Utilities Data Science Data 102

KDnuggets

SEPTEMBER 3, 2019

The quest for recreating cognitive capabilities of the brain in deep neural networks remains one of the elusive goals of AI. Let’s explore some human cognitive skills that are serving as inspiration to a new generation of AI techniques.

78

78

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

KDnuggets

SEPTEMBER 6, 2019

Hone your practical speech recognition application skills with this overview of building a voice assistant using Python.

Building 91

Building Python Machine Learning 91

KDnuggets

SEPTEMBER 4, 2019

Save 40% on Get Programming with Python, Data Science with Python and Dask, and Learn Quantum Computing with Python and Q# with code nlpython40.

Python 82

Python Programming Data Science Coding 82

KDnuggets

SEPTEMBER 4, 2019

Also: The secret sauce for growing from a data analyst to a data scientist; 4 Tips for Advanced Feature Engineering and Preprocessing; R Users’ Salaries from the 2019 Stackoverflow Survey; Emoji Analytics.

Architecture 63

Architecture Engineering Data 63

KDnuggets

SEPTEMBER 4, 2019

This week: Object-oriented programming for data scientists; Deep Learning Next Step: Transformers and Attention Mechanism; R Users' Salaries from the 2019 Stackoverflow Survey; Types of Bias in Machine Learning; 4 Tips for Advanced Feature Engineering and Preprocessing; and much more!

Programming 56

Programming Deep Learning Data Science Machine Learning 56

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

KDnuggets

SEPTEMBER 5, 2019

In this TensorFlow tutorial, you’ll learn the impact of optimizing both operators and entire graphs, how to efficiently organize data in training and testing datasets to minimize data shuffling, and how to identify a well-optimized model using Anaconda and ActivePython.

Datasets 56

Datasets Data 56

KDnuggets

SEPTEMBER 6, 2019

See how creating a system of purpose-specific displays enables users to quickly get answers to their data-related questions.

Designing 57

Designing Systems Data 57

KDnuggets

SEPTEMBER 2, 2019

Also: Types of Bias in Machine Learning; Deep Learning Next Step: Transformers and Attention Mechanism; New Poll: Data Science Skills; R Users Salaries from the 2019 Stackoverflow Survey; How to Sell Your Boss on the Need for Data Analytics.

Deep Learning 45

Deep Learning Programming Machine Learning Data Science 45

KDnuggets

SEPTEMBER 2, 2019

KDnuggets cartoon looks at how AI will impact Labor Day in the year 2050.

54

54

Advertisement

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.

Cloud