Data Engineering Podcast

OCTOBER 28, 2019

Summary Despite the fact that businesses have relied on useful and accurate data to succeed for decades now, the state of the art for obtaining and maintaining that information still leaves much to be desired. In an effort to create a better abstraction for building data applications Nick Schrock created Dagster. In this episode he explains his motivation for creating a product for data management, how the programming model simplifies the work of building testable and maintainable pipelines, and

Building 100

Building Data Pipeline Programming Language Metadata 100

KDnuggets

OCTOBER 30, 2019

Here are five statistical fallacies — data traps — which data scientists should be aware of and definitely avoid.

Data 106

Data 106

Confluent

OCTOBER 31, 2019

The relationship between Apache Kafka® and machine learning (ML) is an interesting one that I’ve written about quite a bit in How to Build and Deploy Scalable Machine Learning in […].

Machine Learning 49

Machine Learning Kafka Building Process 49

Teradata

OCTOBER 27, 2019

At Teradata Universe, we held a roundtable on Next-gen Concepts for Player Performance and Wellness. Learn how insights using AI are readily available for the next-gen of high performers.

8

8

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

KDnuggets

NOVEMBER 1, 2019

As a developer who is excited about leveraging machine learning for faster and more effective development, these software tools are worth trying out.

Machine Learning 92

Machine Learning 92

KDnuggets

OCTOBER 31, 2019

A hands on guide to Logistic Regression for aspiring data scientist and machine learning engineer.

Python 102

Python Building Machine Learning Engineering 102

KDnuggets

OCTOBER 28, 2019

Data collection is one of the first steps of the data lifecycle — you need to get all the data you require in the first place. To collect the right data, you need to know where to find it and determine the effort involved in collecting it. This article answers the most basic question: where does all the data you need (or might need) come from?

Data Collection 73

Data Collection Data IT Datasets 73

KDnuggets

NOVEMBER 1, 2019

This article focused on building an Artificial Neural Network using the Numpy Python library.

Building 91

Building Python 91

KDnuggets

OCTOBER 30, 2019

The problem with RNNs and CNNs is that they aren’t able to keep up with context and content when sentences are too long. This limitation has been solved by paying attention to the word that is currently being operated on. This guide will focus on how this problem can be addressed by Transformers with the help of deep learning.

Deep Learning 62

Deep Learning 62

KDnuggets

NOVEMBER 1, 2019

This live webinar, Nov 14 @ 12pm EST, on MLOps for production-level machine learning, will detail MLOps, a compound of “machine learning” and “operations”, a practice for collaboration and communication between data scientists and operations professionals to help manage the production machine learning lifecycle. Register now.

Machine Learning 61

Machine Learning Management Data 61

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

KDnuggets

OCTOBER 31, 2019

Learn how to approach the challenges when merging an agile methodology into a data science team to bring out the best value your Big Data products.

Big Data 67

Big Data Data Analytics Data Science Data 67

KDnuggets

OCTOBER 29, 2019

Developing an excellent machine learning model is one thing. Deploying it to production is another. Consider these lessons learned and recommendations for approaching this important challenge to help ensure value from your AI work.

Machine Learning 56

Machine Learning IT 56

KDnuggets

OCTOBER 31, 2019

AI-based models are highly dependent on accurate, clean, well-labeled, and prepared data in order to produce the desired output and cognition. These models are fed with bulky datasets covering an array of probabilities and computations to make its functioning as smart and gifted as human intelligence.

Datasets 55

Datasets Data Data Preparation IT 55

KDnuggets

OCTOBER 28, 2019

Visualizing the datasets is an essential component to identify potential sources of bias and unfairness. DeepMind relied on a method called Causal Bayesian networks (CBNs) to represent and estimate unfairness in a dataset.

Machine Learning 49

Machine Learning Datasets 49

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

KDnuggets

OCTOBER 30, 2019

While AutoML started out as an automation approach to develop optimal machine learning pipelines, extensions of AutoML to Data Science embedded products can now enable the processing of much more, including temporal relational data.

Machine Learning 48

Machine Learning Data Science Data Process 48

KDnuggets

OCTOBER 28, 2019

Also: Introduction to Natural Language Processing (NLP); Anomaly Detection, A Key Task for AI and Machine Learning, Explained; How to Become a (Good) Data Scientist — Beginner Guide.

Data Management 47

Data Management Machine Learning Management Data 47

KDnuggets

NOVEMBER 1, 2019

Not only can MLonCode help companies streamline their codebase and software delivery processes, but it also helps organizations better understand and manage their engineering talents.

Machine Learning 46

Machine Learning Coding Engineering Process 46

KDnuggets

OCTOBER 30, 2019

This week in KDnuggets: Feature Selection: Beyond feature importance?; Time Series Analysis: A Simple Example with KNIME and Spark; 5 Advanced Features of Pandas and How to Use Them; How to Measure Foot Traffic Using Data Analytics; Introduction to Natural Language Processing (NLP); and much, much more!

Data Analytics 45

Data Analytics Process Data Python 45

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

KDnuggets

OCTOBER 30, 2019

Also: Highest paid positions in 2019 are DevOps, Data Scientist, Data Engineer (all over $100K) - Stack Overflow Salary Calculator, Updated; A neural net solves the three-body problem 100 million times faster; The Last SQL Guide for Data Analysis You’ll Ever Need; How YouTube is Recommending Your Next Video.

Machine Learning 45

Machine Learning Project Data Analysis SQL 45

KDnuggets

OCTOBER 28, 2019

DataTech is a one-day conference on 16 Mar 2020, at the Technology and Innovation Centre in Glasgow, focusing on key topics in data science, and welcoming members of industry, academia, and the public sector alike. DataTech provides a forum for these different communities to meet, share knowledge and expertise, and forge new collaborations. We are currently welcoming workshop, talk and poster proposals for the DataTech20 conference.

Data Science 45

Data Science Technology Data 45

KDnuggets

OCTOBER 31, 2019

These results will go into each each region and employment type to find out the differences and similarities especially between people from Industry and Students.

Data Science 45

Data Science Data Deep Learning Scala 45

KDnuggets

OCTOBER 29, 2019

Google claimed quantum supremacy, IBM challenged it… but the development is really important for the future of AI.

IT 60

IT 60

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

KDnuggets

OCTOBER 29, 2019

In this post, learn how to extend Scikit-learn code to make your experiments easier to maintain and reproduce.

Machine Learning 55

Machine Learning Coding Software Engineer Software Engineering 55

Teradata

OCTOBER 29, 2019

Teradata CEO Oliver Ratzesberger discusses the company's new strategic partnerships with Deutsche Telekom and Google Cloud. Read more!

Google Cloud 8

Google Cloud Cloud 8