Data Engineering Podcast

SEPTEMBER 30, 2019

Summary Building an end-to-end data pipeline for your machine learning projects is a complex task, made more difficult by the variety of ways that you can structure it. Kedro is a framework that provides an opinionated workflow that lets you focus on the parts that matter, so that you don’t waste time on gluing the steps together. In this episode Tom Goldenberg explains how it works, how it is being used at Quantum Black for customer projects, and how it can help you structure your own.

Data Pipeline 100

Data Pipeline Machine Learning Media Data 100

KDnuggets

OCTOBER 2, 2019

Applying a clustering algorithm is much easier than selecting the best one. Each type offers pros and cons that must be considered if you’re striving for a tidy cluster structure.

Algorithm 111

Algorithm Datasets 111

Teradata

SEPTEMBER 29, 2019

The Teradata Certification program is celebrating its 20th anniversary! Find out how it can advance your career by making you a certified expert on Vantage.

Programming 66

Programming Certification IT 66

Rockset

OCTOBER 1, 2019

Kubernetes at Rockset At Rockset, we use Kubernetes (k8s) for cluster orchestration. It runs all our production microservices — from our ingest workers to our query-serving tier. In addition to hosting all the production infrastructure, each engineer has their own Kubernetes namespace and dedicated resources that we use to locally deploy and test new versions of code and configuration.

SQL 40

SQL Systems Metadata Accessibility 40

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Confluent

SEPTEMBER 30, 2019

Go from zero to production on Apache Kafka ® without talking to sales reps or building infrastructure. Apache Kafka is the standard for event-driven applications. But it’s not without its challenges, and the ops burden can be heavy. Organizations that successfully build and run their own Kafka environment must make significant investments in engineering and operations to account for failover and security.

Kafka 19

Kafka Cloud Amazon Web Services Google Cloud 19

KDnuggets

OCTOBER 2, 2019

As data scientists who are the brains behind the AI-based innovations, you need to understand the significance of data preparation to achieve the desired level of cognitive capability for your models. Let’s begin.

Data Preparation 111

Data Preparation Machine Learning IT Data 111

KDnuggets

OCTOBER 1, 2019

Data science education in Europe has been reevaluated and new recommendations are leading the way to the next generation of data science Master's courses to better support and train students.

Data Science 106

Data Science Education Data 106

KDnuggets

SEPTEMBER 30, 2019

This thorough review focuses on the impact of AI, 5G, and edge computing on the healthcare sector in the 2020s as well as a look at quantum computing's potential impact on AI, healthcare, and financial services.

Healthcare 94

Healthcare Systems IT 94

KDnuggets

OCTOBER 4, 2019

This is it: the last SQL guide for data analysis you'll ever need! OK, maybe it’s actually the first. But it’ll give you a solid head start.

Data Analysis 104

Data Analysis SQL Data IT 104

KDnuggets

OCTOBER 3, 2019

There is no clear outline on how to study Machine Learning/Deep Learning due to which many individuals apply all the possible algorithms that they have heard of and hope that one of implemented algorithms work for their problem in hand. Below, I've listed out some of the steps that one should adopt while solving a machine learning problem.

Machine Learning 86

Machine Learning Engineering Deep Learning Algorithm 86

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

KDnuggets

OCTOBER 1, 2019

There are three types of emotion AI, and their combinations. In this article, I’ll briefly go through these three types and the challenges of their real-life applications.

86

86

KDnuggets

OCTOBER 4, 2019

Find out what was presented at the 6th annual Deep Learning Summit in London where industry leaders, academics, researchers, and innovative startups presenting the latest technological advancements and industry application methods in the field of deep learning.

Deep Learning 87

Deep Learning Technology 87

KDnuggets

SEPTEMBER 30, 2019

Three new releases that will help researchers streamline the implementation of reinforcement learning programs.

Programming 111

Programming 111

KDnuggets

SEPTEMBER 30, 2019

In advance of the Data Science Salon taking place in Seattle on Oct 17, we asked our speakers to shed some light on how Artificial Intelligence and Machine Learning are impacting one of America’s most disruptive industries. Read for more insight, and then register with KDnuggets exclusive link for 20% off tickets.

Machine Learning 84

Machine Learning Data Science Retail Data 84

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

KDnuggets

SEPTEMBER 30, 2019

This article will introduce the different type of data sets, data object and attributes.

Data 118

Data Datasets 118

KDnuggets

OCTOBER 1, 2019

We show what metric to use for visualizing and determining an optimal number of clusters much better than the usual practice — elbow method.

87

87

KDnuggets

OCTOBER 4, 2019

In this guide, we will explore a range of research papers that have sought to solve the challenging task of automating neural network design.

Architecture 83

Architecture Designing Machine Learning 83

KDnuggets

OCTOBER 2, 2019

The tech giant Baidu unveiled its state-of-the-art NLP architecture ERNIE 2.0 earlier this year, which scored significantly higher than XLNet and BERT on all tasks in the GLUE benchmark. This major breakthrough in NLP takes advantage of a new innovation called “Continual Incremental Multi-Task Learning”.

Architecture 71

Architecture IT 71

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

KDnuggets

OCTOBER 3, 2019

While AI may appear magical at times, these five principles will help guide you to avoid pitfalls when leveraging this tech.

Data 81

Data 81

KDnuggets

OCTOBER 3, 2019

You won’t want to miss the opportunity to learn about the future of deep learning first-hand at ODSC West in San Francisco, Oct 29 - Nov 1. So don’t forget to register soon for 20% off.

Deep Learning 63

Deep Learning 63

KDnuggets

OCTOBER 2, 2019

This week, find out what the future of analytics and data science holds; get an introduction to spaCy for natural language processing; find out how to use time series analysis for baseball; get to know your data; read 6 bits of advice for data scientists; and much, much more!

Data Science 57

Data Science Python Data Process 57

KDnuggets

SEPTEMBER 30, 2019

Also: 12 Deep Learning Researchers and Leaders; Natural Language in Python using spaCy: An Introduction; A Single Function to Streamline Image Classification with Keras; Which Data Science Skills are core and which are hot/emerging ones?; 6 bits of advice for Data Scientists.

Deep Learning 57

Deep Learning Data Science Python Data 57

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

KDnuggets

OCTOBER 2, 2019

Also: Top KDnuggets tweets, Sep 18-24: Python Libraries for Interpretable Machine Learning; Scikit-Learn: A silver bullet for basic ML; Automatic Version Control for Data Scientists; My journey path from a Software Engineer to BI Specialist to a Data Scientist.

Python 54

Python BI Software Engineer Software Engineering 54

KDnuggets

OCTOBER 3, 2019

DeepMind researchers created a model to be able to replay past experiences in a way that simulate the mechanisms in the hippocampus.

Building 54

Building 54

KDnuggets

OCTOBER 2, 2019

This online course is available – for free – to anyone interested in building practical skills in using data to solve problems better.

Building 51

Building Education Data 51

Confluent

SEPTEMBER 30, 2019

Day one of the event, summarized for your convenience. They say you never forget your first Kafka Summit. Mine was in New York City in 2017, and it had, what, 300 people? Today we welcomed nearly 2,000 to a giant ballroom in San Francisco. There were laser beams. There were two Tony Stark allusions in the first 60 seconds. And most importantly, there was a vibrant and ever-growing community present.

Kafka 17

Kafka Architecture Cloud Designing 17

Speaker: Evelyn Chou

Choosing the right business intelligence (BI) platform can feel like navigating a maze of features, promises, and technical jargon. With so many options available, how can you ensure you’re making the right decision for your organization’s unique needs? 🤔 This webinar brings together expert insights to break down the complexities of BI solution vetting.

Business Intelligence

Confluent

OCTOBER 4, 2019

This tutorial describes how to set up an Apache Kafka ® cluster on Enterprise Pivotal Container Service (Enterprise PKS) using Confluent Operator , which allows you to deploy and run Confluent Platform at scale on virtually any Kubernetes platform, including Pivotal Container Service (PKS). With Enterprise PKS , you can deploy, scale, patch, and upgrade all the Kubernetes clusters in your system without downtime.

Kafka 16

Kafka Accessibility Accessible Engineering 16

Confluent

OCTOBER 3, 2019

We recently launched a new artificial intelligence (AI) data extraction API called Scrapinghub AutoExtract , which turns article and product pages into structured data. At Scrapinghub, we specialize in web data extraction , and our products empower everyone from programmers to CEOs to extract web data quickly and effectively. Example of article extraction on Introducing a Cloud-Native Experience for Apache Kafka ® in Confluent Cloud.

Kafka 16

Kafka Cloud Amazon Web Services Google Cloud 16

Confluent

OCTOBER 1, 2019

If you looked at the Kafka Summits I’ve been a part of as a sequence of immutable events (and they are, unless you know something about time I don’t), it would look like this: New York City 2017, San Francisco 2017, London 2018, San Francisco 2018, New York City 2019, London 2019, San Francisco 2019. That makes this the seventh Summit I’ve attended.

Kafka 14

Kafka Database Cloud Systems 14