Data Engineering Podcast

OCTOBER 21, 2019

Summary The scale and complexity of the systems that we build to satisfy business requirements is increasing as the available tools become more sophisticated. In order to bridge the gap between legacy infrastructure and evolving use cases it is necessary to create a unifying set of components. In this episode Dipti Borkar explains how the emerging category of data orchestration tools fills this need, some of the existing projects that fit in this space, and some of the ways that they can work to

Cloud 100

Cloud Hadoop Data Lake Programming Language 100

KDnuggets

OCTOBER 22, 2019

For full-stack data science mastery, you must understand data management along with all the bells and whistles of machine learning. This high-level overview is a road map for the history and current state of the expansive options for data storage and infrastructure solutions.

Data Management 121

Data Management Management Data Storage Machine Learning 121

Netflix Tech

OCTOBER 23, 2019

Jeremy Smith , Jonathan Indig , Faisal Siddiqi We are pleased to announce the open-source launch of Polynote : a new, polyglot notebook with first-class Scala support, Apache Spark integration, multi-language interoperability including Scala, Python, and SQL, as-you-type autocomplete, and more. Polynote provides data scientists and machine learning researchers with a notebook environment that allows them the freedom to seamlessly integrate our JVM-based ML platform ?

Scala 93

Scala Machine Learning Python Coding 93

Teradata

OCTOBER 21, 2019

With four new offerings, Teradata is helping companies move from analytics to answers wherever they are on their cloud journey. Read more.

Cloud 66

Cloud 66

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Rockset

OCTOBER 21, 2019

At Rockset, our singular focus is to be the shortest (and most efficient) path from data to applications for our users. We recognize and truly believe that our success lies in the success of our users. We constantly think about improving our workflows, coming up with new ones and iterating on them in ways that takes the user experience to a whole new level.

Unstructured Data 40

Unstructured Data Designing Data Accessible 40

KDnuggets

OCTOBER 21, 2019

If you are interested in learning more about the latest Youtube recommendation algorithm paper, read this post for details on its approach and improvements.

Algorithm 123

Algorithm IT Systems Engineering 123

Teradata

OCTOBER 22, 2019

With our renewed focus on user experience, we’re applying user-centered design principles & conducting ethnographic research on key personas, starting with developers.

Designing 56

Designing 56

Confluent

OCTOBER 24, 2019

I’ve written an event sourcing bank simulation in Clojure (a lisp build for Java virtual machines or JVMs) called open-bank-mark , which you are welcome to read about in my previous blog post explaining the story behind this open source example. As a next step, specifically for this article I’ve added SSL and combined some topics together, using the subject name strategy option of Confluent Schema Registry , making it more production like, adding security, and making it possible to put multiple

Kafka 18

Kafka Java Banking Bytes 18

KDnuggets

OCTOBER 25, 2019

Have you ever wondered how your personal assistant (e.g: Siri) is built? Do you want to build your own? Perfect! Let’s talk about Natural Language Processing.

Process 114

Process Building 114

Netflix Tech

OCTOBER 23, 2019

Jeremy Smith , Jonathan Indig , Faisal Siddiqi We are pleased to announce the open-source launch of Polynote : a new, polyglot notebook with first-class Scala support, Apache Spark integration, multi-language interoperability including Scala, Python, and SQL, as-you-type autocomplete, and more. Polynote provides data scientists and machine learning researchers with a notebook environment that allows them the freedom to seamlessly integrate our JVM-based ML platform ?

Scala 40

Scala Machine Learning Python Coding 40

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Teradata

OCTOBER 20, 2019

A new study by Teradata and research firm, Vanson Bourne, shines a light on the market forces impacting the world's largest companies. Find out more.

40

40

Confluent

OCTOBER 23, 2019

If you’ve worked with the Apache Kafka ® and Confluent ecosystem before, chances are you’ve used a Kafka Connect connector to stream data into Kafka or stream data out of it. While there is an ever-growing list of connectors available—whether Confluent or community supported?you still might find yourself needing to integrate with a technology for which no connectors exist.

Kafka 15

Kafka Cloud Storage Cloud Database 15

KDnuggets

OCTOBER 24, 2019

In this post, you will see 3 different techniques of how to do Feature Selection to your datasets and how to build an effective predictive model.

Datasets 118

Datasets Building Machine Learning 118

Netflix Tech

OCTOBER 21, 2019

Open Sourcing Mantis: A Platform For Building Cost-Effective, Realtime, Operations-Focused Applications By Jeff Chao on behalf of the Mantis team Today we’re excited to announce that we’re open sourcing Mantis , a platform that helps Netflix engineers better understand the behavior of their applications to ensure the highest quality experience for our members.

Building 60

Building AWS Systems Process 60

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

KDnuggets

OCTOBER 21, 2019

One way to process data faster and more efficiently is to detect abnormal events, changes or shifts in datasets. Anomaly detection refers to identification of items or events that do not conform to an expected pattern or to other items in a dataset that are usually undetectable by a human expert.

Machine Learning 97

Machine Learning Datasets Process Data 97

KDnuggets

OCTOBER 23, 2019

In this crash course on GANs, we explore where they fit into the pantheon of generative models, how they've changed over time, and what the future has in store for this area of machine learning.

Machine Learning 87

Machine Learning 87

KDnuggets

OCTOBER 25, 2019

The pandas library offers core functionality when preparing your data using Python. But, many don't go beyond the basics, so learn about these lesser-known advanced methods that will make handling your data easier and cleaner.

Python 86

Python Data Preparation Data 86

KDnuggets

OCTOBER 23, 2019

The task: train and evaluate a simple time series model using a random forest of regression trees and the NYC Yellow taxi dataset.

Datasets 92

Datasets 92

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

KDnuggets

OCTOBER 23, 2019

You need to know how many people visit your store now and what sort of audience you're acquiring. Foot traffic data is going to be invaluable to the success of your business.

Data Analytics 75

Data Analytics Data 75

KDnuggets

OCTOBER 24, 2019

See how Deep Learning can help in solving one of the most commonly diagnosed cancer in women.

Deep Learning 89

Deep Learning Healthcare Python 89

KDnuggets

OCTOBER 22, 2019

Convert your Data Science Projects into cool apps easily without knowing any web frameworks.

Python 87

Python Data Science Data Project 87

KDnuggets

OCTOBER 22, 2019

AI is becoming more mainstream. The fact that computers/robots will learn after being built and will surpass a human's intelligence is terrifying.

Data 66

Data Data Science 66

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

KDnuggets

OCTOBER 22, 2019

To address the current difficulties in hiring data scientists due to their short supply, many companies can benefit from retraining existing analytically minded employees.

Data Science 56

Data Science Data Education 56

KDnuggets

OCTOBER 24, 2019

While there is much excitement today around implementing AI at the enterprise level, the financial costs of this process are often unexpected and underappreciated. These seven myths are crucial lessons learned that executives should know before heading down the road to AI.

Systems 50

Systems Process 50

KDnuggets

OCTOBER 23, 2019

Read useful advice on how to become a good data scientist; see how you can write your 1st neural net in under 30 lines of Keras code; Understand why AI salaries are heading skywards and what skills you need for them; and read about key ideas and methods in anomaly detection.

Coding 47

Coding Data 47

KDnuggets

OCTOBER 25, 2019

Semiotics helps us understand the importance of context to determining the meaning of a term and discourse communities provide us with the background context (mental model) by which to correctly interpret its meaning correctly.

Deep Learning 46

Deep Learning IT 46

Speaker: Evelyn Chou

Choosing the right business intelligence (BI) platform can feel like navigating a maze of features, promises, and technical jargon. With so many options available, how can you ensure you’re making the right decision for your organization’s unique needs? 🤔 This webinar brings together expert insights to break down the complexities of BI solution vetting.

Business Intelligence

KDnuggets

OCTOBER 23, 2019

Also: The 5 Classification Evaluation Metrics Every Data Scientist Must Know; How to Recognize a Good Data Scientist Job From a Bad One; How to Easily Deploy Machine Learning Models Using Flask.

Machine Learning 45

Machine Learning Data Systems 45

KDnuggets

OCTOBER 21, 2019

Recently, a group of AI experts from Microsoft Research published a paper proposing a method for scene understanding that combines two key tasks: image captioning and visual question answering (VQA).

45

45

KDnuggets

OCTOBER 21, 2019

Also: The 5 Classification Evaluation Metrics Every Data Scientist Must Know; Artificial Intelligence: Salaries Heading Skyward; Writing Your First Neural Net in Less Than 30 Lines of Code with Keras; How to select rows and columns in Pandas using [ ],loc, iloc,at and.iat; The Last SQL Guide for Data Analysis You'll Ever Need.

Data Analysis 45

Data Analysis SQL Coding Data 45

KDnuggets

OCTOBER 23, 2019

Samsung’s Tech Day event showcases processor and memory advances for 5G, AI, Cloud and Edge Computing, Automotive, IoT, and more.

Electronics 45

Electronics Cloud Cloud Computing 45

Speaker: Aindra Misra, Senior Manager, Product Management (Data, ML, and Cloud Infrastructure) at BILL

Join us for an insightful webinar that explores the critical intersection of data privacy and AI governance. In today’s rapidly evolving tech landscape, building robust governance frameworks is essential to fostering innovation while staying compliant with regulations. Our expert speaker, Aindra Misra, will guide you through best practices for ensuring data protection while leveraging AI capabilities.

Government