Sat.Oct 19, 2019 - Fri.Oct 25, 2019

article thumbnail

Introduction to Natural Language Processing (NLP)

KDnuggets

Have you ever wondered how your personal assistant (e.g: Siri) is built? Do you want to build your own? Perfect! Let’s talk about Natural Language Processing.

Process 123
article thumbnail

Data Orchestration For Hybrid Cloud Analytics

Data Engineering Podcast

Summary The scale and complexity of the systems that we build to satisfy business requirements is increasing as the available tools become more sophisticated. In order to bridge the gap between legacy infrastructure and evolving use cases it is necessary to create a unifying set of components. In this episode Dipti Borkar explains how the emerging category of data orchestration tools fills this need, some of the existing projects that fit in this space, and some of the ways that they can work to

Cloud 100
article thumbnail

Open-sourcing Polynote: an IDE-inspired polyglot notebook

Netflix Tech

Jeremy Smith , Jonathan Indig , Faisal Siddiqi We are pleased to announce the open-source launch of Polynote : a new, polyglot notebook with first-class Scala support, Apache Spark integration, multi-language interoperability including Scala, Python, and SQL, as-you-type autocomplete, and more. Polynote provides data scientists and machine learning researchers with a notebook environment that allows them the freedom to seamlessly integrate our JVM-based ML platform ?

Scala 94
article thumbnail

Getting Started with Rust and Apache Kafka

Confluent

I’ve written an event sourcing bank simulation in Clojure (a lisp build for Java virtual machines or JVMs) called open-bank-mark , which you are welcome to read about in my previous blog post explaining the story behind this open source example. As a next step, specifically for this article I’ve added SSL and combined some topics together, using the subject name strategy option of Confluent Schema Registry , making it more production like, adding security, and making it possible to put multiple

Kafka 18
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Feature Selection: Beyond feature importance?

KDnuggets

In this post, you will see 3 different techniques of how to do Feature Selection to your datasets and how to build an effective predictive model.

Datasets 123
article thumbnail

Teradata is Moving the Cloud Forward

Teradata

With four new offerings, Teradata is helping companies move from analytics to answers wherever they are on their cloud journey. Read more.

Cloud 66

More Trending

article thumbnail

4 Steps to Creating Dynamic Kafka Connectors with the Kafka Connect API

Confluent

If you’ve worked with the Apache Kafka ® and Confluent ecosystem before, chances are you’ve used a Kafka Connect connector to stream data into Kafka or stream data out of it. While there is an ever-growing list of connectors available—whether Confluent or community supported?you still might find yourself needing to integrate with a technology for which no connectors exist.

Kafka 15
article thumbnail

Everything a Data Scientist Should Know About Data Management

KDnuggets

For full-stack data science mastery, you must understand data management along with all the bells and whistles of machine learning. This high-level overview is a road map for the history and current state of the expansive options for data storage and infrastructure solutions.

article thumbnail

Embracing the Darkness: Vantage Developer

Teradata

With our renewed focus on user experience, we’re applying user-centered design principles & conducting ethnographic research on key personas, starting with developers.

article thumbnail

Open-sourcing Polynote: an IDE-inspired polyglot notebook

Netflix Tech

Jeremy Smith , Jonathan Indig , Faisal Siddiqi We are pleased to announce the open-source launch of Polynote : a new, polyglot notebook with first-class Scala support, Apache Spark integration, multi-language interoperability including Scala, Python, and SQL, as-you-type autocomplete, and more. Polynote provides data scientists and machine learning researchers with a notebook environment that allows them the freedom to seamlessly integrate our JVM-based ML platform ?

Scala 40
article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

The Role of UX in Making Rockset the Shortest Path from Data to Applications

Rockset

At Rockset, our singular focus is to be the shortest (and most efficient) path from data to applications for our users. We recognize and truly believe that our success lies in the success of our users. We constantly think about improving our workflows, coming up with new ones and iterating on them in ways that takes the user experience to a whole new level.

article thumbnail

How YouTube is Recommending Your Next Video

KDnuggets

If you are interested in learning more about the latest Youtube recommendation algorithm paper, read this post for details on its approach and improvements.

Algorithm 123
article thumbnail

Survey: Success of Global Enterprise Depends on Adaptation to Hyper-Digitization

Teradata

A new study by Teradata and research firm, Vanson Bourne, shines a light on the market forces impacting the world's largest companies. Find out more.

40
article thumbnail

Open Sourcing Mantis: A Platform For Building Cost-Effective, Realtime, Operations-Focused…

Netflix Tech

Open Sourcing Mantis: A Platform For Building Cost-Effective, Realtime, Operations-Focused Applications By Jeff Chao on behalf of the Mantis team Today we’re excited to announce that we’re open sourcing Mantis , a platform that helps Netflix engineers better understand the behavior of their applications to ensure the highest quality experience for our members.

article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

Anomaly Detection, A Key Task for AI and Machine Learning, Explained

KDnuggets

One way to process data faster and more efficiently is to detect abnormal events, changes or shifts in datasets. Anomaly detection refers to identification of items or events that do not conform to an expected pattern or to other items in a dataset that are usually undetectable by a human expert.

article thumbnail

Time Series Analysis: A Simple Example with KNIME and Spark

KDnuggets

The task: train and evaluate a simple time series model using a random forest of regression trees and the NYC Yellow taxi dataset.

Datasets 118
article thumbnail

Convolutional Neural Network for Breast Cancer Classification

KDnuggets

See how Deep Learning can help in solving one of the most commonly diagnosed cancer in women.

article thumbnail

Intro to Adversarial Machine Learning and Generative Adversarial Networks

KDnuggets

In this crash course on GANs, we explore where they fit into the pantheon of generative models, how they've changed over time, and what the future has in store for this area of machine learning.

article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

How to Write Web Apps Using Simple Python for Data Scientists

KDnuggets

Convert your Data Science Projects into cool apps easily without knowing any web frameworks.

Python 106
article thumbnail

5 Advanced Features of Pandas and How to Use Them

KDnuggets

The pandas library offers core functionality when preparing your data using Python. But, many don't go beyond the basics, so learn about these lesser-known advanced methods that will make handling your data easier and cleaner.

Python 101
article thumbnail

How to Measure Foot Traffic Using Data Analytics

KDnuggets

You need to know how many people visit your store now and what sort of audience you're acquiring. Foot traffic data is going to be invaluable to the success of your business.

article thumbnail

Bye Data Scientists, Hello AI? Not Likely!

KDnuggets

AI is becoming more mainstream. The fact that computers/robots will learn after being built and will surpass a human's intelligence is terrifying.

Data 89
article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Addressing the Growing Need for Skills in Data Science

KDnuggets

To address the current difficulties in hiring data scientists due to their short supply, many companies can benefit from retraining existing analytically minded employees.

article thumbnail

Seven Myths About the True Costs of AI Systems

KDnuggets

While there is much excitement today around implementing AI at the enterprise level, the financial costs of this process are often unexpected and underappreciated. These seven myths are crucial lessons learned that executives should know before heading down the road to AI.

Systems 69
article thumbnail

KDnuggets™ News 19:n40, Oct 23: How to Become a (Good) Data Scientist; Writing Your First Neural Net in 30 Lines with Keras

KDnuggets

Read useful advice on how to become a good data scientist; see how you can write your 1st neural net in under 30 lines of Keras code; Understand why AI salaries are heading skywards and what skills you need for them; and read about key ideas and methods in anomaly detection.

Coding 65
article thumbnail

Harnessing Semiotics and Discourse Communities to Understand User Intent

KDnuggets

Semiotics helps us understand the importance of context to determining the meaning of a term and discourse communities provide us with the background context (mental model) by which to correctly interpret its meaning correctly.

article thumbnail

How to Drive Cost Savings, Efficiency Gains, and Sustainability Wins with MES

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

article thumbnail

Top KDnuggets tweets, Oct 16-22: How YouTube is Recommending Your Next Video

KDnuggets

Also: The 5 Classification Evaluation Metrics Every Data Scientist Must Know; How to Recognize a Good Data Scientist Job From a Bad One; How to Easily Deploy Machine Learning Models Using Flask.

article thumbnail

This Microsoft Neural Network can Answer Questions About Scenic Images with Minimum Training

KDnuggets

Recently, a group of AI experts from Microsoft Research published a paper proposing a method for scene understanding that combines two key tasks: image captioning and visual question answering (VQA).

54
article thumbnail

Top Stories, Oct 14-20: How to Become a (Good) Data Scientist Beginner Guide

KDnuggets

Also: The 5 Classification Evaluation Metrics Every Data Scientist Must Know; Artificial Intelligence: Salaries Heading Skyward; Writing Your First Neural Net in Less Than 30 Lines of Code with Keras; How to select rows and columns in Pandas using [ ],loc, iloc,at and.iat; The Last SQL Guide for Data Analysis You'll Ever Need.

article thumbnail

Samsung Tech Day: Today’s Electronic Devices Seem Magical, But the Real Super-Power is in Silicon

KDnuggets

Samsung’s Tech Day event showcases processor and memory advances for 5G, AI, Cloud and Edge Computing, Automotive, IoT, and more.

article thumbnail

The Cloud Development Environment Adoption Report

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.