Sat.Oct 12, 2019 - Fri.Oct 18, 2019

article thumbnail

How to Easily Deploy Machine Learning Models Using Flask

KDnuggets

This post aims to make you get started with putting your trained machine learning models into production using Flask API.

article thumbnail

Evolving Michelangelo Model Representation for Flexibility at Scale

Uber Engineering

Michelangelo , Uber’s machine learning (ML) platform, supports the training and serving of thousands of models in production across the company. Designed to cover the end-to-end ML workflow, the system currently supports classical machine learning, time series forecasting, and deep … The post Evolving Michelangelo Model Representation for Flexibility at Scale appeared first on Uber Engineering Blog.

article thumbnail

Keeping Your Data Warehouse In Order With DataForm

Data Engineering Podcast

Summary Managing a data warehouse can be challenging, especially when trying to maintain a common set of patterns. Dataform is a platform that helps you apply engineering principles to your data transformations and table definitions, including unit testing SQL scripts, defining repeatable pipelines, and adding metadata to your warehouse to improve your team’s communication.

article thumbnail

?? On Track with Apache Kafka – Building a Streaming ETL Solution with Rail Data

Confluent

Trains are an excellent source of streaming data—their movements around the network are an unbounded series of events. Using this data, Apache Kafka ® and Confluent Platform can provide the foundations for both event-driven applications as well as an analytical platform. With tools like KSQL and Kafka Connect, the concept of streaming ETL is made accessible to a much wider audience of developers and data engineers.

Kafka 19
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

The 5 Classification Evaluation Metrics Every Data Scientist Must Know

KDnuggets

This post is about various evaluation metrics and how and when to use them.

Data 123
article thumbnail

Evolving Michelangelo Model Representation for Flexibility at Scale

Uber Engineering

Michelangelo , Uber’s machine learning (ML) platform, supports the training and serving of thousands of models in production across the company. Designed to cover the end-to-end ML workflow, the system currently supports classical machine learning, time series forecasting, and deep … The post Evolving Michelangelo Model Representation for Flexibility at Scale appeared first on Uber Engineering Blog.

More Trending

article thumbnail

A Renewed Focus on User Experience at Teradata

Teradata

Find out how our UX team is going to radically simplify the Teradata user experience. To be unveiled at Teradata Universe!

65
article thumbnail

How to Become a (Good) Data Scientist – Beginner Guide

KDnuggets

A guide covering the things you should learn to become a data scientist, including the basics of business intelligence, statistics, programming, and machine learning.

article thumbnail

Why You Should Learn Data Engineering

Dataquest

Exciting news: we just launched a totally revamped Data Engineering path that offers from-scratch training for anyone who wants to become a data engineer or learn some data engineering skills. Looks cool, right? But it begs the question: why learn data engineering in the first place? Typically, data science teams are comprised of data analysts, data scientists, and data engineers.

article thumbnail

ML Platform Meetup: Infra for Contextual Bandits and Reinforcement Learning

Netflix Tech

Faisal Siddiqi Infrastructure for Contextual Bandits and Reinforcement Learning?—? theme of the ML Platform meetup hosted at Netflix, Los Gatos on Sep 12, 2019. Contextual and Multi-armed Bandits enable faster and adaptive alternatives to traditional A/B Testing. They enable rapid learning and better decision-making for product rollouts. Broadly speaking, these approaches can be seen as a stepping stone to full-on Reinforcement Learning (RL) with closed-loop, on-policy evaluation and model objec

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Three Things to Know About Reinforcement Learning

KDnuggets

As an engineer, scientist, or researcher, you may want to take advantage of this new and growing technology, but where do you start? The best place to begin is to understand what the concept is, how to implement it, and whether it’s the right approach for a given problem.

article thumbnail

Artificial Intelligence: Salaries Heading Skyward

KDnuggets

While the average salary for a Software Engineer is around $100,000 to $150,000, to make the big bucks you want to be an AI or Machine Learning (Specialist/Scientist/Engineer.).

article thumbnail

Writing Your First Neural Net in Less Than 30 Lines of Code with Keras

KDnuggets

Read this quick overview of neural networks and learn how to implement your first in very few lines using Keras.

Coding 119
article thumbnail

5 Tips for Novice Freelance Data Scientists

KDnuggets

If you want to launch your data science skills into freelance work, then check out these important tips to help you kick start your next adventure in data.

article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

Choosing a Machine Learning Model

KDnuggets

Selecting the perfect machine learning model is part art and part science. Learn how to review multiple models and pick the best in both competitive and real-world applications.

article thumbnail

An Overview of Density Estimation

KDnuggets

Density estimation is estimating the probability density function of the population from the sample. This post examines and compares a number of approaches to density estimation.

92
article thumbnail

Research Guide for Video Frame Interpolation with Deep Learning

KDnuggets

In this research guide, we’ll look at deep learning papers aimed at synthesizing video frames within an existing video.

article thumbnail

Probability Learning I: Bayes’ Theorem

KDnuggets

Learn about one of the fundamental theorems of probability with an easy everyday example.

87
article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

There is No Such Thing as a Free Lunch: Part 2 – Building an intelligent Digital Assistant

KDnuggets

In this second part we want to outline our own experience building an AI application and reflect on why we chose not to utilise deep learning as the core technology used.

article thumbnail

Automated Data Governance 101

KDnuggets

The way we control our data isn’t working. Data is as vulnerable as ever. Download this white paper, which outlines lessons about how data science and governance programs can, if implemented properly, reinforce each other’s objective.

article thumbnail

Data Anonymization – History and Key Ideas

KDnuggets

While effective anonymization technology remains elusive, understanding the history of this challenge can guide data science practitioners to address these important concerns through ethical and responsible use of sensitive information.

article thumbnail

Top 7 Things I Learned on my Data Science Masters

KDnuggets

Even though I’m still in my studies, here’s a list of the most important things I’ve learned (as of yet).

article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Using Neural Networks to Design Neural Networks: The Definitive Guide to Understand Neural Architecture Search

KDnuggets

A recent survey outlined the main neural architecture search methods used to automate the design of deep learning systems.

article thumbnail

Using DC/OS to Accelerate Data Science in the Enterprise

KDnuggets

Follow this step-by-step tutorial using Tensorflow to setup a DC/OS Data Science Engine as a PaaS for enabling distributed multi-node, multi-GPU model training.

article thumbnail

KDnuggets™ News 19:n39, Oct 16: Key Ideas in Document Embedding; The problem with metrics is a big problem for AI

KDnuggets

This week on KDnuggets: Beyond Word Embedding: Key Ideas in Document Embedding; The problem with metrics is a big problem for AI; Activation maps for deep learning models in a few lines of code; There is No Such Thing as a Free Lunch; 8 Paths to Getting a Machine Learning Job Interview; and much, much more.

article thumbnail

Top KDnuggets tweets, Oct 09-15: #DeepLearning for Natural Language Processing (#NLP) using RNNs & CNNs #KDN Post

KDnuggets

Also: Kannada-MNIST: A new handwritten digits dataset in ML town; Math for Programmers; The 4 Quadrants of Data Science Skills and 7 Principles for Creating a Viral Data Visualization; The Last SQL Guide for Data Analysis You’ll Ever Need.

Process 71
article thumbnail

How to Drive Cost Savings, Efficiency Gains, and Sustainability Wins with MES

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

article thumbnail

How to Get the Most out of ODSC West 2019

KDnuggets

ODSC West comes to San Francisco on Oct 29 - Nov 1. With over 300 hours of content, 200+ speakers, and thousands of attendees, there is certainly a lot to see, learn, and do at the conference. Register by Friday for 10% off your pass.

article thumbnail

Top Stories, Oct 7-13: 10 Free Top Notch Natural Language Processing Courses; The Last SQL Guide for Data Analysis You’ll Ever Need

KDnuggets

Also: Activation maps for deep learning models in a few lines of code; The 4 Quadrants of Data Science Skills and 7 Principles for Creating a Viral Data Visualization; OpenAI Tried to Train AI Agents to Play Hide-And-Seek but Instead They Were Shocked by What They Learned; 10 Great Python Resources for Aspiring Data Scientists.

article thumbnail

Real Data, Big Impact: UChicago Students Work to Improve Sales at Goose Island

KDnuggets

Watch UChicago Master of Science in Analytics capstone projects unfold in Real Data, Big Impact and see how students collaborate with their clients to deliver successful analytics projects.

Project 54
article thumbnail

Go From Total Beginner to Data Engineer with Our New Path

Dataquest

We’ve got some really exciting news: we’ve just launched a total revamp of our Data Engineering learning path ! This revamped path is designed to be more like our other course paths. You can start it even if you have no prior experience with coding , and it’ll take you from total beginner to experienced practitioner with all of the core skills needed to become a data engineer.

article thumbnail

The Cloud Development Environment Adoption Report

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.