Data Engineering Podcast

DECEMBER 8, 2019

Summary Data warehouses have gone through many transformations, from standard relational databases on powerful hardware, to column oriented storage engines, to the current generation of cloud-native analytical engines. SnowflakeDB has been leading the charge to take advantage of cloud services that simplify the separation of compute and storage. In this episode Kent Graziano, chief technical evangelist for SnowflakeDB, explains how it is differentiated from other managed platforms and traditiona

Data Warehouse 100

Data Warehouse Cloud AWS Relational Database 100

KDnuggets

DECEMBER 12, 2019

Python's plotting libraries such as matplotlib and seaborn does allow the user to create elegant graphics as well, but lack of a standardized syntax for implementing the grammar of graphics compared to the simple, readable and layering approach of ggplot2 in R makes it more difficult to implement in Python.

Python 122

Python IT Data Science Data 122

Uber Engineering

DECEMBER 10, 2019

Michelangelo , Uber’s machine learning (ML) platform, powers machine learning model training across various use cases at Uber, such as forecasting rider demand , fraud detection , food discovery and recommendation for Uber Eats , and improving the accuracy of … The post Productionizing Distributed XGBoost to Train Deep Tree Models with Large Data Sets at Uber appeared first on Uber Engineering Blog.

Food 99

Food Machine Learning Data Engineering 99

Netflix Tech

DECEMBER 10, 2019

Netflix Hack Day?—?Fall 2019 By Tom Richards , Carenina Garcia Motion , and Leslie Posada Hack Day at Netflix is an opportunity to build and show off a feature, tool, or quirky app. The goal is simple: experiment with new ideas/technologies, engage with colleagues across different disciplines, and have fun! We know even the silliest idea can spur something more.

Technology 82

Technology Project Systems Building 82

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Teradata

DECEMBER 11, 2019

Teradata's team of experts are chiming in on their top technology and business predictions for 2020 - from AI to Customer Experience to the Cloud. Read more!

Cloud 72

Cloud Technology 72

KDnuggets

DECEMBER 10, 2019

From not sweating missing values, to determining feature importance for any estimator, to support for stacking, and a new plotting API, here are 5 new features of the latest release of Scikit-learn which deserve your attention.

Data Preparation 119

Data Preparation Machine Learning Python Data 119

Netflix Tech

DECEMBER 10, 2019

Netflix Hack Day?—?Fall 2019 By Tom Richards , Carenina Garcia Motion , and Leslie Posada Hack Day at Netflix is an opportunity to build and show off a feature, tool, or quirky app. The goal is simple: experiment with new ideas/technologies, engage with colleagues across different disciplines, and have fun! We know even the silliest idea can spur something more.

Technology 52

Technology Project Systems Building 52

Teradata

DECEMBER 9, 2019

Identifying and focusing on priority analytic use cases within your organization will ensure you are asking the right business questions. Find out more.

Data Analytics 61

Data Analytics Data 61

KDnuggets

DECEMBER 9, 2019

The field of Data Science is growing with new capabilities and reach into every industry. With digital transformations occurring in organizations around the world, 2019 included trends of more companies leveraging more data to make better decisions. Check out these next trends in Data Science expected to take off in 2020.

Data Science 113

Data Science Data Cloud Computing Cloud 113

Confluent

DECEMBER 9, 2019

Although starting out with one Confluent Schema Registry deployment per development environment is straightforward, over time, a company may scale and begin migrating data to a cloud environment (such as […].

Kafka 19

Kafka Cloud Data 19

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Netflix Tech

DECEMBER 10, 2019

Netflix Hack Day?—?Fall 2019 By Tom Richards , Carenina Garcia Motion , and Leslie Posada Hack Day at Netflix is an opportunity to build and show off a feature, tool, or quirky app. The goal is simple: experiment with new ideas/technologies, engage with colleagues across different disciplines, and have fun! We know even the silliest idea can spur something more.

Technology 52

Technology Project Systems Building 52

Teradata

DECEMBER 9, 2019

Identifying and focusing on priority analytic use cases within your organization will ensure you are asking the right business questions. Find out more.

Data Analytics 40

Data Analytics Data 40

KDnuggets

DECEMBER 13, 2019

We show how to build intuitive and useful pipelines with Pandas DataFrame using a wonderful little library called pdpipe.

Building 115

Building Data Preparation Python Data 115

KDnuggets

DECEMBER 12, 2019

The speed at which AI made advancements and news during 2019 makes it imperative now to step back and place these events into order and perspective. It's important to separate the interest that any one advancement initially attracts, from its actual gravity and its consequential influence on the field. This review unfolds the parallel threads of these AI stories over this year and isolates their significance.

IT 86

IT 86

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

KDnuggets

DECEMBER 10, 2019

One of the biggest highlights of Grafana is the ability to bring several data sources together in one dashboard with adding rows that will host individual panels. Let's look at installing, configuring, and creating our first dashboard using Grafana.

Building 85

Building BI Data 85

KDnuggets

DECEMBER 11, 2019

We asked leading experts - what are the most important developments of 2019 and 2020 key trends in AI, Analytics, Machine Learning, Data Science, and Deep Learning? This blog focuses mainly on technology and deployment.

Deep Learning 79

Deep Learning Machine Learning Data Science Technology 79

KDnuggets

DECEMBER 9, 2019

Here are four common hurdles that need to be overcome before tapping into the benefits of predictive maintenance.

Machine Learning 110

Machine Learning 110

KDnuggets

DECEMBER 9, 2019

As we say goodbye to one year and look forward to another, KDnuggets has once again solicited opinions from numerous research & technology experts as to the most important developments of 2019 and their 2020 key trend predictions.

Deep Learning 81

Deep Learning Machine Learning Data Science Technology 81

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

KDnuggets

DECEMBER 13, 2019

What is "ultralearning" and how can you follow the strategy to become an expert of data science? Start with this first part in a series that will guide you through this self-motivated methodology to help you efficiently master difficult skills.

Data Science 78

Data Science Data Education 78

KDnuggets

DECEMBER 11, 2019

The second part in a series on leveraging techniques to take a look inside the black box of AI, this guide considers post-hoc interpretation that is useful when the model is not transparent.

Python 74

Python 74

KDnuggets

DECEMBER 9, 2019

Also: Data Science Curriculum Roadmap; Enabling the Deep Learning Revolution; The Essential Toolbox for Data Cleaning; A Non-Technical Reading List for Data Science; The Future of Careers in Data Science & Analysis.

Machine Learning 60

Machine Learning Deep Learning Data Science Coding 60

KDnuggets

DECEMBER 10, 2019

Graph machine learning is a developing area of research that brings many complexities. One challenge that both fascinates and infuriates those working with graph algorithms is — scalability. We take a close look at scalability for graph machine learning methods covering what it is, what makes it difficult, and an example of a method that tackles it head-on.

Machine Learning 59

Machine Learning Algorithm Deep Learning IT 59

Advertisement

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.

Cloud

KDnuggets

DECEMBER 11, 2019

Math for Programmers teaches you the math you need to know for a career in programming, concentrating on what you need to know as a developer.

Programming 83

Programming 83

KDnuggets

DECEMBER 9, 2019

The new model showed great improvements over the previous AlphaZero agent.

87

87

KDnuggets

DECEMBER 10, 2019

This blog will explain the basics of deploying a machine learning algorithm, focusing on developing a Naïve Bayes model for spam message identification, and using Flask to create an API for that model.

Machine Learning 54

Machine Learning Algorithm 54

KDnuggets

DECEMBER 12, 2019

This post attempts to summarize my recent detour into NLP, describing how I exposed a Huggingface pre-trained Language Model (LM) on an AWS-based web application.

AWS 56

AWS 56

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

KDnuggets

DECEMBER 11, 2019

NeurIPS 2019 is underway in Vancouver, and the committee has just recently announced this year's Outstanding Paper Awards. Find out what the selections were, along with some additional info on NeurIPS papers, here.

47

47

KDnuggets

DECEMBER 12, 2019

ACM SIGKDD Invites Industry and Academic Experts to Submit Advancements in Data Mining, Knowledge Discovery and Machine Learning for 26 th Annual Conference in San Diego.

Data Mining 48

Data Mining Data Science Machine Learning Data 48

KDnuggets

DECEMBER 11, 2019

AI, Analytics, Machine Learning, Data Science, Deep Learning Research Main Developments and Key Trends; Down with technical debt! Clean #Python for #DataScientists; Calculate Similarity?-?the most relevant Metrics in a Nutshell.

Deep Learning 47

Deep Learning Machine Learning Data Science Python 47

KDnuggets

DECEMBER 13, 2019

The Machine Learning community must shape the world so that AI is built and implemented with a focus on the entire outcome for our society, and not just optimized for accuracy and/or profit.

Machine Learning 45

Machine Learning Algorithm 45

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project