Sat.Sep 14, 2019 - Fri.Sep 20, 2019

article thumbnail

A Gentle Introduction to PyTorch 1.2

KDnuggets

This comprehensive tutorial aims to introduce the fundamentals of PyTorch building blocks for training neural networks.

Building 123
article thumbnail

The Rise of Managed Services for Apache Kafka

Confluent

As a distributed system for collecting, storing, and processing data at scale, Apache Kafka ® comes with its own deployment complexities. Luckily for on-premises scenarios, a myriad of deployment options are available, such as the Confluent Platform which can be deployed on bare metal, virtual machines, containers, etc. But deployment is just the tip of the iceberg.

Kafka 21
article thumbnail

Navigating Boundless Data Streams With The Swim Kernel

Data Engineering Podcast

Summary The conventional approach to analytics involves collecting large amounts of data that can be cleaned, followed by a separate step for analysis and interpretation. Unfortunately this strategy is not viable for handling real-time, real-world use cases such as traffic management or supply chain logistics. In this episode Simon Crosby, CTO of Swim Inc., explains how the SwimOS kernel and the enterprise data fabric built on top of it enable brand new use cases for instant insights.

Hadoop 100
article thumbnail

Self-Service Analytics: Classifying Data and Analytic States

Teradata

Learn how to better classify data & analytics within the analytic ecosystem by analyzing the various states of data & analytics within organizations. Read more.

article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Explore the world of Bioinformatics with Machine Learning

KDnuggets

The article contains a brief introduction of Bioinformatics and how a machine learning classification algorithm can be used to classify the type of cancer in each patient by their gene expressions.

article thumbnail

Built-In Multi-Region Replication with Confluent Platform 5.4-preview

Confluent

Running a single Apache Kafka ® cluster across multiple datacenters (DCs) is a common, yet somewhat taboo architecture. This architecture, referred to as a stretch cluster, provides several operational benefits and unlocks the door to many uses cases. Stretch clusters provide better durability guarantees and make disaster recovery much easier by avoiding the problem of offset translation and restarting clients.

Kafka 18

More Trending

article thumbnail

Multitasking Within the Teradata Vantage Optimizer

Teradata

Want scale? Without multitasking capabilities, Teradata Vantage would not be able to support hundreds or thousands of user queries at the same time. Learn more.

8
article thumbnail

Which Data Science Skills are core and which are hot/emerging ones?

KDnuggets

We identify two main groups of Data Science skills: A: 13 core, stable skills that most respondents have and B: a group of hot, emerging skills that most do not have (yet) but want to add. See our detailed analysis.

article thumbnail

Reflections on Event Streaming as Confluent Turns Five – Part 2

Confluent

When people ask me the very top-level question “why do people use Kafka,” I usually lead with the story in my last post , where I talked about how Apache Kafka ® is helping us deliver on the promises the cloud made to us a decade ago. But I follow it up quickly with a second and potentially unrelated pattern: real-time data pipelines. These provide a different set of motivations for using an event streaming platform than scaling and microservices: specifically, the need to produce analytics resu

Kafka 14
article thumbnail

BERT, RoBERTa, DistilBERT, XLNet: Which one to use?

KDnuggets

Lately, varying improvements over BERT have been shown — and here I will contrast the main similarities and differences so you can choose which one to use in your research or application.

123
123
article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

5 Beginner Friendly Steps to Learn Machine Learning and Data Science with Python

KDnuggets

“I want to learn machine learning and artificial intelligence, where do I start?” Here.

article thumbnail

My journey path from a Software Engineer to BI Specialist to a Data Scientist

KDnuggets

The career path of the Data Scientist remains a hot target for many with its continuing high demand. Becoming one requires developing a broad set of skills including statistics, programming, and even business acumen. Learn more about one person's experience making this journey, and discover the many resources available to help you find your way into a world of data science.

article thumbnail

The Hidden Risk of AI and Big Data

KDnuggets

With recent advances in AI being enabled through access to so much “Big Data” and cheap computing power, there is incredible momentum in the field. Can big data really deliver on all this hype, and what can go wrong?

Big Data 123
article thumbnail

The 5 Sampling Algorithms every Data Scientist need to know

KDnuggets

Algorithms are at the core of data science and sampling is a critical technical that can make or break a project. Learn more about the most common sampling techniques used, so you can select the best approach while working with your data.

Algorithm 120
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

How Bad is Multicollinearity?

KDnuggets

For some people anything below 60% is acceptable and for certain others, even a correlation of 30% to 40% is considered too high because it one variable may just end up exaggerating the performance of the model or completely messing up parameter estimates.

IT 119
article thumbnail

5 Alternative Data Science Tools

KDnuggets

What other creative tools for data science beyond Python and R can you use to make an impression? It's not about the tool -- it's about its impact.

article thumbnail

Automate Hyperparameter Tuning for Your Models

KDnuggets

When we create our machine learning models, a common task that falls on us is how to tune them. So that brings us to the quintessential question: Can we automate this process?

article thumbnail

What is Machine Behavior?

KDnuggets

The new emerging field that wants to study AI agents the way social scientists study humans.

112
112
article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

Cartoon: Unsupervised Machine Learning?

KDnuggets

New KDnuggets Cartoon looks at one of the hottest directions in Machine Learning and asks can Machine Learning be too unsupervised?

article thumbnail

Top KDnuggets tweets, Sep 11-17: Python Libraries for Interpretable Machine Learning

KDnuggets

Also: Cartoon: Unsupervised #MachineLearning?; Cartoon: Unsupervised Machine Learning ? How to Become More Marketable as a Data Scientist; Ensemble Methods for Machine Learning: AdaBoost.

article thumbnail

Scikit-Learn & More for Synthetic Dataset Generation for Machine Learning

KDnuggets

While mature algorithms and extensive open-source libraries are widely available for machine learning practitioners, sufficient data to apply these techniques remains a core challenge. Discover how to leverage scikit-learn and other tools to generate synthetic data appropriate for optimizing and fine-tuning your models.

article thumbnail

5 Step Guide to Scalable Deep Learning Pipelines with d6tflow

KDnuggets

How to turn a typical pytorch script into a scalable d6tflow DAG for faster research & development.

article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Applying Data Science to Cybersecurity Network Attacks & Events

KDnuggets

Check out this detailed tutorial on applying data science to the cybersecurity domain, written by an individual with backgrounds in both fields.

article thumbnail

Data Science is Boring (Part 1)

KDnuggets

Read about how one data scientist copes with his boring days of deploying machine learning.

article thumbnail

Reddit Post Classification

KDnuggets

This article covers the implementation of a data scraping and natural language processing project which had two parts: scrape as many posts from Reddit’s API as allowed &then use classification models to predict the origin of the posts.

Project 92
article thumbnail

Top Stories, Sep 9-15: 10 Great Python Resources for Aspiring Data Scientists

KDnuggets

Also: The 5 Graph Algorithms That Data Scientists Should Know; Many Heads Are Better Than One: The Case For Ensemble Learning; BERT is changing the NLP landscape; I wasn't getting hired as a Data Scientist; There is No Free Lunch in Data Science.

Python 90
article thumbnail

How to Drive Cost Savings, Efficiency Gains, and Sustainability Wins with MES

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

article thumbnail

Python 2 End of Life Survey – Are You Prepared?

KDnuggets

Support for Python 2 will expire on Jan. 1, 2020, after which the Python core language and many third-party packages will no longer be supported or maintained. Take this survey to help determine and share your level of preparation.

Python 85
article thumbnail

Turbo-Charging Data Science with AutoML

KDnuggets

Join this technical webinar on Oct 3, where Domino Chief Data Scientist Josh Poduska will dive into popular open source and proprietary AutoML tools, and walk through hands-on examples of how to install and use these tools, so you can start using these technologies in your work right away.

article thumbnail

Webinar: Data-Driven Approaches to Forecasting

KDnuggets

Whether it’s demand forecasting, supply chain management, or any other application, getting it right requires balancing the need for performance with the constraints of implementation and complexity. Learn more in this free webinar, Data-Driven Approaches to Forecasting, Sep 26.

Data 81
article thumbnail

Data Science Symposium 2019, Oct 10-11, Cincinnati

KDnuggets

The UC Center for Business Analytics will present the Data Science Symposium 2019 on Oct 10 & 11, featuring 3 keynote speakers and 16 tech talks/tutorials on a wide range of data science topics and tools.

article thumbnail

The Cloud Development Environment Adoption Report

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.