Marc Lamberti

JANUARY 9, 2022

Airflow TaskGroups have been introduced to make your DAG visually cleaner and easier to read. They are meant to replace SubDAGs which was the historic way of grouping your tasks. The problem with SubDAGs is that they are much more than that. They bring a lot of complexity as you need to create a DAG in a DAG, import the SubDagOperator which is in fact a sensor, define the parameters properly, and so on.

Coding 130

Coding Python Process Management 130

KDnuggets

JANUARY 13, 2022

Any modern company of any significant size around the world has a data science department, and a data engineer at one company might have the same responsibilities as a marketing scientist at another company. Data science jobs are not well-labeled, so make sure to cast a wide net.

Data Science 148

Data Science Data Engineering Data Engineer Data 148

Confluent

JANUARY 11, 2022

Whether you’re a seasoned Apache Kafka® developer or just getting started you’re likely to hit a snag at some point or another—either in configuring and understanding your clients or setting […].

Kafka 138

Kafka 138

Teradata

JANUARY 10, 2022

There is a lot of hype today around data sharing and the value it brings to your business. But what exactly is data sharing, and why should you and your company care? Find out more.

Data 97

Data IT 97

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Netflix Tech

JANUARY 13, 2022

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. As our subscribers grow worldwide and Netflix enters the world of gaming , the number of batch workflows and real-time data pipelines increases rapidly. The data platform is built on top of several distributed systems, and due to the inherent nature of these systems, it is inevitable that these workloads run into fa

Kafka 96

Kafka Big Data Data Machine Learning 96

KDnuggets

JANUARY 14, 2022

Open source Redis is being increasingly used in Machine Learning, but running it on Colab is different compared to on your local machine or with Docker. Read on for a 2-step tutorial on how to do it.

Machine Learning 145

Machine Learning IT Data Science Data 145

DataKitchen

JANUARY 10, 2022

Cambridge, Mass. – June 16, 2021. Today, DataKitchen announced the release of the latest book in its groundbreaking DataOps series, Recipes for DataOps Success: The Complete Guide to An Enterprise DataOps Transformation. This book follows on the heels of its successful precursor, The DataOps Cookbook , which has been downloaded more than 14,000 times and counting.

Programming 69

Programming Certification Pharmaceutical Data Analytics 69

ProjectPro

JANUARY 13, 2022

Have you heard of the Inshorts smartphone app? It is a cutting-edge news app that embodies news stories into a concise 60-word summary. Applications like Inshorts allow you to avoid reading long articles by generating a clear and concise summary. An average individual uses Google Search more than three times a day. Thanks to Featured Snippets, or Knowledge Panels, you receive better results for your search queries.

Python 52

Python Algorithm Deep Learning Data Science 52

KDnuggets

JANUARY 10, 2022

The author shares their experience of almost winning the competition and the things they have learned from the failures. Learn more about the WiDS Datathon and tips on winning the next challenge.

Data Science 144

Data Science Data 144

Wolt

JANUARY 13, 2022

Data Platforms are an essential part of modern businesses. They enable reporting, low friction decision making, and if used correctly, can power very advanced data products in a compliant and traceable manner. Let us take you from the role of data at Wolt, through the data journey we’ve had so far and finish with a peek into what the future of this discipline may look like.

Data 52

Data Data Engineering Data Engineer Engineering 52

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Grouparoo

JANUARY 11, 2022

When it comes to storing large volumes of data, a simple database will be impractical due to the processing and throughput inefficiencies that emerge when managing and accessing big data. This article looks at the options available for storing and processing big data, which is too large for conventional databases to handle. There are two main options available, a data lake and a data warehouse.

Data Lake 52

Data Lake Data Warehouse Unstructured Data Raw Data 52

ProjectPro

JANUARY 11, 2022

“Machine Learning” is one of the most trending buzzwords. It is predominant in every industry sector as it empowers various organizations with innovative solutions to automate and increase the efficacy of products by reducing human intervention. You might have heard about the applications of weather forecasting, spam classification, or stock price prediction applications, so what exactly do these applications use ?

Machine Learning 52

Machine Learning Algorithm Datasets Food 52

KDnuggets

JANUARY 13, 2022

Learn how to query your Pandas DataFrames using the standard SQL SELECT statement, seamlessly from within your Python code.

SQL 160

SQL Python Coding 160

Teradata

JANUARY 13, 2022

2021 was the year of expanding 5G coverage, building out 5G use cases and the start of the migration to 5G Stand Alone. What will the year 2022 bring to the Telco industry?

Telecommunication 52

Telecommunication Building 52

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Elder Research

JANUARY 10, 2022

The post The Customer is Always Wrong – Along with the Rest of Us appeared first on Elder Research.

52

52

ProjectPro

JANUARY 10, 2022

Time series data can be defined as a sequence of data points that need to be seen with respect to the time stamp for each sample. Data samples are indexed by the timestamps or are highly dependent on them in time series. Data for weather forecasting, stock price prediction, user subscriptions, or sales patterns are some examples of time series data.

Python 52

Python Building Machine Learning Datasets 52

KDnuggets

JANUARY 10, 2022

At the end of the day, the value a data scientist provides to an organization lies in their ability to apply data to real-world use cases.

Data Science 153

Data Science Data 153

RudderStack

JANUARY 11, 2022

In this update we cover our latest Destination UI feature, our new VDM for Klaviyo, new SDKs and destination integrations, and more.

40

40

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

Netflix Tech

JANUARY 11, 2022

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , Colin McFarland , Andy Rhines , Sophia Liu , Mihir Tendulkar , Kevin Mercurio , Veronica Hannan , Ting-Po Lee Earlier posts in this series covered the basics of A/B tests ( Part 1 and Part 2 ), core statistical concepts ( Part 3 and Part 4 ), and how to build confidence in decisions based on A/B test results ( Part 5 ).

Data Science 98

Data Science Data Engineering Algorithm 98

KDnuggets

JANUARY 12, 2022

Using one or two performance metrics seems sufficient to claim that your ML model is good — chances are that it’s not.

Machine Learning 160

Machine Learning 160

KDnuggets

JANUARY 12, 2022

It’s crucial to investigate the reasons why data science teams require context, consistency, and secure collaboration of their data to ensure data science success. Let's quickly examine each of these requirements so that we can better understand what data science success moving forward may look like.

Data Science 136

Data Science Data 136

KDnuggets

JANUARY 12, 2022

Is Data Science a Dying Career?; Why Do Machine Learning Models Die In Silence?; SQL Interview Questions for Experienced Professionals; Deliver a Killer Presentation in Data Science Interviews; What is Transfer Learning?

Machine Learning 129

Machine Learning Data Science SQL Data 129

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

KDnuggets

JANUARY 10, 2022

Also: Why are More Developers Using Python for Their Machine Learning Projects?; 3 Tools to Track and Visualize the Execution of Your Python Code; SQL Interview Questions for Experienced Professionals; Deliver a Killer Presentation in Data Science Interviews.

Machine Learning 126

Machine Learning Python Data Science SQL 126

KDnuggets

JANUARY 14, 2022

Read the second article in this series on Transfer Learning, and learn how to apply it to Image Recognition and Natural Language Processing.

Process 138

Process IT Machine Learning 138

KDnuggets

JANUARY 11, 2022

Learn how to build feedforward neural networks that are interpretable by design using PyTorch.

Designing 147

Designing Building Machine Learning 147

KDnuggets

JANUARY 12, 2022

The new Online MS in Business Analytics for Managers from Simon Business School is the latest advancement in analytically rigorous, leadership-focused education designed to help managers and aspiring managers prepare for the future of business-wherever it may lead. Applications are being accepted now and the first 14-month class will begin August 2022.

Management 107

Management Education Designing IT 107

Speaker: Evelyn Chou

Choosing the right business intelligence (BI) platform can feel like navigating a maze of features, promises, and technical jargon. With so many options available, how can you ensure you’re making the right decision for your organization’s unique needs? 🤔 This webinar brings together expert insights to break down the complexities of BI solution vetting.

Business Intelligence

KDnuggets

JANUARY 13, 2022

Focusing on the important concepts for data scientists.

SQL 160

SQL Data Science Data 160

KDnuggets

JANUARY 11, 2022

Finding the data you need is hard. So why not fake it?

Datasets 160

Datasets IT Data Data Science 160

KDnuggets

JANUARY 12, 2022

These are some of the most critical questions that I think are important to consider when selecting the next job.

Data Science 118

Data Science Data 118