Simon Späti

APRIL 6, 2022

With burnout and mental stress at every level of our lives, I find my Personal Knowledge Management (PKM) system even more valuable. As a human, I forget lots of things. As a dad, I have more responsibilities with remembering all things related to my kid. As a developer and knowledge worker, I re-use code snippets or create new things. That’s why a PKM system such as a Second Brain to store all of it in a sustainable way is crucial to me.

Management 189

Management Coding Systems IT 189

Marc Lamberti

APRIL 4, 2022

DAG Dependencies in Apache Airflow might be one of the most popular topics. I received countless questions about DAG dependencies, is it possible? How? What are the best practices? and the list goes on. It’s funny because it comes naturally to wonder how to do that even when we are beginners. Do we like to complexify things by nature? Maybe, but that’s another question 😉 At the end of this article, you will be able to spot when you need to create DAG Dependencies, which metho

Metadata 130

Metadata IT Coding Process 130

KDnuggets

APRIL 8, 2022

Naïve Bayes is a probabilistic machine learning algorithm based on the Bayes Theorem, used in a wide variety of classification tasks. In this article, we will understand the Naïve Bayes algorithm and all essential concepts so that there is no room for doubts in understanding.

Algorithm 160

Algorithm Machine Learning 160

Confluent

APRIL 4, 2022

Our everyday digital experiences are in the midst of a revolution. Customers increasingly expect their online experiences to be interactive, immersive, and real time by default. The need to satisfy […].

Building 124

Building Cloud Programming 124

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Data Engineering Podcast

APRIL 3, 2022

Summary Building a data platform for your organization is a challenging undertaking. Building multiple data platforms for other organizations as a service without burning out is another thing entirely. In this episode Brandon Beidel from Red Ventures shares his experiences as a data product manager in charge of helping his customers build scalable analytics systems that fit their needs.

Designing 100

Designing Data Warehouse Data Engineer Data Engineering 100

Cloudera

APRIL 7, 2022

As a public sector leader, you don’t need the value of data explained to you. You already understand its importance to your vital missions. . The challenge, rather, lies in locating data, streaming it, enriching it, and serving it, and then running analytics to maximize the value of the data that agencies already have — and the massive amount of new data generated every day from a wide variety of structured and unstructured sources.

Government 94

Government Data Governance Machine Learning Cloud 94

Confluent

APRIL 5, 2022

We’re pleased to share a new multi-year partnership between Confluent and Microsoft to accelerate enterprises’ journey to cloud data streaming on Azure. Today’s announcement builds upon the partnership agreement we […].

Cloud 111

Cloud Data Building Programming 111

Data Engineering Podcast

APRIL 3, 2022

Summary The flexibility of software oriented data workflows is useful for fulfilling complex requirements, but for simple and repetitious use cases it adds significant complexity. Coalesce is a platform designed to reduce repetitive work for common workflows by adopting a visual pipeline builder to support your data warehouse transformations. In this episode Satish Jayanthi explains how he is building a framework to allow enterprises to move quickly while maintaining guardrails for data workflow

Data Warehouse 100

Data Warehouse Data Workflow Data Architecture SQL 100

Cloudera

APRIL 4, 2022

Vaccine development became the top priority for the life sciences industry – delivering new vaccines at unprecedented speed and maneuvering large-scale production processes. Numerous factors helped accelerate the vaccine roll-out including prior research, genome sequencing, jumping the FDA approval queue and a plethora of testing volunteers. So now that we’ve experienced these advancements, how can the industry keep momentum to speed-up innovative solutions across healthcare?

Healthcare 80

Healthcare Data Lake Manufacturing Process 80

KDnuggets

APRIL 6, 2022

The near future holds incredible possibility for machine learning to solve real world problems. But we need to be be able to determine which problems are solvable by ML and which are not.

Machine Learning 159

Machine Learning 159

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Confluent

APRIL 6, 2022

Confluent has been offering our customers the opportunity to seamlessly connect their Apache Kafka® topics to Google BigQuery for several years. This helps accelerate data warehouse initiatives by connecting more […].

Google Cloud 64

Google Cloud Kafka Cloud Data Warehouse 64

Monte Carlo

APRIL 7, 2022

Did you ever wish you had a pause button for broken data pipelines? Well, today is your lucky day. Monte Carlo is excited to announce the release of a new suite of data observability capabilities to help data teams automatically stop broken data pipelines at the orchestration layer — before they impact the business. Data engineers spend upwards of 30 percent of their time tackling data downtime , meaning periods of time when data is missing, erroneous, or otherwise inaccurate.

Data Pipeline 52

Data Pipeline Portfolio Retail Metadata 52

Grouparoo

APRIL 5, 2022

We started Grouparoo to enable organizations to make better use of their data. Our experience showed that there was a large gap in how Data and Product teams worked with operational teams like Marketing, Sales, and Support. We set out to accomplish our goal in an open way, both through open-source software and by creating a company culture valuing candor and transparency.

Data Engineer 52

Data Engineer Data Engineering Engineering Cloud 52

KDnuggets

APRIL 7, 2022

According to one source, the types of questions that will generally be asked in data scientist interviews can be broken down into five categories. Let's take a closer look.

Data Science 159

Data Science Data 159

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Confluent

APRIL 8, 2022

Azure Synapse users are looking to unlock access to on-premises, open source, and hybrid cloud systems to extend advanced analytics capabilities for their organizations. Building connectivity between all your distributed […].

Management 52

Management Cloud Accessible Accessibility 52

Rockset

APRIL 5, 2022

A year ago we evaluated Rockset on the Star Schema Benchmark (SSB) , an industry-standard benchmark used to measure the query performance of analytical databases. Subsequently, Altinity published ClickHouse’s results on the SSB. Recently, Imply published revised Apache Druid results on the SSB with denormalized numbers. With all the performance improvements we've been working on lately, we took another look at how these would affect Rockset's performance on the SSB.

Datasets 52

Datasets Database Metadata Kafka 52

dbt Developer Hub

APRIL 4, 2022

"I forgot to mention we dropped that column and created a new one for it!” “Hmm, I’m actually not super sure why customer_id is passed as an int and not a string.” “The primary key for that table is actually the order_id , not the id field.” I think many analytics engineers, including myself, have been on the receiving end of some of these comments from their backend application developers.

Database 52

Database Data Engineering IT 52

KDnuggets

APRIL 4, 2022

Check out the collection of the best data repositories on agriculture, audio, biology, climate, computer vision, economics, education, energy, finance, and government.

Finance 156

Finance Education Government Data 156

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

Confluent

APRIL 7, 2022

Moving to an entirely new company can be daunting. All you know is the job description and the impression made during the interview process. But what about the company’s ethics? […].

Process 52

Process 52

InData Labs

APRIL 4, 2022

Generally speaking, Spark provides 3 main abstractions to work with it. First, we will provide you with a holistic view of all of them in one place. Second, we will explore each option with examples. RDD (Resilient Distributed Dataset). The main approach to work with unstructured data. Pretty similar to a distributed collection that is. Запись Converting Spark RDD to DataFrame and Dataset впервые появилась InData Labs.

Datasets 52

Datasets Unstructured Data IT Data 52

Cloudera

APRIL 6, 2022

This blog post was written by Elizabeth Howell, Ph.D as a guest author for Cloudera. . At a distance of a million miles from Earth, the James Webb Space Telescope is pushing the edge of data transfer capabilities. The observatory launched Dec. 25 2021 on a mission to look at the early universe, at exoplanets, and at other objects of celestial interest.

Big Data 102

Big Data Machine Learning Medical Insurance 102

KDnuggets

APRIL 6, 2022

Learn tricks on importing various data formats using Pandas with a few lines of code. We will be learning to import SQL databases, Excel sheets, HTML tables, CSV, and JSON files with examples.

Data Ingestion 144

Data Ingestion SQL Database Data 144

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

Booking.com Engineering

APRIL 6, 2022

As developers, we always want our apps to offer the best user experience. When it comes to performance, we know that an “ideal” rendering performance for a regular application is 60 frames per second, or 60 fps. This gif illustrates the difference between ideal and not-so-ideal frame rendering: To have a solid 60fps, each frame needs to be rendered by the app within a 16.6ms window (1 sec = 1000ms, 1000ms / 60 = 16.6ms).

Accessible 52

Accessible Accessibility Coding Engineering 52

DareData

APRIL 6, 2022

“All happy families are alike; each unhappy family is unhappy in its own way.”, so starts Leo Tolstoy's novel Anna Karenina. This came to be known as the Anna Karenina Principle - there are many different ways one can fail, but only one way to win: by avoiding each of the routes to failure. The beauty of being a consultant is to experience this first hand.

Data 52

Data Consulting Data Pipeline Machine Learning 52

KDnuggets

APRIL 6, 2022

Using AIMET, developers can incorporate advanced model compression and quantization algorithms into their PyTorch and TensorFlow model-building pipelines for automated post-training optimization, as well as for model fine-tuning.

Algorithm 117

Algorithm Building 117

KDnuggets

APRIL 4, 2022

An introduction to the DBSCAN algorithm and its implementation in Python.

Algorithm 160

Algorithm Machine Learning Python IT 160

Speaker: Evelyn Chou

Choosing the right business intelligence (BI) platform can feel like navigating a maze of features, promises, and technical jargon. With so many options available, how can you ensure you’re making the right decision for your organization’s unique needs? 🤔 This webinar brings together expert insights to break down the complexities of BI solution vetting.

Business Intelligence

KDnuggets

APRIL 4, 2022

Deep dive into Logistic Regression with practical examples.

Machine Learning 160

Machine Learning 160

KDnuggets

APRIL 5, 2022

In this article, we’ll go over SQL window functions and how to use them when writing SQL queries.

SQL 140

SQL 140

KDnuggets

APRIL 8, 2022

Have low-code solutions subverted the need for developers? Are experienced software developers going the way of the dodo? Read on to find out.

Coding 121

Coding Programming 121

KDnuggets

APRIL 8, 2022

Let's look through the points below for useful tips on how to choose the proper outsourcing partner to handle the labeling for your next AI model.

Data Science 113

Data Science Data 113

Speaker: Aindra Misra, Senior Manager, Product Management (Data, ML, and Cloud Infrastructure) at BILL

Join us for an insightful webinar that explores the critical intersection of data privacy and AI governance. In today’s rapidly evolving tech landscape, building robust governance frameworks is essential to fostering innovation while staying compliant with regulations. Our expert speaker, Aindra Misra, will guide you through best practices for ensuring data protection while leveraging AI capabilities.

Government