Confluent

JANUARY 26, 2021

Today, I am thrilled to announce a new strategic alliance with Microsoft to enable a seamless, integrated experience between Confluent Cloud and the Azure platform. This represents a significant milestone […].

Cloud 137

Cloud Programming 137

François Nguyen

JANUARY 29, 2021

The agile part of DataOps In this previous article, we have defined dataops as a”combination of tools and methods inspired by Agile, Devops and Lean Manufacturing » (thanks to DataKitchen for this definition). Let’s focus on the agile part and why it is so relevant for your data use cases. “Data is like a box of chocolates, you never know what you’re gonna get.” It is about the nature of data : you cannot guess what will be the content and the quality of your data sources

Manufacturing 130

Manufacturing Data Analysis Data Building 130

Cloudera

JANUARY 27, 2021

We believe security is the cornerstone of any legitimate data platform, and we’re excited to announce that Cloudera has successfully achieved SOC 2 Type II certification for Cloudera Data Platform (CDP) Public Cloud. Achieving our SOC 2 certification is the culmination of significant work across our organization and demonstrates to independent auditors that we adhere to industry-standard security controls and processes.

Certification 105

Certification Cloud Data Warehouse Machine Learning 105

Data Engineering Podcast

JANUARY 25, 2021

Summary Businesses often need to be able to ingest data from their customers in order to power the services that they provide. For each new source that they need to integrate with it is another custom set of ETL tasks that they need to maintain. In order to reduce the friction involved in supporting new data transformations David Molot and Hassan Syyid built the Hotlue platform.

Data Integration 100

Data Integration IT Python BI 100

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Confluent

JANUARY 29, 2021

What happens when you let engineers go wild building an application to track the score of a table football game? This blog post shares SPOUD’s story of engineering a simple […].

Kafka 118

Kafka Engineering Building 118

François Nguyen

JANUARY 23, 2021

or why you should have a look at Data Observability ! This article is the second part on how Airbnb is managing data quality : “Part 2 — A New Gold Standard” The first part can be found here and it was just good principles about roles and responsabilities. The second part is really how they do it and all the steps to have a “certification” They name it Midas, the famous king who can turn everything into gold ( with a not so good ending ).

Finance 130

Finance Certification Data Pipeline Data 130

Teradata

JANUARY 24, 2021

To satisfy the evolving demands of customers, Chief Commercial Officers need to wield big data in Retail & CPG using a precise scalpel rather than a blunt axe.

Retail 98

Retail Big Data Data 98

DataKitchen

JANUARY 25, 2021

It’s never good when your boss calls at 5 pm on a Friday. “The weekly analytics didn’t build correctly. What happened? Call me every hour with updates until you figure it out!”. For many data professionals, this situation is all too familiar. Analytics, in the modern enterprise, span toolchains, teams, and data centers. Large enterprises ingest data from dozens or hundreds of internal and external data sources.

Data Pipeline 97

Data Pipeline Building Process Utilities 97

Confluent

JANUARY 27, 2021

This a summary of Podium’s technological journey and an example of how our engineering team is tooling ourselves to scale well into the years to come. Here at Podium, we’re […].

Kafka 69

Kafka IT Technology Engineering 69

Cloudera

JANUARY 26, 2021

Has your organization considered upgrading from Hortonworks Data Flow (HDF) to Cloudera Flow Management (CFM) , but thought the migration process would be too disruptive to your mission critical dataflows? In truth, many NiFi dataflows can be migrated from HDF to CFM quickly and easily with no data loss and without any service interruption. Here we explore three common use cases where a CFM cluster can assume an HDF cluster’s dataflows with minimal to no downtime.

Kafka 85

Kafka Hadoop Data Ingestion Utilities 85

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Teradata

JANUARY 28, 2021

This post shines a spotlight on the difference between what you already know & the more specific guidance you really need to create a successful data strategy.

Data 80

Data 80

Monte Carlo

JANUARY 28, 2021

I’ve never done Sales before. Most of my professional history was spent working for a Customer Success company, Gainsight, where I provided the data, insights, and tools for our customer-facing teams. At Gainsight, my bonus was tied to 1) verified customer outcomes, 2) renewal rate, and 3) customer advocacy. I learned to be maniacally customer-focused.

BI 52

BI Machine Learning Engineering Data 52

Grouparoo

JANUARY 26, 2021

I was testing the new Intercom plugin that our team had built, and ran into a strange snag. When adding apps to Grouparoo, we have this handy “Test Connection” button that checks to make sure the connection details and credentials work. When I was testing this new Intercom plugin, something strange appeared this time around. I was testing locally, but the Test Connection button actually talks to an external API, so I was confused that the connection failed due to something from localhost.

Cloud 52

Cloud Accessibility Accessible Data 52

Cloudera

JANUARY 28, 2021

Having introduced the flow delivery challenges and corresponding resolutions in the first article ‘ Cloudera Flow Management Continuous Delivery while Minimizing Downtime ’, we will combine all the preceding solutions into an example of flow management continuous delivery architecture. DataFlow Continuous Delivery Architecture. In the whole process, we can see the following steps. 1.Development.

Architecture 73

Architecture Management Python Project 73

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Teradata

JANUARY 26, 2021

Teradata experts propose a risk model to quantify the risk of infection and vulnerability for COVID-19 using individual-level demographic and behavioral data.

Data 52

Data 52

Retail Insight

JANUARY 25, 2021

For CPGs, the COVID-19 crisis has made one thing abundantly clear: to stay ahead, you have got to remain agile. Pressure on margins is growing as the pandemic causes dramatic shifts in consumer habits and retailer operations. If you cannot identify how and where to invest quickly, you will be at a significant disadvantage. That is why savvy CPGs have been adapting and evolving their net revenue management (NRM).

Retail 52

Retail Management Technology Process 52

Monte Carlo

JANUARY 29, 2021

Talk to us! For Blinkist , a global book insights subscription service, broken data pipelines led to unreliable marketing spend, costly data fire drills, and loss of executive trust. When COVID-19 hit, they realized the growth of their company was being hindered by bad data. They needed a way to automatically identify, resolve, and prevent data quality issues before they affected the business – in other words, they needed data observability.

Business Intelligence 40

Business Intelligence Data Warehouse Data Pipeline Data 40

Cloudera

JANUARY 29, 2021

Manufacturing’s digital transformation growth is truly impressive considering it’s delivering value with explosive growth rates. Consider that Manufacturing’s Industry Internet of Things (IIOT) was valued at $161b with an impressive 25% growth rate, or that the Connected Car market will be valued at $225b by 2027 with a 17% growth rate. But then conflicting information arrives as VentureBeat reports that around 90 percent of machine learning models never make it into production?

Manufacturing 54

Manufacturing Machine Learning Big Data Data Architecture 54

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

FreshBI

JANUARY 26, 2021

Quick Books Power BI connector not working? Because of security requirements, Quick Books has discontinued use of their online connector for several browsers including Internet Explorer. The problem with the Power BI connector is that Power BI uses Internet Explorer to authenticate its webservices. With discontinued support for this browser, Power BI can no longer authenticate the Quick Books connection.

BI 52

BI Business Intelligence Consulting Education 52