Confluent

JANUARY 26, 2021

Today, I am thrilled to announce a new strategic alliance with Microsoft to enable a seamless, integrated experience between Confluent Cloud and the Azure platform. This represents a significant milestone […].

Cloud 137

Cloud Programming 137

François Nguyen

JANUARY 29, 2021

The agile part of DataOps In this previous article, we have defined dataops as a”combination of tools and methods inspired by Agile, Devops and Lean Manufacturing » (thanks to DataKitchen for this definition). Let’s focus on the agile part and why it is so relevant for your data use cases. “Data is like a box of chocolates, you never know what you’re gonna get.” It is about the nature of data : you cannot guess what will be the content and the quality of your data sources

Manufacturing 130

Manufacturing Data Analysis Data Building 130

Cloudera

JANUARY 27, 2021

We believe security is the cornerstone of any legitimate data platform, and we’re excited to announce that Cloudera has successfully achieved SOC 2 Type II certification for Cloudera Data Platform (CDP) Public Cloud. Achieving our SOC 2 certification is the culmination of significant work across our organization and demonstrates to independent auditors that we adhere to industry-standard security controls and processes.

Certification 104

Certification Cloud Data Warehouse Machine Learning 104

Data Engineering Podcast

JANUARY 25, 2021

Summary Businesses often need to be able to ingest data from their customers in order to power the services that they provide. For each new source that they need to integrate with it is another custom set of ETL tasks that they need to maintain. In order to reduce the friction involved in supporting new data transformations David Molot and Hassan Syyid built the Hotlue platform.

Data Integration 100

Data Integration IT Python BI 100

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

Confluent

JANUARY 29, 2021

What happens when you let engineers go wild building an application to track the score of a table football game? This blog post shares SPOUD’s story of engineering a simple […].

Kafka 118

Kafka Engineering Building 118

François Nguyen

JANUARY 23, 2021

or why you should have a look at Data Observability ! This article is the second part on how Airbnb is managing data quality : “Part 2 — A New Gold Standard” The first part can be found here and it was just good principles about roles and responsabilities. The second part is really how they do it and all the steps to have a “certification” They name it Midas, the famous king who can turn everything into gold ( with a not so good ending ).

Finance 130

Finance Certification Data Pipeline Data 130

DataKitchen

JANUARY 25, 2021

It’s never good when your boss calls at 5 pm on a Friday. “The weekly analytics didn’t build correctly. What happened? Call me every hour with updates until you figure it out!”. For many data professionals, this situation is all too familiar. Analytics, in the modern enterprise, span toolchains, teams, and data centers. Large enterprises ingest data from dozens or hundreds of internal and external data sources.

Data Pipeline 97

Data Pipeline Building Process Utilities 97

Cloudera

JANUARY 29, 2021

Shane Prendergast represents so much of what Cloudera values. . He is described as someone who is passionate about and drives Diversity, Equality, and Inclusion (DEI) efforts and helps the company stay aware of events and initiatives. “Flying the flag for the LBGTQ community both in and outside of work, inclusiveness is part of Shane’s DNA and he is relentless in his efforts to make everyone feel involved and heard.” said one peer. .

Management 94

Management Building IT 94

Confluent

JANUARY 27, 2021

This a summary of Podium’s technological journey and an example of how our engineering team is tooling ourselves to scale well into the years to come. Here at Podium, we’re […].

Kafka 69

Kafka IT Technology Engineering 69

Teradata

JANUARY 28, 2021

This post shines a spotlight on the difference between what you already know & the more specific guidance you really need to create a successful data strategy.

Data 80

Data 80

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems

Monte Carlo

JANUARY 28, 2021

I’ve never done Sales before. Most of my professional history was spent working for a Customer Success company, Gainsight, where I provided the data, insights, and tools for our customer-facing teams. At Gainsight, my bonus was tied to 1) verified customer outcomes, 2) renewal rate, and 3) customer advocacy. I learned to be maniacally customer-focused.

BI 52

BI Machine Learning Engineering Data 52

Cloudera

JANUARY 26, 2021

Has your organization considered upgrading from Hortonworks Data Flow (HDF) to Cloudera Flow Management (CFM) , but thought the migration process would be too disruptive to your mission critical dataflows? In truth, many NiFi dataflows can be migrated from HDF to CFM quickly and easily with no data loss and without any service interruption. Here we explore three common use cases where a CFM cluster can assume an HDF cluster’s dataflows with minimal to no downtime.

Kafka 81

Kafka Hadoop Data Ingestion Utilities 81

FreshBI

JANUARY 26, 2021

Quick Books Power BI connector not working? Because of security requirements, Quick Books has discontinued use of their online connector for several browsers including Internet Explorer. The problem with the Power BI connector is that Power BI uses Internet Explorer to authenticate its webservices. With discontinued support for this browser, Power BI can no longer authenticate the Quick Books connection.

BI 52

BI Consulting Business Intelligence Education 52

Grouparoo

JANUARY 26, 2021

I was testing the new Intercom plugin that our team had built, and ran into a strange snag. When adding apps to Grouparoo, we have this handy “Test Connection” button that checks to make sure the connection details and credentials work. When I was testing this new Intercom plugin, something strange appeared this time around. I was testing locally, but the Test Connection button actually talks to an external API, so I was confused that the connection failed due to something from localhost.

Cloud 52

Cloud Accessible Accessibility Data 52

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing

Teradata

JANUARY 26, 2021

Teradata experts propose a risk model to quantify the risk of infection and vulnerability for COVID-19 using individual-level demographic and behavioral data.

Data 52

Data 52

Cloudera

JANUARY 28, 2021

Having introduced the flow delivery challenges and corresponding resolutions in the first article ‘ Cloudera Flow Management Continuous Delivery while Minimizing Downtime ’, we will combine all the preceding solutions into an example of flow management continuous delivery architecture. DataFlow Continuous Delivery Architecture. In the whole process, we can see the following steps. 1.Development.

Architecture 72

Architecture Management Python Project 72

Retail Insight

JANUARY 25, 2021

For CPGs, the COVID-19 crisis has made one thing abundantly clear: to stay ahead, you have got to remain agile. Pressure on margins is growing as the pandemic causes dramatic shifts in consumer habits and retailer operations. If you cannot identify how and where to invest quickly, you will be at a significant disadvantage. That is why savvy CPGs have been adapting and evolving their net revenue management (NRM).

Retail 52

Retail Management Technology Process 52

Monte Carlo

JANUARY 29, 2021

Talk to us! For Blinkist , a global book insights subscription service, broken data pipelines led to unreliable marketing spend, costly data fire drills, and loss of executive trust. When COVID-19 hit, they realized the growth of their company was being hindered by bad data. They needed a way to automatically identify, resolve, and prevent data quality issues before they affected the business – in other words, they needed data observability.

Business Intelligence 40

Business Intelligence Data Warehouse Data Pipeline Data 40

Advertisement

With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you

Data Engineer

Cloudera

JANUARY 29, 2021

Manufacturing’s digital transformation growth is truly impressive considering it’s delivering value with explosive growth rates. Consider that Manufacturing’s Industry Internet of Things (IIOT) was valued at $161b with an impressive 25% growth rate, or that the Connected Car market will be valued at $225b by 2027 with a 17% growth rate. But then conflicting information arrives as VentureBeat reports that around 90 percent of machine learning models never make it into production?

Manufacturing 53

Manufacturing Machine Learning Big Data Data Architecture 53