Sat.Jan 23, 2021 - Fri.Jan 29, 2021

article thumbnail

Why do you need Agile Software Development for your Data Use Case ?

François Nguyen

The agile part of DataOps In this previous article, we have defined dataops as a”combination of tools and methods inspired by Agile, Devops and Lean Manufacturing » (thanks to DataKitchen for this definition). Let’s focus on the agile part and why it is so relevant for your data use cases. “Data is like a box of chocolates, you never know what you’re gonna get.” It is about the nature of data : you cannot guess what will be the content and the quality of your data sources

article thumbnail

Confluent and Microsoft Announce Strategic Alliance

Confluent

Today, I am thrilled to announce a new strategic alliance with Microsoft to enable a seamless, integrated experience between Confluent Cloud and the Azure platform. This represents a significant milestone […].

Cloud 137
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Making It Easier To Stick B2B Data Integration Pipelines Together With Hotglue

Data Engineering Podcast

Summary Businesses often need to be able to ingest data from their customers in order to power the services that they provide. For each new source that they need to integrate with it is another custom set of ETL tasks that they need to maintain. In order to reduce the friction involved in supporting new data transformations David Molot and Hassan Syyid built the Hotlue platform.

article thumbnail

Cloudera Completes SOC 2 Type II Certification for CDP Public Cloud

Cloudera

We believe security is the cornerstone of any legitimate data platform, and we’re excited to announce that Cloudera has successfully achieved SOC 2 Type II certification for Cloudera Data Platform (CDP) Public Cloud. Achieving our SOC 2 certification is the culmination of significant work across our organization and demonstrates to independent auditors that we adhere to industry-standard security controls and processes.

article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

The very strange way of doing Data Quality at Airbnb

François Nguyen

or why you should have a look at Data Observability ! This article is the second part on how Airbnb is managing data quality : “Part 2 — A New Gold Standard” The first part can be found here and it was just good principles about roles and responsabilities. The second part is really how they do it and all the steps to have a “certification” They name it Midas, the famous king who can turn everything into gold ( with a not so good ending ).

Finance 130
article thumbnail

Apache Kafka Meets Table Football

Confluent

What happens when you let engineers go wild building an application to track the score of a table football game? This blog post shares SPOUD’s story of engineering a simple […].

Kafka 118

More Trending

article thumbnail

#ClouderaLife Spotlight: Shane Prendergast, HR Services Manager, EMEA

Cloudera

Shane Prendergast represents so much of what Cloudera values. . He is described as someone who is passionate about and drives Diversity, Equality, and Inclusion (DEI) efforts and helps the company stay aware of events and initiatives. “Flying the flag for the LBGTQ community both in and outside of work, inclusiveness is part of Shane’s DNA and he is relentless in his efforts to make everyone feel involved and heard.” said one peer. .

article thumbnail

Big Data in Retail & CPG Requires a Scalpel, Not an Axe

Teradata

To satisfy the evolving demands of customers, Chief Commercial Officers need to wield big data in Retail & CPG using a precise scalpel rather than a blunt axe.

Retail 98
article thumbnail

How Apache Kafka Enables Podium to “Ship It and See What Happens”

Confluent

This a summary of Podium’s technological journey and an example of how our engineering team is tooling ourselves to scale well into the years to come. Here at Podium, we’re […].

Kafka 69
article thumbnail

How To Convert 100% of Your Proofs of Concept into Happy Customers

Monte Carlo

I’ve never done Sales before. Most of my professional history was spent working for a Customer Success company, Gainsight, where I provided the data, insights, and tools for our customer-facing teams. At Gainsight, my bonus was tied to 1) verified customer outcomes, 2) renewal rate, and 3) customer advocacy. I learned to be maniacally customer-focused.

BI 52
article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Migrating Apache NiFi Flows from HDF to CFM with Zero Downtime

Cloudera

Has your organization considered upgrading from Hortonworks Data Flow (HDF) to Cloudera Flow Management (CFM) , but thought the migration process would be too disruptive to your mission critical dataflows? In truth, many NiFi dataflows can be migrated from HDF to CFM quickly and easily with no data loss and without any service interruption. Here we explore three common use cases where a CFM cluster can assume an HDF cluster’s dataflows with minimal to no downtime.

Kafka 81
article thumbnail

Six Crucial Refinements to Conventional Wisdom About Data Strategy

Teradata

This post shines a spotlight on the difference between what you already know & the more specific guidance you really need to create a successful data strategy.

Data 80
article thumbnail

Don’t Forget Your VPNs and Tracker Blockers

Grouparoo

I was testing the new Intercom plugin that our team had built, and ran into a strange snag. When adding apps to Grouparoo, we have this handy “Test Connection” button that checks to make sure the connection details and credentials work. When I was testing this new Intercom plugin, something strange appeared this time around. I was testing locally, but the Test Connection button actually talks to an external API, so I was confused that the connection failed due to something from localhost.

Cloud 52
article thumbnail

Benefits Of Overhauling NRM | Net Revenue Management | Retail Insight

Retail Insight

For CPGs, the COVID-19 crisis has made one thing abundantly clear: to stay ahead, you have got to remain agile. Pressure on margins is growing as the pandemic causes dramatic shifts in consumer habits and retailer operations. If you cannot identify how and where to invest quickly, you will be at a significant disadvantage. That is why savvy CPGs have been adapting and evolving their net revenue management (NRM).

Retail 52
article thumbnail

How to Drive Cost Savings, Efficiency Gains, and Sustainability Wins with MES

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

article thumbnail

Cloudera Flow Management Continuous Delivery Architecture

Cloudera

Having introduced the flow delivery challenges and corresponding resolutions in the first article ‘ Cloudera Flow Management Continuous Delivery while Minimizing Downtime ’, we will combine all the preceding solutions into an example of flow management continuous delivery architecture. DataFlow Continuous Delivery Architecture. In the whole process, we can see the following steps. 1.Development.

article thumbnail

Modeling the Risk of COVID-19 for Effective Pandemic Response

Teradata

Teradata experts propose a risk model to quantify the risk of infection and vulnerability for COVID-19 using individual-level demographic and behavioral data.

Data 52
article thumbnail

[VIDEO] How Blinkist Increases Marketing ROI with Data Observability and Monte Carlo

Monte Carlo

Talk to us! For Blinkist , a global book insights subscription service, broken data pipelines led to unreliable marketing spend, costly data fire drills, and loss of executive trust. When COVID-19 hit, they realized the growth of their company was being hindered by bad data. They needed a way to automatically identify, resolve, and prevent data quality issues before they affected the business – in other words, they needed data observability.

article thumbnail

PowerBI and Quickbooks PowerQuery Fix

FreshBI

Quick Books Power BI connector not working? Because of security requirements, Quick Books has discontinued use of their online connector for several browsers including Internet Explorer. The problem with the Power BI connector is that Power BI uses Internet Explorer to authenticate its webservices. With discontinued support for this browser, Power BI can no longer authenticate the Quick Books connection.

BI 52
article thumbnail

Improving the Accuracy of Generative AI Systems: A Structured Approach

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

article thumbnail

Industry X.0 – Made Real, Practical Insights Today enabling Profits Tomorrow

Cloudera

Manufacturing’s digital transformation growth is truly impressive considering it’s delivering value with explosive growth rates. Consider that Manufacturing’s Industry Internet of Things (IIOT) was valued at $161b with an impressive 25% growth rate, or that the Connected Car market will be valued at $225b by 2027 with a 17% growth rate. But then conflicting information arrives as VentureBeat reports that around 90 percent of machine learning models never make it into production?