Confluent

APRIL 19, 2021

I’m proud to announce the release of Apache Kafka 2.8.0 on behalf of the Apache Kafka® community. The 2.8.0 release contains many new features and improvements. This blog post highlights […].

Kafka 138

Kafka 138

Cloudera

APRIL 21, 2021

Like most of our customers, Cloudera’s internal operations rely heavily on data. For more than a decade, Cloudera has built internal tools and data analysis primarily on a single production CDH cluster. This cluster runs workloads for every department – from real-time user interfaces for Support to providing recommendations in the Cloudera Data Platform (CDP) Upgrade Advisor to analyzing our business and closing our books.

Cloud 122

Cloud Professional Services Java Data Warehouse 122

Data Engineering Podcast

APRIL 19, 2021

Summary Most of the time when you think about a data pipeline or ETL job what comes to mind is a purely mechanistic progression of functions that move data from point A to point B. Sometimes, however, one of those transformations is actually a full-fledged machine learning project in its own right. In this episode Tal Galfsky explains how he and the team at Cherre tackled the problem of messy data for Addresses by building a natural language processing and entity resolution system that is served

Data Pipeline 100

Data Pipeline Machine Learning Data Warehouse Datasets 100

Retail Insight

APRIL 23, 2021

Social distancing and a life lived largely online have been the reality for over a year. But, as the world gradually emerges from lockdown, ha s the shape of retail really changed forever?

Retail 52

Retail Data 52

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Confluent

APRIL 22, 2021

Why should you monitor your Apache Kafka® client applications? Apart from the usual reasons for monitoring any application, such as ensuring uptime SLAs, there are a few specific reasons for […].

Kafka 72

Kafka Cloud 72

Cloudera

APRIL 23, 2021

Our latest Influential Women in Data session featured Brenda Le Sueur from Cambridge Assessments. Brenda has worked across many organisations and continents, but what has always been crucial to her is relationships – how we cultivate them, how we nurture them and how they, in turn, define us. I sat down with Brenda to ask her about her journey as a woman in tech and understand more about the impact of relationships on our career.

Technology 106

Technology Building Coding Project 106

Grouparoo

APRIL 21, 2021

Two fun facts about SQLite : The initial release was more than 20 years ago! It is the most widely used database (and likely one of the most widely deployed pieces of software). And here are a few of my opinions on SQLite: It's super cool. We don't talk about it enough. It's actually really easy to use (which is likely why it's so widely used).

Bytes 52

Bytes Database PostgreSQL MySQL 52

Teradata

APRIL 21, 2021

Hyper-personalization is a must-have for businesses today. But how do digital payments data help? By bringing granularity to your personalization strategies.

Data 52

Data 52

Cloudera

APRIL 22, 2021

This post was co-authored by two Cisco Employees as well: Karthik Krishna, Silesh Bijjahalli. Today’s enterprise data analytics teams are constantly looking to get the best out of their platforms. Storage plays one of the most important roles in the data platforms strategy, it provides the basis for all compute engines and applications to be built on top of it.

Pipeline-centric 104

Pipeline-centric Data Lake Hadoop Metadata 104

DataKitchen

APRIL 20, 2021

The post The battle to combat data sprawl: what CIOs need to do now first appeared on DataKitchen.

Data 52

Data 52

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Silectis

APRIL 19, 2021

Should you build your own tooling, take a “best of breed” approach, or buy a turnkey data engineering platform? We’ve got you covered. Data Engineering Platforms: Build, Best of Breed, or Buy? Every company wants to be data-driven. Modern organizations that thrive based on data have a common strength: a solid data engineering practice.

Data Engineer 52

Data Engineer Data Engineering Engineering Data 52

Grouparoo

APRIL 18, 2021

Building an open source tool to connect data to many different services means a lot of integrations. It can be pretty tricky, so we were lucky to meet Pedro S Lopez a few weeks back when he started adding several plugins to that integration list. He has now come aboard officially and will work more on the core product. Pedro makes the Grouparoo team an international one.

Engineering 52

Engineering Building IT Data 52

Cloudera

APRIL 20, 2021

What is Streaming Analytics? Streaming Analytics is a type of data analysis that processes data streams for real-time analytics. It continuously processes data from multiple streams and performs simple calculations to complex event processing for delivering sophisticated use cases. The primary purpose is to present the most up-to-date operational events for the user to stay on top of the business needs and take action as changes happen in real-time.

Kafka 100

Kafka Hospitality Retail Data Ingestion 100

Teradata

APRIL 18, 2021

As customer behavior changes rapidly, the challenges & opportunities for fast, flexible, agile, and future fit improvements for retailers are huge. Read more.

Retail 52

Retail 52

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Monte Carlo

APRIL 21, 2021

Many data leaders tell us that their data scientists and engineers spend 40 percent or more of their time tackling data issues instead of working on projects that actually move the needle. It doesn’t have to be this way. Here’s how the data engineering team at Resident, a house of direct-to-consumer furnishings brands, reduced their data incidents by 90% with data observability at s cale.

Google Cloud 40

Google Cloud Data Retail BI 40

Zalando Engineering

APRIL 21, 2021

When the pandemic started in 2020 many Zalando employees went into home office. It changed our working habits and many other things and Zalando published remote working guidelines to support their employees. This concentrates only on remote working, but what happens if you change companies during the pandemic? Joining a new company and getting onboarded can be already pretty tough during normal times.

Programming 40

Programming Engineering Building Coding 40

Cloudera

APRIL 19, 2021

Introduction. In our previous blog post in this series , we explored the benefits of using GPUs for data science workflows, and demonstrated how to set up sessions in Cloudera Machine Learning (CML) to access NVIDIA GPUs for accelerating Machine Learning Projects. While the time-saving potential of using GPUs for complex and large tasks is massive, setting up these environments and tasks such as wrangling NVIDIA drivers, managing CUDA versions and deploying custom engines for your specific proje

Deep Learning 76

Deep Learning Machine Learning Algorithm Data Science 76

ProjectPro

APRIL 19, 2021

Are you passionate about numbers and algebraic functions? Does the idea of evaluating, processing, analyzing, and interpreting statistical data makes you roll up your sleeves and get the job done? Do you love to distinguish the trends and patterns in data? Do you enjoy sharing your work and communicating your knowledge with others in the team? Do you have the attitude of self-learning and can figure things out on your own?

Portfolio 40

Portfolio Data Certification Finance 40

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Cloudera

APRIL 23, 2021

Introduction: Encryption of Data at Rest is a highly desirable or sometimes mandatory requirement for data platforms in a range of industry verticals including HealthCare, Financial & Government organizations. The capability increases security and protects sensitive data from various kinds of attack that could be internal or external to the platform.

MySQL 73

MySQL Java Bytes Data 73

Cloudera

APRIL 21, 2021

Meet Boglarka Egyed, also known as “Bogi” to her colleagues. . She’s a 5-year Clouderan who recently transitioned into the role of Engineering Manager. . Bogi originally graduated from college with her degree in Applied Mathematics but has spent her career as a Software Engineer. “Mathematics provided me with solid fundamentals to use in this field but programming was what really caught my attention due to its creative nature while being able to get results fast.” .

Engineering 81

Engineering Management Software Engineer Software Engineering 81

Cloudera

APRIL 22, 2021

Happy Earth Day! Earth Day was introduced in 1970 and has celebrated various milestone achievements including expanding globally and leveraging the power of social media to expand climate awareness and action. A great summary and history can be found on earthday.org/history. For those in financial services, climate initiatives are another major market event with far-reaching impact on capital adequacy and compliance regulations.

Portfolio 75

Portfolio Finance Transportation Insurance 75