Confluent

OCTOBER 28, 2021

Kafka Streams is an abstraction over Apache Kafka® producers and consumers that lets you forget about low-level details and focus on processing your Kafka data. You could of course write […].

Kafka 131

Kafka Process Data 131

Data Engineering Podcast

OCTOBER 28, 2021

Summary Streaming data systems have been growing more capable and flexible over the past few years. Despite this, it is still challenging to build reliable pipelines for stream processing. In this episode Eric Sammer discusses the shortcomings of the current set of streaming engines and how they force engineers to work at an extremely low level of abstraction.

Data Pipeline 100

Data Pipeline SQL Data Warehouse Data Lake 100

Cloudera

OCTOBER 26, 2021

As Halloween night quickly approaches, there is only one question on every kid’s mind: how can I maximize my candy haul this year with the best possible candy? This kind of question lends itself perfectly to data science approaches that enable quick and intuitive analysis of data across multiple sources. Using Cloudera Machine Learning, the world’s first hybrid data cloud machine learning tooling, let’s take a deep dive into the world of candy analytics to answer the tough question on everyone’s

Data Mining 105

Data Mining Portfolio Machine Learning Data Science 105

Teradata

OCTOBER 27, 2021

Recent events have illustrated the fragility of ultra-lean supply chains. Chief Supply Chain Officers must figure out how to navigate these crises to manage costs, speed & quality of service.

Retail 98

Retail Management 98

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Confluent

OCTOBER 29, 2021

At the recent Kafka Summit, Confluent announced the general availability of Stream Governance–the industry’s only governance suite for data in motion. Offered as a fully managed cloud solution, it delivers […].

Government 122

Government IT Kafka Cloud 122

Data Engineering Podcast

OCTOBER 29, 2021

Summary The perennial question of data warehousing is how to model the information that you are storing. This has given rise to methods as varied as star and snowflake schemas, data vault modeling, and wide tables. The challenge with many of those approaches is that they are optimized for answering known questions but brittle and cumbersome when exploring unknowns.

Data Warehouse 100

Data Warehouse BI Data Workflow Data Engineer 100

Netflix Tech

OCTOBER 27, 2021

Open-Sourcing a Monitoring GUI for Metaflow, Netflix’s ML Platform tl;dr Today, we are open-sourcing a long-awaited GUI for Metaflow. The Metaflow GUI allows data scientists to monitor their workflows in real-time, track experiments, and see detailed logs and results for every executed task. The GUI can be extended with plugins, allowing the community to build integrations to other systems, custom visualizations, and embed upcoming features of Metaflow directly into its views.

Python 91

Python Machine Learning Data Science Project 91

ProjectPro

OCTOBER 28, 2021

In this blog, we have mentioned all the topics that are considered as prerequisites for learning machine learning. We have covered all the subjects and the best resources that will help you learn them thoroughly. Upskilling in the era of the Internet has become hassle-free.The Internet has given a platform to experts who can now share their knowledge with a large number of people and help those people in acquiring new skills irrespective of their previous knowledge about the subject.

Machine Learning 52

Machine Learning Programming Language Datasets Python 52

Monte Carlo

OCTOBER 27, 2021

Fall is here, Halloween is right around the corner (see below), and we’re one week away from my favorite event of the year: IMPACT , the world’s first Data Observability summit! Here are five reasons why I’m excited – and you should be, too: The lineup. The former CEO of Snowflake. The first Chief Data Officer of the U.S. The founder of the data mesh.

Data 52

Data Data Engineer Data Engineering Engineering 52

Cloudera

OCTOBER 29, 2021

CDP Operational Database (COD) is an autonomous transactional database powered by Apache HBase and Apache Phoenix. It is one of the main Data Services that runs on Cloudera Data Platform (CDP) Public Cloud. You can access COD right from your CDP console. With COD, application developers can now leverage the power of HBase and Phoenix without the overheads that are often related to deployment and management.

Database 91

Database Amazon Web Services AWS Cloud 91

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Netflix Tech

OCTOBER 26, 2021

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the fourth post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. Need to catch up? Have a look at Part 1 (Decision Making at Netflix), Part 2 (What is an A/B Test?), Part 3 (False positives and statistical significance).

Designing 83

Designing Building Systems Accessibility 83

DataKitchen

OCTOBER 28, 2021

This article was originally published in Forbes. Engineers unleashed artificial intelligence (AI) bias, and it will be engineers who design the solutions that eliminate it. Authors of an article published by McKinsey Global Institute assert that “more human vigilance is needed to critically analyze the unfair biases that can become baked in and scaled by AI systems.

Coding 52

Coding IT Manufacturing Algorithm 52

ProjectPro

OCTOBER 27, 2021

Wondering how to implement machine learning in finance effectively and gain valuable insights? This blog presents the topmost useful machine learning applications in finance to help you understand how financial markets thrive by adopting AI and ML solutions. It also covers some innovative use cases to highlight the significance of machine learning in finance.

Finance 52

Finance Machine Learning Project Banking 52

Cloudera

OCTOBER 25, 2021

With the launch of the Cloudera Public Cloud 7.2.12, the Streams Messaging for Data Hub deployments have gotten some interesting new features! From this release, Streams Messaging templates will support scaling with automatic rebalancing allowing you to grow or shrink your Apache Kafka cluster based on demand. Another notable item is that Streams Replication Manager (SRM) will now support multi-cluster monitoring patterns and aggregate replication metrics from multiple SRM deployments into a sin

Cloud 90

Cloud Kafka Metadata Management 90

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Netflix Tech

OCTOBER 28, 2021

Data Engineers of Netflix?—?Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer at Netflix. Pallavi Phadnis is a Senior Software Engineer on the Product Data Science and Engineering team.

Data Engineer 71

Data Engineer Data Engineering Engineering Software Engineering 71

Grouparoo

OCTOBER 26, 2021

In today’s data-driven business world, organizations are looking for more efficient ways to leverage data from a variety of sources. For example, businesses often need to evaluate their performance based on large volumes of customer and sales data that might be stored in a variety of locations and formats. Security and compliance teams need to monitor data from a wide array of devices and systems to detect threats as quickly as possible.

Data Pipeline 52

Data Pipeline ETL Tools Data Warehouse ETL System 52

ProjectPro

OCTOBER 26, 2021

There is no “one-size-fits-all” machine learning framework for model building. Data scientists and machine learning engineers use various machine learning tools and frameworks to build production-ready models. Since there are so many machine learning frameworks and tools available in the market with varied learning curves and user bases, deciding on which machine learning framework to choose for a business use case.

Machine Learning 52

Machine Learning Programming Language Deep Learning Healthcare 52

Cloudera

OCTOBER 27, 2021

Krishna is a Software Engineer working on our Compute Platform and operates out of Bangalore, India. His primary responsibility is to develop, test and maintain software applications that provide compute services to various Cloudera products. His day to day revolves around cloud computing, resource scheduling and API & systems designing. . Technology and design are his major interest areas.

Software Engineering 89

Software Engineering Software Engineer Engineering Cloud Computing 89

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

Rockset

OCTOBER 26, 2021

There are more than 65 million speech-impaired people worldwide of every age and in every social sphere. Historically, they are a vulnerable social group, found in special education institutions, rehab centers, hospitals and clinics, or their own homes. Every one of them needs rehabilitation, education, and help, in order to communicate their needs, emotions and ideas.

NoSQL 52

NoSQL Building Hospitality Education 52

Grouparoo

OCTOBER 26, 2021

There are some people that you meet and hope to work with someday. Two of our co-founders met Edmundo in school long ago and have been looking for that opportunity. It has arrived! Edmundo is joining the Grouparoo team as a Senior Full-Stack Engineer. Most recently, Edmundo was at Drift making conversational marketing and sales tools. Drift and tools like it are examples of where Grouparoo users want to sync their data.

Engineering 52

Engineering IT Data 52

Data Science Blog: Data Engineering

OCTOBER 25, 2021

Knowing how to optimize your organization’s database for maximum performance can lead to greater efficiency, productivity, and user satisfaction. While it may seem challenging at first, there are a few easy performance tuning tips that you can get started with. 1. Use Indexing Indexing is one of the core ways to give databases a performance boost. There are different ways of approaching indexing , but they all have the same goal: decreasing query wait time by making it easier to find and access

Database 52

Database Computer Science Data Science SQL 52

Cloudera

OCTOBER 26, 2021

World Mental Health Day took place earlier this month. Many came forward to share their personal struggles with mental health to raise awareness and reduce the stigma surrounding these issues. The pressures of the pandemic may have exacerbated some deep-seated problems among some of us, which has led us to place greater emphasis on mental health. . The 2021 Global WellBeing report by professional services firm, AON, revealed that mental health and working environment are ranked among the top thr

Professional Services 86

Professional Services Project Building Management 86

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

Datakin

OCTOBER 25, 2021

A modern data pipeline is a large, complex, and often fragmented system with cascading interactions across multiple tools and platforms. It can be difficult to evaluate longer-term pipeline health in the absence of discrete warnings and failures, and to track tasks and dependencies across multiple teams and disparate systems. At Datakin, we’ve honed in on the runtime of pipeline jobs as a key metric to watch in daily data operations.

Datasets 52

Datasets Data Pipeline Systems Coding 52

DataKitchen

OCTOBER 25, 2021

A survey commissioned by data.world and DataKitchen reveals a disturbing state of affairs among data engineering professionals. The study of 600 data engineers, conducted by Wakefield Research, suggests an overwhelming majority are burned out and calling for relief. This infographic highlights the results. You can also download the infographic here.

Data Engineer 52

Data Engineer Data Engineering Engineering Data 52

AltexSoft

OCTOBER 25, 2021

“AI is technology’s most important priority, and health care is its most urgent application,” said Microsoft’s CEO Satya Nadella announcing the company’s new acquisition. Nuance, acquired for $19.7 billion (Microsoft’s biggest purchase since LinkedIn), provides niche AI products for clinical voice transcription, used in 77 percent of US hospitals. Its deep learning natural language processing algorithm is best in class for alleviating clinical documentation burnout, which is one of the main prob

Medical 52

Medical Healthcare Process Hospitality 52

Cloudera

OCTOBER 25, 2021

At Cloudera, we believe that data can make what is impossible today, possible tomorrow. There are many good uses of data. With data, we can monitor our business, the overall business, or specific business units. We can segment based on the customer verticals or whether they run in the public or private cloud. We can understand customers better, see usage patterns and main consumption drivers.

Machine Learning 82

Machine Learning Engineering Cloud Project 82

Speaker: Evelyn Chou

Choosing the right business intelligence (BI) platform can feel like navigating a maze of features, promises, and technical jargon. With so many options available, how can you ensure you’re making the right decision for your organization’s unique needs? 🤔 This webinar brings together expert insights to break down the complexities of BI solution vetting.

Business Intelligence

Grouparoo

OCTOBER 23, 2021

The 0.7 release of Grouparoo is a huge step forward for data engineers using Grouparoo to reliably sync a variety of types of data to operational tools. Here are the key features of the release. Models enable Grouparoo to work with multiple data schemas at once. Grouparoo helps troubleshoot messy data and is more resistant to data problems New Destination: Braze Users DevOps Logging Plugins: AWS CloudWatch, Prometheus Models The primary addition is the concept of having multiple Models.

AWS 52

AWS Data Schemas Datasets Data Engineer 52

Teradata

OCTOBER 25, 2021

Data liquidity is the lifeblood of the digital transformation needed to deliver the Bank of the Future. Find out more.

Banking 52

Banking Data 52

RudderStack

OCTOBER 26, 2021

In this tutorial project, you’ll learn how you can replicate the sentiment analysis system we use here at RudderStack within your own stack.

Project 40

Project Systems 40

ProjectPro

OCTOBER 29, 2021

The widely used phrase “Data is the New Oil” was coined by the British mathematician Clive Humby way back in 2006. Since then, many other well-loved terms, such as “data economy,” have come to be widely used by industry experts to describe the influence and importance of big data in today’s society. You might already be familiar with some of the popular data glorifying expressions, seldom do they also take the time to mention that raw data isn’t valuable in an

Data Mining 52

Data Mining Datasets Machine Learning Metadata 52

Speaker: Aindra Misra, Senior Manager, Product Management (Data, ML, and Cloud Infrastructure) at BILL

Join us for an insightful webinar that explores the critical intersection of data privacy and AI governance. In today’s rapidly evolving tech landscape, building robust governance frameworks is essential to fostering innovation while staying compliant with regulations. Our expert speaker, Aindra Misra, will guide you through best practices for ensuring data protection while leveraging AI capabilities.

Government