Confluent

OCTOBER 28, 2021

Kafka Streams is an abstraction over Apache Kafka® producers and consumers that lets you forget about low-level details and focus on processing your Kafka data. You could of course write […].

Kafka 131

Kafka Process Data 131

Cloudera

OCTOBER 26, 2021

As Halloween night quickly approaches, there is only one question on every kid’s mind: how can I maximize my candy haul this year with the best possible candy? This kind of question lends itself perfectly to data science approaches that enable quick and intuitive analysis of data across multiple sources. Using Cloudera Machine Learning, the world’s first hybrid data cloud machine learning tooling, let’s take a deep dive into the world of candy analytics to answer the tough question on everyone’s

Data Mining 109

Data Mining Portfolio Machine Learning Data Science 109

Data Engineering Podcast

OCTOBER 29, 2021

Summary The perennial question of data warehousing is how to model the information that you are storing. This has given rise to methods as varied as star and snowflake schemas, data vault modeling, and wide tables. The challenge with many of those approaches is that they are optimized for answering known questions but brittle and cumbersome when exploring unknowns.

Data Warehouse 100

Data Warehouse BI Data Workflow Data Engineer 100

Teradata

OCTOBER 27, 2021

Recent events have illustrated the fragility of ultra-lean supply chains. Chief Supply Chain Officers must figure out how to navigate these crises to manage costs, speed & quality of service.

Retail 98

Retail Management 98

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Confluent

OCTOBER 29, 2021

At the recent Kafka Summit, Confluent announced the general availability of Stream Governance–the industry’s only governance suite for data in motion. Offered as a fully managed cloud solution, it delivers […].

Government 122

Government IT Kafka Cloud 122

Cloudera

OCTOBER 28, 2021

I’ve had the pleasure to participate in a few Commercial Lines insurance industry events recently and as a prior Commercial Lines insurer myself, I am thrilled with the progress the industry is making using data and analytics. However, I do not think Commercial Lines insurance gets the credit it deserves for the industry-leading role it has played in analytics.

Insurance 102

Insurance Transportation Unstructured Data Manufacturing 102

Netflix Tech

OCTOBER 27, 2021

Open-Sourcing a Monitoring GUI for Metaflow, Netflix’s ML Platform tl;dr Today, we are open-sourcing a long-awaited GUI for Metaflow. The Metaflow GUI allows data scientists to monitor their workflows in real-time, track experiments, and see detailed logs and results for every executed task. The GUI can be extended with plugins, allowing the community to build integrations to other systems, custom visualizations, and embed upcoming features of Metaflow directly into its views.

Python 92

Python Machine Learning Data Science Project 92

ProjectPro

OCTOBER 28, 2021

In this blog, we have mentioned all the topics that are considered as prerequisites for learning machine learning. We have covered all the subjects and the best resources that will help you learn them thoroughly. Upskilling in the era of the Internet has become hassle-free.The Internet has given a platform to experts who can now share their knowledge with a large number of people and help those people in acquiring new skills irrespective of their previous knowledge about the subject.

Machine Learning 52

Machine Learning Programming Language Datasets Python 52

Cloudera

OCTOBER 29, 2021

CDP Operational Database (COD) is an autonomous transactional database powered by Apache HBase and Apache Phoenix. It is one of the main Data Services that runs on Cloudera Data Platform (CDP) Public Cloud. You can access COD right from your CDP console. With COD, application developers can now leverage the power of HBase and Phoenix without the overheads that are often related to deployment and management.

Database 97

Database Amazon Web Services AWS Cloud 97

DataKitchen

OCTOBER 28, 2021

This article was originally published in Forbes. Engineers unleashed artificial intelligence (AI) bias, and it will be engineers who design the solutions that eliminate it. Authors of an article published by McKinsey Global Institute assert that “more human vigilance is needed to critically analyze the unfair biases that can become baked in and scaled by AI systems.

Coding 52

Coding IT Manufacturing Algorithm 52

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Netflix Tech

OCTOBER 26, 2021

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the fourth post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. Need to catch up? Have a look at Part 1 (Decision Making at Netflix), Part 2 (What is an A/B Test?), Part 3 (False positives and statistical significance).

Designing 85

Designing Building Systems Accessibility 85

ProjectPro

OCTOBER 27, 2021

Wondering how to implement machine learning in finance effectively and gain valuable insights? This blog presents the topmost useful machine learning applications in finance to help you understand how financial markets thrive by adopting AI and ML solutions. It also covers some innovative use cases to highlight the significance of machine learning in finance.

Finance 52

Finance Machine Learning Project Banking 52

Cloudera

OCTOBER 25, 2021

With the launch of the Cloudera Public Cloud 7.2.12, the Streams Messaging for Data Hub deployments have gotten some interesting new features! From this release, Streams Messaging templates will support scaling with automatic rebalancing allowing you to grow or shrink your Apache Kafka cluster based on demand. Another notable item is that Streams Replication Manager (SRM) will now support multi-cluster monitoring patterns and aggregate replication metrics from multiple SRM deployments into a sin

Cloud 96

Cloud Kafka Metadata Management 96

Monte Carlo

OCTOBER 27, 2021

Fall is here, Halloween is right around the corner (see below), and we’re one week away from my favorite event of the year: IMPACT , the world’s first Data Observability summit! Here are five reasons why I’m excited – and you should be, too: The lineup. The former CEO of Snowflake. The first Chief Data Officer of the U.S. The founder of the data mesh.

Data 52

Data Data Engineer Data Engineering Engineering 52

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Netflix Tech

OCTOBER 28, 2021

Data Engineers of Netflix?—?Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer at Netflix. Pallavi Phadnis is a Senior Software Engineer on the Product Data Science and Engineering team.

Data Engineer 73

Data Engineer Data Engineering Engineering Software Engineer 73

ProjectPro

OCTOBER 26, 2021

There is no “one-size-fits-all” machine learning framework for model building. Data scientists and machine learning engineers use various machine learning tools and frameworks to build production-ready models. Since there are so many machine learning frameworks and tools available in the market with varied learning curves and user bases, deciding on which machine learning framework to choose for a business use case.

Machine Learning 52

Machine Learning Programming Language Deep Learning Healthcare 52

Cloudera

OCTOBER 27, 2021

Krishna is a Software Engineer working on our Compute Platform and operates out of Bangalore, India. His primary responsibility is to develop, test and maintain software applications that provide compute services to various Cloudera products. His day to day revolves around cloud computing, resource scheduling and API & systems designing. . Technology and design are his major interest areas.

Software Engineer 95

Software Engineer Software Engineering Engineering Cloud Computing 95

Grouparoo

OCTOBER 26, 2021

In today’s data-driven business world, organizations are looking for more efficient ways to leverage data from a variety of sources. For example, businesses often need to evaluate their performance based on large volumes of customer and sales data that might be stored in a variety of locations and formats. Security and compliance teams need to monitor data from a wide array of devices and systems to detect threats as quickly as possible.

Data Pipeline 52

Data Pipeline ETL Tools Data Warehouse ETL System 52

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Data Science Blog: Data Engineering

OCTOBER 25, 2021

Knowing how to optimize your organization’s database for maximum performance can lead to greater efficiency, productivity, and user satisfaction. While it may seem challenging at first, there are a few easy performance tuning tips that you can get started with. 1. Use Indexing Indexing is one of the core ways to give databases a performance boost. There are different ways of approaching indexing , but they all have the same goal: decreasing query wait time by making it easier to find and access

Database 52

Database Computer Science Data Science SQL 52

Rockset

OCTOBER 26, 2021

There are more than 65 million speech-impaired people worldwide of every age and in every social sphere. Historically, they are a vulnerable social group, found in special education institutions, rehab centers, hospitals and clinics, or their own homes. Every one of them needs rehabilitation, education, and help, in order to communicate their needs, emotions and ideas.

NoSQL 52

NoSQL Building Hospitality Education 52

Cloudera

OCTOBER 26, 2021

World Mental Health Day took place earlier this month. Many came forward to share their personal struggles with mental health to raise awareness and reduce the stigma surrounding these issues. The pressures of the pandemic may have exacerbated some deep-seated problems among some of us, which has led us to place greater emphasis on mental health. . The 2021 Global WellBeing report by professional services firm, AON, revealed that mental health and working environment are ranked among the top thr

Professional Services 93

Professional Services Project Building Management 93

Grouparoo

OCTOBER 26, 2021

There are some people that you meet and hope to work with someday. Two of our co-founders met Edmundo in school long ago and have been looking for that opportunity. It has arrived! Edmundo is joining the Grouparoo team as a Senior Full-Stack Engineer. Most recently, Edmundo was at Drift making conversational marketing and sales tools. Drift and tools like it are examples of where Grouparoo users want to sync their data.

Engineering 52

Engineering IT Data 52

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Datakin

OCTOBER 25, 2021

A modern data pipeline is a large, complex, and often fragmented system with cascading interactions across multiple tools and platforms. It can be difficult to evaluate longer-term pipeline health in the absence of discrete warnings and failures, and to track tasks and dependencies across multiple teams and disparate systems. At Datakin, we’ve honed in on the runtime of pipeline jobs as a key metric to watch in daily data operations.

Datasets 52

Datasets Data Pipeline Systems Coding 52

Teradata

OCTOBER 25, 2021

Data liquidity is the lifeblood of the digital transformation needed to deliver the Bank of the Future. Find out more.

Banking 52

Banking Data 52

Cloudera

OCTOBER 25, 2021

At Cloudera, we believe that data can make what is impossible today, possible tomorrow. There are many good uses of data. With data, we can monitor our business, the overall business, or specific business units. We can segment based on the customer verticals or whether they run in the public or private cloud. We can understand customers better, see usage patterns and main consumption drivers.

Machine Learning 88

Machine Learning Engineering Cloud Project 88

DataKitchen

OCTOBER 25, 2021

A survey commissioned by data.world and DataKitchen reveals a disturbing state of affairs among data engineering professionals. The study of 600 data engineers, conducted by Wakefield Research, suggests an overwhelming majority are burned out and calling for relief. This infographic highlights the results. You can also download the infographic here.

Data Engineer 52

Data Engineer Data Engineering Engineering Data 52

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

AltexSoft

OCTOBER 25, 2021

“AI is technology’s most important priority, and health care is its most urgent application,” said Microsoft’s CEO Satya Nadella announcing the company’s new acquisition. Nuance, acquired for $19.7 billion (Microsoft’s biggest purchase since LinkedIn), provides niche AI products for clinical voice transcription, used in 77 percent of US hospitals. Its deep learning natural language processing algorithm is best in class for alleviating clinical documentation burnout, which is one of the main prob

Medical 52

Medical Healthcare Process Hospitality 52

Grouparoo

OCTOBER 23, 2021

The 0.7 release of Grouparoo is a huge step forward for data engineers using Grouparoo to reliably sync a variety of types of data to operational tools. Here are the key features of the release. Models enable Grouparoo to work with multiple data schemas at once. Grouparoo helps troubleshoot messy data and is more resistant to data problems New Destination: Braze Users DevOps Logging Plugins: AWS CloudWatch, Prometheus Models The primary addition is the concept of having multiple Models.

AWS 52

AWS Data Schemas Datasets Data Engineer 52

RudderStack

OCTOBER 26, 2021

In this tutorial project, you’ll learn how you can replicate the sentiment analysis system we use here at RudderStack within your own stack.

Project 40

Project Systems 40

ProjectPro

OCTOBER 29, 2021

The widely used phrase “Data is the New Oil” was coined by the British mathematician Clive Humby way back in 2006. Since then, many other well-loved terms, such as “data economy,” have come to be widely used by industry experts to describe the influence and importance of big data in today’s society. You might already be familiar with some of the popular data glorifying expressions, seldom do they also take the time to mention that raw data isn’t valuable in an

Data Mining 52

Data Mining Datasets Machine Learning Metadata 52

Advertisement

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.

Cloud