Cloudera

JUNE 1, 2021

Today marks the beginning of an exciting new chapter for Cloudera. Cloudera will become a private company with the flexibility and resources to accelerate product innovation, cloud transformation and customer growth. Cloudera will benefit from the operating capabilities, capital support and expertise of Clayton, Dubilier & Rice (CD&R) and KKR – two of the most experienced and successful global investment firms in the world recognized for supporting the growth strategies of the businesses

Cloud 144

Cloud Big Data Data Lake Finance 144

Data Engineering Podcast

JUNE 3, 2021

Summary SQL is the most widely used language for working with data, and yet the tools available for writing and collaborating on it are still clunky and inefficient. Frustrated with the lack of a modern IDE and collaborative workflow for managing the SQL queries and analysis of their big data environments, the team at Pinterest created Querybook. In this episode Justin Mejorada-Pier and Charlie Gu share the story of how the initial prototype for a data catalog ended up as one of their most widel

SQL 100

SQL Building Big Data BI 100

Confluent

JUNE 1, 2021

One of the canonical examples of streaming data is tracking location data over time. Whether it’s ride-sharing vehicles, the position of trains on the rail network, or tracking airplanes waking […].

Data 118

Data Process 118

Netflix Tech

JUNE 1, 2021

Data Engineers of Netflix?—?Interview with Dhevi Rajendran Dhevi Rajendran This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Dhevi Rajendran is a Data Engineer on the Growth Data Science and Engineering team. Dhevi joined Netflix in July 2020 and is one of many Data Engineers who have onboarded remotely during the pandemic.

Data Engineering 55

Data Engineering Data Engineer Engineering Software Engineer 55

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Cloudera

JUNE 3, 2021

Cloudera Support’s cluster validations proactively identify known problem signatures contained in customers’ diagnostic data with the goal of increasing cluster health, performance, and overall stability. Cluster validations are included in a customer’s enterprise subscription at no additional cost. All customers with access to the Support case portal will also be able to take advantage of cluster validations.

Programming 95

Programming Consulting Designing Accessible 95

Data Engineering Podcast

JUNE 1, 2021

Summary Every part of the business relies on data, yet only a small team has the context and expertise to build and maintain workflows and data pipelines to transform, clean, and integrate it. In order for the true value of your data to be realized without burning out your engineers you need a way for everyone to get access to the information they care about.

Data Pipeline 100

Data Pipeline Data Warehouse Data Data Engineering 100

Netflix Tech

JUNE 1, 2021

Data Engineers of Netflix?—?Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Samuel Setegne is a Senior Software Engineer on the Core Data Science and Engineering team. Samuel and his team build tools and frameworks that support data engineering teams across Netflix.

Data Engineering 52

Data Engineering Data Engineer Engineering Data Science 52

Cloudera

JUNE 2, 2021

Apache Ozone is a distributed object store built on top of Hadoop Distributed Data Store service. It can manage billions of small and large files that are difficult to handle by other distributed file systems. As an important part of achieving better scalability, Ozone separates the metadata management among different services: . Ozone Manager (OM) service manages the metadata of the namespace such as volume, bucket and keys.

Metadata 95

Metadata Hadoop Certification Algorithm 95

Grouparoo

JUNE 2, 2021

Grouparoo uses Next.js to build our web frontend(s), and we distribute these frontend User Interfaces (UIs) via NPM as packages, e.g. @grouparoo/ui-community. This allows Grouparoo users to choose which UI they want to use (or none) by changing their package.json : Example package.json for a Grouparoo project: { "author" : "Your Name <email@example.com>" , "name" : "grouparoo-application" , "description" : "A Grouparoo Deployment" , "ve

Project 52

Project Building Coding IT 52

Confluent

JUNE 2, 2021

This is part two in a blog series on streaming a feed of AIS maritime data into Apache Kafka® using Confluent and how to apply it for a variety of […].

Kafka 59

Kafka Data IT Process 59

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Monte Carlo

JUNE 2, 2021

As companies leverage more and more data to drive decision-making and maintain their competitive edge, it’s crucial that this data is accurate and reliable. With the new Databricks integration from Monte Carlo, teams working in data lakes can finally trust their data through end-to-end data observability and automated lineage of their entire data ecosystem.

Data Lake 52

Data Lake Machine Learning Unstructured Data Datasets 52

Cloudera

JUNE 2, 2021

Data pipelines are in high demand in today’s data-driven organizations. As critical elements in supplying trusted, curated, and usable data for end-to-end analytic and machine learning workflows, the role of data pipelines is becoming indispensable. To keep up, data pipelines are being vigorously reshaped with modern tools and techniques. At Cloudera, we recently introduced several cutting-edge innovations in our Cloudera Data Engineering experience (CDE) as part of our Enterprise Data Cloud pro

Data Pipeline 92

Data Pipeline Data Warehouse Machine Learning Data Architect 92

ProjectPro

JUNE 2, 2021

"Exploratory data analysis is an attitude, a state of flexibility, a willingness to look for those things that we believe are not there, as well as the things we believe might be there. “ - quoted in Exploratory Data Analysis Tukey PDF on Nonparametric Statistical Data Modeling. This data science blog will discover what is exploratory data analysis (EDA), the importance of performing EDA when solving data science problems, the various exploratory data analysis techniques that one can use w

Data Analysis 52

Data Analysis Python Machine Learning Data Science 52

Airbnb Tech

JUNE 1, 2021

Metric Infrastructure with Minerva @ Airbnb Part II: The six design principles of Minerva compute infrastructure By: Amit Pahwa , Cristian Figueroa , Donghan Zhang , Haim Grosman , John Bodley , Jonathan Parks , Maggie Zhu , Philip Weiss , Robert Chang , Shao Xie , Sylvia Tomiyama , Xiaohui Sun Introduction As described in the first post of this series, Airbnb invested significantly in building Minerva, a single source of truth metric platform that standardizes the way business metrics are creat

Datasets 52

Datasets Pipeline-centric Metadata Data Science 52

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Teradata

JUNE 1, 2021

To meet evolving customer demands banks must find ways to manage billions of hyper-personalized interactions at low cost. This demands the right tech & operating model.

Banking 52

Banking Management 52

Rock the JVM

JUNE 2, 2021

Cats is a complex library for Scala: This article deconstructs the major type classes and explains their connections

Scala 52

Scala 52

DataKitchen

JUNE 2, 2021

The post The Techniques and Technologies Bringing Agility to Enterprise Data first appeared on DataKitchen.

Technology 52

Technology Data 52

ProjectPro

JUNE 4, 2021

Are you a final-year student or a beginner looking to improve your skills in IoT technology? If yes, this blog has some of the best and most exciting IoT projects for you! You will find various IoT-based projects relevant to different industries that can help you land your dream job in data science! IoT is likely to grow from 8.74 billion in 2020 to more than 13 billion in 2023, according to Statista Research Department.

Project 40

Project Healthcare Medical Hospitality 40

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

Teradata

MAY 31, 2021

Learn about the capabilities and benefits of NOS WRITE -- the latest offering within the Native Object Store feature, which was released in early 2020.

Cloud Storage 52

Cloud Storage IT Cloud Data 52

Rockset

JUNE 4, 2021

In this blog, we will describe a new storage format that we adopted for our search index, one of the indexes in Rockset’s Converged Index. This new format reduced latencies for common queries by as much as 70% and the size of the search index by about 20%. As described in our Converged Index blog, we store every column of every document in a row-based store, column-based store, and a search index.

Metadata 40

Metadata Designing Database Process 40

Monte Carlo

JUNE 3, 2021

In this report, we’ll dive into the latest data platform trends and challenges, as well as outline the key factors teams should consider when building their solutions, including: Data discovery Data mesh Data democratization Data observability And many others. We’ll also highlight how teams at Uber, Nike, Pinterest, and other companies leading with data apply these concepts at scale to drive value and trustworthy insights for the business.

Data 52

Data Building 52

ProjectPro

MAY 31, 2021

Ace your big data interview by adding some unique and exciting Big Data projects to your portfolio. This blog lists over 20 big data projects you can work on to showcase your big data skills and gain hands-on experience in big data tools and technologies. You will find several big data projects depending on your level of expertise- big data projects for students, big data projects for beginners, etc.

Big Data 52

Big Data Coding Project Hadoop 52

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

Rockset

JUNE 1, 2021

MySQL and PostgreSQL are widely used as transactional databases. When it comes to supporting high-scale and analytical use cases, you may often have to tune and configure these databases, which leads to a higher operational burden. Some challenges when doing analytics on MySQL and Postgres include: running a large number of concurrent queries/users working with large data sizes needing to define and manage tons of indexes.

MySQL 40

MySQL PostgreSQL AWS Relational Database 40