Team Data Science

AUGUST 26, 2020

There are a huge number of tools and platforms for data engineers. It's this enormous selection that makes it difficult for newcomers to filter out the really important tools. In the course of the Data Engineer Coaching I was able to gain important experience in this regard and would like to tell you the most important tools on this basis today! During the coaching sessions I saw that a lot of tools keep coming up all the time: Kafka, Spark and AWS.

Data Engineering 130

Data Engineering Data Engineer Engineering AWS 130

Netflix Tech

AUGUST 28, 2020

by Aditya Mavlankar , Liwei Guo , Anush Moorthy and Anne Aaron Netflix has an ever-expanding collection of titles which customers can enjoy in 4K resolution with a suitable device and subscription plan. Netflix creates premium bitstreams for those titles in addition to the catalog-wide 8-bit stream profiles¹. Premium features comprise a title-dependent combination of 10-bit bit-depth, 4K resolution, high frame rate (HFR) and high dynamic range (HDR) and pave the way for an extraordinary viewing

Media 133

Media Algorithm Data Science Engineering 133

Data Engineering Podcast

AUGUST 24, 2020

Summary In order to scale the use of data across an organization there are a number of challenges related to discovery, governance, and integration that need to be solved. The key to those solutions is a robust and flexible metadata management system. LinkedIn has gone through several iterations on the most maintainable and scalable approach to metadata, leading them to their current work on DataHub.

Metadata 100

Metadata Management Kafka Data Engineering 100

Cloudera

AUGUST 28, 2020

In part 2 of the series focusing on the impact of evolving technology on the telecom industry, we sat down with Vijay Raja, Director of Industry & Solutions Marketing at Cloudera to get his views on how the sector is changing and where it goes next. Hi Vijay, thank you so much for joining us again. To continue where we left off, as industry players continue to shift toward a more 5G centric network, how is 5G impacting the industry from a data perspective?

Machine Learning 110

Machine Learning Transportation Cloud Data Lake 110

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Teradata

AUGUST 25, 2020

This post presents a simulation framework that leverages several mathematical models to simulate the spread of diseases such as COVID-19 in urban environments.

113

113

Confluent

AUGUST 28, 2020

Whether you are a developer working on a cool new real-time application or an architect formulating the plan to reap the benefits of event streaming for the organisation, the subject […].

Cloud 105

Cloud 105

Cloudera

AUGUST 27, 2020

There’s no doubt that cloud has become ubiquitous, and thank goodness for that in 2020. We wouldn’t have survived the challenges of this year without cloud. It’s supported everything, from the sudden changes in the way we work to the way we access healthcare and even shop for vital goods. While cloud is the vehicle, it’s what sits on it that makes it so valuable — data.

Telecommunication 101

Telecommunication Data Data Lake Cloud 101

Teradata

AUGUST 26, 2020

No operator ever made, or ever will make, a single cent or penny from purely digitizing and then storing data – they need to do something with it! Find out how.

IT 98

IT Data 98

Confluent

AUGUST 27, 2020

If you know me, you know two things: first, that I am committed to remote work as an effective way to build a company; I’ve been a remote employee for […].

Kafka 105

Kafka Building 105

Rockset

AUGUST 27, 2020

The effects of climate change and inequality are threatening societies across the world, but there is still an annual funding gap of US$2.5 trillion to achieve the UN Sustainable Development Goals by 2030. A substantial amount of that money is expected to come from private sources like pension funds, but institutional investors often struggle to efficiently incorporate sustainability into their investment decisions.

NoSQL 40

NoSQL Data Lake Portfolio Architecture 40

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Cloudera

AUGUST 26, 2020

Live data-streaming offers businesses exciting new opportunities to transform the way they operate, leveraging real-time insights to drive better decision making and enhance operational efficiency. To find out more about how live-streaming data might impact the financial services sector, I sat down for a chat with Dinesh Chandrasekhar, Head of Product Marketing in Cloudera’s data-in-motion Business Unit.

Banking 83

Banking Data Ingestion Kafka Data Lake 83

Teradata

AUGUST 27, 2020

Learn why milliseconds of WAN network latency can wreak havoc on performance for analytics in the cloud. Read more.

Cloud 66

Cloud 66

Confluent

AUGUST 24, 2020

This is the fifth month of Project Metamorphosis: an initiative that addresses the manual toil of running Apache Kafka® by bringing the best characteristics of modern cloud-native data systems to […].

Project 93

Project Cloud Kafka Systems 93

Grouparoo

AUGUST 25, 2020

In the process of integrating Grouparoo with Zendesk , I searched the documentation for the right way to format tags, but was unable to find it. I thought I'd write up a guide to help others on the same journey. In case you are "that person" and just want the answer, here it is: Tags needs to be lowercase and not have any spaces. You can have underscores.

Database 40

Database Process IT Data 40

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Cloudera

AUGUST 24, 2020

In the last blog with Deloitte’s Marc Beierschoder, we talked about what the hybrid cloud is, why it can benefit a business and what the key blockers often are in implementation. You can read it here. . Today we are continuing our discussion with Martin Mannion , EMEA Big Data Community lead at Deloitte and Paul Mackay, the EMEA Cloud Lead at Cloudera to look at why security and governance requirements must be tackled in the early stages of data-led use case development, thereby mitigating more

Cloud 81

Cloud Building Government Data 81

Teradata

AUGUST 24, 2020

Data is the new battleground for banks; yet for all the talk about digitalization, most banks still do not have a coherent enterprise-wide strategy for data.

Banking 52

Banking Data 52

Confluent

AUGUST 24, 2020

Here is what happened on day one of the event—spoiler alert: My first Summit was awesome. This year’s Kafka Summit is my first and I’ve been lucky to have a […].

Kafka 85

Kafka 85

Rockset

AUGUST 25, 2020

In Part One , we discussed how to first identify slow queries on MongoDB using the database profiler, and then investigated what the strategies the database took doing during the execution of those queries to understand why our queries were taking the time and resources that they were taking. In this blog post, we’ll discuss several other targeted strategies that we can use to speed up those problematic queries when the right circumstances are present.

MongoDB 40

MongoDB NoSQL SQL Database 40

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

Cloudera

AUGUST 25, 2020

Introducing Model Monitoring & Metrics Store In Cloudera Data Science Workbench. With only about 35% of machine learning models making into production in the enterprise ( IDC ), it’s no wonder that production machine learning has become one of the most important focus areas for data scientists and ML engineers alike. As you may remember, we recently announced a full set of MLOps capabilities in Cloudera Machine Learning , our cloud native machine learning tool for the cloud.

Machine Learning 78

Machine Learning Data Science Python Cloud 78

Rock the JVM

AUGUST 24, 2020

The final chapter in our type-level trilogy: mastering list sorting at compile time

Scala 52

Scala Programming 52

Cloudera

AUGUST 25, 2020

Evaluating anomalies and unpredicted events like pandemics and ESG concerns. In part II of the series, we sat down for an interview with Dr. Richard Harmon, Managing Director of Financial Services at Cloudera, to find out more about how the industry is adopting new technology. You can catch-up and read part 1 of the series, here. Thank you for joining us for part two of our discussion around data, analytics and machine learning within the Financial Service Sector Dr.

Technology 73

Technology Machine Learning Banking Government 73

Cloudera

AUGUST 26, 2020

On August 18, we completed our Enterprise Data Cloud vision of bringing a truly hybrid cloud experience with the general availability of Cloudera Data Platform Private Cloud (CDP Private Cloud). CDP Private Cloud, which is based on Kubernetes (RedHat OpenShift), extends cloud-native speed, simplicity and economics for the connected data lifecycle to the on-prem world, enabling IT to respond to business needs faster and deliver rock-solid service levels so people can be more productive with data.

Machine Learning 84

Machine Learning BI Big Data Data Warehouse 84

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project