Start Data Engineering
APRIL 10, 2020
Many data engineers coming from traditional batch processing frameworks have questions about real time data processing systems, like “What kind of data model did you implement, for real-time processing?
Confluent
APRIL 9, 2020
Many companies have recently started to take cybersecurity and data protection even more seriously, particularly driven by the recent General Data Protection Regulation (GDPR) legislation. They are increasing their investment […].
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Data Engineering Podcast
APRIL 27, 2020
Summary Data is a critical element to every role in an organization, which is also what makes managing it so challenging. With so many different opinions about which pieces of information are most important, how it needs to be accessed, and what to do with it, many data projects are doomed to failure. In this episode Chris Bergh explains how taking an agile approach to delivering value can drive down the complexity that grows out of the varied needs of the business.
Teradata
APRIL 6, 2020
By fully utilizing the data for telco operators in China, Teradata helped communities battle the COVID-19 epidemic through ongoing public health communication, travel updates and inquiries.
Advertisement
Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?
Netflix Tech
APRIL 20, 2020
How Netflix brings safer and faster streaming experience to the living room on crowded networks using TLS 1.3 By Sekwon Choi At Netflix, we are obsessed with the best streaming experiences. We want playback to start instantly and to never stop unexpectedly in any network environment. We are also committed to protecting users’ privacy and service security without sacrificing any part of the playback experience.
U-Next
APRIL 17, 2020
Workforce analytics – what sounds like a complex technical term is relatively easy and inevitable when you understand its importance and how to leverage its full potential to your benefit. Some of the elite HR analysts out there have implemented workforce analytics in their businesses and have seen results that their competitors couldn’t dream of. As an HR manager, you need to be aware of these analytics concepts and theories to pave way for organizational and departmental success and curb any b
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
Confluent
APRIL 16, 2020
On behalf of the Apache Kafka® community, it is my pleasure to announce the release of Apache Kafka 2.5.0. The community has created another exciting release. We are making progress […].
Data Engineering Podcast
APRIL 19, 2020
Summary Modern applications frequently require access to real-time data, but building and maintaining the systems that make that possible is a complex and time consuming endeavor. Eventador is a managed platform designed to let you focus on using the data that you collect, without worrying about how to make it reliable. In this episode Eventador Founder and CEO Kenny Gorman describes how the platform is architected, the challenges inherent to managing reliable streams of data, the simplicity off
Teradata
APRIL 29, 2020
Lots of smart people have created many predictive analytics models to help us manage the COVID-19 pandemic. But many of these models use different inputs, different heuristics, and come to different conclusions.
Netflix Tech
APRIL 2, 2020
By Haruka Miyagawa & Kylee Peña Continue reading on Netflix TechBlog ».
Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin
As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.
Advancing Analytics: Data Engineering
APRIL 23, 2020
The thought of learning Scala fills many with fear, its very name often causes feelings of terror. This suggests it’s either doing something very good, or very bad! The truth is Scala can be used for many things; from a simple web application to complex ML (Machine Learning). Moreover, it unusually fully incorporates two programming paradigms: OOP (Object Orientated Programming) and FP (Functional programming).
Start Data Engineering
APRIL 24, 2020
In this article we aim to go over the reasoning behind why someone might want to use dbt. If you are interested in learning dbt checkout this article.
Confluent
APRIL 21, 2020
Confluent Raises $250M and Kicks Off Project Metamorphosis It’s an exciting day for Confluent, in the middle of a very unusual and difficult time in the larger world. Nonetheless, I […].
Data Engineering Podcast
APRIL 6, 2020
Summary Knowledge graphs are a data resource that can answer questions beyond the scope of traditional data analytics. By organizing and storing data to emphasize the relationship between entities, we can discover the complex connections between multiple sources of information. In this episode John Maiden talks about how Cherre builds knowledge graphs that provide powerful insights for their customers and the engineering challenges of building a scalable graph.
Speaker: Nikhil Joshi, Founder & President of Snic Solutions
Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.
Teradata
APRIL 16, 2020
How can Teradata's data analytics platform help communities stop the spread of COVID-19? Find out more.
U-Next
APRIL 22, 2020
Is your HR department failing to embrace the digital transformation (especially AI) revolution? If so, you are not alone. Human resources departments are notorious for lagging behind in adopting new technologies. It comes as no surprise that the use of automation and artificial intelligence in HR is still relatively rare compared to other departments in organizations across different industries.
Hepta Analytics
APRIL 17, 2020
Last year in September, Hepta Analytics was amongst the few startup companies invited to participate in the World Economic Forum for Africa in Cape Town, South Africa. Such a rare opportunity for a young company like ours given the high profile individuals, such as heads of states invited to attend these types of events. It also included a great mix of local, regional and international companies execs, academic and civil society leaders, all coming together to discuss one thing: Shaping inclusi
Start Data Engineering
APRIL 17, 2020
When getting started with Apache Airflow , data engineers have questions similar to the two below “What are people’s opinions of Airflow?
Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage
When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.
Confluent
APRIL 24, 2020
We are pleased to announce the release of Confluent Platform 5.5. With this release, Confluent makes event streaming more broadly accessible to developers of all backgrounds, enhancing three categories of […].
Grouparoo
APRIL 14, 2020
Grouparoo is the Reverse ETL platform to connect Google Sheets data to your SaaS tools. This enables all of those crazy sheets out there to be the source of truth for your profiles and be fed into your marketing tools. Don't forget: with great power comes great responsibility! Google setup In Grouparoo, apps make the connection to facilitate data movement in the form of sources and destinations.
Teradata
APRIL 8, 2020
There is no ROI in technology - specifically in data analytics, AI & Machine Learning - until we deploy in production and change the way we do business.
U-Next
APRIL 17, 2020
There’s always a sense of apprehension when someone walks down to the HR desk to put down their papers. More so if it is a key employee whose loss is going to be a definite setback. Then people wonder – the upper management, the line manager, the HR department – how it is that they never saw this coming. There used to be a time when employee retention processes would kick in only after an employee resigned.
Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network
In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.
Rock the JVM
APRIL 29, 2020
Master file reading in Scala with ease: compare it to other languages and discover how our simple API approach is almost as straightforward as Python's read()
Rockset
APRIL 28, 2020
Recently, InfoWorld’s Martin Heller described Rockset as a "one-of-a-kind database for operational analytics." After testing Rockset with a variety of queries on a large collection, Heller rated Rockset 4.5 out of 5 stars. Heller’s review of Rockset can be found here. Only one of the test queries timed out: SELECT * FROM commons."twitter-firehose" ORDER BY "twitter-firehose".favorite_count DESC LIMIT 10 For context, twitter-firehose is one of Rockset’s demo collections.
Confluent
APRIL 27, 2020
When Confluent Schema Registry was first introduced, Apache Avro™ was initially chosen as the default format. While Avro has worked well for many users, over the years, we’ve received many […].
Preset
APRIL 14, 2020
This post details the process of building a GitHub community dashboard by extracting data out of the GitHub API, loading it into a database, and building a Superset dashboard on top of it.
Speaker: Aindra Misra, Senior Manager, Product Management (Data, ML, and Cloud Infrastructure) at BILL
Join us for an insightful webinar that explores the critical intersection of data privacy and AI governance. In today’s rapidly evolving tech landscape, building robust governance frameworks is essential to fostering innovation while staying compliant with regulations. Our expert speaker, Aindra Misra, will guide you through best practices for ensuring data protection while leveraging AI capabilities.
Teradata
APRIL 9, 2020
Teradata participated in the MIT COVID Challenge Hackathon to design approaches and mentor teams focused on stamping out the pandemic. Learn more.
U-Next
APRIL 17, 2020
It’s time that organizations realize great skillsets like HR Analytics, are the key to bigger businesses. Companies now find it fancy to promote contests around “Best place to work” and the popularity of LinkedIn and Employee Relations departments have gained a significant amount of importance in the last few years. “Human Resources isn’t a thing we do.
Rock the JVM
APRIL 7, 2020
In this article, you'll learn one of the most important Spark skills: reading how your job will run, which is foundational for any further Spark optimization
Rockset
APRIL 20, 2020
Elasticsearch is an open-source, distributed JSON-based search and analytics engine built using Apache Lucene with the purpose of providing fast real-time search functionality. It is a NoSQL data store that is document-oriented, scalable, and schemaless by default. Elasticsearch is designed to work at scale with large data sets. As a search engine, it provides fast indexing and search capabilities that can be horizontally scaled across multiple nodes.
Advertisement
Entity Resolution Sometimes referred to as data matching or fuzzy matching, entity resolution, is critical for data quality, analytics, graph visualization and AI. Learn what entity resolution is, why it matters, how it works and its benefits. Advanced entity resolution using AI is crucial because it efficiently and easily solves many of today’s data quality and analytics problems.
Expert insights. Personalized for you.
130 
Let's personalize your content