Team Data Science

MARCH 31, 2020

I built a serverless architecture for my simulated credit card complaints stream using, AWS S3 AWS Lambda AWS Kinesis the above picture gives a high-level view of the data flow. I assume uploading the CSV file as a data producer, so once you upload a file, it generates object created event and the Lambda function is invoked asynchronously. The file data content will be written to the Kinesis stream as a record (record = data + partition key), which triggers another Lambda function and persist th

Process 130

Process AWS Python Architecture 130

Start Data Engineering

MARCH 28, 2020

One of the most common use cases for Apache Airflow is to run scheduled SQL scripts. Developers who start with Airflow often ask the following questions “How to use airflow to orchestrate sql?

SQL 130

SQL 130

Data Engineering Podcast

MARCH 30, 2020

Summary Building and maintaining a system that integrates and analyzes all of the data for your organization is a complex endeavor. Operating on a shoe-string budget makes it even more challenging. In this episode Tyler Colby shares his experiences working as a data professional in the non-profit sector. From managing Salesforce data models to wrangling a multitude of data sources and compliance challenges, he describes the biggest challenges that he is facing.

AWS 100

AWS Data Big Data Machine Learning 100

Confluent

APRIL 1, 2020

Running fully managed Apache Kafka® as a service brings many responsibilities that leading cloud providers hide well. There is a reason why cloud services? are so popular right now—?companies realize […].

Kafka 97

Kafka Cloud Management 97

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Netflix Tech

APRIL 2, 2020

By Haruka Miyagawa & Kylee Peña Continue reading on Netflix TechBlog ».

96

96

Teradata

MARCH 30, 2020

With the COVID-19 epidemic in full swing, the countries that are faring the best are employing large-scale testing and electronic surveillance. But what does this mean for our civil liberties?

Electronics 59

Electronics 59

Confluent

MARCH 31, 2020

Data can originate in a number of different sources—transactional databases, mobile applications, external integrations, one-time scripts, etc.—but eventually it has to be synchronized to a central data warehouse for analysis […].

Data Warehouse 91

Data Warehouse Data Database IT 91

Rockset

APRIL 3, 2020

PROBLEM STATEMENT: Fleet operators often suffer business and monetary losses due to a lack of information on the health of their fleet and inventory it carries. This problem arises due to a lack of real-time data on vehicle health or inventory health, to take preemptive action or real-time action. EXAMPLES: A vehicle’s coolant is leaking and engine temperature is going up.

Data Pipeline 40

Data Pipeline Systems Management NoSQL 40

Teradata

APRIL 2, 2020

Learn about the underlying concept of Bayes' Theorem which is the foundation for the Naive Bayes algorithm in Vantage, a powerful tool in predicting the outcome of business or healthcare related events.

Healthcare 52

Healthcare Algorithm 52

Rock the JVM

APRIL 2, 2020

Self-types are a powerful way to enforce type constraints in Scala: learn to use them effectively in just a few minutes

Scala 52

Scala 52

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Rock the JVM

MARCH 28, 2020

Pattern matching is one of the most powerful Scala features: learn to use it to the max and write your best Scala code

Scala 52

Scala Coding IT 52

Rock the JVM

MARCH 31, 2020

Learn to use Akka HTTP with Scala and send HTTP requests in just a few minutes with the Akka HTTP server DSL

Scala 52

Scala 52

Rock the JVM

APRIL 3, 2020

Learn how to handle deterministic Futures in Scala using Promises in this article

Scala 52

Scala 52