KDnuggets

SEPTEMBER 8, 2023

Understand the relevance of databases in data science. Also learn the fundamentals of relational databases, NoSQL database categories, and more.

Database 141

Database Data Science NoSQL Relational Database 141

Snowflake

NOVEMBER 11, 2024

It’s easy these days for an organization’s data infrastructure to begin looking like a maze, with an accumulation of point solutions here and there. Snowflake is committed to doing just that by continually adding features to help our customers simplify how they architect their data infrastructure. Here’s a closer look.

Data Architecture 105

Data Architecture Architecture Data Lake Kafka 105

Analytics Vidhya

FEBRUARY 21, 2023

Introduction SQL is a database programming language created for managing and retrieving data from Relational databases like MySQL, Oracle, and SQL Server. SQL(Structured Query Language) is the common language for all databases. In other terms, SQL is a language that communicates with databases.

SQL 172

SQL MySQL Programming Language Relational Database 172

Confessions of a Data Guy

JANUARY 12, 2023

Anyone who’s been roaming around the forest of Data Engineering has probably run into many of the newish tools that have been growing rapidly around the concepts of Data Warehouses, Data Lakes, and Lake Houses … the merging of the old relational database functionality with TB and PB level cloud-based file storage systems.

Data Lake 162

Data Lake Relational Database Data Warehouse Data Engineering 162

Hevo

MARCH 9, 2025

Relational databases like Postgres have been the backbone of enterprise data management for years. However, as data volumes grow and the need for flexibility, scalability, and advanced analytics increases, modern solutions like Apache Iceberg are becoming essential.

Relational Database 52

Relational Database Architecture Database Data 52

Team Data Science

JANUARY 8, 2021

Big Data has become the dominant innovation in all high-performing companies. Notable businesses today focus their decision-making capabilities on knowledge gained from the study of big data. Big Data gives you an advantage in competition as true for businesses as it is for professionals working in the area of analytics.

Data Engineering 130

Data Engineering Data Engineer Engineering Unstructured Data 130

Striim

MARCH 21, 2025

Business transactions captured in relational databases are critical to understanding the state of business operations. Since the value of data quickly drops over time, organizations need a way to analyze data as it is generated. What is Change Data Capture?

IT 52

IT Data Lake Data Warehouse Relational Database 52

Towards Data Science

JANUARY 16, 2024

My personal take on justifying the existence of Data Mesh A senior stakeholder at one my projects mentioned that they wanted to decentralise their data platform architecture and democratise data across the organisation. When I heard the words ‘decentralised data architecture’, I was left utterly confused at first!

Data Warehouse 95

Data Warehouse Data Architecture Relational Database NoSQL 95

phData: Data Engineering

NOVEMBER 8, 2024

The world we live in today presents larger datasets, more complex data, and diverse needs, all of which call for efficient, scalable data systems. Open Table Format (OTF) architecture now provides a solution for efficient data storage, management, and processing while ensuring compatibility across different platforms.

Architecture 52

Architecture Systems Data Lake Google Cloud 52

Team Data Science

FEBRUARY 23, 2021

Companies can now make data useful to elevate decision making and to optimise products and processes. It's currently easy to acquire data strategically. If you ever have to explain to friends or colleagues why data capabilities are crucial to navigating the future of work and innovation, try this storytelling tactic. .

Business Intelligence 130

Business Intelligence Food Unstructured Data Relational Database 130

Data Engineering Weekly

JUNE 10, 2024

Experience Enterprise-Grade Apache Airflow Astro augments Airflow with enterprise-grade features to enhance productivity, meet scalability and availability demands across your data pipelines, and more. Databricks and Snowflake offer a data warehouse on top of cloud providers like AWS, Google Cloud, and Azure.

Data Engineering 103

Data Engineering Data Engineer Engineering Kafka 103

Hevo

MARCH 9, 2025

Relational databases like Oracle have been the backbone of enterprise data management for years. However, as data volumes grow and the need for flexibility, scalability, and advanced analytics increases, modern solutions like Apache Iceberg are becoming essential.

Relational Database 40

Relational Database Architecture Database Data 40

Confluent

NOVEMBER 2, 2021

What will the next important category of databases look like? For decades, relational databases were the undisputed home of data. They powered everything: from websites to analytics, from customer data […].

Database 121

Database Systems Relational Database Data 121

Start Data Engineering

JULY 18, 2020

RDS AWS RDS is a managed service provided by AWS to run a relational database. Go to Services -> RDS Click on Create Database, In the Create Database prompt, choose Standard Create option with PostgreSQL as engine type. We will see how to setup a postgres instance using AWS RDS. Log in to your AWS account.

PostgreSQL 130

PostgreSQL AWS Relational Database Database 130

Precisely

JULY 12, 2024

Data can be your organization’s most valuable asset, but only if it’s data you can trust. When companies work with data that is untrustworthy for any reason, it can result in incorrect insights, skewed analysis, and reckless recommendations to become data integrity vs data quality.

Data Integration 105

Data Integration Datasets Data Data Governance 105

Data Engineering Podcast

FEBRUARY 27, 2022

Summary Building a data platform is a complex journey that requires a significant amount of planning to do well. In this episode Tobias Macey, the host of the show, reflects on his plans for building a data platform and what he has learned from running the podcast that is influencing his choices. That’s Timescale.

Designing 100

Designing Metadata Data Lake Relational Database 100

Confluent

FEBRUARY 23, 2023

How to use Kafka Streams to aggregate change data capture (CDC) messages from a relational database into transactional messages, powering a scalable microservices architecture.

Kafka 110

Kafka Relational Database Architecture Database 110

Data Engineering Podcast

DECEMBER 8, 2019

Summary Data warehouses have gone through many transformations, from standard relational databases on powerful hardware, to column oriented storage engines, to the current generation of cloud-native analytical engines. How does it compare to the other available platforms for data warehousing?

Data Warehouse 100

Data Warehouse Cloud AWS Relational Database 100

Confluent

AUGUST 20, 2019

Traditional relational database systems are ubiquitous in software systems. They are surrounded by a strong ecosystem of tools, such as object-relational mappers and schema migration helpers. Today’s businesses, however, want to process ever-increasing amounts of data. All of these are enforced by relational databases.

Kafka 22

Kafka Systems Building Relational Database 22

Hevo

DECEMBER 20, 2024

PostgreSQL is one of the most popular open-source choices for relational databases. It is loved by engineers for its powerful features, flexibility, efficient data retrieval mechanism, and on top of all its overall performance. There are several […]

PostgreSQL 40

PostgreSQL Coding Relational Database Database 40

U-Next

MARCH 1, 2023

Introduction Data Engineer is responsible for managing the flow of data to be used to make better business decisions. A solid understanding of relational databases and SQL language is a must-have skill, as an ability to manipulate large amounts of data effectively. What is a data warehouse?

Data Engineering 75

Data Engineering Data Engineer Non-relational Database Engineering 75

AltexSoft

JUNE 7, 2021

Hadoop and Spark are the two most popular platforms for Big Data processing. They both enable you to deal with huge collections of data no matter its format — from Excel tables to user feedback on websites to images and video files. Which Big Data tasks does Spark solve most effectively? How does it work? cost-effectiveness.

Big Data Tools 98

Big Data Tools Hadoop Big Data Database-centric 98

Snowflake

JUNE 13, 2024

The journey toward achieving a robust data platform that secures all your data in one place can seem like a daunting one. But at Snowflake, we’re committed to making the first step the easiest — with seamless, cost-effective data ingestion to help bring your workloads into the AI Data Cloud with ease.

Data Ingestion 115

Data Ingestion MySQL PostgreSQL Data Pipeline 115

Data Engineering Podcast

APRIL 15, 2019

Summary Database indexes are critical to ensure fast lookups of your data, but they are inherently tied to the database engine. Pilosa is rewriting that equation by providing a flexible, scalable, performant engine for building an index of your data to enable high-speed aggregate analysis.

Big Data 100

Big Data Relational Database Database Media 100

Data Engineering Podcast

MARCH 13, 2022

Summary Data observability is a term that has been co-opted by numerous vendors with varying ideas of what it should mean. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Data Lake 100

Data Lake Relational Database Data Engineering Data Engineer 100

Data Engineering Podcast

AUGUST 3, 2020

Summary Finding connections between data and the entities that they represent is a complex problem. Graph data models and the applications built on top of them are perfect for representing relationships and finding emergent structures in your information. If you hand a book to a new data engineer, what wisdom would you add to it?

NoSQL 100

NoSQL Database Algorithm Relational Database 100

François Nguyen

MARCH 22, 2021

TL;DR After setting up and organizing the teams, we are describing 4 topics to make data mesh a reality. TL;DR After setting up and organizing the teams, we are describing 4 topics to make data mesh a reality. How do we build data products ? How can we interoperate between the data domains ?

Technology 130

Technology Architecture Google Cloud Metadata 130

Hevo

MAY 9, 2023

As a business grows, the demand to efficiently handle and process the exponentially growing data also rises. A popular open-source relational database used by several organizations across the world is PostgreSQL.

PostgreSQL 97

PostgreSQL Relational Database Database Data Integration 97

Data Engineering Podcast

MAY 29, 2022

Summary A large fraction of data engineering work involves moving data from one storage location to another in order to support different access and query patterns. Singlestore aims to cut down on the number of database engines that you need to run so that you can reduce the amount of copying that is required.

Database 100

Database Architecture Data Architecture PostgreSQL 100

U-Next

MARCH 8, 2023

For more than 40 years, relational databases have been managed and modified using the programming language SQL (Structured Query Language). Given that it lets organizations efficiently store, retrieve, and analyze massive volumes of data, it has become an essential tool in their daily operations.

SQL 97

SQL Relational Database Database Data Analysis 97

KDnuggets

JULY 25, 2019

As long as there is ‘data’ in data scientist, Structured Query Language (or see-quel as we call it) will remain an important part of it. In this blog, let us explore data science and its relationship with SQL.

SQL 120

SQL Data Science Data Relational Database 120

Knowledge Hut

DECEMBER 26, 2023

Data science is a field of study that works with large amounts of facts and uses splitting tools and methods to uncover hidden patterns, extract useful data, and make business choices. Data scientists use complex machine learning techniques to develop prediction models. Why Should You Learn Data Science?

Data Science 98

Data Science Programming Language Deep Learning Machine Learning 98

U-Next

MARCH 7, 2023

ntroduction Data Analytics is an extremely important field in today’s business world, and it will only become more so as time goes on. By 2023, Data Analytics is projected to be worth USD 240.56 The Data Analyst interview questions are very competitive and difficult. How to track changes in databases?

Data Mining 96

Data Mining Scala Government Data Governance 96

Cloudera

NOVEMBER 23, 2021

What is Cloudera Operational Database (COD)? Operational Database is a relational and non-relational database built on Apache HBase and is designed to support OLTP applications, which use big data. The operational database in Cloudera Data Platform has the following components: .

Database 91

Database Non-relational Database NoSQL Government 91

Monte Carlo

NOVEMBER 14, 2024

Lior drove straight into the three reasons why data downtime happens: The three root causes of data downtime. Lior drove straight into the three reasons why data downtime happens: The three root causes of data downtime. For us, data quality monitoring is just the first step, something we all must move beyond.

Relational Database 52

Relational Database SQL Metadata Data Validation 52

Snowflake

NOVEMBER 27, 2023

Hum is harnessing frontier AI to transform content and audience data into actionable insights and personalized experiences. What problem does Hum aim to solve, and how are you using data to address the issue? To do that, they need rich data and powerful AI. Hum’s fast data store is built on Elasticsearch.

Raw Data 124

Raw Data Relational Database Consulting Architecture 124

Knowledge Hut

FEBRUARY 29, 2024

Being a data scientist means constantly growing, enabling businesses to become more data-propelled, and learning newer trends and tools. There are various excellent resources in data science that can help you to develop your skillset. So, having the right knowledge of tools and technology is important for handling such data.

Data Science 98

Data Science Datasets Machine Learning Database Design 98