Analytics Vidhya

FEBRUARY 21, 2023

Introduction SQL is a database programming language created for managing and retrieving data from Relational databases like MySQL, Oracle, and SQL Server. SQL(Structured Query Language) is the common language for all databases. In other terms, SQL is a language that communicates with databases.

SQL 168

SQL MySQL Programming Language Relational Database 168

Cloudera

FEBRUARY 9, 2021

Cloudera Operational Database is now available in three different form-factors in Cloudera Data Platform (CDP). . If you are new to Cloudera Operational Database, see this blog post. Cloudera Operational Database (COD) experience that is is a managed dbPaaS solution. You can also access your data using the Hue HBase app.

Database 104

Database Java SQL Data Ingestion 104

Cloudera

NOVEMBER 23, 2021

What is Cloudera Operational Database (COD)? Operational Database is a relational and non-relational database built on Apache HBase and is designed to support OLTP applications, which use big data. The operational database in Cloudera Data Platform has the following components: .

Database 91

Database Non-relational Database NoSQL Government 91

Confessions of a Data Guy

JANUARY 12, 2023

Anyone who’s been roaming around the forest of Data Engineering has probably run into many of the newish tools that have been growing rapidly around the concepts of Data Warehouses, Data Lakes, and Lake Houses … the merging of the old relational database functionality with TB and PB level cloud-based file storage systems.

Data Lake 163

Data Lake Relational Database Data Warehouse Data Engineering 163

Data Engineering Podcast

APRIL 22, 2019

Summary One of the biggest challenges for any business trying to grow and reach customers globally is how to scale their data storage. FaunaDB is a cloud native database built by the engineers behind Twitter’s infrastructure and designed to serve the needs of modern systems.

Database 100

Database Cloud NoSQL Scala 100

Pinterest Engineering

JANUARY 4, 2024

While KVStore was the client facing abstraction, we also built a storage service called Rockstorewidecolumn : a wide column, schemaless NoSQL database built using RocksDB. Additionally, the last section explains how this new database supports a key platform in the product. Individual rows constitute a dataset.

Database 97

Database Building Datasets Relational Database 97

Data Engineering Podcast

MAY 29, 2022

Summary A large fraction of data engineering work involves moving data from one storage location to another in order to support different access and query patterns. Singlestore aims to cut down on the number of database engines that you need to run so that you can reduce the amount of copying that is required.

Database 100

Database Architecture Data Architecture PostgreSQL 100

Cloudera

SEPTEMBER 9, 2021

The CDP Operational Database ( COD ) builds on the foundation of existing operational database capabilities that were available with Apache HBase and/or Apache Phoenix in legacy CDH and HDP deployments. Cloudera Machine Learning or Cloudera Data Warehouse), to deliver fast data and analytics to downstream components.

Database 95

Database AWS Relational Database Cloud 95

Team Data Science

JANUARY 8, 2021

Big Data has become the dominant innovation in all high-performing companies. Notable businesses today focus their decision-making capabilities on knowledge gained from the study of big data. Big Data gives you an advantage in competition as true for businesses as it is for professionals working in the area of analytics.

Data Engineering 130

Data Engineering Data Engineer Engineering Unstructured Data 130

Start Data Engineering

JULY 18, 2020

RDS AWS RDS is a managed service provided by AWS to run a relational database. Go to Services -> RDS Click on Create Database, In the Create Database prompt, choose Standard Create option with PostgreSQL as engine type. We will see how to setup a postgres instance using AWS RDS. Log in to your AWS account.

PostgreSQL 130

PostgreSQL AWS Relational Database Database 130

Workfall

OCTOBER 3, 2023

What is MySQL Database? CRUD represents Create, Read/Retrieve, Update, and Delete – fundamental actions on persistent storage, aligned with HTTP methods used in web development and database management: – POST: Establishes a fresh resource. What is MySQL Database? What is Spring Boot? – DELETE: Removes a resource.

MySQL 85

MySQL Database Java Coding 85

Knowledge Hut

MARCH 27, 2024

Think of a database as a smart, organized library that stores and manages information efficiently. On the other hand, data structures are like the tools that help organize and arrange data within a computer program. What is a Database? SQL, or structured query language, is widely used for writing and querying data.

Database 52

Database Relational Database Algorithm PostgreSQL 52

Towards Data Science

JANUARY 16, 2024

My personal take on justifying the existence of Data Mesh A senior stakeholder at one my projects mentioned that they wanted to decentralise their data platform architecture and democratise data across the organisation. When I heard the words ‘decentralised data architecture’, I was left utterly confused at first!

Data Warehouse 95

Data Warehouse Data Architecture Relational Database NoSQL 95

Confluent

AUGUST 20, 2019

Traditional relational database systems are ubiquitous in software systems. They are surrounded by a strong ecosystem of tools, such as object-relational mappers and schema migration helpers. Today’s businesses, however, want to process ever-increasing amounts of data. All of these are enforced by relational databases.

Kafka 22

Kafka Systems Building Relational Database 22

Snowflake

JUNE 13, 2024

The journey toward achieving a robust data platform that secures all your data in one place can seem like a daunting one. But at Snowflake, we’re committed to making the first step the easiest — with seamless, cost-effective data ingestion to help bring your workloads into the AI Data Cloud with ease.

Data Ingestion 104

Data Ingestion MySQL PostgreSQL Data Pipeline 104

Confluent

FEBRUARY 23, 2023

How to use Kafka Streams to aggregate change data capture (CDC) messages from a relational database into transactional messages, powering a scalable microservices architecture.

Kafka 110

Kafka Relational Database Architecture Database 110

Hevo

MAY 9, 2023

As a business grows, the demand to efficiently handle and process the exponentially growing data also rises. A popular open-source relational database used by several organizations across the world is PostgreSQL.

PostgreSQL 97

PostgreSQL Relational Database Database Data Integration 97

Precisely

JULY 12, 2024

Data can be your organization’s most valuable asset, but only if it’s data you can trust. When companies work with data that is untrustworthy for any reason, it can result in incorrect insights, skewed analysis, and reckless recommendations to become data integrity vs data quality.

Data Integration 105

Data Integration Datasets Data Data Governance 105

Data Engineering Podcast

AUGUST 3, 2020

Summary Finding connections between data and the entities that they represent is a complex problem. Graph data models and the applications built on top of them are perfect for representing relationships and finding emergent structures in your information. If you hand a book to a new data engineer, what wisdom would you add to it?

NoSQL 100

NoSQL Database Algorithm Relational Database 100

Precisely

JANUARY 9, 2025

Does the LLM capture all the relevant data and context required for it to deliver useful insights? Not to mention the crazy stories about Gen AI making up answers without the data to back it up!) Are we allowed to use all the data, or are there copyright or privacy concerns? But simply moving the data wasnt enough.

Data Integration 119

Data Integration Hadoop Data Warehouse Data Lake 119

Data Engineering Podcast

APRIL 15, 2019

Summary Database indexes are critical to ensure fast lookups of your data, but they are inherently tied to the database engine. Pilosa is rewriting that equation by providing a flexible, scalable, performant engine for building an index of your data to enable high-speed aggregate analysis.

Big Data 100

Big Data Relational Database Database Media 100

Team Data Science

FEBRUARY 23, 2021

Companies can now make data useful to elevate decision making and to optimise products and processes. It's currently easy to acquire data strategically. If you ever have to explain to friends or colleagues why data capabilities are crucial to navigating the future of work and innovation, try this storytelling tactic. .

Business Intelligence 130

Business Intelligence Food Unstructured Data Relational Database 130

Knowledge Hut

MARCH 14, 2024

Do you want a database system that can scale quickly and manage heavy workloads? Should that be the case, Azure SQL Database might be your best bet. Microsoft SQL Server's functionalities are fully included in Azure SQL Database, a cloud-based database service that also offers greater flexibility and scalability.

Database 52

Database SQL Relational Database BI 52

Data Engineering Weekly

JUNE 10, 2024

Experience Enterprise-Grade Apache Airflow Astro augments Airflow with enterprise-grade features to enhance productivity, meet scalability and availability demands across your data pipelines, and more. Databricks and Snowflake offer a data warehouse on top of cloud providers like AWS, Google Cloud, and Azure.

Data Engineering 103

Data Engineering Data Engineer Engineering Kafka 103

Data Engineering Podcast

FEBRUARY 27, 2022

Summary Building a data platform is a complex journey that requires a significant amount of planning to do well. In this episode Tobias Macey, the host of the show, reflects on his plans for building a data platform and what he has learned from running the podcast that is influencing his choices. That’s Timescale.

Designing 100

Designing Metadata Data Lake Relational Database 100

Data Engineering Podcast

DECEMBER 8, 2019

Summary Data warehouses have gone through many transformations, from standard relational databases on powerful hardware, to column oriented storage engines, to the current generation of cloud-native analytical engines. How does it compare to the other available platforms for data warehousing?

Data Warehouse 100

Data Warehouse Cloud AWS Relational Database 100

U-Next

MARCH 1, 2023

Introduction Data Engineer is responsible for managing the flow of data to be used to make better business decisions. A solid understanding of relational databases and SQL language is a must-have skill, as an ability to manipulate large amounts of data effectively. What is a data warehouse?

Data Engineering 75

Data Engineering Data Engineer Non-relational Database Engineering 75

Towards Data Science

JANUARY 7, 2025

How CDC tools use MySQL Binlog and PostgreSQL WAL with logical decoding for real-time data streaming Photo by Matoo.Studio on Unsplash CDC (Change Data Capture) is a term that has been gaining significant attention over the past few years. Log-based CDC : This method utilizes the databases transaction log to capture every change made.

PostgreSQL 84

PostgreSQL MySQL Data Lake Bytes 84

Knowledge Hut

APRIL 23, 2024

We live in a data-driven culture where familiarity with databases is crucial. Database management is crucial for businesses of all sizes to guarantee that their data is complete, safe, and easily available when needed. There will likely be a greater need for database specialists' skills in 2024.

Database 52

Database Management Relational Database SQL 52

Knowledge Hut

FEBRUARY 29, 2024

Being a data scientist means constantly growing, enabling businesses to become more data-propelled, and learning newer trends and tools. There are various excellent resources in data science that can help you to develop your skillset. So, having the right knowledge of tools and technology is important for handling such data.

Data Science 98

Data Science Datasets Machine Learning Database Design 98

U-Next

MARCH 8, 2023

For more than 40 years, relational databases have been managed and modified using the programming language SQL (Structured Query Language). Given that it lets organizations efficiently store, retrieve, and analyze massive volumes of data, it has become an essential tool in their daily operations.

SQL 97

SQL Relational Database Database Programming Language 97

AltexSoft

JUNE 7, 2021

Hadoop and Spark are the two most popular platforms for Big Data processing. They both enable you to deal with huge collections of data no matter its format — from Excel tables to user feedback on websites to images and video files. Which Big Data tasks does Spark solve most effectively? How does it work? cost-effectiveness.

Big Data Tools 98

Big Data Tools Hadoop Big Data Database-centric 98

Knowledge Hut

JULY 26, 2023

Database applications have become vital in current business environments because they enable effective data management, integration, privacy, collaboration, analysis, and reporting. Database applications also help in data-driven decision-making by providing data analysis and reporting tools.

Database 52

Database NoSQL Telecommunication MongoDB 52

Data Engineering Podcast

MARCH 13, 2022

Summary Data observability is a term that has been co-opted by numerous vendors with varying ideas of what it should mean. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform.

Data Lake 100

Data Lake Relational Database Data Engineering Data Engineer 100

U-Next

FEBRUARY 27, 2023

Introduction Data is the foundation of the modern world. The importance of data depends on what kind of business you have and what you want to do with it. If you run an e-commerce store, then data will be critical for understanding your customers. Data is growing at a phenomenal rate, with more than 2.5

IT 98

IT Bytes Database Recruitment 98

Knowledge Hut

DECEMBER 26, 2023

Data science is a field of study that works with large amounts of facts and uses splitting tools and methods to uncover hidden patterns, extract useful data, and make business choices. Data scientists use complex machine learning techniques to develop prediction models. Why Should You Learn Data Science?

Data Science 98

Data Science Programming Language Deep Learning Machine Learning 98

Engineering at Meta

OCTOBER 31, 2023

Meta’s Systematic Code and Asset Removal Framework (SCARF) has a subsystem for identifying and removing unused data types. SCARF scans production data systems to identify tables or assets that are unused and safely removes them. Each represents a class of data — not individual records.

Data 108

Data Metadata Coding Systems 108