Cloudera

FEBRUARY 22, 2022

Over the past decade, the successful deployment of large scale data platforms at our customers has acted as a big data flywheel driving demand to bring in even more data, apply more sophisticated analytics, and on-board many new data practitioners from business analysts to data scientists.

Metadata 110

Metadata Datasets BI SQL 110

Striim

AUGUST 29, 2023

We are proud to announce that Striim has successfully achieved Google Cloud Ready – Cloud SQL Designation for Google Cloud’s fully managed relational database service for MySQL, PostgreSQL, and SQL Server.

Google Cloud 52

Google Cloud SQL Cloud Designing 52

Monte Carlo

OCTOBER 31, 2024

Key Differences Between AI Data Engineers and Traditional Data Engineers While traditional data engineers and AI data engineers have similar responsibilities, they ultimately differ in where they focus their efforts.

Data Engineering 52

Data Engineering Data Engineer Engineering Unstructured Data 52

Towards Data Science

OCTOBER 25, 2023

Not too long ago, almost all data architectures and data team structures followed a centralized approach. As a data or analytics engineer, you knew where to find all the transformation logic and models because they were all in the same codebase. Your organization may be undergoing the decentralization of data.

Data Pipeline 98

Data Pipeline SQL Data Architecture Data 98

Edureka

APRIL 9, 2025

Development of Some Relevant Skills and Knowledge Data Engineering Fundamentals: Theoretical knowledge of data loading patterns, data architectures, and orchestration processes. Data Analytics: Capability to effectively use tools and techniques for analyzing data and drawing insights.

Engineering 40

Engineering Data Ingestion Data Lake Programming Language 40

Data Engineering Podcast

AUGUST 20, 2021

Summary Data lakes have been gaining popularity alongside an increase in their sophistication and usability. Despite improvements in performance and data architecture they still require significant knowledge and experience to deploy and manage. The data you’re looking for is already in your data warehouse and BI tools.

Building 100

Building Data Lake Data Warehouse SQL 100

ProjectPro

FEBRUARY 16, 2023

At the heart of these data engineering skills lies SQL that helps data engineers manage and manipulate large amounts of data. Did you know SQL is the top skill listed in 73.4% of data engineer job postings on Indeed? Almost all major tech organizations use SQL. use SQL, compared to 61.7%

Data Engineering 52

Data Engineering Data Engineer SQL Engineering 52

Cloudera

MAY 10, 2024

Iceberg, a high-performance open-source format for huge analytic tables, delivers the reliability and simplicity of SQL tables to big data while allowing for multiple engines like Spark, Flink, Trino, Presto, Hive, and Impala to work with the same tables, all at the same time.

Government 103

Government Data Governance Big Data Data Pipeline 103

Confluent

JULY 17, 2019

Together, MongoDB and Apache Kafka ® make up the heart of many modern data architectures today. This API enables users to leverage ready-to-use components that can stream data from external systems into Kafka topics, as well as stream data from Kafka topics into external systems.

MongoDB 21

MongoDB Kafka Database Medical 21

Snowflake

JANUARY 30, 2023

And for the few small issues we had with configuration or SQL differences, I was able to bounce ideas around with Snowflake’s startup team. Ramp transforms performance and overcomes data processing challenges With a new system that can scale with its growing datasets, du Toit and his team have been able to transform performance.

Data Architecture 52

Data Architecture Architecture Management Datasets 52

Data Engineering Podcast

APRIL 3, 2022

Atlan is a collaborative workspace for data-driven teams, like Github for engineering or Figma for design teams. Datafold built automated regression testing to help data and analytics engineers deal with data quality in their pull requests. No more shipping and praying, you can now know exactly what will change in your database!

Data Warehouse 100

Data Warehouse Data Workflow Data Architecture SQL 100

Data Engineering Podcast

OCTOBER 7, 2019

Summary The process of exposing your data through a SQL interface has many possible pathways, each with their own complications and tradeoffs. One of the recent options is Rockset, a serverless platform for fast SQL analytics on semi-structured and structured data. Visit Datacoral.com today to find out more.

Structured Data 100

Structured Data Cloud SQL Programming Language 100

Snowflake

NOVEMBER 2, 2023

And, since historically tools and commercial platforms were often designed to align with one specific architecture pattern, organizations struggled to adapt to changing business needs – which of course has implications on data architecture.

Data Lake 115

Data Lake Data Warehouse Cloud Unstructured Data 115

Data Engineering Podcast

SEPTEMBER 1, 2021

Summary The Presto project has become the de facto option for building scalable open source analytics in SQL for the data lake. Atlan is a collaborative workspace for data-driven teams, like Github for engineering or Figma for design teams. Can you describe what Ahana is and the story behind it?

Data Lake 100

Data Lake Cloud AWS SQL 100

Data Engineering Podcast

OCTOBER 2, 2021

Atlan is a collaborative workspace for data-driven teams, like Github for engineering or Figma for design teams. What are the driving factors for building a real-time data platform? How is Aerospike being incorporated in application and data architectures? Can you describe how the Aerospike engine is architected?

Building 100

Building BI Data Architecture Architecture 100

AltexSoft

FEBRUARY 11, 2023

This specialist works closely with people on both business and IT sides of a company to understand the current needs of the stakeholders and help them unlock the full potential of data. To get a better understanding of a data architect’s role, let’s clear up what data architecture is.

Data Architect 87

Data Architect Certification Generalist Big Data 87

Monte Carlo

AUGUST 30, 2024

We started with popular modern data warehouses and quickly expanded our support as data lakes became data lakehouses. Ensuring Data Quality In Dremio Dremio and its SQL Query Engine efficiently queries (but doesn’t move) data across a diverse set of sources. And now, Dremio!

SQL 40

SQL Engineering Data Lake High Quality Data 40

Cloudera

MARCH 23, 2022

In fact, we recently announced the integration with our cloud ecosystem bringing the benefits of Iceberg to enterprises as they make their journey to the public cloud, and as they adopt more converged architectures like the Lakehouse. 1: Multi-function analytics . 2: Open formats. Reproducibility for ML Ops. Flexible and open file formats.

Metadata 92

Metadata Data Architecture BI Machine Learning 92

Data Engineering Podcast

OCTOBER 14, 2019

Summary Managing a data warehouse can be challenging, especially when trying to maintain a common set of patterns. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo! and Facebook, scaling from mere terabytes to petabytes of analytic data. Visit Datacoral.com today to find out more.

Data Warehouse 100

Data Warehouse PostgreSQL AWS Programming Language 100

Data Engineering Podcast

SEPTEMBER 3, 2021

The data you’re looking for is already in your data warehouse and BI tools. Connect your warehouse to Hightouch, paste a SQL query, and use their visual mapper to specify how data should appear in your SaaS systems. No more scripts, just SQL. How do you measure the success of a data platform?

Designing 100

Designing Building SQL BI 100

phData: Data Engineering

NOVEMBER 8, 2024

Additionally, the optimized query execution and data pruning features reduce the compute cost associated with querying large datasets. Scaling data infrastructure while maintaining efficiency is one of the primary challenges of modern data architecture. Amazon S3, Azure Data Lake, or Google Cloud Storage).

Architecture 52

Architecture Systems Data Lake Google Cloud 52

Cloudera

JUNE 18, 2022

In a rush to own this term, many vendors have lost sight of the fact that the openness of a data architecture is what guarantees its durability and longevity. On data warehouses and data lakes. Data lakes and data warehouses unify large volumes and varieties of data into a central location.

Data Lake 94

Data Lake Data Warehouse BI SQL 94

Cloudera

DECEMBER 21, 2021

We are excited to offer in Tech Preview this born-in-the-cloud table format that will help future proof data architectures at many of our public cloud customers. Modernizing pipelines. CDP Airflow Operators.

Data Engineering 118

Data Engineering Data Engineer Engineering Data Pipeline 118

Data Engineering Podcast

JULY 3, 2022

Datafold built automated regression testing to help data and analytics engineers deal with data quality in their pull requests. Datafold shows how a change in SQL code affects your data, both on a statistical level and down to individual rows and values before it gets merged to production.

Architecture 100

Architecture Metadata MongoDB Data Warehouse 100

Data Engineering Podcast

OCTOBER 21, 2019

Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo! and Facebook, scaling from terabytes to petabytes of analytic data. He started Datacoral with the goal to make SQL the universal data programming language. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo!

Cloud 100

Cloud Hadoop Data Lake Programming Language 100

Snowflake

DECEMBER 12, 2023

To give customers flexibility for how they fit Snowflake into their data architecture, Iceberg Tables can be configured to use either Snowflake or an external service such as AWS Glue as the table’s catalog to track metadata, with an easy, one-line SQL command to convert the table’s catalog to Snowflake in a metadata-only operation.

Metadata 118

Metadata Python Government AWS 118

Data Engineering Podcast

JULY 8, 2019

We have partnered with organizations such as O’Reilly Media, Dataversity, and the Open Data Science Conference. Coming up this fall is the combined events of Graphorum and the Data Architecture Summit. What are some of the advanced capabilities, such as SQL extensions, supported data types, etc.

Data Warehouse 100

Data Warehouse MySQL Hadoop Data Lake 100

Snowflake

JULY 22, 2024

The benefits of migrating to Snowflake start with its multi-cluster shared data architecture, which enables scalability and high performance. Finalizing the new business capabilities and use cases to be enabled in the next phases. Features such as auto-suspend and a pay-as-you-go model help you save costs.

Government 119

Government Data Cloud Hadoop 119

Data Engineering Podcast

DECEMBER 8, 2019

Contact Info LinkedIn Website @KentGraziano on Twitter Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Warehouse 100

Data Warehouse Cloud AWS Relational Database 100

Towards Data Science

FEBRUARY 15, 2023

In this context, data management in an organization is a key point for the success of its projects involving data. One of the main aspects of correct data management is the definition of a data architecture. First, let’s write the data from 2016 to the delta table. load("/data/acidentes/datatran2016.csv")

Data Lake 98

Data Lake Data Warehouse Hadoop Architecture 98

Data Engineering Podcast

JUNE 16, 2019

We have partnered with organizations such as O’Reilly Media, Dataversity, and the Open Data Science Conference. Coming up this fall is the combined events of Graphorum and the Data Architecture Summit. We have partnered with organizations such as O’Reilly Media, Dataversity, and the Open Data Science Conference.

Data Lake 100

Data Lake Lambda Architecture Data Warehouse Hadoop 100

Cloudera

SEPTEMBER 28, 2020

ACID transactions, ANSI 2016 SQL SupportMajor Performance improvements. The data lifecycle model ingests data using Kafka, enriches that data with Spark-based batch process, performs deep data analytics using Hive and Impala, and finally uses that data for data science using Cloudera Data Science Workbench to get deep insights.

Cloud 132

Cloud Kafka Professional Services Metadata 132

Cloudera

JUNE 30, 2022

Companies, on the other hand, have continued to demand highly scalable and flexible analytic engines and services on the data lake, without vendor lock-in. Organizations want modern data architectures that evolve at the speed of their business and we are happy to support them with the first open data lakehouse. .

Data Lake 88

Data Lake Business Intelligence Metadata Data Warehouse 88

Edureka

APRIL 14, 2025

Meanwhile, the visualization tool offers wide-ranging data connectors—from Azure SQL and SharePoint to Salesforce and Google Analytics—enabling quick access to structured and semi-structured data. However, it leans more toward transforming and presenting cleaned data rather than processing raw datasets.

BI 40

BI Business Intelligence Raw Data Retail 40

Striim

SEPTEMBER 11, 2024

Data pipelines are the backbone of your business’s data architecture. Implementing a robust and scalable pipeline ensures you can effectively manage, analyze, and organize your growing data. Understanding the essential components of data pipelines is crucial for designing efficient and effective data architectures.

Data Pipeline 98

Data Pipeline Designing Data Lake Data Warehouse 98

Cloudera

NOVEMBER 27, 2023

Many architects and team leaders expressed to us a desire to democratize stream processing to larger user bases, especially SQL analysts and/or a desire to move from manual configuration and maintenance of Flink environments to more of a PaaS model to maintain performance while freeing up development resources.

Kafka 84

Kafka SQL ETL Tools Architecture 84

Confluent

JUNE 18, 2019

Who has never seen an application use RDBMS SQL statements to run searches? Using SQL to run your search might be enough for your use case, but as your project requirements grow and more advanced features are needed—for example, enabling synonyms, multilingual search, or even machine learning—your relational database might not be enough.

Architecture 97

Architecture Building Kafka Database-centric 97