Snowflake

DECEMBER 20, 2023

To expand the capabilities of the Snowflake engine beyond SQL-based workloads, Snowflake launched Snowpark , which added support for Python, Java and Scala inside virtual warehouse compute. The team is moving fast to make Snowpark Container Services available across all AWS regions, with support for other clouds to follow.

Scala 139

Scala Government Java Cloud 139

Data Engineering Podcast

JUNE 19, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Metadata 130

Metadata MongoDB MySQL Scala 130

Zalando Engineering

APRIL 12, 2023

Some teams use tools like dependabot , scala-steward that create pull requests in repositories when new library versions are available. Another insight from analyzing the SBOM data was our usage of the AWS SDK. Dependency hygiene Dependency updates are a tedious task when maintaining thousands of microservices.

Java 98

Java Scala Python Metadata 98

Data Engineering Podcast

SEPTEMBER 9, 2018

Given that the S3 API has become a de facto standard for many other object storage platforms, what would be involved in running Chaos Search on data stored outside of AWS? Given that the S3 API has become a de facto standard for many other object storage platforms, what would be involved in running Chaos Search on data stored outside of AWS?

IT 100

IT PostgreSQL Scala AWS 100

Cloudera

JULY 13, 2021

After the launch of CDP Data Engineering (CDE) on AWS a few months ago, we are thrilled to announce that CDE, the only cloud-native service purpose built for enterprise data engineers, is now available on Microsoft Azure. . CDE supports Scala, Java, and Python jobs.

Data Engineering 127

Data Engineering Data Engineer Engineering Pipeline-centric 127

Snowflake

SEPTEMBER 7, 2023

Snowpark is the set of libraries and runtimes that enables data engineers, data scientists and developers to build data engineering pipelines, ML workflows, and data applications in Python, Java, and Scala. With this announcement, External Access is in public preview on Amazon Web Services (AWS) regions.

Amazon Web Services 134

Amazon Web Services AWS Government Python 134

ProjectPro

JANUARY 24, 2023

A survey by Data Warehousing Institute TDWI found that AWS Glue and Azure Data Factory are the most popular cloud ETL tools with 69% and 67% of the survey respondents mentioning that they have been using them. Azure Data Factory and AWS Glue are powerful tools for data engineers who want to perform ETL on Big Data in the Cloud.

AWS 52

AWS Cloud Amazon Web Services ETL Tools 52

Data Engineering Podcast

JUNE 12, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Unstructured Data 130

Unstructured Data MongoDB MySQL Scala 130

Data Engineering Podcast

DECEMBER 9, 2018

Book Discount Use the code poddataeng18 to get 40% off of all of Manning’s products at manning.com Links Apache Spark Spark In Action Book code examples in GitHub Informix International Informix Users Group MySQL Microsoft SQL Server ETL (Extract, Transform, Load) Spark SQL and Spark In Action ‘s chapter 11 Spark ML and Spark In Action (..)

MySQL 100

MySQL Scala Kafka Hadoop 100

Monte Carlo

OCTOBER 31, 2024

In addition, AI data engineers should be familiar with programming languages such as Python , Java, Scala, and more for data pipeline, data lineage, and AI model development.

Data Engineering 52

Data Engineering Data Engineer Engineering Unstructured Data 52

Edureka

JULY 4, 2024

It is a cloud-based service by Amazon Web Services (AWS) that simplifies processing large, distributed datasets using popular open-source frameworks, including Apache Hadoop and Spark. Let’s see what is AWS EMR, its features, benefits, and especially how it helps you unlock the power of your big data. What is EMR in AWS?

AWS 52

AWS Amazon Web Services Hadoop Big Data 52

ProjectPro

JANUARY 24, 2023

With over 20 pre-built connectors and 40 pre-built transformers, AWS Glue is an extract, transform, and load (ETL) service that is fully managed and allows users to easily process and import their data for analytics. AWS Glue Job Interview Questions For Experienced Mention some of the significant features of AWS Glue.

AWS 52

AWS Data Lake ETL Tools Scala 52

Data Engineering Podcast

NOVEMBER 6, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

MongoDB 130

MongoDB MySQL Scala Machine Learning 130

ProjectPro

FEBRUARY 16, 2023

ETL is a critical component of success for most data engineering teams, and with teams harnessing it with the power of AWS, the stakes are higher than ever. AWS refers to Amazon Web Service, the most widely used cloud computing system. AWS offers cloud services to businesses and developers, assisting them in maintaining agility.

AWS 52

AWS Data Management ETL Tools Management 52

Knowledge Hut

SEPTEMBER 29, 2023

As an expert in the dynamic world of cloud computing, I am always amazed by the variety of job prospects provided by Amazon Web Services (AWS). Having an Amazon AWS online course certification in your possession will allow you to showcase the most sought-after skills in the industry. Who is an AWS Engineer?

AWS 52

AWS Amazon Web Services Cloud Computing Programming Language 52

Data Engineering Podcast

AUGUST 21, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Lambda Architecture 100

Lambda Architecture MongoDB MySQL Scala 100

Confluent

JUNE 7, 2019

Loading involves batching and storing data in Avro for replay and schema evolution, as well as in Parquet for optimized batch processing in AWS Athena. To interface with the peer-to-peer network, we have node templates written in Terraform, which allow us to easily deploy and bootstrap nodes across the planet in different AWS regions.

Accessibility 93

Accessibility Accessible Kafka Scala 93

Knowledge Hut

NOVEMBER 17, 2023

AWS has changed the life of data scientists by making all the data processing, gathering, and retrieving easy. One popular cloud computing service is AWS (Amazon Web Services). Many people are going for Data Science Courses in India to leverage the true power of AWS. What is Amazon Web Services (AWS)?

AWS 52

AWS Data Science Certification Amazon Web Services 52

Knowledge Hut

MAY 3, 2024

Spark offers over 80 high-level operators that make it easy to build parallel apps and one can use it interactively from the Scala, Python, R, and SQL shells. The core is the distributed execution engine and the Java, Scala, and Python APIs offer a platform for distributed ETL application development. Basic knowledge of SQL.

Hadoop 98

Hadoop Scala Healthcare Big Data 98

Data Engineering Podcast

OCTOBER 16, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Data Lake 100

Data Lake Food MongoDB MySQL 100

Data Engineering Podcast

OCTOBER 30, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Engineering 100

Engineering MongoDB MySQL Scala 100

Data Engineering Podcast

SEPTEMBER 11, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Data Pipeline 130

Data Pipeline Building MongoDB MySQL 130

Data Engineering Podcast

MARCH 1, 2021

Links Iguazio MLOps Oracle Exadata SAP HANA Mellanox NVIDIA Multi-Model Database Nuclio MLRun Jupyter Notebook Pandas Scala Feature Imputing Feature Store Parquet Spark Apache Flink Podcast Episode Apache Beam NLP (Natural Language Processing) Deep Learning BERT Airflow Podcast.__init__

Machine Learning 100

Machine Learning Data Warehouse Scala Hadoop 100

Data Engineering Podcast

MAY 22, 2022

To help other people find the show please leave a review on iTunes and tell your friends and co-workers Links Prophecy Podcast Episode CUDA Clustrix Hortonworks Apache Hive Compilerworks Podcast Episode Airflow Databricks Fivetran Podcast Episode Airbyte Podcast Episode Streamsets Change Data Capture Apache Pig Spark Scala Ab Initio Type 2 Slowly Changing (..)

Scala 100

Scala SQL Data Data Engineering 100

Data Engineering Podcast

JULY 17, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Data Engineering Podcast

AUGUST 13, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Metadata 100

Metadata MongoDB MySQL Scala 100

Snowflake

MARCH 29, 2023

Iceberg supports many catalog implementations: Hive, AWS Glue, Hadoop, Nessie, Dell ECS, any relational database via JDBC, REST, and now Snowflake. show() And you’re not limited to only SQL—you can also query using DataFrames with other languages like Python and Scala. First, let’s see what tables are available to query.

Metadata 105

Metadata Scala Hadoop Relational Database 105

Data Engineering Podcast

APRIL 22, 2019

Go to dataengineeringpodcast.com/segmentio today to sign up for their startup plan and get $25,000 in Segment credits and $1 million in free software from marketing and analytics companies like AWS, Google, and Intercom.

Database 100

Database Cloud NoSQL Scala 100

Data Engineering Podcast

NOVEMBER 18, 2019

This week’s episode is also sponsored by Datacoral, an AWS-native, serverless, data infrastructure that installs in your VPC. This week’s episode is also sponsored by Datacoral, an AWS-native, serverless, data infrastructure that installs in your VPC. And don’t forget to thank them for their continued support of this show!

Data Lake 100

Data Lake Scala Data Warehouse Hadoop 100

Data Engineering Podcast

MAY 29, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Database 100

Database Architecture Data Architecture PostgreSQL 100

Data Engineering Podcast

JUNE 5, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Data Security 100

Data Security Metadata MongoDB MySQL 100

Data Engineering Podcast

JULY 3, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Data Integration 100

Data Integration MongoDB MySQL Scala 100

Data Engineering Podcast

JULY 10, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Data Engineering Podcast

JULY 24, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

MongoDB 100

MongoDB MySQL Scala Data Lake 100

Data Engineering Podcast

JULY 31, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Data Analysis 100

Data Analysis MongoDB Algorithm MySQL 100

Data Engineering Podcast

SEPTEMBER 18, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Hospitality 100

Hospitality Food MongoDB MySQL 100

Data Engineering Podcast

SEPTEMBER 25, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Ascend automates workloads on Snowflake, Databricks, BigQuery, and open source Spark, and can be deployed in AWS, Azure, or GCP.

Food 100

Food MongoDB MySQL Scala 100