The Pragmatic Engineer

NOVEMBER 29, 2024

The last 12 months, The Pragmatic Engineer covered a variety of deepdives, revealing previously unshared details like: * What Stripe's engineering culture is like * The architecture evolution of Bluesky * How the ChatGPT scaled to meet demand * How Anthropic builds products * How and why hardware startup Oxide built two new computers from

Engineering 133

Engineering Architecture Building Computer Science 133

Confessions of a Data Guy

NOVEMBER 29, 2024

Well, another turkey day has come upon us all. I trust you are getting at least a day or two off from your overlords from writing code and taking names. While the rest of you will be slicing up that turkey with your friends and family, clinking your glasses and giving toasts to each other, […] The post Turkey Day Is Here – Black Friday Sale – %50 Off appeared first on Confessions of a Data Guy.

Coding 100

Coding Data 100

KDnuggets

NOVEMBER 29, 2024

Working with large datasets is common but challenging. Here are some tips to make working with such large datasets in Python simpler.

Datasets 110

Datasets Python 110

RandomTrees

NOVEMBER 29, 2024

Considering how most industries have rapidly evolved thanks to technology, upgrading grids has been of utmost importance for utility companies out there. With the increasing demand for energy and renewable energy transition progressing forward, the older grid systems fall behind because they cannot meet the efficiency, reliability, and sustainability targets.

Utilities 52

Utilities Big Data Algorithm Finance 52

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

KDnuggets

NOVEMBER 29, 2024

This is a collection of the 10 most frequently used Conda commands that every data scientist, machine learning engineer, or Python developer should have at their fingertips.

Data Science 91

Data Science Machine Learning Python Data 91

Hevo

NOVEMBER 29, 2024

With so many data integration tools available these days, it can become very overwhelming to choose one that best suits your needs. Here in this blog post, I have broken down an all-comprehensive comparison of two leading platforms: Airbyte VS Stitch.  So, let’s get into the main discussion.

Data Integration 52

Data Integration Data Pipeline Data IT 52

Hevo

NOVEMBER 29, 2024

When searching for a reliable data integration platform, many options might cross your mind. However, Hevo Data stands out as a no-code, fully managed solution. Recognized in G2’s Fall 2021 report, Hevo delivers unmatched ease of use, setup simplicity, and comprehensive support.

Data Engineering 40

Data Engineering Data Engineer Engineering Data Integration 40

Hevo

NOVEMBER 29, 2024

An ETL tool, which has become the critical choice for any organization today, is tied directly to the ever-growing importance of data integration. However, both Matillion and Talend are among the most used ETL tools, providing different functionalities suited to different business needs.

ETL Tools 40

ETL Tools Data Integration IT Data 40

Hevo

NOVEMBER 29, 2024

Data is everywhere. We make huge amounts of data every day from our social media interactions to the things we buy online. According to expert predictions, data will globally surpass 175 zettabytes by 2025, a figure that is nearly unfathomable.

Data Analysis 40

Data Analysis Data Analytics Media Data 40

Hevo

NOVEMBER 29, 2024

Databricks is a well-known cloud-based data engineering, processing, and analytics platform. One of its key functions is DATEDIFF(date_diff()) used by data professionals widely. The DATEDIFF function in Databricks is very helpful in analyzing time-based data. Using this function helps the user do complex operations like finding time differences between two date values.

Data Engineering 40

Data Engineering Data Engineer Cloud Engineering 40

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data