Towards Data Science

DECEMBER 10, 2024

Three Zero-Cost Solutions That Take Hours, NotMonths A data quality certified pipeline. Source: unsplash.com In my career, data quality initiatives have usually meant big changes. From governance processes to costly tools to dbt implementationdata quality projects never seem to want to besmall. Whats more, fixing the data quality issues this way often leads to new problems.

PostgreSQL 75

PostgreSQL Data Python SQL 75

Engineering at Meta

DECEMBER 10, 2024

Were explaining the end-to-end systems the Facebook app leverages to deliver relevant content to people. Learn about our video-unification efforts that have simplified our product experience and infrastructure, in-depth details around mobile delivery, and new features we are working on in our video-content delivery stack. The end-to-end delivery of highly relevant, personalized, timely, and responsive content comes with complex challenges.

Systems 68

Systems Architecture Engineering Data Pipeline 68

ArcGIS

DECEMBER 10, 2024

Explore Density tools in ArcGIS Pro for spatial data analysis to reveal hidden patterns and effective visualization to aid in informed decision-making.

Data Analysis 109

Data Analysis Data 109

databricks

DECEMBER 10, 2024

Data engineering teams are frequently tasked with building bespoke ingestion solutions for myriad custom, proprietary, or industry-specific data sources. Many teams find that.

Data Ingestion 105

Data Ingestion Python Data Data Engineering 105

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

Sync Computing

DECEMBER 10, 2024

Databricks is a quickly evolving platform with several compute options available for users, leaving many with a difficult choice. In this blog post, we look at three popular options for scheduled jobs using Databricks own TPC-DI benchmark suite. By the way, kudos to the Databricks team for creating such a fantastic test package. We highly encourage anybody here to use it for their own internal testing.

SQL 59

SQL Raw Data Cloud AWS 59

Confluent

DECEMBER 10, 2024

Confluent Platform 7.8 brings Confluent Platform for Apache Flink (GA), mTLS Identity for RBAC Authorization, and more.

59

59

databricks

DECEMBER 10, 2024

Inspiration Going on vacation is an enjoyable experience, but planning the trip can take time and effort for most people. There are numerous.

Systems 52

Systems Building Entertainment Media 52