The Pragmatic Engineer

SEPTEMBER 19, 2024

This is a follow-up to the article Paying down tech debt , written by industry veteran Lou Franco. Lou has been in the software business for over 30 years as an engineer, EM, and executive. He’s also worked at four startups and the companies that later acquired them; most recently Atlassian as a Principal Engineer on the Trello iOS app. Later this year, he’s publishing a book on tech debt.

Recruitment 176

Recruitment Java Coding Project 176

KDnuggets

SEPTEMBER 19, 2024

In Python, functions often require multiple arguments, and you may find yourself repeatedly passing the same values for certain parameters. This is where partial functions can help. Python’s built-in functools module allows you to create partial functions.

Python 148

Python 148

databricks

SEPTEMBER 19, 2024

Mosaic AI Model Training now supports fine-tuning up to 131K context length for Llama 3.1 models. More efficient training at long sequence lengths is made possible by several optimizations highlighted in this post.

138

138

KDnuggets

SEPTEMBER 19, 2024

ggplot2 is a tool in R for making charts. You can create charts with dots, bars, or lines. You can also add layers to show more details. This article will help you learn how to use ggplot2 to create visualizations. Getting started with ggplot2 Before using ggplot2, you need to install it and.

Data 131

Data IT 131

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

databricks

SEPTEMBER 19, 2024

Today, we're excited to introduce Databricks Assistant Quick Fix , a powerful new feature designed to automatically correct common, single-line errors such as.

Designing 122

Designing 122

KDnuggets

SEPTEMBER 19, 2024

Image generated with FLUX.1 [dev] and edited with Canva Pro The 10 GitHub Repository Education Series has been a hit among readers, so here is another list to help you master the basics of deep learning. This collection will guide you through understanding popular deep learning frameworks and various model architectures. In short, you.

Deep Learning 128

Deep Learning Education Architecture 128

Confessions of a Data Guy

SEPTEMBER 19, 2024

It is a Brave New World out there these days. The new tools and features come out faster than your mom on Sunday morning getting you ready for church. The same goes for the context and advice being produced on a myriad of platforms, the ole’ Like and Subscribe, and all that bit. It does […] The post Data Modeling in the Brave New Lakehouse World appeared first on Confessions of a Data Guy.

Data 113

Data IT Data Engineer Data Engineering 113

Snowflake

SEPTEMBER 19, 2024

Data is increasingly becoming critical for the public sector — from guiding decisions in higher education to enhancing citizen services and streamlining government operations. Government agencies are overwhelmed with data, whether it be structured, like incident logs, or unstructured, like satellite images. Harnessing the vast amount of data can become a burden for any organization, yet the insights have the potential to significantly improve quality of life and strengthen national security.

Government 83

Government Education Data Analytics Engineering 83

Precisely

SEPTEMBER 19, 2024

Key Takeaways: Data integrity is essential for AI success and reliability – helping you prevent harmful biases and inaccuracies in AI models. Robust data governance for AI ensures data privacy, compliance, and ethical AI use. Proactive data quality measures are critical, especially in AI applications. Using AI systems to analyze and improve data quality both benefits and contributes to the generation of high-quality data.

Data Governance 78

Data Governance Government High Quality Data Datasets 78

ArcGIS

SEPTEMBER 19, 2024

Guide to TEMPO NO2 multidimensional analysis in ArcGIS Pro 3.3. Track air quality changes and gain insights for public health and environmental monitoring.

Data 64

Data 64

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Pinterest Engineering

SEPTEMBER 19, 2024

Li Tang; Sr. Software Engineer | Saurabh Vishwas Joshi; Sr. Staff Software Engineer | Zhiyuan Zhang; Sr. Manager, Engineering | At Pinterest, we operate a large-scale online machine learning inference system, where feature caching plays a critical role to achieve optimal efficiency. In this blog post, we will discuss our decision to adopt Cachelib project by Meta Open Source (“Cachelib”) and how we have built a high-throughput, flexible feature cache by leveraging and expanding upon the capabili

Systems 57

Systems Utilities Architecture Software Engineer 57

Striim

SEPTEMBER 19, 2024

What makes MotherDuck and DuckDB a game-changer for data analytics? Join us as we sit down with Jacob Matson, a renowned expert in SQL Server, dbt, and Excel, who recently became a developer advocate at MotherDuck. During this episode, Jacob shares his compelling journey to MotherDuck, driven by his frequent use of DuckDB for solving data challenges.

BI 52

BI Big Data SQL Utilities 52

Knowledge Hut

SEPTEMBER 19, 2024

Are you working on many big projects with lots of smaller tasks that all depend on each other? If you become a PgMP-certified pro, you can make things run smoothly. You can learn more about this by taking a PgMP certification course. Getting PgMP certified doesn't just help your career—it also teaches you important things about how organizations work.

Certification 52

Certification Education Programming Project 52

Snowflake

SEPTEMBER 19, 2024

Building on the momentum from Snowflake Summit , where Snowflake announced the rollout of dozens of new features, this year’s Industry Day showcased the numerous ways these capabilities can be put to use, particularly in an AI- and ML-driven world. In his keynote address , Snowflake CEO Sridhar Ramaswamy explained how the AI Data Cloud aligns with customers’ AI and data strategies, highlighting the platform’s unique position to achieve enterprise AI goals.

Telecommunication 98

Telecommunication Hospitality Entertainment Retail 98

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud