Tue.Apr 09, 2024

article thumbnail

Shutting Down My Job Board for Software Engineering Positions After 2.5 Years

The Pragmatic Engineer

I started The Pragmatic Engineer Job Board in October 2021. 2.5 years later, I am shutting it down permanently, despite a reasonable success in traction. The shutdown was triggered by my vendor – Pallet – discontinuing their job board and talent collective approach. However, I might have eventually come to the same decision myself, even without Pallet making this call.

article thumbnail

Bringing MegaBlocks to Databricks

databricks

At Databricks, we’re committed to building the most efficient and performant training tools for large-scale AI models. With the recent release of DBRX.

Building 138
article thumbnail

Convert Python Dict to JSON: A Tutorial for Beginners

KDnuggets

Learn how to convert a Python dictionary to JSON with this quick tutorial.

Python 135
article thumbnail

Writing Apache Spark with Rust! Spark Connect Introduced.

Confessions of a Data Guy

I never thought I would live to see the day, it’s crazy. I’m not sure who’s idea it was to make it possible to write Apache Spark with Rust, Golang, or Python … but they are all genius. As of Apache Spark 3.4 it is now possible to use Spark Connect … a thin API […] The post Writing Apache Spark with Rust! Spark Connect Introduced. appeared first on Confessions of a Data Guy.

Python 100
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

The Case of Homegrown Large Language Models

KDnuggets

Recent developments in building large language models (LLMs) to boost generative AI in local languages have caught everyone’s attention. This post focuses on the needs and challenges of homegrown LLMs amid the fast-evolving technology landscape.

article thumbnail

What is Agile and How Does It Work?

Knowledge Hut

Agile began as an iterative, collaborative, value-driven approach to developing software. It was originally conceived as a framework to help structure work on complex projects with dynamic, unpredictable characteristics. But since then, it has evolved into somewhat of a philosophy or worldview with a set of well-articulated values and principles that it shares with Agmany Agilearieties.

IT 98

More Trending

article thumbnail

Kotlin Flows - The Ultimate Guide

Rock the JVM

By Riccardo Cardin Video version: In the article Kotlin Coroutines—A Comprehensive Introduction , we saw how to use Kotlin Coroutines to write asynchronous code in a more natural and readable way. This article will focus on another crucial concept in Kotlin Coroutines: Kotlin flows. Flows are a data structure you didn’t know, but you can’t live without them once you know them.

article thumbnail

Threat Modeling at Ripple

Ripple Engineering

Background Hi, I’m Andrew Hoffman , a Senior Staff Security Engineer on Ripple’s Product Security team. My team is making use of a process known as threat modeling in order to assist our software engineers in building more secure products and features. My hope is that by the end of this post you'll not only have gained insight into Ripple’s threat modeling methodology, you’ll also have developed a sense of why threat modeling is important and how an effective thr

Coding 59
article thumbnail

Kotlin 101: Flows Quickly Explained

Rock the JVM

This article delves into Kotlin Flows: a crucial reactive data structure in Kotlin Coroutines that, once discovered, becomes indispensable

Data 52
article thumbnail

Driving Innovation with Data: In partnership with FreshBI

FreshBI

Company Description – Innovative Organic Food Producer A leading organic food producer is committed to delivering high-quality, innovative products to its customers. With a focus on sustainable and health-conscious choices, they seek to continuously enhance their ability to track and analyze the performance of their new innovative items and product groupings.

Food 52
article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

The Cost of Bad Data

Monte Carlo

When data engineers tell scary stories around a campfire, it’s usually a cautionary tale about bad data. Data downtime can occur suddenly at any time—and often not when or where you’re looking for it. And its cost is the scariest part of all. But just how much can data downtime actually cost your business? In this article, we’ll learn from a real-life data downtime horror story to understand the cost of bad data, its impacts, and how to prevent it.

Data 52
article thumbnail

A Complete Guide on Project Documentation

Knowledge Hut

There are many project managers who feel that documentation is an arduous task. It takes up considerable time and effort—and they might feel that there are many other pressing tasks that require more immediate focus, and documentation can easily be relegated to the back burner! However, nothing can be further from the truth. Proper documentation ensures that project expectations are met, deliverables are on track, and tasks can be easily traced.

Project 52
article thumbnail

What Is Project Description: Key Criteria and Steps

Knowledge Hut

Before we discuss what comprises a project description, it's essential to understand what we're trying to describe in the first place, i.e., the project itself. Simply put, a project is a unique and temporary endeavor, with a fixed beginning and end. Every project aims to produce results, and this may be in the form of a product or service just the way a PMP Certification does for budding professionals.

Project 52
article thumbnail

DevOps Methodologies: Understanding the Practices & Principles

Knowledge Hut

In a fast-paced and ever-changing world, organizations are always looking for ways to become more efficient and get an edge over the competition. One way of doing this is through DevOps methodologies. DevOps is a combination of methodologies to increase software development speed, efficiency, and security compared to traditional processes. DevOps methodologies also involve practices and principles that help organizations achieve control in the market, reduce costs, and improve quality.

Coding 52
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

What is Project Management Experience & How to Get It?

Knowledge Hut

Over the past few years, the project management industry has been booming. Hence there is a constant need for professionals with comprehensive project management experience and aptitudes as modern enterprises become more project oriented. So, if you have ever worked on any business aspects related to leading, planning, directing, and handling projects, it implies that you have relevant PMP experience.

Project 52