Christophe Blefari

JANUARY 11, 2025

I have a 15% discount code if you're interested BLEF_AIProductDay25. AI companies are aiming for the moon—AGI—promising it will arrive once OpenAI develops a system capable of generating at least $100 billion in profits. Agents write python code to call tools and orchestrate other agents.

Data 130

Data Data Warehouse Coding Programming Language 130

Engineering at Meta

JANUARY 22, 2025

It is a critical and powerful tool for scalable discovery of relevant data and data flows, which supports privacy controls across Metas systems. It enhances the traceability of data flows within systems, ultimately empowering developers to swiftly implement privacy controls and create innovative products.

Data Warehouse 109

Data Warehouse SQL Programming Language Data 109

The Pragmatic Engineer

NOVEMBER 21, 2023

If you had a continuous deployment system up and running around 2010, you were ahead of the pack: but today it’s considered strange if your team would not have this for things like web applications.  Backend code I wrote and pushed to prod took down Amazon.com for several hours. and hand-rolled C -code.

Engineering 345

Engineering Bytes Cloud Computing AWS 345

The Pragmatic Engineer

MARCH 12, 2024

” They write the specification, code, tests it, and write the documentation. Code reviews reduce the need to pair while working on a task, allowing engineers to keep up with changes and learn from each other. CI/CD : running automated tests on all changes, and deploying code to production automatically. The copilot.

Engineering 329

Engineering Programming Language Hospitality Programming 329

Tweag

MARCH 13, 2023

The dependency is now installed in your Python virtual environment or on your system. You might forget one of the imports you used in your code. FawltyDeps proceeds in three steps: It reads your Python code and Jupyter notebooks and discovers all imports from packages outside the standard library and the project itself (aka.

Python 145

Python Coding Project Systems 145

The Pragmatic Engineer

JUNE 1, 2023

Juraj included system monitoring parts which monitor the server’s capacity he runs the app on: The monitoring page on the Rides app And it doesn’t end here. Juraj created a systems design explainer on how he built this project, and the technologies used: The systems design diagram for the Rides application The app uses: Node.js

Education 364

Education Project PostgreSQL Software Engineer 364

Edureka

APRIL 10, 2025

When you hear the term System Hacking, it might bring to mind shadowy figures behind computer screens and high-stakes cyber heists. In this blog, we’ll explore the definition, purpose, process, and methods of prevention related to system hacking, offering a detailed overview to help demystify the concept.

Systems 40

Systems Education Banking Accessibility 40

Data Engineering Weekly

DECEMBER 28, 2024

Investment in an Agent Management System (AMS) is crucial, as it offers a framework for scaling, monitoring, and refining AI agents. Ananth shares his journey, highlighting how AI tools have reshaped his approach to coding. How will roles change in a world where agents are omnipresent?

Unstructured Data 114

Unstructured Data Metadata Data Government 114

The Pragmatic Engineer

OCTOBER 17, 2024

We recently covered how CockroachDB joins the trend of moving from open source to proprietary and why Oxide decided to keep using it with self-support , regardless Web hosting:  Netlify : chosen thanks to their super smooth preview system with SSR support. Internal comms: Chat: Slack Coordination / project management: Linear 3.

Cloud 332

Cloud AWS Metadata Cloud Computing 332

Snowflake

JANUARY 27, 2025

Experienced engineers in the database space, they wrote a lot of the code that is still powering Snowflake today. Our founders believe every engineer should write code, regardless of seniority. In 2012, Benoit Dageville and Thierry Cruanes founded Snowflake. Developer productivity had a head-count surge to staff up the team.

Programming Language 93

Programming Language Coding Cloud Systems 93

Towards Data Science

JANUARY 30, 2025

That said, this tutorial aims to introduce airflow-parse-bench , an open-source tool I developed to help data engineers monitor and optimize their Airflow environments, providing insights to reduce code complexity and parsetime. When writing Airflow DAGs, there are some important best practices to bear in mind to create optimized code.

Python 48

Python Coding Google Cloud Database 48

The Pragmatic Engineer

MARCH 19, 2024

The company says: “Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork. years ago, and it became the leading AI coding assistant almost overnight. It’s more a copilot.

Software Engineer 327

Software Engineer Software Engineering Programming Language Media 327

Engineering at Meta

JANUARY 21, 2025

Engineers and developers can use this information to identify performance and resource bottlenecks, optimize their code, and improve utilization. Lets say an engineer makes a code change that introduces an unintended copy of some large object on a services critical path. This is also why Strobelight provides ad-hoc profilers.

Technology 114

Technology Metadata Utilities Engineering 114

The Pragmatic Engineer

OCTOBER 10, 2023

However, Martin had not written a line of production code for the last four years, as he’s taken on the role of CEO, and heads up observability scaleup Chronosphere – at more than 250 people and growing. From learning to code in Australia, to working in Silicon Valley How did I learn to code?

Software Engineer 327

Software Engineer Software Engineering Architecture Media 327

Scott Logic

DECEMBER 14, 2024

Advent of Code (AoC) is an annual, christmas-themed, coding competition that has been running for the past years and is something that I participate in at times. It was writing code to complete puzzles that took me half an hour or more, in just seconds! Do not describe your approach, only return the JavaScript code.

Coding 98

Coding Datasets Software Engineer Software Engineering 98

Analytics Vidhya

FEBRUARY 3, 2023

Introduction “Let’s containerize your code to ship worldwide!” Say Harish and Lisa are two people working on the same project but on two different systems(say windows and […] The post Getting Started with The Basics of Docker appeared first on Analytics Vidhya. Well, my friend, this is what Docker is.

Coding 264

Coding Project Systems IT 264

The Pragmatic Engineer

SEPTEMBER 26, 2023

Every day, there’s more code at a tech company, not less. However, monorepos result in codebases growing large, so that even checking out the code or updating to the head can be time consuming. Concern about code leaks. Open source VS Code Server. In 2021, Microsoft open sourced VS Code Server.

Cloud 316

Cloud Software Engineer Software Engineering Cloud Computing 316

Scott Logic

MARCH 6, 2025

While vibe coding embraces AIs ability to generate quick solutions, true progress lies in models that can acknowledge ambiguity, seek clarification, and recognise when they are out of their depth. The gist of vibe coding is simple, let your AI tools worry about the code, you just instruct (prompt) the AI to do your bidding.

Coding 104

Coding Building Utilities Programming 104

The Pragmatic Engineer

SEPTEMBER 22, 2023

Bun has other contributors, but Jared writes the lion’s share of code. Its top focus is performance, and according to benchmarks shared in the launch video , around 10x performance increases can be observed when building packages, running code, or handling inbound requests on a server.

Programming Language 316

Programming Language Project Coding Engineering 316

Snowflake

JUNE 5, 2024

Snowflake AI & ML Studio for LLMs (private preview): Enable users of all technical levels to utilize AI with no-code development. Tabular data, figure synthesis: Get answers from non-free-text structures in your data — such as data specifically formatted and often found in common data storage systems, like databases and spreadsheets.

Coding 115

Coding Building Management Government 115

Data Engineering Podcast

FEBRUARY 18, 2024

As a listener to the Data Engineering Podcast you can get a special discount of 20% off your ticket by using the promo code dataengpod20. What are the pain points that are still prevalent in lakehouse architectures as compared to warehouse or vertically integrated systems? Promo Code: depod20 Starburst : ![Starburst

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Netflix Tech

NOVEMBER 12, 2024

Failures in a distributed system are a given, and having the ability to safely retry requests enhances the reliability of the service. Implementing idempotency would likely require using an external system for such keys, which can further degrade performance or cause race conditions.

Datasets 100

Datasets Computer Science Systems Kafka 100

The Pragmatic Engineer

MAY 1, 2024

The company says: “Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork. years ago, and it became the leading AI coding assistant almost overnight. It’s more a copilot.

Software Engineer 246

Software Engineer Software Engineering Programming Language Media 246

The Pragmatic Engineer

NOVEMBER 9, 2023

What would you do if you learned your company is up to something illegal like stealing customer funds, or you’re asked to make code changes that will enable something illegal to happen, like misleading investors, or defrauding customers? Sign up to The Pragmatic Engineer to get articles like this earlier in your inbox.

Software Engineer 290

Software Engineer Software Engineering Engineering Coding 290

Snowflake

JANUARY 28, 2025

Thats why we are announcing that SnowConvert , Snowflakes high-fidelity code conversion solution to accelerate data warehouse migration projects, is now available for download for prospects, customers and partners free of charge. And today, we are announcing expanded support for code conversions from Amazon Redshift to Snowflake.

Data Warehouse 92

Data Warehouse Professional Services SQL Coding 92

Cloudera

NOVEMBER 13, 2024

LLMs deployed as code assistants accelerate developer efficiency within an organization, ensuring that code meets standards and coding best practices. No-code, low-code, and all-code solutions. Anyone with any skill level can leverage the power of Fine Tuning Studio with or without code.

Datasets 87

Datasets Machine Learning Coding Data Preparation 87

Netflix Tech

DECEMBER 19, 2024

Many of these projects are under constant development by dedicated teams with their own business goals and development best practices, such as the system that supports our content decision makers , or the system that ranks which language subtitles are most valuable for a specific piece ofcontent.

Machine Learning 81

Machine Learning Project Data Warehouse Coding 81

Snowflake

NOVEMBER 6, 2024

Alberta Health Services ER doctors automate note-taking to treat 15% more patients The integrated health system of Alberta, Canada’s third-most-populous province, with 4.5 But Cortex AI worked out of the box, integrating into our system seamlessly and translating into huge productivity gains for the team."

Hospitality 97

Hospitality Medical Government Software Engineer 97

The Pragmatic Engineer

FEBRUARY 29, 2024

But first, a few current cases of systems whose developers didn’t: In Sweden, card payments are down at a leading supermarket chain. Airline Avianca printed tickets dated as 3/1 instead of 2/29, thanks to their system not accounting for the leap day. The system was almost fully restored before noon.”

Software Engineer 281

Software Engineer Software Engineering Banking Engineering 281

Snowflake

JANUARY 28, 2025

Thats why we are announcing that SnowConvert , Snowflakes high-fidelity code conversion solution to accelerate data warehouse migration projects, is now available for download for prospects, customers and partners free of charge. And today, we are announcing expanded support for code conversions from Amazon Redshift to Snowflake.

Data Warehouse 85

Data Warehouse Professional Services SQL Data 85

Data Engineering Podcast

SEPTEMBER 10, 2023

Summary Data systems are inherently complex and often require integration of multiple technologies. Datafold leverages data-diffing to compare production and development environments and column-level lineage to show you the exact impact of every code change on data, metrics, and BI tools, keeping your team productive and stakeholders happy.

BI 208

BI SQL Machine Learning Data 208

dbt Developer Hub

APRIL 20, 2025

Both AI agents and business stakeholders will then operate on top of LLM-driven systems hydrated by the dbt MCP context. Todays system is not a full realization of the vision in the posts shared above, but it is a meaningful step towards safely integrating your structured enterprise data into AI workflows. Why does this matter?

Structured Data 98

Structured Data SQL BI Project 98

Data Engineering Podcast

OCTOBER 29, 2023

This episode is brought to you by Datafold – a testing automation platform for data engineers that finds data quality issues before the code and data are deployed to production. If you are migrating to a modern data stack, Datafold can also help you automate data and code validation to speed up the migration.

Database 189

Database SQL BI Machine Learning 189

Simon Späti

APRIL 6, 2022

With burnout and mental stress at every level of our lives, I find my Personal Knowledge Management (PKM) system even more valuable. As a developer and knowledge worker, I re-use code snippets or create new things. That’s why a PKM system such as a Second Brain to store all of it in a sustainable way is crucial to me.

Management 189

Management Coding Systems IT 189

Engineering at Meta

APRIL 28, 2025

Meta’s vast and diverse systems make it particularly challenging to comprehend its structure, meaning, and context at scale. We discovered that a flexible and incremental approach was necessary to onboard the wide variety of systems and languages used in building Metas products. We believe that privacy drives product innovation.

Metadata 56

Metadata Data Utilities Data Warehouse 56

Netflix Tech

JANUARY 6, 2025

In this case, the main stakeholders are: - Title Launch Operators Role: Responsible for setting up the title and its metadata into our systems. In this context, were focused on developing systems that ensure successful title launches, build trust between content creators and our brand, and reduce engineering operational overhead.

Metadata 87

Metadata Algorithm Systems Building 87