The Pragmatic Engineer

NOVEMBER 21, 2023

Backend code I wrote and pushed to prod took down Amazon.com for several hours. and hand-rolled C -code. To update code, we flipped a symlink ( a symbolic link is a file whose purpose is to point to a file or directory ) to swap between the code and HTML files contained in these directories.

Engineering 337

Engineering Bytes Cloud Computing AWS 337

The Pragmatic Engineer

SEPTEMBER 26, 2023

Every day, there’s more code at a tech company, not less. However, monorepos result in codebases growing large, so that even checking out the code or updating to the head can be time consuming. Concern about code leaks. With full-remote work, the risk is higher that someone other than the employee accesses the codebase.

Cloud 309

Cloud Software Engineer Software Engineering Cloud Computing 309

The Pragmatic Engineer

MARCH 19, 2024

Today, full subscribers got access to a comprehensive Senior-and-above tech compensation research. The company says: “Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork.

Software Engineering 323

Software Engineering Software Engineer Programming Language Media 323

Snowflake

NOVEMBER 11, 2024

Optimize performance and cost with a broader range of model options Cortex AI provides easy access to industry-leading models via LLM functions or REST APIs, enabling you to focus on driving generative AI innovations. This no-code interface allows you to quickly experiment with, compare and evaluate models as they become available.

Unstructured Data 97

Unstructured Data SQL AWS Healthcare 97

Engineering at Meta

JANUARY 22, 2025

In order to build high-quality data lineage, we developed different techniques to collect data flow signals across different technology stacks: static code analysis for different languages, runtime instrumentation, and input and output data matching, etc. Static analysis tools simulate code execution to map out data flows within our systems.

Data Warehouse 117

Data Warehouse SQL Programming Language Data 117

Cloudera

NOVEMBER 13, 2024

LLMs deployed as code assistants accelerate developer efficiency within an organization, ensuring that code meets standards and coding best practices. No-code, low-code, and all-code solutions. Anyone with any skill level can leverage the power of Fine Tuning Studio with or without code.

Datasets 87

Datasets Machine Learning Coding Data Preparation 87

Snowflake

JANUARY 29, 2025

As described by DeepSeek , this model, trained via large-scale reinforcement learning (RL) without supervised fine-tuning (SFT), can achieve performance comparable to OpenAI-o1 across math, code and reasoning tasks. To request access during preview please reach out to your sales team. The model is hosted in the U.S.

Unstructured Data 94

Unstructured Data SQL Python Government 94

The Pragmatic Engineer

OCTOBER 10, 2024

What makes Wordpress popular is a mix of factors: Restrictive license : licensed as  GPLv2 , which allows for commercial use, and for modifying the code; as long as the license remains in place.   Forks gaining momentum that has the code of Wordpress, but uses a different name could also be in the books. 25 Sep: Block.

Consulting 345

Consulting AWS Engineering Software Engineering 345

The Pragmatic Engineer

SEPTEMBER 19, 2024

Use tech debt payments to get into the flow and stay in it A good reason to add new comments to old code before you change it is to speed up a code review. When it takes me time to learn what code does, writing something down helps me remember what I figured out. Clarifying the code is even better.

Recruitment 285

Recruitment Java Coding Project 285

The Pragmatic Engineer

MARCH 12, 2024

” They write the specification, code, tests it, and write the documentation. Code reviews reduce the need to pair while working on a task, allowing engineers to keep up with changes and learn from each other. CI/CD : running automated tests on all changes, and deploying code to production automatically. The copilot.

Engineering 319

Engineering Programming Language Hospitality Programming 319

Snowflake

MARCH 31, 2025

All customer accounts are automatically provisioned to have access to default CPU and GPU compute pools that are only in use during an active notebook session and automatically suspended when inactive. Secure access to open source repositories via pip and the ability to bring in any model from hubs such as Hugging Face (see example here ).

Healthcare 92

Healthcare Medical Government Food 92

Data Engineering Podcast

FEBRUARY 18, 2024

As a listener to the Data Engineering Podcast you can get a special discount of 20% off your ticket by using the promo code dataengpod20. What are the differences in terms of pipeline design/access and usage patterns when using a Trino/Iceberg lakehouse as compared to other popular warehouse/lakehouse structures?

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Snowflake

NOVEMBER 6, 2024

But as technology speeds forward, organizations of all sizes are realizing that generative AI isn’t just aspirational: It’s accessible and applicable now. " Now Advisor360° has instant access to the most up-to-date customer insights — allowing the firm to provide the enterprise-class customer care it is known for.

Hospitality 95

Hospitality Medical Government Software Engineering 95

Snowflake

APRIL 30, 2025

Ransomware is a type of malicious software that encrypts a victim's data or locks their device, demanding a ransom to restore access or to not expose the data. Prevention Access controls Access to Snowflake infrastructure is protected by multiple layers of security (defense in depth and zero trust ).

Accessible 74

Accessible Accessibility Metadata Cloud 74

Snowflake

JUNE 5, 2024

It provides access to industry-leading large language models (LLMs), enabling users to easily build and deploy AI-powered applications. By using Cortex, enterprises can bring AI directly to the governed data to quickly extend access and governance policies to the models. Fine-tuned models can be managed using Snowflake Model Registry.

Coding 112

Coding Building Management Government 112

Marc Lamberti

SEPTEMBER 22, 2023

To access XComs, go to the user interface, then Admin and XComs. and put the code in it. With just one line of code, you’ve pushed your first XComs! To know which one, you have to look into the code but there is one parameter that operators have in common: do_xcom_push. How to use XCom in Airflow? Time to practice.

MySQL 246

MySQL Data Pipeline Database Python 246

dbt Developer Hub

APRIL 20, 2025

We are committed to building the data control plane that enables AI to reliably access structured data from across your entire data lineage. We believe it is important for the industry to start coalescing on best practices for safe and trustworthy ways to access your business data via LLM. What is MCP?

Structured Data 98

Structured Data SQL BI Project 98

Analytics Vidhya

FEBRUARY 2, 2023

Introduction SQL injection is an attack in which a malicious user can insert arbitrary SQL code into a web application’s query, allowing them to gain unauthorized access to a database. We can use this to steal sensitive information or make unauthorized changes to the data stored in the database.

Database 209

Database SQL Coding Accessible 209

Netflix Tech

DECEMBER 19, 2024

A natural solution is to make flows configurable using configuration files, so variants can be defined without changing the code. Unlike parameters, configs can be used more widely in your flow code, particularly, they can be used in step or flow level decorators as well as to set defaults for parameters.

Machine Learning 82

Machine Learning Project Data Warehouse Coding 82

Snowflake

FEBRUARY 13, 2025

Snowflake has embraced serverless since our founding in 2012, with customers providing their code to load, manage and query data and us taking care of the rest. They can easily access multiple code interfaces, including those for SQL and Python, and the Snowflake AI & ML Studio for no-code development.

Management 84

Management Government Cloud Unstructured Data 84

Netflix Tech

DECEMBER 17, 2024

Metric definitions are often scattered across various databases, documentation sites, and code repositories, making it difficult for analysts and data scientists to find reliable information quickly. Enter DataJunction (DJ). For example, LORE provides human-readable reasoning on how it arrived at the answer that users can cross-verify.

Engineering 85

Engineering Entertainment Amazon Web Services Utilities 85

Snowflake

NOVEMBER 11, 2024

Ingest data more efficiently and manage costs For data managed by Snowflake, we are introducing features that help you access data easily and cost-effectively. This reduces the overall complexity of getting streaming data ready to use: Simply create external access integration with your existing Kafka solution.

Data Architecture 105

Data Architecture Architecture Data Lake Kafka 105

The Pragmatic Engineer

OCTOBER 17, 2024

The startup was able to start operations thanks to getting access to an EU grant called NGI Search grant. Code and raw data repository:   Version control: GitHub Heavily using GitHub Actions for things like getting warehouse data from vendor APIs, starting cloud servers, running benchmarks, processing results, and cleaning up after tuns.

Cloud 326

Cloud AWS Metadata Cloud Computing 326

Towards Data Science

JANUARY 30, 2025

That said, this tutorial aims to introduce airflow-parse-bench , an open-source tool I developed to help data engineers monitor and optimize their Airflow environments, providing insights to reduce code complexity and parsetime. When writing Airflow DAGs, there are some important best practices to bear in mind to create optimized code.

Python 48

Python Coding Google Cloud Database 48

Netflix Tech

NOVEMBER 12, 2024

However, this category requires near-immediate access to the current count at low latencies, all while keeping infrastructure costs to a minimum. Reducing Code Complexity : We reduce a lot of code complexity in Counter Abstraction by delegating a major portion of the functionality to an existing service.

Datasets 101

Datasets Computer Science Systems Kafka 101

The Pragmatic Engineer

OCTOBER 18, 2024

  Modify the code so it removed ways to upgrade from free to paid Spotify features in this free app. Blocked from WordPress.com : even though WP Engine lawsuit is against Automattic and its CEO, WordPress.org bans anyone affiliated with WP Engine from accessing the site and updating plugins.

Engineering 356

Engineering Government Project AWS 356

Picnic Engineering

DECEMBER 5, 2024

These plugins run custom checks during the build process, improving code quality by identifying bugs, enhancing style, performing migrations, and enforcing coding standards. If utilized correctly, Error Prone’s automation can significantly improve code quality and save developer hours. How Did We Get Here?

Java 40

Java Coding Project Building 40

Snowflake

FEBRUARY 12, 2025

Agents need to access an organization's ever-growing structured and unstructured data to be effective and reliable. As data connections expand, managing access controls and efficiently retrieving accurate informationwhile maintaining strict privacy protocolsbecomes increasingly complex. text, audio) and structured (e.g.,

Unstructured Data 82

Unstructured Data Government SQL Structured Data 82

Knowledge Hut

MAY 3, 2024

Any coding interview is a test that primarily focuses on your technical skills and algorithm knowledge. The type of interview you might face can be a remote coding challenge, a whiteboard challenge or a full day on-site interview. So, if you can prove your coding skills learnt in your python programming classes in the interview.

Python 98

Python Coding Data Programming 98

Engineering at Meta

APRIL 28, 2025

We developed tools and APIs for developers to organize assets, classify data, and auto-generate annotation code. Each product features its own distinct data model, physical schema, query language, and access patterns. Strict measurements provided precision/recall guarantees. Datasets provide a native API for creating data pipelines.

Metadata 83

Metadata Data Utilities Data Warehouse 83

Snowflake

JANUARY 28, 2025

Thats why we are announcing that SnowConvert , Snowflakes high-fidelity code conversion solution to accelerate data warehouse migration projects, is now available for download for prospects, customers and partners free of charge. And today, we are announcing expanded support for code conversions from Amazon Redshift to Snowflake.

Data Warehouse 82

Data Warehouse Professional Services SQL Coding 82

Engineering at Meta

MAY 5, 2025

with PEP-484 , allow developers to specify variable types, enhancing code understanding without affecting runtime behavior. Tooling and automation: Developing tools to address common challenges adding types and keeping the types up-to-date with the source code. Increase developer velocity in the IDE with improved type annotations.

Python 73

Python Coding Programming Project 73

KDnuggets

OCTOBER 30, 2024

Each project, from beginner tasks like Image Classification to advanced ones like Anomaly Detection, includes a link to the dataset and source code for easy access and implementation.

Project 150

Project Datasets Coding Accessible 150

The Pragmatic Engineer

OCTOBER 10, 2023

However, Martin had not written a line of production code for the last four years, as he’s taken on the role of CEO, and heads up observability scaleup Chronosphere – at more than 250 people and growing. From learning to code in Australia, to working in Silicon Valley How did I learn to code?

Software Engineering 318

Software Engineering Software Engineer Architecture Media 318

The Pragmatic Engineer

MAY 1, 2024

The company says: “Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork. Source: Cognition So far, all we have is video demos, and accounts of those with access to this tool.

Software Engineering 239

Software Engineering Software Engineer Programming Language Media 239

Snowflake

SEPTEMBER 7, 2023

We are excited to announce the public preview of External Access, which enables customers to reach external endpoints from Snowpark seamlessly and securely. With this announcement, External Access is in public preview on Amazon Web Services (AWS) regions.

Amazon Web Services 134

Amazon Web Services AWS Government Python 134

Snowflake

JUNE 5, 2024

At the same time, organizations must ensure the right people have access to the right content, while also protecting sensitive and/or Personally Identifiable Information (PII) and fulfilling a growing list of regulatory requirements.

Government 115

Government Accessible Accessibility Cloud 115