Zalando Engineering

MAY 13, 2024

As a design system evolves alongside with the brand it represents, there are often multiple occasions when a need to introduce variations arises. The previous article on this blog gives a wider overview of the Zalando Design System. The previous article on this blog gives a wider overview of the Zalando Design System.

Designing 59

Designing Systems Architecture Coding 59

Engineering at Meta

OCTOBER 23, 2023

To optimize build and performance, we developed our own build system called Buck , which was first open-sourced in 2013. We debated between using Java (like Buck1), Haskell (like the Shake build system ) or Go for the core programming language. Meta has a very large monorepo, with many different programming languages.

Programming Language 117

Programming Language Java Python Programming 117

Tweag

FEBRUARY 15, 2023

opam performs four main tasks: Download the sources. Provide those dependencies such that the build system can find them. Run the build system. This allows for irreproducible builds, and makes it easy to forget to explicitly list a system dependency if it happens to be installed on the author’s system.

Project 144

Project Programming Language Building Systems 144

Knowledge Hut

APRIL 22, 2024

Python is a fantastic programming language for automating tasks, and most Linux system comes with Python pre-installed. Environment Variable: a variable whose value is set externally to the application via an operating system or microservice feature. x version on your system Make sure you have Ubuntu 18.04 is version 3.6.8

Python 98

Python Programming Language Data Science Programming 98

The Pragmatic Engineer

JANUARY 5, 2023

We also recommend customers review internal logs for their systems for any unauthorized access starting from December 21, 2022, through today, January 4, 2023, or upon completion of your secrets rotation. (.)We We take the security of our systems and our customers’ systems extremely seriously.

Pipeline-centric 130

Pipeline-centric Database-centric Coding Accessibility 130

Engineering at Meta

FEBRUARY 12, 2024

Meta engineer Pascal Hartig ( @passy ) is joined on the Meta Tech Podcast by Itamar Oren and Carl Meyer, two software engineers at Meta, to discuss their teams’ contributions to the latest Python release, including new hooks that allow for custom JITs like Cinder , Immortal Objects , improvements to the type system, faster comprehensions, and more.

Python 106

Python Software Engineer Software Engineering Engineering 106

Engineering at Meta

JUNE 27, 2023

Sapling: Scaling version control Sapling is a version control system that can scale to huge sizes, but also emphasizes usability. There are three main components to Sapling – a server, a client, and a virtual file system. The final component is the virtual file system.

Java 128

Java Programming Language Algorithm Coding 128

Cloudera

DECEMBER 13, 2021

An attacker can use this vulnerability to instruct affected systems to download and execute a malicious payload through submitting a custom-crafted request. On December 10th 2021, the Apache Software Foundation released version 2.15.0 This vulnerability is critical and is rated 10 out of 10 on the CVSS 3.1 scoring scale.

Java 129

Java Coding Project Engineering 129

Engineering at Meta

AUGUST 28, 2024

Someday, advances in quantum computing will make it possible to decrypt sensitive data that was encrypted using today’s complex cryptography systems. The advent of quantum computers has raised real questions about the future of data privacy over the internet.

Engineering 105

Engineering Systems IT Data 105

DoorDash Engineering

FEBRUARY 27, 2024

We reviewed the architecture of our global search at DoorDash in early 2022 and concluded that our rapid growth meant within three years we wouldn’t be able to scale the system efficiently, particularly as global search shifted from store-only to a hybrid item-and-store search experience. latency reduction and a 75% hardware cost decrease.

Engineering 130

Engineering Systems Designing Architecture 130

The Modern Data Company

MAY 2, 2023

The Modern Data Company Brief The Modern Data Company is radically simplifying data architecture with its paradigm-shifting data operating system, DataOS. We’re replacing overwhelm with composability, reinventing governance, and connecting legacy systems to your newest tools.

Data Architecture 98

Data Architecture Government Data Architecture 98

Knowledge Hut

MAY 16, 2024

System requirements Software Requirements: 1. Operating System: OS X (macOS) is necessary. Install it after downloading it from the official website. Watchman: To effectively track file system changes, React Native depends on Watchman. To avoid this, try entering sudo before this command, then enter your system password.

Java 98

Java Coding Utilities Project 98

Engineering at Meta

MAY 3, 2023

It includes: malware analysis and targeted threat disruption, continuously improving detection systems to block malware at scale, security product updates, community support and education, threat information sharing with other companies and holding threat actors accountable in court. For more security tips, visit our Newsroom.

Media 113

Media Metadata Coding Database 113

Netflix Tech

SEPTEMBER 24, 2021

Lastly, the packager kicks in, adding a system layer to the asset, making it ready to be consumed by the clients. From chunk encoding to assembly and packaging, the result of each previous processing step must be uploaded to cloud storage and then downloaded by the next processing step.

Cloud 96

Cloud Bytes Cloud Storage Media 96

Marc Lamberti

OCTOBER 11, 2023

As you may know, Airflow has many operators to perform actions on different tools, systems, etc. It downloads the dependencies, copies the files, runs commands, defines the environment variables, etc. If the image does not exist, Docker will download it, which increases the execution time of the task. Let’s go!

AWS 130

AWS Python Hadoop SQL 130

The Modern Data Company

FEBRUARY 14, 2023

After a winter storm blew through a large swath of the United States, Southwest’s systems and processes had a complete meltdown. While the weather certainly was a catalyst for the mess, it is widely understood that a high level of technical debt within Southwest’s operational systems made a bad situation much, much worse.

Government 105

Government Systems Accessibility Accessible 105

Engineering at Meta

NOVEMBER 21, 2023

It powers Instagram’s backend and plays an important role in our configuration systems, as well as much of our AI work. Python plays a big part at Meta. Meta even made contributions to Python 3.12 , the latest version of Python.

Python 106

Python Engineering Systems IT 106

Engineering at Meta

NOVEMBER 6, 2023

But this achievement wouldn’t have been possible without Meta’s existing systems and infrastructure. In about five short months, a small team of engineers at Meta took Threads, the new text-based conversations app, from from an idea to the most successful app launch of all time, pulling in over 100M users in its first five days.

Engineering 105

Engineering Systems IT 105

Cloudera

MAY 5, 2021

According to wikipedia , Gang Scheduling refers to a scheduling algorithm for parallel systems that schedules related threads or processes to run simultaneously on different processors. What is Gang Scheduling? In the distributed computing world, this refers to the mechanism to schedule correlated tasks in an All or Nothing manner.

Metadata 136

Metadata Algorithm Big Data Machine Learning 136

Knowledge Hut

DECEMBER 26, 2023

People with malicious intent fund hackers to break into security systems to compromise security features or significant amounts of money by introducing malware. Organizations must upgrade their hack-prevention plans and employ various technologies to secure the system before falling victim to a hacker. rating on Google Play.

Certification 98

Certification Government Programming Education 98

Snowflake

JANUARY 18, 2024

A fragmented resource planning system causes data silos, making enterprise-wide visibility virtually impossible. And in many ERP consolidations, historical data from the legacy system is lost, making it challenging to do predictive analytics. Ease of use Snowflake’s architectural simplicity improves ease of use.

Manufacturing 92

Manufacturing Unstructured Data Cloud Architecture 92

Knowledge Hut

JANUARY 12, 2024

Docker is a tool that enables developers, system administrators, and others to easily deploy their applications in a sandbox (referred to as containers) to run on the host operating system. VMs run applications inside a guest Operating System powered by the server's host OS. What Are Containers? Why Use Containers?

Systems 97

Systems MySQL Architecture Certification 97

Cloudera

NOVEMBER 19, 2021

Using the COPML methodology [link to eBook gated page] , you can maintain production ML systems with the minimum required human input while also adhering to both specific and more intangible requirements of your production ML projects. . CD is also first and foremost a framework for software systems.

Machine Learning 123

Machine Learning IT Project Data Engineering 123

Cloudera

SEPTEMBER 28, 2020

Document the operating system versions, database versions, and JDK versions. Determine if the operations systems need upgrade, follow the documentation to backup and upgrade your operating systems to the supported versions. Download, distribute, and activate Cloudera Runtime 7.1.x Download Information.

Cloud 132

Cloud Kafka Professional Services Metadata 132

Netflix Tech

OCTOBER 29, 2020

remotely configurable files that get downloaded to the device. Disk cache Of course, network connectivity may not always be available so downloaded rule sets need to be cached to disk. Networking Hendrix interprets rule set(s)?—?remotely We’re using Ktor ’s Multiplatform HttpClient to embed our networking code within the SDK.

Coding 111

Coding Architecture Technology Database 111

Snowflake

JANUARY 4, 2024

Your company collects huge amounts of data about everything from customer transactions to supplier contracts to system performance. And there’s a host of APIs, FTP sites, flat files, downloads, Excel downloads, and so on that are involved for this very wide range of data sources.

SQL 107

SQL Data Retail Banking 107

Snowflake

APRIL 24, 2024

Members of the Snowflake AI Research team pioneered systems such as ZeRO and DeepSpeed , PagedAttention / vLLM , and LLM360 which significantly reduced the cost of LLM training and inference, and open sourced them to make LLMs more accessible and cost-effective for the community.

Amazon Web Services 145

Amazon Web Services SQL AWS Architecture 145

Scott Logic

OCTOBER 18, 2023

Rust has always been a good fit for WebAssembly; it is a modern system-level language that has broad popularity (the Stack Overflow revealed it is the most desired language seven years in a row), it also happens to be a popular language for authoring WebAssembly runtimes and platforms. pass values to JavaScript within the browser).

Programming Language 145

Programming Language Coding Java Programming 145

Netflix Tech

JUNE 13, 2023

This is where large-scale system migrations come into play. By tracking metrics only at the level of service being updated, we might miss capturing deviations in broader end-to-end system functionality. Canaries and sticky canaries are valuable tools in the system migration process.

Systems 114

Systems Utilities Entertainment Coding 114

Engineering at Meta

JANUARY 29, 2024

Fetching : CAF maintains a cache on the destination host, ensuring that only content not already present in the cache needs to be downloaded. To optimize the efficiency of this system, we deploy a CAS daemon on the majority of Meta’s data center hosts.

Machine Learning 95

Machine Learning Building Python Utilities 95

Rockset

MARCH 28, 2024

Find an end-to-end Colab notebook that you can run without any dependencies on your local operating system: Recsys_workshop. Introduction A real-time personalized recommender system can add tremendous value to an organization by enhancing the level user engagement and ultimately increasing user satisfaction. Click on Start.

Systems 52

Systems Building Database Utilities 52

Engineering at Meta

MARCH 18, 2024

Systems and application logs play a key role in operations, observability, and debugging workflows at Meta. We designed the system to support service-level guarantees on log freshness, completeness, durability, query latency, and query result completeness. PyTorch, data readers, checkpointing, framework code, and hardware).

Engineering 103

Engineering Metadata Architecture Designing 103

Snowflake

JUNE 20, 2024

Designed for processing large data sets, Spark has been a popular solution, yet it is one that can be challenging to manage, especially for users who are new to big data processing or distributed systems. Batch Processing Pipelines : Large volumes of data can be processed on schedule using the tool.

Data Engineering 95

Data Engineering Data Engineer Scala Engineering 95

Knowledge Hut

DECEMBER 22, 2023

Python interpreters are available on various operating systems, such as Windows , Linux, and Mac OS. Excellent ones can execute code, control a debugger, and interact with source control systems. Hence, the downloads and installation are quite tedious. A code editor is built for editing and modifying source code.

Python 97

Python Coding Programming Language Data Science 97

Pinterest Engineering

SEPTEMBER 29, 2023

In this post, we will outline our diagnostic process and share insights that can be generalized to debugging any large-scale distributed system where judiciously placed print statements alone are not sufficient to debug issues. It became increasingly evident that this issue needed to be looked at.

Utilities 112

Utilities Coding Engineering Kafka 112

Engineering at Meta

FEBRUARY 6, 2024

DotSlash handles transparently fetching, decompressing, and verifying the appropriate remote artifact for the current operating system and CPU. Our continuous integration (CI) system supports special configuration for DotSlash jobs where a user must specify: A set of builds to run (these can span multiple platforms).

Metadata 129

Metadata Coding Building Project 129

Snowflake

JULY 8, 2024

In 2023, Snowflake launched the AI Data Cloud for Government & Education to provide a trusted data platform for federal, state and local governments, and educational institutions, to securely break down data silos, improve system resiliency and better serve citizens. Snowflake continues to invest in supporting some of the U.S.

Cloud 101

Cloud Google Cloud Education AWS 101