The Pragmatic Engineer

MARCH 19, 2024

A first, smaller wave of these stories included Magic.dev raising $100M in funding from Nat Friedman (CEO of GitHub from 2018-2021,) and Daniel Gross (cofounder of search engine Cue which Apple acquired in 2013,) to build a “superhuman software engineer.” And COBOL was just one of many attempts.

Software Engineer 328

Software Engineer Software Engineering Programming Language Media 328

ProjectPro

JULY 3, 2018

News on Hadoop - June 2018 RightShip uses big data to find reliable vessels.HoustonChronicle.com,June 15, 2018. The rating system gives one star rating to ships that are likely to experience an incident in the next year and a five star rating to ships which are least likely to do so. Zdnet.com, June 18, 2018.

Hadoop 52

Hadoop Big Data Government Data Mining 52

The Pragmatic Engineer

OCTOBER 10, 2024

Wordpress is the most popular content management system (CMS),  estimated  to power around 43% of all websites; a staggering number!  A company that raised $250M of funding from Silver lake Partners in 2018. This article was originally published a week ago, on 3 October 2024, in The Pragmatic Engineer.

Consulting 350

Consulting AWS Software Engineer Software Engineering 350

Towards Data Science

OCTOBER 12, 2023

The associated data in our scenario is stored in a SAP HCM system which is one of the leading applications for human resource management in enterprise environments. To solve this kind of objective, every data engineer needs to build up a lot of business related knowledge which is strongly interdependent to the underlying data model.

Data Integration 97

Data Integration Systems Engineering Datasets 97

Netflix Tech

SEPTEMBER 29, 2022

Timestone: Netflix’s High-Throughput, Low-Latency Priority Queueing System with Built-in Support for Non-Parallelizable Workloads by Kostas Christidis Introduction Timestone is a high-throughput, low-latency priority queueing system we built in-house to support the needs of Cosmos , our media encoding platform. Over the past 2.5

Systems 94

Systems Metadata Media Kafka 94

Engineering at Meta

FEBRUARY 4, 2025

Here we explore initial system designs we considered, an overview of the current architecture, and some important principles Meta takes into account in making data accessible and easy to understand. 2018: Users have a curated experience to find information about them through Access Your Information. feature on Facebook.

Accessible 89

Accessible Accessibility Raw Data Data Warehouse 89

U-Next

FEBRUARY 16, 2023

As my thoughts started wandering around our Banking systems and Cosmos Bank Cyber-attack 2018. Also, the recovery also gets affected as there is a lag of almost 24 months between fraud and detection. A robust fraud detection and monitoring system is required.

Banking 74

Banking Systems Education Government 74

The Pragmatic Engineer

MAY 1, 2024

A first, smaller wave of these stories included Magic.dev raising $100M in funding from Nat Friedman (CEO of GitHub from 2018-2021,) and Daniel Gross (cofounder of search engine Cue which Apple acquired in 2013,) to build a “superhuman software engineer.” And COBOL was just one of many attempts.

Software Engineer 245

Software Engineer Software Engineering Programming Language Media 245

Maxime Beauchemin

JANUARY 7, 2018

For example, if a change is introduced as a new rule around how to calculate taxes for 2018 that shouldn’t be applied prior to 2018, it would be dangerous to simply update the task to reflect this new logic moving forward. Things have changed quite a bit since then.

Data Process 183

Data Process Data Engineering Data Engineer Process 183

Netflix Tech

DECEMBER 18, 2018

Much of Netflix’s backend and mid-tier applications are built using Java, and as part of this effort Netflix engineering built several cloud infrastructure libraries and systems?—? All of these Netflix libraries and systems were open-sourced around 2012 and are still used by the community to this day.

Java 111

Java Cloud AWS Government 111

Data Engineering Podcast

FEBRUARY 11, 2023

Materialize breaks down those barriers with a true cloud-native streaming database - not simply a database that connects to streaming systems. How have the goals and features of the Quilt platform changed since I spoke with Kevin in June of 2018? What are the types of tools and systems that Quilt gets integrated with?

PostgreSQL 130

PostgreSQL SQL Machine Learning Data Warehouse 130

Engineering at Meta

OCTOBER 15, 2024

AI has been at the core of the experiences Meta has been delivering to people and businesses for years, including AI modeling innovations to optimize and improve on features like Feed and our ads system. DSF is powered by the open OCP-SAI standard and FBOSS , Meta’s own network operating system for controlling network switches.

Designing 128

Designing Deep Learning Architecture Systems 128

ProjectPro

JUNE 6, 2025

A total of 3.572 billion viewers , or more than half of the world's population aged four and over, watched the 2018 World Cup, according to the official broadcast coverage. FIFA is deploying a brand-new, cutting-edge camera system using artificial intelligence to help referees make better decisions during the 2022 World Cup.

Machine Learning 40

Machine Learning Manufacturing Datasets Data Science 40

ProjectPro

JUNE 6, 2025

In 2018, the Wall Street Journal reported that every company is a tech company, suggesting that every company is likely to hire a tech co-founder for future growth. Learn to Interact with the DBMS Systems Many companies keep their data warehouses far from the stations where data can be accessed.

Data Engineering 58

Data Engineering Data Engineer Engineering Amazon Web Services 58

Knowledge Hut

MARCH 7, 2024

The Need for More Trained Professionals Research shows that since 2018, 2.5 In August 2018,  LinkedIn reported claimed that US alone needs 151,717 professionals with data science skills. Working with data distributed across multiple systems makes it both cumbersome and risky. quintillion bytes (or 2.5

Big Data 98

Big Data Bytes Data Governance Government 98

Netflix Tech

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Technology 89

Technology Project Systems Building 89

Cloudera

FEBRUARY 1, 2023

Underrepresentation in tech is a complex, systemic problem, and no one company or organization can solve these issues alone. Specifically, higher education and broader systemic change. “In In 2018, only 19% of computing degree recipients were women. Enter: the Reboot Representation Tech Coalition.

Education 80

Education Technology Programming Accessible 80

Netflix Tech

DECEMBER 23, 2020

By Fabio Kung , Sargun Dhillon , Andrew Spyker , Kyle , Rob Gulewich, Nabil Schear , Andrew Leung , Daniel Muino, and Manas Alekar As previously discussed on the Netflix Tech Blog, Titus is the Netflix container orchestration system. It runs a wide variety of workloads from various parts of the company?—?everything

Media 122

Media Accessible Accessibility Systems 122

Data Engineering Podcast

FEBRUARY 3, 2018

Summary One of the critical components for modern data infrastructure is a scalable and reliable messaging system. Publish-subscribe systems have been popular for many years, and recently stream oriented systems such as Kafka have been rising in prominence.

Kafka 100

Kafka Data Pipeline Data Engineering Data Engineer 100

Data Engineering Podcast

FEBRUARY 3, 2018

Summary One of the critical components for modern data infrastructure is a scalable and reliable messaging system. Publish-subscribe systems have been popular for many years, and recently stream oriented systems such as Kafka have been rising in prominence.

Kafka 100

Kafka Data Pipeline Data Engineering Data Engineer 100

Confluent

FEBRUARY 27, 2019

In part 1 of this series, we developed an understanding of event-driven architectures and determined that the event-first approach allows us to model the domain in addition to building decoupled, scalable and enterprise-wide systems that can evolve. Peeking Behind the Curtains of Serverless Platforms, 2018.

Kafka 109

Kafka AWS Architecture Cloud 109

Data Engineering Podcast

FEBRUARY 25, 2018

Summary One of the sources of data that often gets overlooked is the systems that we use to run our businesses. This data is not used to directly provide value to customers or understand the functioning of the business, but it is still a critical component of a successful system.

Kafka 100

Kafka AWS Data Data Pipeline 100

Knowledge Hut

DECEMBER 26, 2023

Systems engineering is an interdisciplinary technology and systematic engineering methodology focusing on designing, developing, and managing complex systems over their entire life cycle. Systems engineering works on such projects utilizing work procedures, optimization methodologies, and tools for risk management.

Systems 52

Systems Engineering Software Engineer Software Engineering 52

Tweag

JULY 26, 2023

Cargo is great when you are developing and packaging a single Rust library or application, but when it comes to a fast-growing and complex workspace, one could be attracted to the idea of using a more flexible and scalable build system. Here is a nice article elaborating on why Cargo should not be considered as a such a build system.

Building 97

Building Metadata Coding Project 97

ProjectPro

JUNE 6, 2025

The supply chain management system determines the optimum fulfillment center based on distance and inventory levels for every order. The company generates 35% of its annual sales using the Recommendation based systems (RBS) method. This Bin Packing problem is a classic NP-Hard problem familiar to data scientists.

Data Science 67

Data Science Project Food Pharmaceutical 67

Towards Data Science

FEBRUARY 15, 2023

The Data Lake architecture was proposed in a period of great growth in the data volume, especially in non-structured and semi-structured data, when traditional Data Warehouse systems start to become incapable of dealing with this demand. FULL DATA FROM 2018 df_acidentes_2018 = ( spark.read.format("csv").option("delimiter",

Data Lake 98

Data Lake Data Warehouse Data Architecture Architecture 98

Data Engineering Podcast

FEBRUARY 18, 2018

To save 60% off your tickets go to dataengineeringpodcast.com/odsc-east-2018 and register. What parallels do you see between the relationships of data engineers and data scientists and those of developers and systems administrators? To save 60% off your tickets go to dataengineeringpodcast.com/odsc-east-2018 and register.

Data Science 100

Data Science Data Engineering Data Engineer Data Pipeline 100

Engineering at Meta

FEBRUARY 6, 2023

The app makes heavy use of code generation, spurred by Buck , our custom build system. Without heavy caching from our build system, engineers would have to spend an entire workday waiting for the app to build. The app’s ‘module’ system gave each product ungoverned access to all the app’s resourcing. a(FBSomeFile.mm.o)

Architecture 145

Architecture Coding Engineering Systems 145

Knowledge Hut

MAY 6, 2024

10 Steps to Launching your First SAFe® Agile Release Train [link] pic.twitter.com/rT8FDhqcoj — Yves Mulkers (@YvesMulkers) 27 January 2018 5 Governing Principles for SAFe® Agile Release Train ART is the self-organised team of Agile Teams. ART must follow the culture of continuous system integration.

Consulting 98

Consulting Government Programming Architecture 98

ProjectPro

JUNE 6, 2025

Detectron2 Detectron2 is the updated version of Detectron, an object detection library developed by Facebook AI in 2018. This was primarily because since 2018, there have been several code modifications that have combined Caffe2 and PyTorch into a single repository, making Detectron more challenging to use.

Project 53

Project Deep Learning Machine Learning Algorithm 53

Cloudera

NOVEMBER 25, 2021

As the systems we develop become increasingly sophisticated, and in some cases autonomous, we remain ethically responsible for those systems. This includes systems based on AI and ML. Ethical AI is a multi-disciplinary effort to design and build AI systems that are fair and improve our lives. Why is Ethical AI Important?

Government 98

Government Insurance Algorithm Machine Learning 98

LinkedIn Engineering

APRIL 18, 2023

Minion (an agent on host) sees jobs and results by subscribing to events published on the event bus by master service, It uses ZMQ (ZeroMQ) to achieve high-speed, asynchronous communication between connected systems. Targeted minions execute the job on the host and return to master.

MySQL 103

MySQL Python Bytes Kafka 103

Cloudera

JULY 11, 2022

Forrester ranked Cloudera at the same level in their two previous Wave reports on this topic (2020 and 2018). . Their most recent evaluation, Forrester Wave : Enterprise Data Fabric, Q2 2022, came out on June 23, 2022 and ranked Cloudera as a strong performer.

Data Architecture 107

Data Architecture Architecture Data Government 107

Engineering at Meta

OCTOBER 18, 2023

My team is responsible for the design and development of Meta’s in-house machine learning (ML) accelerator, and I partner closely with our co-design, architecture, verification, implementation, emulation, validation, system, firmware, and software teams to successfully build and deploy the silicon in our data centers.

Designing 117

Designing Deep Learning Media Architecture 117

Snowflake

SEPTEMBER 24, 2024

Some of the most pressing risks include: Privacy: AI systems can process enormous amounts of personal data, raising concerns about how this data is used and protected. Autonomy: AI systems used in decision-making processes can potentially undermine individual autonomy if not properly designed.

Government 96

Government Algorithm Machine Learning Metadata 96

ProjectPro

JUNE 6, 2025

Bias and discrimination Algorithmic bias: Machine learning algorithms that have been trained on biased data have the potential to reinforce and even magnify pre existing societal biases, which can result in discrimination against particular groups in the criminal justice system, employment market, and loan approval processes, among other contexts.

Data Science 40

Data Science Algorithm Consulting Healthcare 40

Edureka

APRIL 10, 2023

Actually, ChatGPT’s initial release was in 2018. GPT-4 is the newest version of OpenAI’s language model systems that accept image and text inputs, and emit text outputs. The most recent version of the AI, which was released on March 14, is the fourth iteration. What’s new in GPT-4? How to access GPT-4?

Accessible 98

Accessible Accessibility Systems IT 98