How Meta discovers data flows via lineage at scale
Engineering at Meta
JANUARY 22, 2025
In order to build high-quality data lineage, we developed different techniques to collect data flow signals across different technology stacks: static code analysis for different languages, runtime instrumentation, and input and output data matching, etc. web endpoints, data tables, AI models) used across Meta. Hack, C++, Python, etc.)
Let's personalize your content