Snowflake

APRIL 9, 2025

Its Snowflake Native App, Digityze AI, is an AI-powered document intelligence platform that transforms unstructured biomanufacturing documentation into structured, actionable data and manages the document lifecycle.

Pharmaceutical 98

Pharmaceutical Manufacturing Data Ingestion SQL 98

Snowflake

MARCH 6, 2025

Unstructured text is everywhere in business: customer reviews, support tickets, call transcripts, documents. Meanwhile, operations teams use entity extraction on documents to automate workflows and enable metadata-driven analytical filtering.

Unstructured Data 97

Unstructured Data Medical Media Data Workflow 97

The Pragmatic Engineer

MARCH 12, 2024

” They write the specification, code, tests it, and write the documentation. Edits documentation the chief programmer writes, and makes it production-ready. Brooks discusses software in the context of producing operating systems, pre-internet. Brooks calls this person “the surgeon.” The copilot. The editor.

Engineering 329

Engineering Programming Language Hospitality Programming 329

Data Engineering Podcast

NOVEMBER 20, 2022

In this episode Ian Schweer shares his experiences at Riot Games supporting player-focused features such as machine learning models and recommeder systems that are deployed as part of the game binary. The biggest challenge with modern data systems is understanding what data you have, where it is located, and who is using it.

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Snowflake

NOVEMBER 6, 2024

Alberta Health Services ER doctors automate note-taking to treat 15% more patients The integrated health system of Alberta, Canada’s third-most-populous province, with 4.5 But Cortex AI worked out of the box, integrating into our system seamlessly and translating into huge productivity gains for the team."

Hospitality 97

Hospitality Medical Government Software Engineer 97

Snowflake

APRIL 16, 2025

Instead of maintaining separate systems for structured data and image processing, data analysts and scientists can now work within the familiar Snowflake environment, using simple SQL to explore correlations between traditional metrics and visual intelligence. Sonnet excels at document understanding with an impressive 90.3%

Data Analysis 76

Data Analysis Unstructured Data Manufacturing Retail 76

Monte Carlo

MARCH 28, 2025

Gemini can polish Google documents for research teams. Table of Contents Understanding How Data + AI Can Break Data System Code Model Data + AI observability must cover inputs and outputs it is all or nothing Understanding How Data + AI Can Break Data + AI applications are complex. But code takes on new weight in the data + AI system.

Coding 52

Coding Systems Data Pipeline ETL Tools 52

Snowflake

NOVEMBER 11, 2024

Conversational apps: Creating reliable, engaging responses for user questions is now simpler, opening the door to powerful use cases such as self-service analytics and document search via chatbots. For instance, if your documents are in multiple languages, an LLM with strong multilingual capabilities is key.

Unstructured Data 98

Unstructured Data SQL AWS Healthcare 98

KDnuggets

NOVEMBER 11, 2024

A practical guide to easily implement a reranker capable of putting together multiple document scoring criteria in RAG systems

Systems 90

Systems 90

Snowflake

JANUARY 30, 2025

Use cases range from getting immediate insights from unstructured data such as images, documents and videos, to automating routine tasks so you can focus on higher-value work. Personalization is also a game changer in healthcare and life sciences, leading to improved patient outcomes and cost savings for healthcare systems.

Unstructured Data 97

Unstructured Data Entertainment Healthcare Telecommunication 97

The Pragmatic Engineer

SEPTEMBER 28, 2023

Willem Spruijt is a software engineer whom I worked on the same team with at Uber in Amsterdam, building payments systems. For example: A recently joined senior staff engineer decided to propose a project to do a re-architecture of a system. We cover one out of four topics in today’s subscriber-only The Pulse issue.

Software Engineer 314

Software Engineer Software Engineering Engineering Building 314

The Pragmatic Engineer

OCTOBER 10, 2023

I wrote code for drivers on Windows, and started to put a basic observability system in place. EC2 had no observability system back then: people would spin up EC2 instances but have no idea whether or not they worked. With my team, we built the basics of what is now called AWS Systems Manager.

Software Engineer 327

Software Engineer Software Engineering Architecture Media 327

Towards Data Science

FEBRUARY 6, 2024

ERP and CRM systems are designed and built to fulfil a broad range of business processes and functions. Accessing Operational Data I used to connect to views in transactional databases or APIs offered by operational systems to request the raw data. Does it sound familiar?

Systems 98

Systems Raw Data Metadata Data Cleanse 98

Netflix Tech

DECEMBER 19, 2024

Many of these projects are under constant development by dedicated teams with their own business goals and development best practices, such as the system that supports our content decision makers , or the system that ranks which language subtitles are most valuable for a specific piece ofcontent.

Machine Learning 81

Machine Learning Project Data Warehouse Coding 81

The Pragmatic Engineer

NOVEMBER 9, 2023

Several times throughout various testimonies, we’ve seen a document written by Sam Bankman-Fried, in which he describes his thinking that Alameda Research should be shut down. That document was, ultimately, how Singh learned in September 2022 that Alameda Research had taken billions of dollars of customer funds from FTX.

Software Engineer 290

Software Engineer Software Engineering Engineering Coding 290

Snowflake

DECEMBER 4, 2024

Beyond working with well-structured data in a data warehouse, modern AI systems can use deep learning and natural language processing to work effectively with unstructured and semi-structured data in data lakes and lakehouses. Expect autonomous agents, document digestion and AI as its own killer app.

Unstructured Data 97

Unstructured Data Data Lake Deep Learning Structured Data 97

dbt Developer Hub

APRIL 20, 2025

Both AI agents and business stakeholders will then operate on top of LLM-driven systems hydrated by the dbt MCP context. Todays system is not a full realization of the vision in the posts shared above, but it is a meaningful step towards safely integrating your structured enterprise data into AI workflows. Why does this matter?

Structured Data 98

Structured Data SQL BI Project 98

Snowflake

MARCH 12, 2025

Maintaining the quality and integrity of this data as it persists and moves through our organization's systems is crucial to our operations and compliance. After experiencing numerous data quality challenges, they created Anomalo, a no-code platform for validating and documenting data warehouse information.

Unstructured Data 95

Unstructured Data High Quality Data Banking Machine Learning 95

Snowflake

NOVEMBER 11, 2024

SnowConvert is an easy-to-use code conversion tool that accelerates legacy relational database management system (RDBMS) migrations to Snowflake. Florida State University has been using Document AI to efficiently extract data from PDFs and third-party sources, which simplifies data auditing and eliminates weeks’ worth of manual effort.

Data Architecture 105

Data Architecture Architecture Data Lake Kafka 105

Netflix Tech

NOVEMBER 12, 2024

It allows users to choose between different counting modes, such as Best-Effort or Eventually Consistent , while considering the documented trade-offs of each option. Failures in a distributed system are a given, and having the ability to safely retry requests enhances the reliability of the service.

Datasets 100

Datasets Computer Science Systems Kafka 100

Edureka

JANUARY 21, 2025

An overview on “What is RAG” by edureka Retrieval This is the act of getting data from somewhere outside the computer, usually a database, knowledge base, or document store. In RAG, retrieval is the process of looking for useful data (like text or documents) based on what the user or system asks for or types in.

Healthcare 52

Healthcare Education Medical Database 52

Snowflake

APRIL 13, 2025

Agentic AI refers to AI systems that act autonomously on behalf of their users. These systems make decisions, learn from interactions and continuously improve without constant human intervention. This results in more accurate outputs and actions compared to standard AI systems, facilitating autonomous decision-making.

Data Management 78

Data Management Management Consulting Unstructured Data 78

The Pragmatic Engineer

AUGUST 8, 2024

The experience is snappy: in 20 seconds, you always get an answer: This is how Klarna’s chatbot works On one hand, the bot is a tool that seems to find relevant parts of documentation, and then shares these sections. With clever-enough probing, this system prompt can be revealed. This feels word-by-word, or sometimes summarized.

IT 253

IT Software Engineer Software Engineering Systems 253

Data Engineering Weekly

APRIL 6, 2025

The article summarizes the recent macro trends in AI and data engineering, focusing on Vibe coding, human-in-the-loop system design, and rapid simplification of developer tooling. One reason why all the engineering documentation fails and quickly becomes outdated is that it is always written from the author's perspective.

Data Engineering 63

Data Engineering Data Engineer Engineering Kafka 63

Precisely

APRIL 7, 2025

Documentation: Many datasets are not accompanied by clear or up-to-date documentation. And even when there is documentation, people dont read it. Within your operations, stress the need to get and read documentation. This makes de-coding the data a challenge that may prevent potentially valuable data from being usable.

Retail 75

Retail Datasets Data Portfolio 75

The Pragmatic Engineer

OCTOBER 18, 2024

Corporate conflict recap Automattic is the creator of open source WordPress content management system (CMS), and WordPress powers an incredible 43% of webpages and 65% of CMSes.  According to internal documents, OpenAI expects to generate $100B in revenue in 5 years, which is 25x more than it currently makes.

Engineering 357

Engineering Government Project AWS 357

Data Engineering Podcast

OCTOBER 29, 2023

I especially like the ability to combine your technical diagrams with data documentation and dependency mapping, allowing your data engineers and data consumers to communicate seamlessly about your projects. What is driving the broad adoption of columnar stores as a separate environment from transactional systems?

Database 189

Database SQL BI Machine Learning 189

The Pragmatic Engineer

AUGUST 1, 2023

Expectations for moving into an SDE3 (senior) role Amazon is almost alone among most tech companies in the way its internal leveling document specifies levels and their expectations, and also provides guidance on how to move to the next level. Address systemic issues. Reduce support costs by addressing systemic issues.

Software Engineer 246

Software Engineer Software Engineering Engineering Designing 246

Snowflake

FEBRUARY 13, 2025

When you read the documentation on platform as a service (PaaS) offerings, youll often see references to features that are not supported in certain versions of the service, along with outage windows for planned maintenance none of these are an issue with Snowflake. While this system worked, it came with fairly high cost and overhead.

Management 93

Management Government Cloud Unstructured Data 93

Netflix Tech

DECEMBER 17, 2024

Analytics Engineers deliver these insights by establishing deep business and product partnerships; translating business challenges into solutions that unblock critical decisions; and designing, building, and maintaining end-to-end analytical systems.

Engineering 84

Engineering Entertainment Amazon Web Services Utilities 84

DoorDash Engineering

FEBRUARY 27, 2024

We reviewed the architecture of our global search at DoorDash in early 2022 and concluded that our rapid growth meant within three years we wouldn’t be able to scale the system efficiently, particularly as global search shifted from store-only to a hybrid item-and-store search experience. latency reduction and a 75% hardware cost decrease.

Engineering 130

Engineering Systems Designing Architecture 130

Pinterest Engineering

APRIL 7, 2025

In recent years, while managing Pinterests EC2 infrastructure, particularly for our essential online storage systems, we identified a significant challenge: the lack of clear insights into EC2s network performance and its direct impact on our applications reliability and performance. Refer to AWS documentation for the up-to-date ENAstats.

AWS 57

AWS Bytes Database Data Ingestion 57

Edureka

FEBRUARY 12, 2025

A lot of people use LangChain to do things like chatbots, answering questions, analyzing documents, and automating logic. Flexibility and Modularity : The modular design of LangChain lets coders change how parts work, connect them to other systems, and try out different setups. Document loaders for PDFs, web pages, or text files.

IT 52

IT Database Google Cloud Coding 52

Snowflake

JANUARY 28, 2025

Snowflake and many of its system integrator (SI) partners have leveraged SnowConvert to accelerate hundreds of migration projects. To get started and learn more about SnowConvert, please refer to SnowConvert documentation. Need help with a large-scale, complex migration?

Data Warehouse 92

Data Warehouse Professional Services SQL Coding 92

Data Engineering Weekly

JANUARY 15, 2025

The answer lies in unstructured data processing—a field that powers modern artificial intelligence (AI) systems. To address these challenges, AI Data Engineers have emerged as key players, designing scalable data workflows that fuel the next generation of AI systems. How does a self-driving car understand a chaotic street scene?

Data Engineering 63

Data Engineering Data Engineer Unstructured Data Engineering 63

Precisely

FEBRUARY 20, 2025

Solution: Ensure that your users have self-service access to data from all of your mission-critical systems. Legacy system modernization It can be costly and time consuming for you to access, integrate, and migrate data from your complex legacy systems like mainframe and IBM i into your cloud environment and applications.

Data Integration 69

Data Integration Government Datasets Data Pipeline 69

Monte Carlo

APRIL 28, 2025

Not every solution out there is built the same, and if youve ever tried to wrangle documentation from scratch, you know how painful a clunky tool can be. This basically means the tool updates itself by pulling in changes to data structures from your systems. Its like a time machine for your documentation. Made a mistake?

Metadata 52

Metadata Hadoop Data SQL 52