Christophe Blefari

MARCH 1, 2023

ℹ️ I want to mention that the dbt documentation is one of the best tools documentation out there. You just have to understand that there is the reference part which is the detailed documentation of function or configuration and there is the documentation part which is more about concepts and tutorials.

Data Warehouse 278

Data Warehouse SQL Metadata Raw Data 278

Analytics Vidhya

MARCH 5, 2023

It stores and retrieves large amounts of data, including photos, movies, documents, and other files, in a durable, accessible, and scalable manner. Introduction S3 is Amazon Web Services cloud-based object storage service (AWS).

Amazon Web Services 267

Amazon Web Services AWS Cloud Accessibility 267

Analytics Vidhya

JANUARY 30, 2023

Whether we are analyzing IoT data streams, managing scheduled events, processing document uploads, responding to database changes, etc. Azure functions allow developers […] The post How to Develop Serverless Code Using Azure Functions? appeared first on Analytics Vidhya.

Coding 244

Coding Database Management Process 244

The Pragmatic Engineer

MARCH 12, 2024

” They write the specification, code, tests it, and write the documentation. Edits documentation the chief programmer writes, and makes it production-ready. Brooks suggests the set up below, borrowed from Harlan Mills, could work well: The chief programmer. Brooks calls this person “the surgeon.” The copilot.

Engineering 299

Engineering Programming Language Hospitality Programming 299

The Pragmatic Engineer

SEPTEMBER 28, 2023

This person wrote up a neat document that was well thought out, and sent it around to other senior staff engineers. But there was a problem, this engineer took an existing document that other engineers had written a few months before, copy-pasted it, changed a few words, and presented it as their own work.

Software Engineering 278

Software Engineering Software Engineer Engineering Building 278

The Pragmatic Engineer

NOVEMBER 9, 2023

Several times throughout various testimonies, we’ve seen a document written by Sam Bankman-Fried, in which he describes his thinking that Alameda Research should be shut down. That document was, ultimately, how Singh learned in September 2022 that Alameda Research had taken billions of dollars of customer funds from FTX.

Software Engineer 251

Software Engineer Software Engineering Engineering Coding 251

The Pragmatic Engineer

OCTOBER 10, 2023

In this document, we covered: The product The market The go-to-market (GTM) plan Our competitors … and many other things! With the plan in place, we sent this document – rather than the usual pitch deck – over to the VCs. Our approach was unorthodox, but worked!

Software Engineering 293

Software Engineering Software Engineer Architecture Media 293

KDnuggets

FEBRUARY 20, 2025

Turn your local LLMs into a personal, autonomous AI application that can effortlessly retrieve answers from the web or your documents.

130

130

Tweag

MAY 1, 2024

tl;dr You may not believe it, but Nix documentation is getting better. Table of contents Overview Motivation Statistics Retrospective Thoughts on future work Acknowledgements Overview This is a retrospective of my and many other people’s work on documentation in the Nix ecosystem between October 2022 and March 2024.

Architecture 112

Architecture Project Coding Designing 112

KDnuggets

NOVEMBER 15, 2024

Turn any document into a conversation-ready AI tool with AnythingLLM — a versatile, open-source platform for building a secure, private assistant.

Building 141

Building 141

Snowflake

JULY 25, 2024

Snowflake Cortex Search, a fully managed search service for documents and other unstructured data, is now in public preview. For document- or chunk-level access controls, you can use metadata filtering to ensure that the service only returns the results that the client is authorized to view.

Unstructured Data 124

Unstructured Data Metadata Government SQL 124

KDnuggets

AUGUST 6, 2024

Learn statistics through interactive books, code examples, cheat sheets, guides, and tools documentation.

Coding 138

Coding Data Science Data 138

KDnuggets

MAY 29, 2023

Top free tools for detecting thesis, research papers, assignments, documentation, and blogs generated by AI models.

152

152

databricks

OCTOBER 22, 2024

Over the years, organizations have amassed a vast amount of unstructured text data—documents, reports, and emails—but extracting meaningful insights has remained a challenge.

Data 137

Data 137

Data Engineering Podcast

OCTOBER 29, 2023

I especially like the ability to combine your technical diagrams with data documentation and dependency mapping, allowing your data engineers and data consumers to communicate seamlessly about your projects. Miro is your single pane of glass where everyone can discover, track, and collaborate on your organization's data.

Database 189

Database SQL BI Machine Learning 189

Snowflake

APRIL 20, 2023

Protecting sensitive or proprietary data such as source code, PII, internal documents, wikis, code bases, and other sensitive data sets, along with prompts, used to contextualize the LLMs is particularly important. Figure 1: Visual Question Answering Challenge data types and results.

Building 130

Building Unstructured Data Government Coding 130

DoorDash Engineering

FEBRUARY 27, 2024

Two primary aspects of that search engine were causing the trouble: its document-replication mechanism and its lack of support for complex document relationships. We designed the index to store multiple types of documents with relations between them. Our analysis identified Elasticsearch as our architecture’s primary bottleneck.

Engineering 130

Engineering Systems Designing Architecture 130

Snowflake

MAY 7, 2024

Document chatbots. Their knowledge was contained in more than 700,000 pages of private R&D documents. Using a RAG-based architecture that combines Cortex and Streamlit in Snowflake, the team has built a document chatbot. Ready to build your own document chatbot in Snowflake? Try this step-by-step quickstart.

Government 124

Government SQL Data Security Accessibility 124

LinkedIn Engineering

MAY 9, 2023

In the past, we addressed latency, throughput and cost issues by migrating off Oracle onto Espresso , an open-source document platform, and adding more nodes. Espresso supports document schema and the schema can evolve over time. The number of requests to our storage infrastructure doubles every year.

Database 133

Database Project Datasets Designing 133

Snowflake

NOVEMBER 1, 2023

Text Summarization (in private preview): Summarize long documents for faster consumption. With the initial release, you will be able to find tables, views, databases, schemas, Marketplace data products, and Snowflake documentation articles. Figure 4 – Quickly extract data from documents with Document AI.

Unstructured Data 120

Unstructured Data SQL Python Accessibility 120

Seattle Data Guy

OCTOBER 2, 2024

Or maybe you need to parse financial filing documents such as 10-Ks. you work in data, then at some point in your career, you’ll likely need to parse data from a PDF. You might need to parse thousands of PDFs in order to pull out invoice information. This can seem challenging at first.

Data 130

Data Big Data 130

LinkedIn Engineering

DECEMBER 19, 2023

Co-authors: Max Kanat-Alexander and Grant Jenks Today we are open-sourcing the LinkedIn Developer Productivity & Happiness Framework (DPH Framework) - a collection of documents that describe the systems, processes, metrics, and feedback systems we use to understand our developers and their needs internally at LinkedIn. Why Open-Source It?

Data Schemas 121

Data Schemas Software Engineering Software Engineer Designing 121

Christophe Blefari

JULY 28, 2023

📃 In every data team this is super important to write documentation, Marie wrote an awesome 101 about data documentation. The article gives best practices for establishing complete and reliable data documentation.

Data 130

Data SQL Python Programming 130

dbt Developer Hub

APRIL 19, 2023

dim_product.yml : This file will contain our documentation and tests for dim_product. fct_sales.yml : This file will contain our documentation and tests for fct_sales. Step 8: Create model documentation and tests ​ Alongside our fct_sales.sql model, we can populate the corresponding fct_sales.yml file to document and test our model.

Building 145

Building PostgreSQL BI Database 145

KDnuggets

AUGUST 5, 2024

Get noticed by recruiters and hiring managers by creating and documenting the following AI projects.

Portfolio 118

Portfolio Project Recruitment Management 118

Snowflake

APRIL 10, 2024

Account Executives can bring together documents, spreadsheets, presentations, Salesforce reports, and data from Snowflake to get a comprehensive view of the customer in a single interactive document in Coda. For example, Sales teams can use Coda and Snowflake together for account planning and customer engagement.

Finance 122

Finance Media Cloud Data 122

Snowflake

JUNE 5, 2024

Cortex Search (public preview soon): Quickly and securely find information by asking questions within a given set of enterprise documents using the state-of-the-art Arctic embed model. In this model, Cortex Search first fetches relevant documents or passages from a knowledge source, based on the input question.

Coding 103

Coding Building Management Government 103

Seattle Data Guy

JANUARY 18, 2025

Because they can preserve the visual layout of documents and are compatible with a wide range of devices and operating systems, PDFs are used for everything from business forms and educational material to creative designs. PDF files are one of the most popular file formats today.

IT 130

IT Education Data Designing 130

Data Engineering Podcast

JANUARY 21, 2024

I especially like the ability to combine your technical diagrams with data documentation and dependency mapping, allowing your data engineers and data consumers to communicate seamlessly about your projects. Miro is your single pane of glass where everyone can discover, track, and collaborate on your organization's data.

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

The Pragmatic Engineer

OCTOBER 18, 2024

 According to internal documents, OpenAI expects to generate $100B in revenue in 5 years, which is 25x more than it currently makes.   Sudden layoffs at Meta, Spotify confirms work-from-anywhere, US mandates “click-to-cancel,” a historic SpaceX booster catch – and more.

Engineering 335

Engineering Government Project AWS 335

Knowledge Hut

MAY 2, 2024

Who Owns and Documents User Stories? Anybody who has clarity on the requirement can add details, usually, if there is a Business Analyst in the team, they would document requirements, and in other teams the team member documents them. These may be documented for final verification however cannot implement as a separate story.

Business Analyst 98

Business Analyst Project Certification Management 98

Snowflake

NOVEMBER 11, 2024

Conversational apps: Creating reliable, engaging responses for user questions is now simpler, opening the door to powerful use cases such as self-service analytics and document search via chatbots. For instance, if your documents are in multiple languages, an LLM with strong multilingual capabilities is key.

Unstructured Data 91

Unstructured Data SQL AWS Healthcare 91

Data Engineering Weekly

MAY 3, 2024

Documentation support Notebooks support intuitive code documentation, which allows developers to include explanations, thought processes, analysis conclusions, and project goals. Many orchestration engines try supporting the Markdown for documentation, yet it is less intuitive than a Notebook.

Programming Language 117

Programming Language ETL Tools Data Pipeline Coding 117

Christophe Blefari

JULY 3, 2023

They announced: Document AI — A new integrated product where you can ask questions in natural language on documents (PDF, etc.). With LLMs they will try to answer questions.

SQL 130

SQL Data Kafka AWS 130

Lyft Engineering

JUNE 28, 2023

As we refined our onboarding process and improved our documentation, our involvement decreased, and we moved towards a self-service model where partner teams would primarily follow how-to guides and tutorials, and only ask for occasional support when they needed to make tricky decisions or work through kinks.

Machine Learning 118

Machine Learning Building Kafka Metadata 118

Snowflake

MARCH 5, 2024

Put the product name, defect and summary in JSON format: <review>', content, '</review>') ) FROM reviews LIMIT 10; For use cases such as chatbots on top of documents, it may be costly to put all the documents as context in the prompt.

Government 111

Government Data Preparation AWS Data Governance 111

Christophe Blefari

JUNE 16, 2023

Data Documentation 101: Why? — Marie wrote best practices for establishing complete and reliable data documentation. The first advice is about the documentation readers: data team, business users or other stakeholders. Data warehouses are mutable, this is one of the many root causes proposed by Lucas.

Programming Language 130

Programming Language SQL PostgreSQL Data 130