The Pragmatic Engineer

OCTOBER 10, 2023

In this document, we covered: The product The market The go-to-market (GTM) plan Our competitors … and many other things! With the plan in place, we sent this document – rather than the usual pitch deck – over to the VCs. Right at the start, I still had GitHub access and did some reviews.

Software Engineer 268

Software Engineer Software Engineering Architecture Media 268

Cloudera

JUNE 1, 2021

Well, at Cloudera, we envision a world where everyone can quickly and easily access the data-powered information and insights they need – in just a few clicks. . The mission is to “Make data and analytics easy and accessible, for everyone.” Cloudera may also file other documents with the SEC regarding the proposed transaction.

Cloud 144

Cloud Big Data Data Lake Finance 144

Snowflake

MAY 7, 2024

Snowflake Cortex is a fully-managed service that enables access to industry-leading large language models (LLMs) is now generally available. Document chatbots. Their knowledge was contained in more than 700,000 pages of private R&D documents. license, it provides ungated access to weights and code. Daily limits apply.

Government 114

Government SQL Data Security Accessible 114

Snowflake

APRIL 10, 2024

One of our key objectives at Snowflake is to help enterprises fully unlock the value of their data, and an important aspect of that is making data both accessible and actionable to as many people as possible, regardless of their role or technical skill set.

Finance 115

Finance Media Cloud Data 115

Snowflake

NOVEMBER 1, 2023

For organizations to fully capitalize on this potential, it’s critical that everyone — not just those with AI expertise — is able to access and use generative AI. With just a single line of SQL or Python, analysts can instantly access specialized ML and LLM models tuned for specific tasks. See Document AI in action on YouTube.

Unstructured Data 111

Unstructured Data SQL Python Accessible 111

Snowflake

JULY 25, 2024

Snowflake Cortex Search, a fully managed search service for documents and other unstructured data, is now in public preview. Governed : Cortex Search services are schema-level objects in Snowflake and integrate with existing role-based access control (RBAC) policies in a Snowflake account.

Unstructured Data 115

Unstructured Data Metadata Government SQL 115

Robinhood

MAY 30, 2024

Robinhood Crypto has continued to see its market share increase as customers get access to a growing number of advanced trading tools to help them efficiently navigate the crypto market.” Only customers with active Robinhood Crypto accounts will be able to gain access and create their API keys. Learn more at [link].

Insurance 142

Insurance Portfolio Algorithm Coding 142

LinkedIn Engineering

MAY 9, 2023

In the past, we addressed latency, throughput and cost issues by migrating off Oracle onto Espresso , an open-source document platform, and adding more nodes. Espresso supports document schema and the schema can evolve over time. The number of requests to our storage infrastructure doubles every year.

Database 133

Database Project Datasets Designing 133

Cloudera

DECEMBER 2, 2021

For the most security-conscious customers, it is a requirement that all network access be done over private networks. This reduces the threat surface area, rendering impossible many of the most common attack vectors that rely on public access to the customer’s systems. Private Endpoint Access for Required Azure Services.

PostgreSQL 128

PostgreSQL Data Lake Data Warehouse Retail 128

Snowflake

JUNE 5, 2024

It provides access to industry-leading large language models (LLMs), enabling users to easily build and deploy AI-powered applications. By using Cortex, enterprises can bring AI directly to the governed data to quickly extend access and governance policies to the models. Our state-of-the-art hybrid search enables better results.

Coding 93

Coding Building Management Government 93

LinkedIn Engineering

DECEMBER 19, 2023

Co-authors: Max Kanat-Alexander and Grant Jenks Today we are open-sourcing the LinkedIn Developer Productivity & Happiness Framework (DPH Framework) - a collection of documents that describe the systems, processes, metrics, and feedback systems we use to understand our developers and their needs internally at LinkedIn. Why Open-Source It?

Data Schemas 121

Data Schemas Software Engineer Software Engineering Data Pipeline 121

Christophe Blefari

JULY 3, 2023

There are so many sessions at both summits that this is impossible to watch everything, more Databricks and Snowflake do not put in free access online everything so I can't wait everything. They announced: Document AI — A new integrated product where you can ask questions in natural language on documents (PDF, etc.).

SQL 130

SQL Data Kafka AWS 130

Snowflake

SEPTEMBER 7, 2023

We are excited to announce the public preview of External Access, which enables customers to reach external endpoints from Snowpark seamlessly and securely. With this announcement, External Access is in public preview on Amazon Web Services (AWS) regions.

Amazon Web Services 122

Amazon Web Services AWS Government Python 122

Christophe Blefari

SEPTEMBER 28, 2023

If we summarise the initial modern data stack vision , this is something like: move data with Fivetran store data in Snowflake transform data with dbt visualise with Looker document with a catalog, prevent with data observability, orchestrate So what's left of the original vision of the modern data stack that can be applied in 2023 and beyond?

Big Data 147

Big Data Cloud Storage Hadoop SQL 147

Cloudera

JUNE 11, 2024

This type of data includes a variety of content such as documents, emails, images and videos. The Role of an Open Data Lakehouse in Seamless Data Access To fully capitalize on the potential of GenAI, enterprises need seamless access to their data. This is where an open data lakehouse comes into play.

Unstructured Data 98

Unstructured Data Pharmaceutical Banking Manufacturing 98

Tweag

MAY 1, 2024

tl;dr You may not believe it, but Nix documentation is getting better. Table of contents Overview Motivation Statistics Retrospective Thoughts on future work Acknowledgements Overview This is a retrospective of my and many other people’s work on documentation in the Nix ecosystem between October 2022 and March 2024.

Architecture 107

Architecture Project Coding Designing 107

Snowflake

SEPTEMBER 13, 2023

In the coming months, Salesforce and Snowflake plan to launch BYOL Data Federation so Snowflake data can be accessed within Salesforce Data Cloud, completing the bidirectional data sharing capability, to close the loop and facilitate data activation and streamline value for joint customers.

Finance 112

Finance AWS Accessible Accessibility 112

Snowflake

JUNE 5, 2024

At the same time, organizations must ensure the right people have access to the right content, while also protecting sensitive and/or Personally Identifiable Information (PII) and fulfilling a growing list of regulatory requirements.

Government 105

Government Accessible Accessibility Cloud 105

Snowflake

NOVEMBER 11, 2024

Conversational apps: Creating reliable, engaging responses for user questions is now simpler, opening the door to powerful use cases such as self-service analytics and document search via chatbots. For instance, if your documents are in multiple languages, an LLM with strong multilingual capabilities is key.

Unstructured Data 82

Unstructured Data SQL AWS Healthcare 82

Marc Lamberti

OCTOBER 20, 2023

A template engine is a library that combines templates with data models to produce documents. To know if you can use templating or not, you must look at… the documentation Let’s retake the BashOperator. I prefer checking the code instead of the documentation, but it is up to you. Here is a template: <!doctype

SQL 130

SQL Python Coding Metadata 130

Knowledge Hut

SEPTEMBER 24, 2024

Features: Single code base compatible with every major platform Enables to connect to 20+ databases natively via FireDAC's high-paced direct access. Ensures access to stock statements and finance news reports on government economics, all displayed in a simple to parse format. Over 70 data sources connectors of CData Enterprise 2.

Electronics 98

Electronics MongoDB SQL Java 98

Snowflake

MARCH 5, 2024

RAG is a popular framework in which an LLM gets access to a specific knowledge base with the most up-to-date, accurate information available before generating a response. This content needs to be inserted into an automated pipeline that chunks (that is, breaks documents into smaller pieces) and embeds the text into a vector store.

Government 101

Government Data Preparation AWS Data Governance 101

Knowledge Hut

FEBRUARY 28, 2024

The business analyst is expected to bridge the gap between the traditional and advanced practices of information gathering; it saves the time of all the project team members that they otherwise invest in pulling data from a spreadsheet and then feeding it into the Excel sheet to make it accessible at different points.

Business Analyst 98

Business Analyst Data Science Project Designing 98

Snowflake

FEBRUARY 5, 2024

The foundation for success is a data platform that allows flexible, cost-effective ways to access gen AI — whether organizations want to use off-the-shelf commercial and open-source large language models (LLMs), or fine-tune their own LLMs for more complex applications. Rinesh Patel, Snowflake’s Global Head of Financial Services 2.

Unstructured Data 106

Unstructured Data Banking Government Insurance 106

Data Engineering Podcast

MAY 26, 2024

Trusted by the teams at Comcast and Doordash, Starburst delivers the adaptability and flexibility a lakehouse ecosystem promises, while providing a single point of access for your data and all your data governance allowing you to discover, transform, govern, and secure all in one place. Want to see Starburst in action?

Systems 130

Systems Data Lake High Quality Data Google Cloud 130

Knowledge Hut

FEBRUARY 14, 2024

The primary role of a business analyst in a project is to elicit, analyze and document requirements related to the solution being developed. This uncertainty results in difficulties with regards to eliciting, analyzing and documenting the exact need. The Business Analyst must document assumptions along with the associated attributes.

Business Analyst 98

Business Analyst BI Banking Finance 98

Tweag

FEBRUARY 15, 2023

However, there are some problems with step (4): The build is not properly isolated: it can (in theory) fetch arbitrary things from the network, access arbitrary files on the filesystem, and even modify other packages. Run the build system. It is pretty good at this. The proper way to fix such errors is to fix the packaging upstream.

Project 144

Project Programming Language Building Systems 144

Snowflake

OCTOBER 18, 2024

An open standard for storage format and catalog API has helped, but there’s still a need for open standards for the catalog, including a consistent way to apply security access controls to data. Since open sourcing, more people have become involved to help improve documentation, fix bugs and propose new features.

Government 91

Government Data Lake Engineering Accessible 91

Knowledge Hut

JANUARY 24, 2024

Data Sources Tableau Software can access many data sources and servers. Provides Great Security Data connections and user access feature a fail-safe security system based on authentication and authorization mechanisms. Users can access a range of resources for issue resolution and guidance.

BI 98

BI Business Intelligence Non-relational Database Data Analysis 98

Data Engineering Podcast

JULY 23, 2023

Summary Real-time data processing has steadily been gaining adoption due to advances in the accessibility of the technologies involved. Hex also has AI built directly into the workflow to help you generate, edit, explain and document your code. Despite that, it is still a complex set of capabilities.

Building 130

Building Machine Learning SQL Python 130

Cloudera

AUGUST 15, 2024

Data practitioners are consistently asked to deliver more with less, and although most executives recognize the value of innovating with data, the reality is that most data teams spend the majority of their time responding to support tickets for data access, performance and troubleshooting, and other mundane activities.

Data Warehouse 79

Data Warehouse Accessible Accessibility Designing 79

Snowflake

DECEMBER 20, 2023

Accessing the necessary resources from cloud providers demands careful planning and up to month-long wait times due to the high demand for GPUs. Documentation See how Snowpark ML plus Snowpark Container Services simplifies LLM deployment. There is no need to self-procure instances or make reservations with their public cloud provider.

Scala 122

Scala Government Java Cloud 122

Data Engineering Podcast

NOVEMBER 19, 2023

I especially like the ability to combine your technical diagrams with data documentation and dependency mapping, allowing your data engineers and data consumers to communicate seamlessly about your projects. Miro is your single pane of glass where everyone can discover, track, and collaborate on your organization's data.

Project 147

Project Data Lake High Quality Data SQL 147

Knowledge Hut

MAY 2, 2024

Who Owns and Documents User Stories? Anybody who has clarity on the requirement can add details, usually, if there is a Business Analyst in the team, they would document requirements, and in other teams the team member documents them. These may be documented for final verification however cannot implement as a separate story.

Business Analyst 98

Business Analyst Project Certification Management 98

Christophe Blefari

MARCH 31, 2023

Still one complaint I might have is about documentation, sometimes docs page are not of great quality, the presentation is pretty bad and full of usage examples when we only need complete documentation of ressources. They created Looker Modeler as a metrics layer that will be accessible by all the application downstream.

Bytes 130

Bytes Data Google Cloud Education 130

Edureka

FEBRUARY 8, 2023

12 Code Documentation : It is written material that explains how classes, modules, functions, and variables used in computer programmes work and how they were designed. Code that is well documented is simpler to maintain, debug, and reuse. ” Fig.11 By looking at the example shown below, you will get an idea of how it works.

Coding 130

Coding Deep Learning Programming Java 130

Rockset

APRIL 18, 2023

In the demo, you’ll see how Rockset delivers search results in 15 milliseconds over thousands of documents. Organizations have continued to accumulate large quantities of unstructured data, ranging from text documents to multimedia content to machine and sensor data. Why use vector search?

Unstructured Data 105

Unstructured Data Metadata Machine Learning SQL 105