SlackHow we built enterprise search to be secure and private
Read Full ArticleSummary
The article discusses the development of Slack's enterprise search feature, emphasizing its security and privacy principles that align with Slack AI's compliance standards. It details how the system utilizes Retrieval Augmented Generation (RAG) to ensure that customer data remains within Slack's trust boundary and is not used to train large language models. The architecture leverages OAuth for user permissions, ensuring that only authorized data is accessed and that external data is not stored in Slack's databases. This approach allows for real-time, permissioned search results from external applications like Google Drive and GitHub, enhancing the user experience while maintaining strict security protocols.
Key Learnings
- 1Slack's enterprise search uses Retrieval Augmented Generation to provide real-time, secure access to external data without storing it.
- 2The architecture ensures that customer data remains within Slack's trust boundary, adhering to enterprise-grade security standards.
- 3OAuth is utilized to manage user permissions effectively, ensuring that users control access to their external data.
- 4The principle of least privilege is applied by only requesting necessary permissions for external data access, enhancing security.
Who Should Read This
Senior Security Engineers implementing enterprise-grade security measures in AI-driven applications
Test Your Knowledge
What are the advantages and disadvantages of using Retrieval Augmented Generation compared to traditional training of large language models?
How does Slack ensure that external data remains up-to-date and relevant for user queries?
In what ways does the OAuth protocol enhance security in the context of Slack's enterprise search?
What are the implications of not storing external data in Slack's databases for data retrieval and user experience?
How does the principle of least privilege influence the design decisions made in Slack's enterprise search architecture?
Topics
More articles about Retrieval Augmented Generation
Explore Retrieval Augmented Generation engineering →Unified Context-Intent Embeddings for Scalable Text-to-SQL
The article outlines Pinterest's evolution from basic Text-to-SQL systems to a sophisticated Analytics Agent that leverages unified context-intent embeddings for enhanced query understanding and SQL...
Scaling Search Relevance: Augmenting App Store Ranking with LLM-Generated Judgments
The article presents a study on enhancing search relevance in app store rankings by integrating LLM-generated judgments. It identifies the challenge of limited expert-provided textual relevance...
Using LLMs to amplify human labeling and improve Dash search relevance
The article outlines how Dropbox Dash utilizes a retrieval-augmented generation (RAG) approach to enhance search relevance by integrating large language models (LLMs) with human labeling. It explains...
Unifying Ranking and Generation in Query Auto-Completion via Retrieval-Augmented Generation and Multi-Objective Alignment
The article discusses a novel approach to Query Auto-Completion (QAC) that integrates Retrieval-Augmented Generation (RAG) with multi-objective Direct Preference Optimization (DPO). This unified...
Engineering VP Josh Clemm on how we use knowledge graphs, MCP, and DSPy in Dash
In this article, Josh Clemm discusses the technical architecture behind Dropbox Dash, focusing on the integration of knowledge graphs, retrieval methods, and the use of large language models (LLMs)....
More from Slack Engineering
View Slack engineering blogs →Android VPAT journey
The article outlines Slack's journey in improving accessibility for its Android application through a Voluntary Product Accessibility Template (VPAT). It details the identification of accessibility...
Streamlining Security Investigations with Agents
The article outlines how Slack's Security Engineering team leverages AI agents to enhance the efficiency of security investigations. It details the development of a prototype that evolved into a...
Migration Automation: Easing the Jenkins → GHA shift with help from AI
The article outlines a project undertaken at Slack to automate the migration of CI jobs from Jenkins to GitHub Actions (GHA). It details the development of a conversion tool that leverages the GitHub...
Automated Accessibility Testing at Slack
The article outlines Slack's approach to enhancing accessibility through automated testing, emphasizing the importance of integrating accessibility checks within the existing testing frameworks. It...
Optimizing Our E2E Pipeline
The article outlines how Slack's DevXP team optimized their end-to-end (E2E) testing pipeline by addressing inefficiencies in frontend builds within a monolithic repository. By implementing a...