The Fifth Elephant 2025 Annual Conference CfP

Current employees are increasingly using AI tools like ChatGPT to enhance their tasks, but these tools often lack access to internal organizational data, limiting tool’s effectiveness. This limitation leads to lower employee productivity. Key challenges include limited access to proprietary information by open AI tools, privacy and security concerns. AI tools may provide generic responses that do not align with the specific needs of the organization or its employees.

To address these issues, there is a pressing need for AI tools that integrate seamlessly with internal systems, ensure data security, and enhance employee productivity by providing tailored solutions. Enter Rovo Search, developed by Atlassian, aims to facilitate cross-product searching and leverage AI for insights into enterprise data, supporting various native Atlassian products (e.g. Confluence) and 3P platforms (e.g. Slack/Google Drive/MS Sharepoint) while honouring organizational access controls. This integration not only enhances the relevance of the information retrieved but also empowers employees to make informed decisions based on comprehensive data analysis.

This presents engineering challenges such as data ingestion, which involves efficiently collecting and processing data from various internal/external sources; data transformation including vector embeddings for semantic search, which is the process of converting data into a usable format for analysis and insights; and indexing allows for quick retrieval of information and personalized relevance ranking. Join us to explore the challenges we encountered and the solutions we implemented while building a large-scale enterprise AI.