Copilot AI Systems Release Notes

Dec 6, 2024

Numerous QoR (Quality of Results) improvements to the query type classification based question answering AI workflow.
Better resiliency and retry mechanisms to allow for AI to recover from model communication issues.
AI generated titles for conversations before completing them
Query classification now covers a broader range of types and are stored as part of our ongoing analytics
- Coming Soon (Analytics dashboard access to this and more!)
Improvements to accuracy of related content suggestions presented as part of the conversation
Better history interpretation in a multi-turn conversation

We are catching up on our August to October changes via this release note.

New query type classification based, multi-step question answering flow
New - Product Catalog and Product Glossary based query types for:
- Looking up technical specifications for one or more products
- Looking up products that match certain technical specifications
- Comparing two or more specific products
- Search by keywords
- General queries
AI Explainability - now you can see clearly what steps our AI workflows took in order to present a result.
Artifacts!
- The specialized query types above will now present artifacts such as comparison tables, data sheets allowing you to get an even more dynamic answer, plus you can download those artifacts as PDFs, share it with others etc.

Talk to us if you are interested in a product catalog powered expert assistant!

We are catching up on our July release notes in this early August release notes update.

We've improved our automated evaluation metrics for our proprietary RAG system.
We've added initial query enrichment to improve answers for brief or terse queries (select customers)
We have made significant improvements in automated ingestion systems, though we are still a few more weeks away from productizing it and providing self service control.
We have improved our conversation history document schema, and now can add more useful insights by analyzing conversations after they are complete, and to provide richer, more useful analytics.

Query type specific additional guidelines and prompts help us surgically handle edge cases for that type of question.

More robust error handling when conversation streams encounter errors. There's now feedback in the copilot UX about the error and a rendering of the partial answer in case the error happened mid-flight in a conversation.

For customers with product catalogs, we now also handle use case type questions. Given a use case, we can find matching products and answer specific attributes of the matching products.
We've improved our internal tracing systems allowing us to track all steps involved in the agent's AI workflow to find issues and improve accuracy
In addition to keyword and semantic search, we now support fuzzy search of product catalog terms
Latency improvements for our advanced model. 90% of questions are now answered ~5-10 seconds faster.

Multi-step question answering with query classification, query rewriting, product catalog based retrieval

Copilot now retrieves related videos, learning modules for customers who provide those as sources.
More advanced agentic retrieval and question answering system
Copilot now supports Advanced AI models.
- Our Advanced models follow instructions better, are more robust at answering questions and in general more powerful for a variety of tasks, with greater world knowledge.
- Contact us at support@rapidflare.ai if you would like to set your enterprise to this more advanced model.
Note: These models will take longer to generate responses.
Responses from the Copilot will now be always streamed as they are being generated. Since advanced models take longer to complete this will enable humans to start processing the copilot's responses as they are being generated.