OCR for more models

Currently, interacting with text-based LLMs requires pre-processing of visual data (images, PDFs) to extract the text. Implementing state-of-the-art OCR models directly into the chat interface would eliminate this manual step. Users could upload images or PDFs, and the system would automatically extract the text, making it available for the LLM. A key enhancement is the ability to recognise and format tabular data within these documents into Markdown tables.

Benefits:

• Improved User Experience: Simplifies the process of using visual data with text-based LLMs.

• Increased Efficiency: Reduces the time and effort required for text extraction.

• Markdown Table Formatting: Automatically converts tabular data into well-formatted Markdown tables for easy readability and integration.

• Competitive Advantage: Positions the platform as a leader in integrating visual and textual data processing.