Repository History
5 repositories tagged with Multimodal
AWESOME-OCR-LLM: Curated Reading List for OCR in the LLM Era
AWESOME-OCR-LLM is a continuously updated reading list focusing on Optical Character Recognition (OCR) in the era of large language models (LLMs). It covers key areas like document parsing, understanding, visual text generation, and benchmarks, highlighting research from the past five years. This resource is invaluable for anyone tracking the rapid advancements in multimodal document AI.
PixelRAG: Pixel-Native Search for Visual Retrieval-Augmented Generation
PixelRAG revolutionizes search by enabling pixel-native retrieval, moving beyond traditional text parsing. It renders documents as screenshots, preserving visual context like tables and charts, which is crucial for accurate answers from reader models. This allows for searching any document based on its visual appearance, not just its textual content.
Qwen3-VL: A Powerful Multimodal Large Language Model Series
Qwen3-VL is a cutting-edge multimodal large language model series from Alibaba Cloud's Qwen team. It offers significant advancements in visual and text understanding, extended context length, and enhanced agent capabilities. This model is designed for flexible deployment, scaling from edge to cloud.
VideoSDK AI Agents: Build Real-time Multimodal Conversational AI
VideoSDK AI Agents is an open-source Python framework designed for developing real-time, multimodal conversational AI agents. It enables seamless, natural voice and media interactions between users and intelligent agents within VideoSDK rooms. This powerful framework supports integration with various AI models and tools, facilitating advanced conversational experiences.
Podcastfy: Transform Multimodal Content into AI-Generated Multilingual Podcasts
Podcastfy is an open-source Python package that transforms diverse multimodal content, such as text, images, and videos, into engaging multilingual audio conversations. Utilizing generative AI, it offers a flexible and programmatic alternative to tools like NotebookLM, focusing on customization and scalability. This makes it an excellent solution for content creators, educators, and researchers aiming to broaden their audience reach and improve content accessibility.