QwenLM/Qwen3-Omni

Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and performing real-time speech generation.

open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.

A fast multimodal LLM for real-time voice

A framework for efficient model inference with omni-modality models

Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider. Uses Stream's edge network for ultra-low latency.

A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone

Kimi-Audio, an open-source audio foundation model excelling in audio understanding, generation, and conversation

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model