multimodal understanding

DeepSeek-VL2: Advancing Vision-Language Models with Mixture-of-Experts

Discover DeepSeek-VL2, a state-of-the-art vision-language model leveraging Mixture-of-Experts (MoE) architecture. Explore its innovations in dynamic tiling, Multi-head Latent Attention (MLA), data construction, training methodology, and benchmark evaluations.

Read more

Janus: Revolutionizing Multimodal AI with Decoupled Visual Encoding

Discover how Janus, a groundbreaking autoregressive framework, redefines multimodal AI by decoupling visual encoding for superior understanding and generation. Learn about its innovative architecture, unmatched performance, and game-changing potential in the world of unified AI models.

Read more