LLMs have gained outstanding reasoning capabilities through reinforcement learning (RL) on correctness rewards. Modern RL algorithms for LLMs, including GRPO, VinePPO, and Leave-one-out PPO, have moved away from traditional PPO approaches by eliminating the learned value function network in favor of empirically estimated returns. This reduces computational demands and GPU memory consumption, making RL training… →

Artificial intelligence has grown beyond language-focused systems, evolving into models capable of processing multiple input types, such as text, images, audio, and video. This area, known as multimodal learning, aims to replicate the natural human ability to integrate and interpret varied sensory data. Unlike conventional AI models that handle a single modality, multimodal generalists are… →

In this tutorial, we will guide you step-by-step through creating and publishing a sleek, modern AI blogging website using Lovable.dev. Lovable.dev simplifies website creation, enabling users to effortlessly develop visually appealing and responsive web pages tailored to specific niches, like AI and technology. We’ll demonstrate how to build a homepage quickly, integrate interactive components, and… →

Video-LLMs process whole pre-recorded videos at once. However, applications like robotics and autonomous driving need causal perception and interpretation of visual information online. This fundamental mismatch shows a limitation of current Video-LLMs, as they are not naturally designed to operate in streaming scenarios where timely understanding and responsiveness are paramount. The transition from offline to… →