Mistral unveils Robostral Navigate to guide robots with a single camera
The French AI powerhouse is officially bringing vision models out of chatbot windows and into physical reality, giving robots a brain that reads natural text commands while steering around furniture without breaking a sweat.
Engineers at Mistral have introduced Robostral Navigate, an open model designed to pilot autonomous ground robots through indoors using nothing more than a basic RGB web camera feed and human text prompts. Instead of forcing machines to map environments down to the millimeter, the system simply picks visual points on a live screen and points the robot toward them.
The brains behind the operation rely on an 8-billion parameter vision-language model that acts like a backseat driver, updating directional targets roughly twice per second. Because computing exact spatial math is a notorious nightmare for cheap optics, this model delegates motor control to a lightweight 121-million parameter diffusion model, which translates targeted image pixels into smooth physical pathways.
Training took place entirely inside virtual worlds rather than real-world obstacle courses. Mistral generated 2.4 million navigation trajectories across 350,000 simulated environments, randomly tweaking ceiling heights, lighting angles, and room clutter so the software wouldn't panic when encountering an unfamiliar rug.
To fix recurring mistakes, the team ran a reinforcement learning algorithm called CISPO across 35,000 brutal edge-case tasks. On the standard R2R-CE navigation benchmark, Robostral Navigate completed 77.4% of assigned routes in unseen buildings, easily outperforming previous single-camera baselines that capped out at 66.9%.
Physical verification was conducted using standard commercial hardware, specifically the Galaxea R1 and the compact Hiwonder JetAuto, where researchers swapped out only the high-level movement software while leaving all factory sensors untouched.
Hardware manufacturers currently selling overpriced multi-sensor arrays and depth cameras to robotics labs may need to reconsider their pricing strategies sooner than expected.
Source: Mistral AI
Comments
This is where the magic happens: AI reads your discussion and rewrites the article based on the most interesting comments. Each strong comment adds points to the meter below. Once the meter is full, the article updates live — no page reload needed.