Article
RSI-Anything lets AI improvements to be made while working, fixing more bugs without changing the programming model
According to a news brief from Beating AI news,AI research institution PhAI Labs released RSI-Anything, attempting to let AI Agent continually accumulate experience from real-world tasks and improve its own methods of working. This framework can be used for code repair, computer operation, and scientific research.
Its approach is to equip the Agent with a “world model” dedicated to predicting the possible results of different actions. The Agent first proposes several plans, the world model determines which is more likely to succeed, and then selects a plan for actual execution. The system subsequently compares the prediction with the actual result and improves the Agent’s action strategy. If the prediction is inaccurate, it also updates the world model. A new version can be retained for the next round of tasks only after passing tests.
For bug fixing, for example, the coding model generates four modification plans at once.RSI-Anything first predicts which one is most likely to pass the tests, runs only one in practice, and then uses the test results to improve subsequent judgments. This allows limited testing opportunities to be allocated to the most promising plans.
In 200 Code CodeContests problems, the coding ReasonFlux-Coder-7B remains unchanged throughout, and the number of tests is also broadly the same. With a traditional static verifier, the repair pass rate was 26.3%. After introducing world-model screening, it rose to 29.2%, and after updating the world model using actual feedback, reached 31.2%.
The team also applied this method to computer operation and scientific experiments. In laboratory planning tests, a 4B model was continuously updated through five versions, with the planning score rising from 21.80%to 46.01%.
The project code has been made public. At present, different tasks still use their own Agents and world models. The paper also acknowledges that whether execution strategies and world models can continue to improve jointly over the long term on the same task requires further experimental validation.
Original link https://m.theblockbeats.info/flash/371379