CounterMem: World-Model-Verified Counterfactual Memory for Language Agents2026.04 - Present Web Intelligent Systems and Engineering Lab · Prof. Yongfeng ZhangRutgers University (US) Click to expand / 点击展开详情
Method: Developed CounterMem, an RL-based framework for constructing and reusing verified counterfactual memory in language agents. The method generates local alternatives to failed actions, verifies their outcomes with executable world models, stores action contrasts together with evidence and reuse conditions, and trains a DQN selector to decide when retrieved memory should guide a new task.
Results: Evaluated on 12 benchmarks across six domains. CounterMem improved ReAct and Reflexion in 24/24 benchmark-agent comparisons with gpt-oss-120b, averaging +12.6 pp; across two backbones, four-domain gains reached 8.2–20.4 pp while task-run token usage fell by 7.7–42.0%.
Links: Paper (arXiv:2609.31874) — under review at ICLR 2027.