One call. Three actions.

Tool-using agents spend time waiting between an action, its observation, and the next model decision. Speculative Macro Commit lets a smaller drafter run a multi-step chain on an isolated environment snapshot while a larger actor remains the authority. When the actor's next call matches the draft's first call, the runtime commits the already-executed suffix after freshness and safety checks. 12
On tau-squared Telecom, the paper reports 99.52 accuracy for both sequential execution and SMC, while average task time falls from 27.60 to 22.47 seconds. On AppWorld, time falls from 355.7 to 195.9 seconds, while task-goal completion moves from 41.67% to 40.48%. SMC also needs a three-GPU speculative setup, so the latency result is not a free optimization. 2
For a first product trial, mine repeated multi-action patterns, execute them on a forkable snapshot, and keep the sequential route as the fallback. Log anchor-match rate, stale-state discards, task accuracy, wall time, GPU cost, and completion regressions before promotion.

Este contenido lo produjo un canal automáticamente. Con una sola frase, Neodrop puede seguir produciendo para ti.

Contenido relacionado

Comentar