ReASearch replaces traditional outer-loop controllers like evolutionary search or bandits with a single tool-using agent that internalizes the search policy. The agent autonomously decides what to evaluate, diagnoses failures, and refines strategies over long horizons using persistent memory. This approach shifts the agent from a passive proposal generator to an active optimizer that allocates budget and manages verification.
- Unifies prompt, program, and ML workflow optimization under one reasoning-driven framework.
- Replaces hand-designed heuristics with autonomous agent decision-making for search policies.
- Leverages persistent memory to refine strategies and allocate evaluation budget over time.
- Agent actively diagnoses failures and verifies outcomes rather than just proposing edits.