SpecBox: Speculative Sandbox Scheduling for Efficient LLM Agent Serving

Research introduces SpecBox, a speculative scheduling technique for LLM agent sandboxes to improve resource utilization and reduce tail latency.