Scaling Inference-Time Compute: Decoding Efficiency vs. Logical Reasoning Gain
Increasing test-time compute through MCTS or rejection sampling yields diminishing logarithmic returns on reasoning benchmarks (e.g., AIME) after a 10x compute threshold, where token-level variance outweighs the logical gain of exhaustive path exploration.