LLM Calls and Compound Inference Systems Scaling Laws

Increasing the number of LLM calls may not always improve performance due to query difficulty diversity.