Yes LLM sometime feels like a stubborn child who insists on his own way. Many methods can be applied to fix it. Like improving reranker, instructions. One other option is to break the problem into multiple small problems and chain them together to gain better control of the flow and formulate the answer. So my finding is it's becoming more and more important to have a good router that knows which chain to invoke.