8 Feb 2025 | Maciej Besta1†, Florim Memedi1, Zhenyu Zhang1, Robert Gerstenberger1, Guangyuan Piao2, Nils Blach1, Piotr Nyczyk3, Marcin Copik1, Grzegorz Kwasi?iewski1, Jürgen Müller1, Lukas Gianinazzi1, Ales Kubicek1, Hubert Niewiadomski3, Aidan O'Mahony2, Onur Mutlu1, Torsten Hoefer1
This article discusses the evolution and analysis of reasoning topologies used in prompting large language models (LLMs). It introduces a general blueprint for effective and efficient LLM reasoning schemes, focusing on structures such as chains, trees, and graphs. The study analyzes existing prompting schemes, clarifying concepts and building a taxonomy of structure-enhanced LLM reasoning. It highlights the importance of reasoning topologies, which can be modeled as graphs, and how they influence performance, cost, and efficiency. The article compares different prompting schemes, discussing their design choices, performance, and cost. It also outlines theoretical underpinnings and challenges in the field, emphasizing the need for further research. The study provides insights into the use of different reasoning topologies, including chains, trees, and graphs, and their applications in tasks such as logical reasoning, planning, and creative writing. The article concludes with a discussion of the effectiveness of various prompting schemes and the potential for future improvements in LLM reasoning through the integration of advanced structures and techniques.This article discusses the evolution and analysis of reasoning topologies used in prompting large language models (LLMs). It introduces a general blueprint for effective and efficient LLM reasoning schemes, focusing on structures such as chains, trees, and graphs. The study analyzes existing prompting schemes, clarifying concepts and building a taxonomy of structure-enhanced LLM reasoning. It highlights the importance of reasoning topologies, which can be modeled as graphs, and how they influence performance, cost, and efficiency. The article compares different prompting schemes, discussing their design choices, performance, and cost. It also outlines theoretical underpinnings and challenges in the field, emphasizing the need for further research. The study provides insights into the use of different reasoning topologies, including chains, trees, and graphs, and their applications in tasks such as logical reasoning, planning, and creative writing. The article concludes with a discussion of the effectiveness of various prompting schemes and the potential for future improvements in LLM reasoning through the integration of advanced structures and techniques.