AI as a Rational Theologian

The publication presents the results of research on the abilities of leading chatbots based on large language models in the field of theological skills. In accordance with the author's methodology, it has been shown that they can, among others: effectively interpret the Bible and recognize theological problems, analyse and evaluate theological argumentation, and formulate their own conclusions and conduct reasoning. The publication is licensed under the Creative Commons Attribution 4.0 (CC BY 4.0) (full license available at: https://creativecommons.org/licenses/by/4.0/legalcode.en). ****** AI jako racjonalny teolog. Kompleksowa ocena umiejętności Publikacja prezentuje wyniki badań nad zdolnościami wiodących chatbotów opartych na dużych modelach językowych w obszarze umiejętności teologicznych. Zgodnie z autorską metodologią wykazano, że potrafią one m.in.: skutecznie interpretować Biblię, rozpoznawać problemy teologiczne, analizować i oceniać argumentację teologiczną oraz formułować własne wnioski i przeprowadzać rozumowanie. Publikacja na licencji Creative Commons Uznanie autorstwa 4.0 (CC BY 4.0) (pełna treść wzorca dostępna pod adresem: https://creativecommons.org/licenses/by/4.0/legalcode.pl).

Abstract 7 Executive Summary 8 1. Introduction 11 2. Methodology 14 2.1. Aim and Research Questions 14 2.2. General Assumptions 14 2.3. Theological Skills and Assessment Criteria 18 2.4. Rating Framework 20 2.5. Tasks 22 3. Results: Discussion and Assessment 37 3.1. Interpreting the Bible 37 3.2. Clarification of Theological Problems 44 3.3. Critical Assessment of Theological Reasoning 49 3.4. Formulating Theological Reasoning 65 3.5. Linking Biblical Utterances to Theological Statements 73 3.6. Discussing Issues in Natural Theology 79 3.7. Providing Theological Guidance 85 3.8. Applying the Concept of a Rational Theologian 88 3.9. Evaluating Theological Skills 98 4. Final Assessment and Rating 103 4.1. Interpreting the Bible 103 4.2. Clarification of Theological Problems 104 4.3. Critical Assessment of Theological Reasoning 104 4.4. Formulating Theological Reasoning 106 4.5. Linking Biblical Utterances to Theological Statements 106 4.6. Discussing Issues in Natural Theology 107 4.7. Providing Theological Guidance 108 4.8. Applyng the Concept of a Rational Theologian 109 4.9. Evaluating Theological Skills 109 4.10. Final Rating 110 5. Conclusions 113 References 117 Appendix: Final Conversations with the Chatbots 120 Group 1: ChatGPT 120 Group 1: Gemini 138 Group 2: ChatGPT 150 Group 2: Gemini 162 Group 3: ChatGPT 168 Group 3: Gemini 192 Group 4: ChatGPT 204 Group 4: Gemini 223 Group 5: ChatGPT 231 Group 5: Gemini 244 Group 6: ChatGPT 249 Group 6: Gemini 264 Group 7: ChatGPT 269 Group 7: Gemini 282 Group 8: ChatGPT 288 Group 8: Gemini 293 Group 9: ChatGPT 300 Group 9: Gemini 308 Acknowledgements 315