Theology and LLMs: Truth, Bias, and Mediation
Article Sidebar
How to Cite
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Downloads
Societal impact
Main Article Content
Abstract
This article analyzes the theological and pastoral implications of using large language models in the context of the life and mission of the Catholic Church. It arises from a growing concern: how artificial intelligence systems may influence the mediation of revealed Truth and the integrity of ecclesial Tradition. The main objective is to identify the risks and potentialities of these technologies when applied to theology, particularly regarding doctrinal fidelity, Church authority, and the transmission of Tradition.
The research follows an empirical and interdisciplinary methodology, combining a comparative analysis of the responses generated by six language models to twelve questions on doctrinally sensitive topics, with theological and ethical reflection. The topics addressed include the appointment of bishops in China, the Church’s teaching on abortion, and its position regarding same-sex marriage. The data reveal consistent factual knowledge in many areas, but also instances of thematic censorship, doctrinal instability, and ideological bias, influenced by the cultural or political context of the models.
The conceptual framework is grounded in Catholic theology, digital ethics, and recent proposals for AI regulation. The study highlights the importance of theological discernment and proposes the need for responsible oversight, diversity of sources, and the development of models that promote critical use and serve the Church’s mission without compromising truth, community, or the common good.
Article Details
References
Alpaydin, E. (2016). Machine learning: The new AI. MIT Press.
Antón, A. (1996). La «recepción» en la Iglesia y eclesiología (II). Gregorianum, 77(3), 437–469.
Barfield, W., & Pagallo, U. (2020). Advanced introduction to law and artificial intelligence. Edward Elgar Publishing.
Benanti, P. (2022). Human in the loop. Decisioni umane e intelligenze artificiali. Mondadori.
Bento XVI. (2010). Exortação Pós-Sinodal Verbum Domini sobre a Palavra de Deus na vida e na missão da Igreja (30/09/2010). AAS, 102(11), 681–787.
Binti Mohd Nazri, N. A., Binti Omar, A., & Bin Amir Hussin, A. ’Aatieff. (2025). Fine-tuning Large Language Model (BERT) for Islamic Moral Inquiry and Response. International Journal on Perceptive and Cognitive Computing, 11(1), 88–94. https://doi.org/10.31436/ijpcc.v11i1.533
Bostrom, N. (2017). Superintelligence: Paths, dangers, strategies (Reprinted with corrections 2017). Oxford University Press.
Buijsman, S., Klenk, M., & van den Hoven, J. (2025). Ethics of AI: Toward a “Design for Values” Approach. Em N. A. Smuha (Ed.), The Cambridge Handbook of the Law, Ethics and Policy of Artificial Intelligence (1.a ed., pp. 59–78). Cambridge University Press. https://doi.org/10.1017/9781009367783
Chua, E. R. (2024). ChatGPT’s Gospel Preaching Process: A Grounded Theory Study. Preprints. https://doi.org/10.31124/advance.23257727.v2
Coeckelbergh, M. (2019). Artificial Intelligence: Some ethical issues and regulatory challenges. Technology and Regulation, 2019, 31–34. https://doi.org/10.71265/a9yxhg88
Coeckelbergh, M. (2020). AI ethics. The MIT press.
Concílio Ecuménico Vaticano II. (1965). Decreto Unitatis Redintegratio sobre o Ecumenismo. AAS, 57(1), 90–112.
Concílio Ecuménico Vaticano II. (1966). Constituição dogmática Dei Verbum sobre a revelação divina (18/11/1965). AAS, 58(12), 817–836.
Conselho Pontifício para a Promoção da Nova Evangelização. (2020). Diretório para a catequese. SNEC.
Danesi, C. (2022). El imperio de los algoritmos. IA inclusiva, ética y al servicio de la Humanidad (1st ed). Galerna.
Dias, P., Andrade, J. G., & Ilharco, F. (Eds.). (2025). Além das Palavras: Inteligência Artificial e uma nova Era da Comunicação. Em Comunicação e inteligência artificial. Perspetivas Multidisciplinares. UCP Editora.
Dicastério para a Doutrina da Fé, & Dicastério para a Cultura e a Educação. (2025). Antiqua et nova. Nota sobre a relação entre a inteligência artificial e a inteligência humana. Editorial A.O.
Dulles, A. (2018). The craft of theology: From symbol to system (New expanded edition). Crossroad.
Fanous, A., Goldberg, J., Agarwal, A. A., Lin, J., Zhou, A., Daneshjou, R., & Koyejo, S. (2025). SycEval: Evaluating LLM Sycophancy (No. arXiv:2502.08177). arXiv. https://doi.org/10.48550/arXiv.2502.08177
Ferrara, E. (2023). Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies. Sci, 6(1), 1–15. https://doi.org/10.3390/sci6010003
Ferrarotti, F. (1990). Time, memory, and society. Greenwood Press.
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., Schafer, B., Valcke, P., & Vayena, E. (2018). AI4People—An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations. Minds and Machines, 28(4), 689–707. https://doi.org/10.1007/s11023-018-9482-5
Hagendorff, T. (2024). Mapping the Ethics of Generative AI: A Comprehensive Scoping Review. Minds and Machines, 34(4), 39. https://doi.org/10.1007/s11023-024-09694-w
Hirano, M., Suzuki, M., & Sakaji, H. (2023). llm-japanese-dataset v0: Construction of Japanese Chat Dataset for Large Language Models and its Methodology (No. arXiv:2305.12720). arXiv. https://doi.org/10.48550/arXiv.2305.12720
Huang, C., Zhang, Z., Mao, B., & Yao, X. (2023). An Overview of Artificial Intelligence Ethics. IEEE Transactions on Artificial Intelligence, 4(4), 799–819. https://doi.org/10.1109/TAI.2022.3194503
Huang, Y. (Ed.). (2017). The Oxford handbook of pragmatics (First edition). Oxford University Press.
Jeong, C. (2024). Fine-tuning and Utilization Methods of Domain-specific LLMs. Journal of Intelligence and Information Systems, 30(1), 93–120. https://doi.org/10.13088/jiis.2024.30.1.093
Jungen, A. (2024). Revelation or cliché? AI-Jesus appears in Lucerne church. SWI. https://www.swissinfo.ch/eng/aging-society/revelation-or-cliché-jesus-avatar-appears-in-lucerne-church/87332771
Jurafsky, D., & Martin, J. (2008). Speech and language processing: An introduction to natural language processing, computational linguistics, and speech recognition (2. ed.). Prentice Hall.
Karaarslan, E., Alan, A. Y., & Aydın, Ö. (2025). Improving LLM Reliability with RAG in Religious Question-Answering: MufassirQAS. Turkish Journal of Engineering, 9(3), 544–559. https://doi.org/10.31127/tuje.1624773
Kong, H., Ahn, Y., Lee, S., & Maeng, Y. (2024). Gender Bias in LLM-generated Interview Responses (Versão 3). arXiv. https://doi.org/10.48550/ARXIV.2410.20739
Lanza, S. (2001). Fede e prassi. Em N. Reali & G. R. Alberti (Eds.), In Cristo nuova creatura (pp. 199–221). Mursia.
Ling, L., Rabbi, F., Wang, S., & Yang, J. (2024). Bias Unveiled: Investigating Social Bias in LLM-Generated Code (Versão 4). arXiv. https://doi.org/10.48550/ARXIV.2411.10351
Liu, S., Lu, Y., Fang, W., Li, M., & Xie, Z. (2025). OpenLLM-RTL: Open Dataset and Benchmark for LLM-Aided Design RTL Generation (No. arXiv:2503.15112). arXiv. https://doi.org/10.48550/arXiv.2503.15112
Lorizio, G. (2003). La tradizione cristiana nel contesto del «villaggio globale». Rassegna di Teologia, 44, 663–706.
Luca, M., Beneduce, C., Lepri, B., & Staiano, J. (2025). The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Data (Versão 1). arXiv. https://doi.org/10.48550/ARXIV.2504.01951
Marcondes, F. S., Gala, A., Magalhães, R., Perez De Britto, F., Durães, D., & Novais, P. (2025). Natural Language Analytics. Em F. S. Marcondes, A. Gala, R. Magalhães, F. Perez De Britto, D. Durães, & P. Novais, Natural Language Analytics with Generative Large-Language Models (pp. 9–21). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-76631-2_2
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016). The ethics of algorithms: Mapping the debate. Big Data & Society, 3(2), 2053951716679679. https://doi.org/10.1177/2053951716679679
Nehring, J., Gabryszak, A., Burchardt, A., Schaffer, S., Spielkamp, M., & Stark, B. (2024). Large Language Models are Echo Chambers. Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024, 10117–10123.
Noceti, S. (2020a). Elaborare decisioni nella Chiesa. Una riflessione ecclesiologica. Em R. Battocchio & L. Tonello (Eds.), Sinodalità. Dimensione della Chiesa, pratiche nella Chiesa. Edizioni Messaggero : Facoltà teologica del Triveneto.
Noceti, S. (2020b). La sinodalità. Una riflessione ecclesiologica. Em N. Salato (Ed.), La sinodalità al tempo di Papa Francesco. Una chiave di lettura storico-dogmatica (pp. 153–169). EDB Edizioni Dehoniane Bologna.
Palma, A. (2018). Porquê a teologia? Na universidade e espaço público. Universidade Católica Editora.
Panagoulias, D. P., Virvou, M., & Tsihrintzis, G. A. (2024). Augmenting Large Language Models with Rules for Enhanced Domain-Specific Interactions: The Case of Medical Diagnosis. Electronics, 13(2), 320. https://doi.org/10.3390/electronics13020320
Patel, S., Kane, H., & Patel, R. (2023). Building Domain-Specific LLMs Faithful To The Islamic Worldview: Mirage or Technical Possibility? (No. arXiv:2312.06652). arXiv. https://doi.org/10.48550/arXiv.2312.06652
Pinho, A. de. (1984). A fé transmitida pela Igreja. Communio, 1, 29–39.
Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. (2018). Improving Language Understanding by Generative Pre-Training. https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
Raspanti, A., & Palazzani, L. (2022). Intelligenza artificiale e intelligenza umana. Contributi della teologia cristiana e della filosofia della persona. BioLaw Journal - Rivista di BioDiritto, 457-471 Paginazione. https://doi.org/10.15168/2284-4503-2486
Resnik, D. B., & Hosseini, M. (2025). The ethics of using artificial intelligence in scientific research: New guidance needed for a new tool. AI and Ethics, 5(2), 1499–1521. https://doi.org/10.1007/s43681-024-00493-8
Rogers, J., & Jonker, A. (2024). What is data bias? https://www.ibm.com/think/topics/data-bias
Ruiz de la Peña, J. L. (2006). Imagen de Dios: Antropología teológica fundamental (5a. ed). Ed. Sal Terrae.
Sequeri, P. (2010). Sensus fidei. Em Dizionario di Ecclesiologia (pp. 1306–1320). Città Nuova.
Sharma, N., Liao, Q. V., & Xiao, Z. (2024). Generative Echo Chamber? Effects of LLM-Powered Search Systems on Diverse Information Seeking (No. arXiv:2402.05880). arXiv. https://doi.org/10.48550/arXiv.2402.05880
Shrishak, K. (2024). AI-Complex Algorithms and effective Data Protection Supervision—Bias evaluation. EDPB.
Simmerlein, J. (2024). Sacred Meets Synthetic: A Multi-Method Study on the First AI Church Service. Review of Religious Research, 0034673X241282962. https://doi.org/10.1177/0034673X241282962
Torró, L. (2024). El impacto plural de la Inteligencia Artificial en la teología. Razón y fe, 287(1463), 401–416. https://doi.org/10.14422/ryf.vol287.i1463.y2023.003
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention Is All You Need (Versão 7). arXiv. https://doi.org/10.48550/ARXIV.1706.03762
Wang, C., Liu, X., Yue, Y., Tang, X., Zhang, T., Jiayang, C., Yao, Y., Gao, W., Hu, X., Qi, Z., Wang, Y., Yang, L., Wang, J., Xie, X., Zhang, Z., & Zhang, Y. (2023). Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity (No. arXiv:2310.07521). arXiv. https://doi.org/10.48550/arXiv.2310.07521