Islamic Question Answering Systems Survey and Evaluation Criteria

Sarah Alnefaie, Eric Atwell, Mohammad Ammar Alsalka

Abstract


Many researchers built Islamic question-answering systems which find the answer to the question from the Quran, Hadith, or Fatwa text using only efficient retrieval techniques. However, it is challenging to answer all kinds of questions due to the current shortcomings in natural language processing tools. Therefore, in this paper, we review the Islamic question-answering systems that can answer all kinds of questions by building a questions and answers corpus and then using the retrieval technique or pre-training model to answer the user's question. After that, we use thirteen evaluation criteria, such as the search approaches and the system scope, to evaluate these systems. We can conclude from this survey that there are flaws in the existing systems, such as all these systems being unavailable and can answer a limited number of questions.


Full Text:

PDF

References


• Adany M. A. 2017. An automatic question answering system for the Arabic Quran. Ph.D. thesis, Sudan University of Science and Technology.

• Adany, M.AH. 2017. An automatic question answering system for the Arabic Quran. Sudan University of Science and Technology.

• Aftab, E. and Malik, M.K. 2022. eRock at Qur’an QA 2022: Contemporary Deep Neural Networks for Qur’an based Reading Comprehension Question Answers In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).

• Ahmed, B.H., Saad, M.K. and Refaee, E.A. 2022. QQATeam at Qurán QA 2022: Fine-Tunning Arabic QA Models for Qurán QA Task In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).

• Alqahtani, M. and Atwell, E. 2017. Evaluation criteria for computational Quran search. International Journal on Islamic Applications in Computer Science And Technology. 5(1), pp.12–22.

• Alsaleh, A., Althabiti, S., Alshammari, I., Alnefaie, S., Alowaidi, S., Alsaqer, A., Atwell, E., Altahhan, A. and Alsalka, M.A. 2022. LK2022 at Qur’an QA 2022: Simple Transformers Model for Finding Answers to Questions from Qur’an In: Proceedings of the OSACT 2022 Workshop., pp.120–125.

• ElKomy, M. and Sarhan, A. 2022. TCE∗ at Qur’an QA 2022:Arabic Language Question Answering Over Holy Qur’an Using a Post-Processed Ensemble of BERT-based Models In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).

• Hamdelsayed, M.A. and Atwell, E. 2016. Islamic applications of automatic question-answering.

• Hamoud, B. and Atwell, E. 2016a. Quran question and answer corpus for data mining with WEKA In: 2016 Conference of Basic Sciences and Engineering Studies (SGCAC). IEEE, pp.211–216.

• Hamoud, B. and Atwell, E. 2016b. Using an Islamic Question and Answer Knowledge Base to answer questions about the holy Quran. International Journal on Islamic Applications in Computer Science And Technology. 4(4), pp.20–29.

• Hamoud, B.I. 2017. A Question Answering System Design about the Holy Quran. Sudan University of Science and Technology.

• Heidaria, S., Sherkata, E. and Moosavia, S. 2014. A Novel Closed-Domain Question Answering System Fully Implemented Based on GATE Framework.

• Ibn Baz, Abdul Aziz and AlUthaymeen, Muhammad and Al-Madkhalee, R. 2003. Three Essays on the Obligation of Veiling. edited by Translated by Abu Maryam Ismaeel Alarcon Toronto: Al,. Ibaanah Book Publishing.

• Keleg, A. and Magdy, W. 2022. SMASH at Qur’an QA 2022: Creating Better Faithful Data Splits for Low-resourced Question Answering Scenarios In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).

• Malhas, R., Mansour, W. and Elsayed, T. 2022. Qur’an QA 2022: Overview of the first shared task on question answering over the holy qur’an In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).

• Maraoui, H., Haddar, K. and Romary, L. 2021. Arabic factoid Question-Answering system for Islamic sciences using normalized corpora. Procedia Computer Science. 192, pp.69–79.

• Mellah, Y., Touahri, I., Kaddari, Z., Haja, Z., Berrich, J. and Bouchentouf, T. 2022. LARSA22 at Qur’an QA 2022: Text-to-Text Transformer for Finding Answers to Questions from Qur’an In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).

• Mostafa, A. and Mohamed, O. 2022. GOF at Qur’an QA 2022: Towards an Efficient Question Answering For The Holy Qu’ran In The Arabic Language Using Deep Learning Based Approach In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).

• Premasiri, D., Ranasinghe, T., Zaghouani, W. and Mitkov, R. 2022. DTW at Qur’an QA 2022: Utilising Transfer Learning with Transformers for Question Answering in a Low-resource Domain In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).

• Saeedi, P., Heidari, S. and Farhoodi, M. 2014a. Creating quranic question taxonomy In: 2014 22nd Iranian Conference on Electrical Engineering (ICEE). IEEE, pp.1070–1074.

• Saeedi, P., Heidari, S. and Farhoodi, M. 2014b. Creating quranic question taxonomy In: 2014 22nd Iranian Conference on Electrical Engineering (ICEE)., pp.1070–1074.

• Sheker, M., Saad, S., Abood, R. and Shakir, M. 2016a. Domain-specific ontology-based approach for Arabic question answering. Journal of Theoretical and Applied Information Technology. 83(1), p.43.

• Sheker, M., Saad, S., Abood, R. and Shakir, M. 2016b. Domain-specific ontology-based approach for Arabic question answering. Journal of Theoretical and Applied Information Technology. 83(1), p.43.

• Singh, N. 2022. niksss at Qur’an QA 2022: A Heavily Optimized BERT Based Model for Answering Questions from the Holy Qu’ran In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).

• Wasfey, A., Elrefai, E., Marwa, M. and Haq, N. 2022. Stars at Qur’an QA 2022: Building Automatic Extractive Question Answering Systems for the Holy Qur’an with Transformer Models and Releasing a New Dataset In: Proceedings of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT5) at the 13th Language Resources and Evaluation Conference (LREC 2022).


Refbacks

  • There are currently no refbacks.