Kontaktujte nás | Jazyk: čeština English
dc.title | Automatic short answer grading (ASAG) using attention-based deep learning MODEL | en |
dc.contributor.author | Amur, Zaira Hassan | |
dc.contributor.author | Hooi, Yew Kwang | |
dc.contributor.author | Soomro, Gul Muhammad | |
dc.relation.ispartof | 2022 International Conference on Digital Transformation and Intelligence, ICDI 2022 - Proceedings | |
dc.identifier.isbn | 979-8-3503-9700-0 | |
dc.identifier.isbn | 979-8-3503-9698-0 | |
dc.date.issued | 2022 | |
dc.citation.spage | 1 | |
dc.citation.epage | 7 | |
dc.event.title | 2022 International Conference on Digital Transformation and Intelligence, ICDI 2022 | |
dc.event.location | Kuching, Sarawak | |
utb.event.state-en | Malaysia | |
utb.event.state-cs | Malajsie | |
dc.event.sdate | 2022-12-01 | |
dc.event.edate | 2022-12-02 | |
dc.type | conferenceObject | |
dc.language.iso | en | |
dc.publisher | Institute of Electrical and Electronics Engineers Inc. | |
dc.identifier.doi | 10.1109/ICDI57181.2022.10007187 | |
dc.relation.uri | https://ieeexplore.ieee.org/document/10007187 | |
dc.relation.uri | https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10007187 | |
dc.subject | ASAGS | en |
dc.subject | automatic grading | en |
dc.subject | BERT | en |
dc.subject | short text | en |
dc.description.abstract | In artificial intelligence, automatic short answer grading (ASAG) sparked the interest of many researchers. These Systems are used to evaluate the student's performance based on their intellectual and cognitive skills. Unfortunately, short answer grading poses various challenges to assess individual abilities. The first challenge, short sentences can be 10 to 20 words long. These short sentences include primary and secondary keywords, identifying such keywords is a challenge for syntactic processing. Furthermore, the order and relationship among the words affect the actual meaning of the answers. Answers provided by students may not be syntactically correct. The second challenge is different question types included in the short text:-factoid, descriptive, short, and long questions. Different question types influence the intent of the answer which affects the precision of grading accuracy. As a result, strategies for overcoming these problems in the assessment are required. In this study, we have proposed the attention-based deep learning model known as bidirectional encoder representation from a transformer (BERT) for the evaluation of short subjective answers. The measurement findings indicate that the BERT model is effective for automatic short answer grading. © 2022 IEEE. | en |
utb.faculty | Faculty of Applied Informatics | |
dc.identifier.uri | http://hdl.handle.net/10563/1011370 | |
utb.identifier.scopus | 2-s2.0-85147022679 | |
utb.source | d-scopus | |
dc.date.accessioned | 2023-02-17T00:08:30Z | |
dc.date.available | 2023-02-17T00:08:30Z | |
utb.contributor.internalauthor | Soomro, Gul Muhammad | |
utb.fulltext.affiliation | Zaira Hassan Department of computer and information sciences University teknologi Petronas Zaira_20001009@utp.edu.my Amur Yew Kwang Hooi department of computer and information sciences Universiti teknologi Petronas yewkwanghooi@utp.edu.my Gul Muhammad Soomro Tomas Bata University, Czech Republic gulmuhammadsoomro@yahoo.com | |
utb.fulltext.references | [1] S. Das, N. Deb, A. Cortesi, and N. J. S. C. S. Chaki, "Sentence embedding models for similarity detection of software requirements," vol. 2, no. 2, pp. 1-11, 2021. [2] L. B. Galhardi and J. D. Brancher, "Machine learning approach for automatic short answer grading: A systematic review," in Ibero-american conference on artificial intelligence, 2018, pp. 380-391: Springer. [3] M. Han et al., "A survey on the techniques, applications, and performance of short text semantic similarity," vol. 33, no. 5, p. e5971, 2021. [4] P.-S. Huang, P.-S. Chiu, J.-W. Chang, Y.-M. Huang, and M.-C. J. J. o. I. T. Lee, "A study of using syntactic cues in short-text similarity measure," vol. 20, no. 3, pp. 839-850, 2019. [5] B. Agarwal, H. Ramampiaro, H. Langseth, M. J. I. P. Ruocco, and Management, "A deep network model for paraphrase detection in short text messages," vol. 54, no. 6, pp. 922-937, 2018. [6] H. Al-Bataineh, W. Farhan, A. Mustafa, H. Seelawi, and H. T. Al-Natsheh, "Deep contextualized pairwise semantic similarity for arabic language questions," in 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), 2019, pp. 1586-1591: IEEE. [7] W. Huang, Q. Qu, M. J. N. C. Yang, and Applications, "Interactive knowledge-enhanced attention network for answer selection," vol. 32, no. 15, pp. 11343-11359, 2020. [8] L. Zhang, Y. Huang, X. Yang, S. Yu, and F. J. I. l. e. Zhuang, "An automatic short-answer grading model for semi-open-ended questions," vol. 30, no. 1, pp. 177-190, 2022. [9] H. Khorashadizadeh, R. Monsefi, and S. Foolad, "Attention-based Convolutional Neural Network for Answer Selection using BERT," in 2020 8th Iranian Joint Congress on Fuzzy and intelligent Systems (CFIS), 2020, pp. 121-126: IEEE. [10] A. A. Shah, S. D. Ravana, S. Hamid, M. A. J. K. Ismail, and I. Systems, "Accuracy evaluation of methods and techniques in Web-based question answering systems: a survey," vol. 58, no. 3, pp. 611-650, 2019. [11] P. Ranjan and R. C. Balabantaray, "Question answering system for factoid based question," in 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I), 2016, pp. 221-224: IEEE. [12] J. Mozafari, A. Fatemi, and M. A. J. a. p. a. Nematbakhsh, "BAS: an answer selection method using BERT language model," 2019. [13] !!! INVALID CITATION !!! . [14] M. Lewis et al., "Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension," 2019. [15] M. Mansoor, Z. ur Rehman, M. Shaheen, M. A. Khan, M. J. I. T. Habib, and Control, "Deep learning based semantic similarity detection using text data," vol. 49, no. 4, pp. 495-510, 2020. [16] M. H. Nguyen and D. Q. J. J. I. S. E. Tran, "Estimation in Semantic Similarity of Texts," vol. 37, no. 3, pp. 617-633, 2021. [17] J. Schneider, R. Richner, and M. J. a. p. a. Riser, "Towards Trustworthy AutoGrading of Short, Multilingual, Multi-type Answers," 2022. [18] X. Song, Y. J. Min, L. Da-Xiong, W. Z. Feng, and C. J. P. C. S. Shu, "Research on text error detection and repair method based on online learning community," vol. 154, pp. 13-19, 2019. [19] S. J. H. S. Sun and O. R. Methodology, "Meta-analysis of Cohen’s kappa," vol. 11, no. 3, pp. 145-163, 2011. | |
utb.fulltext.sponsorship | - | |
utb.scopus.affiliation | University Teknologi Petronas, Department of Computer and Information Sciences, Malaysia; Tomas Bata University, Czech Republic | |
utb.fulltext.projects | - | |
utb.fulltext.faculty | - | |
utb.fulltext.ou | - |