1Muhammad Ismail Wahyuda, 2Dwiyani Pratiwi
1,2Universitas Negeri Yogyakarta, Indonesia
DOI : https://doi.org/10.47191/ijmra/v8-i04-04Google Scholar Download Pdf
ABSTRACT:
The implementation of AI-based applications in education is increasingly prevalent. The use of technology in learning has proven effective in improving student learning outcomes, as well as making the learning process more engaging and interesting. One of the AI-based applications used in learning activities is the Automated Writing Evaluation tool, among which the ProWritingAid application is included. Thus, this study aims to investigate the accuracy of the ProWritingAid application as an Automated Writing Evaluation Tool. The research employs a qualitative approach, using descriptive qualitative as the research design. For data collection, document artifacts were utilized. The documents analyzed in this study consist of students' work on the degree of comparison material. After collecting the data, it was analyzed using document analysis techniques. The respondents in this research were 25 eleventh-grade students, selected through a convenience sampling technique. The findings of this research indicate that the application demonstrates inaccuracies in providing feedback. Some writing errors were detected by the ProWritingAid application, while other errors were not identified by the application.
KEYWORDS:Automated Writing Evaluation Tool, English Language Teaching, ProWritingAid Application, Writing Learning.
REFERENCES1) AbdAlgane, M., & Othman, K. A. J. (2023). Utilizing Artificial Intelligence Technologies in Saudi EFL Tertiary Level Classrooms. Journal of Intercultural Communication, 23, 92–99. https://doi.org/10.36923/jicc.v23i1.124
2) Alruwais, N., Wills, G., & Wald, M. (2018). Advantages and Challenges of Using e-Assessment. International Journal of Information and Education Technology, 8(1), 34–37. https://doi.org/10.18178/ijiet.2018.8.1.1008
3) Ariyanto, M. S. A., Mukminatien, N., & Tresnadewi, S. (2019). Students’ and Teacher’s Perceptions towards the Implementation of ProWritingAid and Teacher Feedback. Jurnal Pendidikan: Teori, Penelitian, Dan Pengembangan, 4(10), 1353. https://doi.org/10.17977/jptpp.v4i10.12843
4) Ary, D., Jacobs, L. C., Sorensen, C., & Razavieh, A. (2010). Introduction to research in education (8th ed). Belmont, CA: Wadsworth.
5) Bowen, G. A. (2009). Document Analysis as a Qualitative Research Method. Qualitative Research Journal, 9(2), 27–40. https://doi.org/10.3316/QRJ0902027
6) Cavaleri, M., & Dianati, S. (2016). You want me to check your grammar again? The usefulness of an online grammar checker as perceived by students. Journal of Academic Language & Learning, 10(1), 223–236.
7) Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in education (6th ed). London ; New York: Routledge.
8) Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed). Boston: Pearson.
9) Daneshvar, E., & Rahimi, A. (2014). Written Corrective Feedback and Teaching Grammar. Procedia - Social and Behavioral Sciences, 136, 217–221. https://doi.org/10.1016/j.sbspro.2014.05.317
10) Farjadnasab, A., & Khodashenas, M. (2017). The Effect of Written Corrective Feedback on EFL Students’ Writing Accuracy. International Journal of Research in English Education,2(2), 30–42. https://doi.org/10.18869/acadpub.ijree.2.2.30
11) Fitria, T. N. (2023). ProWritingAid as AI-Powered Writing Tools: The Performance in Checking Grammar and Spelling of Students’ Writing. Scientific Journal of Linguistics, Literature and Language Education, 12(2).
12) Ghufron, M. A., & Rosyida, F. (2018). The Role of Grammarly in Assessing English as a Foreign Language (EFL) Writing. Lingua Cultura, 12(4), 395. https://doi.org/10.21512/lc.v12i4.4582
13) Gilbert, L., Whitelock, D., & Gale, V. (2011). Synthesis Report on Assessment and Feedback with Technology Enhancement. Southampton (e-Print).
14) Guo, Q., Feng, R., & Hua, Y. (2022). How effectively can EFL students use automated written corrective feedback (AWCF)n in research writing? Computer Assisted Language Learning, 35(9), 2312–2331. https://doi.org/10.1080/09588221.2021.1879161
15) Hockly, N. (2019). Automated writing evaluation. ELT Journal, 73(1), 82–88. https://doi.org/10.1093/elt/ccy044
16) Hyland, K., & Hyland, F. (Eds.). (2019). Feedback in second language writing: Contexts and issues (2nd Edition). New York: Cambridge University Press.
17) Karyuatry, L., Rizkan, M. D. A., & Darayani, N. A. (2018). Grammarly as a Tool to Improve Students’ Writing Quality: Free Online-Proofreader across the Boundaries. JSSH (Jurnal Sains Sosial Dan Humaniora), 2(1), 83. https://doi.org/10.30595/jssh.v2i1.2297
18) Kisnanto, Y. P. (2016). The Effect of Written Corrective Feedback on Higher Education Students’ Writing Accuracy. Jurnal Pendidikan Bahasa Dan Sastra, 16(2), 121. https://doi.org/10.17509/bs_jpbsp.v16i2.4476
19) Koka, N. A., Khan, A. S., & Jan, N. (2023). Exploring the Attitudes and Perceptions of Foreign Language Lecturers on Artificial Intelligence-Driven Writing Evaluation and Feedback Tools for Improving Undergraduate Writing Skills. Journal of Southwest Jiaotong University, 58(5). https://doi.org/10.35741/issn.0258-2724.58.5.6
20) Koltovskaia, S. (2020). Student engagement with automated written corrective feedback (AWCF) provided by Grammarly: A multiple case study. Assessing Writing, 44, 100450. https://doi.org/10.1016/j.asw.2020.100450
21) Lim, F. V., & Phua, J. (2019). Teaching Writing with Language Feedback Technology. Computers and Composition, 54, 1– 13. https://doi.org/10.1016/j.compcom.2019.102518
22) Miles, M. B., Huberman, A. M., & Saldaña, J. (2014). Qualitative data analysis: A methods sourcebook (Third edition). Thousand Oaks, Califorinia: SAGE Publications, Inc.
23) Nasution, A., & Fatimah, S. (2018). The Use of ProWritingAid Web in Editing Students Writing. Journal of English Language Teaching, 7(2).
24) Nazarov, A., & Kuvandikova, D. (2023). Developing Writing Competence. Current Approaches and New Research in Modern Sciences, 3. Poland: The Polish open conference. https://doi.org/10.5281/ZENODO.7977238
25) O’Neill, R., & Russell, A. (2019). Stop! Grammar time: University students’ perceptions of the automated feedback program Grammarly. Australasian Journal of Educational Technology, 35(1). https://doi.org/10.14742/ajet.3795
26) Parra, L., & Calero, X. (2019). Automated Writing Evaluation Tools in the Improvement of the Writing Skill. International Journal of Instruction, 12(2), 209–226. https://doi.org/10.29333/iji.2019.12214a
27) Perdana, I., & Farida, M. (2019). Online Grammar Checkers and Their Use for EFL Writing. Journal of English Teaching, Applied Linguistics and Literatures (JETALL), 2(2), 67. https://doi.org/10.20527/jetall.v2i2.7332
28) Rahma, M., & Zen, E. L. (2023). Errors in Students’ Writing (Reports from ProWritingAid). Scope : Journal of English Language Teaching, 7(2), 202. https://doi.org/10.30998/scope.v7i2.15528
29) Ro’isatin, U. A., Hoesny, M. U., & Adibah, A. (2023). The Implementation of ProWritingAid to Help Students Reducing Grammatical Errors. Prosiding Seminar Nasional Gabungan Bidang Sosial, 5. Malang.
30) Schmidt-Fajlik, R. (2023). ChatGPT as a Grammar Checker for Japanese English Language Learners: A Comparison with Grammarly and ProWritingAid. AsiaCALL Online Journal, 14(1), 105–119. https://doi.org/10.54855/acoj.231417
31) Selvarasu, E., Thomas, A., Sundareswaran, I., Rahaman, A., Farzana, S., & Pareli, M. K. (2021). Teaching Writing Using Online Tools: An Experimental Study at the University of Technology and Applied Sciences. International Journal of Linguistics, Literature and Translation, 4(6), 196–201.
32) Soleimani, H., & Moqimi, J. (2023). Teaching ESL/EFL Writing Skill Website Evaluation: The Purdue Online Writing Lab and Pro Writing Aid. Interdisciplinary Studies in English Language Teaching, 2(1), 127–145. https://doi.org/10.22080/iselt.2023.25121.1049
33) Sorensen, E. (2013). Implementation and student perceptions of e-assessment in a Chemical Engineering module. European Journal of Engineering Education, 38(2), 172–185. https://doi.org/10.1080/03043797.2012.760533
34) Wahyuda, M. I., Putera, A. A., & Khuseini, M. (2022). The Effectiveness of ProWritingAid toward Students’ Writing Skills in Senior High School. English Edu: Journal of English Teaching and Learning, 1(1), 26–34. https://doi.org/10.18860/jetl.v1i1.1624
35) Yang, H. (2018). Efficiency of Online Grammar Checker in English Writing Performance and Students’ Perceptions. Korean Journal of English Language and Linguistics, 18(3), 328–348. https://doi.org/10.15738/kjell.18.3.201809.328
Volume 08 Issue 04 April 2025
There is an Open Access article, distributed under the term of the Creative Commons Attribution – Non Commercial 4.0 International (CC BY-NC 4.0) (https://creativecommons.org/licenses/by-nc/4.0/), which permits remixing, adapting and building upon the work for non-commercial use, provided the original work is properly cited.
Our Services and Policies
Authors should prepare their manuscripts according to the instructions given in the authors' guidelines. Manuscripts which do not conform to the format and style of the Journal may be returned to the authors for revision or rejected.
The Journal reserves the right to make any further formal changes and language corrections necessary in a manuscript accepted for publication so that it conforms to the formatting requirements of the Journal.
International Journal of Multidisciplinary Research and Analysis will publish 12 monthly online issues per year,IJMRA publishes articles as soon as the final copy-edited version is approved. IJMRA publishes articles and review papers of all subjects area.
Open access is a mechanism by which research outputs are distributed online, Hybrid open access journals, contain a mixture of open access articles and closed access articles.
International Journal of Multidisciplinary Research and Analysis initiate a call for research paper for Volume 08 Issue 04 (April 2025).
PUBLICATION DATES:
1) Last Date of Submission : 26 April 2025.
2) Article published within a week.
3) Submit Article : editor@ijmra.in or Online
Why with us
1 : IJMRA only accepts original and high quality research and technical papers.
2 : Paper will publish immediately in current issue after registration.
3 : Authors can download their full papers at any time with digital certificate.
The Editors reserve the right to reject papers without sending them out for review.
Authors should prepare their manuscripts according to the instructions given in the authors' guidelines. Manuscripts which do not conform to the format and style of the Journal may be returned to the authors for revision or rejected. The Journal reserves the right to make any further formal changes and language corrections necessary in a manuscript accepted for publication so that it conforms to the formatting requirements of the Journal.