Presentation Evaluation Guidelines: AI and ChatGPT – An Initial Study at the Department of English and Linguistics, University of Ruhuna.

Abstract

The use of Generative AI in humanities and the social sciences education in Sri Lanka has raised significant concerns in higher education discourses in Sri Lanka. The use of Generative AI is an issue categorically in a discipline such as English studies given that authenticity and originality are critical to develop skills in textual and linguistic analyses. This mixed-methods research is an ongoing, collaborative project by the Staff Members of the Department of English and Linguistics of the Faculty of Humanities and Social Sciences of the University of Ruhuna on the feasibility of adopting an assessment methodology/criterion for oral presentations considering undergraduates‘ expectations for quality education in the humanities and social sciences within emerging trends of Generative AI such as ChatGPT and Gemini. This study is important to ascertain the validity and reliability of the testing and evaluation procedures in assessing the undergraduate performance in the modules offered within the curricula of BA (Hons) in English and BA (General) in Arts degree programmes. Considering the policy level implications of the study, policy document analysis will be employed as a primary research method along with the data gathered from open-ended interviews with practitioners, researchers and lecturers involved in the curricula of the Department. The qualitative data thus gained will be triangulated with quantitative data gathered from a questionnaire administered among the undergraduates of the Department as key stakeholders of the university education system. The study will argue for a pedagogic necessity for adopting alternative assessments based on criteria that primarily assess the undergraduates‘ presentation skills, its relevance within the discourse on quality assurance in the higher education sector and the establishment of a policy framework on using Generative AI in pedagogical activities in a responsible and ethical manner. Finally, based on the best practices explored during the study on creating a framework on presentation-based alternative assessments as followed at the Department of English and Linguistics, the researchers will present recommendations to be implemented at the national level.