Found 11 bookmarks
Newest
A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study
A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study
The recent rise in artificial intelligence systems, such as ChatGPT, poses a fundamental problem for the educational sector. In universities and schools, many forms of assessment, such as coursework, are completed without invigilation. Therefore, students could hand in work as their own which is in fact completed by AI. Since the COVID pandemic, the sector has additionally accelerated its reliance on unsupervised ‘take home exams’. If students cheat using AI and this is undetected, the integrity of the way in which students are assessed is threatened. We report a rigorous, blind study in which we injected 100% AI written submissions into the examinations system in five undergraduate modules, across all years of study, for a BSc degree in Psychology at a reputable UK university. We found that 94% of our AI submissions were undetected. The grades awarded to our AI submissions were on average half a grade boundary higher than that achieved by real students. Across modules there was an 83.4% chance that the AI submissions on a module would outperform a random selection of the same number of real student submissions.
·journals.plos.org·
A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study
GPT detectors are biased against non-native English writers
GPT detectors are biased against non-native English writers
GPT detectors frequently misclassify non-native English writing as AI generated, raising concerns about fairness and robustness. Addressing the biases in these detectors is crucial to prevent the marginalization of non-native English speakers in evaluative and educational settings and to create a more equitable digital landscape.
·cell.com·
GPT detectors are biased against non-native English writers
Redefining Classroom Readiness: How Initial Teacher Training Can Mitigate Risks and Capitalize on the Potential of GenAI
Redefining Classroom Readiness: How Initial Teacher Training Can Mitigate Risks and Capitalize on the Potential of GenAI
This chapter presents a roadmap for teacher educators to equip their graduates with the ability to recognize and mitigate the limitations and risks of using ChatGPT in educational settings. With the rise of artificial intelligence (AI), the incorporation of AI-powered technologies like ChatGPT has t...
Detect
·igi-global.com·
Redefining Classroom Readiness: How Initial Teacher Training Can Mitigate Risks and Capitalize on the Potential of GenAI
Simple techniques to bypass GenAI text detectors: implications for inclusive education - International Journal of Educational Technology in Higher Education
Simple techniques to bypass GenAI text detectors: implications for inclusive education - International Journal of Educational Technology in Higher Education
This study investigates the efficacy of six major Generative AI (GenAI) text detectors when confronted with machine-generated content modified to evade detection (n = 805). We compare these detectors to assess their reliability in identifying AI-generated text in educational settings, where they are increasingly used to address academic integrity concerns. Results show significant reductions in detector accuracy (17.4%) when faced with simple techniques to manipulate the AI generated content. The varying performances of GenAI tools and detectors indicate they cannot currently be recommended for determining academic integrity violations due to accuracy limitations and the potential for false accusation which undermines inclusive and fair assessment practices. However, these tools may support learning and academic integrity when used non-punitively. This study aims to guide educators and institutions in the critical implementation of AI text detectors in higher education, highlighting the importance of exploring alternatives to maintain inclusivity in the face of emerging technologies.
·link.springer.com·
Simple techniques to bypass GenAI text detectors: implications for inclusive education - International Journal of Educational Technology in Higher Education