GenAI Output – The Importance of Critical Evaluation

How to Critically Evaluate GenAI Output:

Learners should approach GenAI content with the understanding that while these technologies can produce content that seems to be accurate and appropriate, it may not be. This critical analysis is something your learners need to practice. Consider modelling this process and including this type of activity as a learning activity in your course.

Humber College identified the following essential considerations:

Content Accuracy

Although AI models can generate grammatically correct text that may seem logical and informative, they can produce content that is misleading and/or incorrect. Always cross-verify AI generated content with trusted resources to ensure accuracy.

Bias Awareness

GenAI can (and will) generate biased or skewed content. It is vital to critically evaluate the output for gender, racial, cultural, and ableist biases.

Ethical Considerations

GenAI is powerful and can create content that seems incredibly human-like. This can lead to misuse, such as generating deepfakes or disseminating false information. As responsible learners, it’s crucial to understand and respect the ethical boundaries surrounding the use of these technologies.

Source Verification

Always verify the source of the information. GenAI, including models like ChatGPT don’t generate information based on new data after their training cut-off. Furthermore, GenAI is widely known to “hallucinate” meaning it will make things up and present the content as the truth.

Start by talking to your students. Using critical media literacy, the following guide offers foundational questions you can prompt your students with regarding GenAI. The questions are intentionally broad – they will best be used to begin the process of analysis.

Attribution

Adapted from: Generative Artificial Intelligence in Teaching and Learning Copyright © 2023 by Centre for Faculty Development and Teaching Innovation, Centennial College is licensed under a Creative Commons Attribution 4.0 International License. Adapted to include examples of the four evaluation criteria.

Considerations for Your Course (Talk to Your Students) by the Centre for Teaching and Learning at Queen’s University is licensed under CC BY SA 4.0

Licence

Icon for the Creative Commons Attribution-NonCommercial 4.0 International License

Are You AI Ready? Investigating AI tools in Higher Education - Faculty Guide Copyright © by SATLE Project Team 'Are You AI Ready?' University College Dublin is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, except where otherwise noted.

Share This Book