Measure Student Outcomes Using BoodleBox

Measuring student outcomes is crucial when implementing Collaborative Generative AI (GenAI) in your classroom. It helps you understand the impact of this technology on student learning and allows you to make data-driven decisions for improvement. Here are some key strategies for measuring student outcomes:

Prepare Evaluation Materials

Set Clear Learning Objectives

• Establish specific, measurable learning objectives that align with your course goals and the intended use of Collaborative GenAI.
• Ensure these objectives are communicated clearly to students at the beginning of the course.

Develop Assessments & Rubrics

• Pre-assessments: Conduct pre-assessments to establish a baseline of student knowledge and skills before introducing Collaborative GenAI.
• Post-assessments: Draft a post-assessment to distribute at the end of the course.
• Rubrics: Develop comprehensive rubrics that include criteria for effective use of Collaborative GenAI.
• AI-integrated assignments: Develop assignments that evaluate students’ ability to critically analyze AI-generated content.

Integrate AI Throughout Your Course

Individual Assignments

• Use regular quizzes, discussions, or short assignments that incorporate Collaborative GenAI to gauge ongoing student progress.
• Analyze these assessments to identify areas where students may need additional support or where the AI implementation can be refined.

Group Projects

• Assign projects that require students to use Collaborative GenAI and assess their ability to apply the technology effectively.
• Evaluate both the process and the final product to understand how students are integrating AI into their learning.

Evaluate Findings

Track Engagement Metrics

• BoodleBox offers detailed analytics on student participation and engagement, allowing for a more nuanced understanding of individual and group performance.

Utilize Assessments & Rubrics

• Pre & Post Assessments: Administer post-assessments to measure growth and achievement after using the technology. Compare results to pre-assessment to identify areas of improvement and potential challenges.
• Rubrics: Measure their understanding of AI capabilities, limitations, and ethical considerations.
• AI-Integrated Assignments: Assess students’ ability to prompt effectively, critically evaluate AI outputs, and integrate AI-generated content with their own ideas.

Compare Across Different Learning Modalities

• Analyze student performance on tasks completed with and without Collaborative GenAI to understand its impact.
• Look for improvements in areas such as depth of analysis, creativity, or problem-solving skills.