Skip to content

Creating FRQ Runners for AI Grading - #1909

Merged
jm1021 merged 5 commits into
Open-Coding-Society:mainfrom
AAApages:main
Oct 28, 2026
Merged

jm1021 merged 5 commits into
Open-Coding-Society:mainfrom
AAApages:main

Conversation

@6lue2

@6lue2 6lue2 commented Oct 28, 2026

Copy link
Copy Markdown
Contributor

Add reflection answer boxes to the Variables Challenge (Hack #1)

Testing + Backend

Will commit backend after resolving other conflicts and run through process with Avantika.
Link to testing issue on checking FRQ runner submission to GIST for AI Grading: AAApages#51 (comment)

Problem

The JavaScript Variables and HTML DOM Challenge (/game/essentials/variables-challenge) asks three
"Reflect:" questions in Hack #1, but there was nowhere on the page to answer them. Students could not
submit reflections, so the AI grader scored Hack #1 (60% of the grade) without them, which lowered scores.

Change

  • Added a reflection runner for each of the three Hack Add site.baseurl fix/ updates #1 questions, word for word:
    • Did adding lives impact the enemy? Why or why not?
    • How can values be the same for both player and enemy? Without duplicating assignments?
    • How can you have default values for lives, but also allow for custom values?
  • The boxes are inside Hack Add site.baseurl fix/ updates #1, right after its code runner. The grader splits the page into weighted
    hacks at each "Hack #N (Weight: …)" heading, so boxes placed later would be graded as part of
    Hack Gamify Team Teach - ML(Tablesaw, Weka, Smile) #2 (40%) instead of Hack Add site.baseurl fix/ updates #1.
  • Only the lesson notebook changes (_projects/systems/gamebuilder/notebooks/2026-02-16-variables-challenge.ipynb).

How the reflection runner works

  • It looks like a code runner, with a plain text box instead of a code editor: wrapping text, no line
    numbers. 📤 Submit replaces Run, and there's no output panel.
  • Drafts are saved locally, so a refresh keeps the answer. Submitting an empty answer shows a warning.
  • Clicking 📤 saves the answer. The page's existing Submit Code sends it in the same Gist as the
    code, as a .md file marked "reflection" in the Gist manifest, so the AI grader grades it as
    written work.

Testing

6lue2 added 5 commits October 27, 2026 11:20
- Introduced a new Reflection Runner feature that allows students to submit written answers alongside code submissions.
- Updated AGENTS.md and AGENTS_MD_DOCUMENTATION.md to include details about the Reflection Runner.
- Modified the Gist export process to include reflection answers in the same submission.
- Created a new HTML template for the Reflection Runner, styled to match the existing code runner.
- Implemented JavaScript logic to handle the reflection runner's behavior, including saving drafts and submitting answers.
- Added tests for the Reflection Runner conversion and functionality to ensure proper integration.
- Updated various stylesheets to accommodate the new reflection runner design.
@jm1021

jm1021 commented Oct 28, 2026

Copy link
Copy Markdown
Contributor

This is a lot in a day. The thought I have is whether .reflection-runner-container is different from another container. Not sure it would need its own unique Sass rule.

The example looks sensible. REFLECTION RUNNER is a good name, and asking something after you code is a good pedagogical practice.

@jm1021
jm1021 merged commit 1ff2816 into Open-Coding-Society:main Oct 28, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants