File: workshop/*.md (all 84 files — second systemic rubric bug)
Overall Score Impact: Every file scores 5.0 / 10.0 on scaffolding instead of 10.0, reducing the weighted contribution by 1.5 × 5.0 = 7.5 points per file; corpus mean is depressed by ~0.75.
Flagged Dimensions:
| Dimension |
Score |
Benchmark |
Delta |
| scaffolding |
5.0 |
10.0 (prereq section present) |
−5.0 |
Root Cause (≤ 2 sentences):
The rubric's PREREQ_RE regex in curriculum_assessment.py matches 📋 Before You Start (Unicode clipboard emoji) or Prerequisites, but every workshop file uses the Markdown alias :clipboard: Before You Start. Because :clipboard: does not expand to 📋 in plain-text regex matching, has_prereq_section is always False and scaffolding always scores 5.0 instead of 10.0.
Evidence (quoted from the file):
PREREQ_RE = re.compile(r"##\s+(📋\s*Before\s+You\s+Start|Prerequisites)", re.IGNORECASE)
All files use: ## :clipboard: Before You Start
Learning Science Rationale:
Ausubel's advance organiser theory establishes that explicit prerequisite framing at the start of a lesson reduces cognitive load by activating relevant prior knowledge and setting accurate expectations for what is required. The scaffolding dimension exists precisely to reward this practice; a regex mismatch silently removes the reward for every file that already follows the convention, producing a false corpus-wide scaffolding deficit.
Improvement Prompt (for an agent):
In `.github/skills/curriculum-quantitative-assessment/curriculum_assessment.py`, update the PREREQ_RE pattern to also match the :clipboard: Markdown alias. Replace:
PREREQ_RE = re.compile(r"##\s+(📋\s*Before\s+You\s+Start|Prerequisites)", re.IGNORECASE)
with:
PREREQ_RE = re.compile(r"##\s+(?:📋|:clipboard:)\s*Before\s+You\s+Start|##\s+Prerequisites", re.IGNORECASE)
Then re-run the assessment to regenerate rubric-results.json and score-history.json.
Expected Score After Fix: Corpus mean scaffolding rises from 5.0 to 10.0 for all 84 files; overall corpus mean score rises by approximately +0.75.
Warning
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
To allow these domains, add them to the network.allowed list in your workflow frontmatter:
network:
allowed:
- defaults
- "awmgmcpg"See Network Configuration for more information.
Generated by 🔬 Curriculum Quality Evaluator · 95.9 AIC · ⌖ 9.05 AIC · ⊞ 6.2K · ◷
File:
workshop/*.md(all 84 files — second systemic rubric bug)Overall Score Impact: Every file scores
5.0 / 10.0on scaffolding instead of10.0, reducing the weighted contribution by 1.5 × 5.0 = 7.5 points per file; corpus mean is depressed by ~0.75.Flagged Dimensions:
Root Cause (≤ 2 sentences):
The rubric's
PREREQ_REregex incurriculum_assessment.pymatches📋 Before You Start(Unicode clipboard emoji) orPrerequisites, but every workshop file uses the Markdown alias:clipboard: Before You Start. Because:clipboard:does not expand to📋in plain-text regex matching,has_prereq_sectionis alwaysFalseand scaffolding always scores 5.0 instead of 10.0.Evidence (quoted from the file):
Learning Science Rationale:
Ausubel's advance organiser theory establishes that explicit prerequisite framing at the start of a lesson reduces cognitive load by activating relevant prior knowledge and setting accurate expectations for what is required. The scaffolding dimension exists precisely to reward this practice; a regex mismatch silently removes the reward for every file that already follows the convention, producing a false corpus-wide scaffolding deficit.
Improvement Prompt (for an agent):
Expected Score After Fix: Corpus mean scaffolding rises from
5.0to10.0for all 84 files; overall corpus mean score rises by approximately+0.75.Warning
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
awmgmcpgSee Network Configuration for more information.