What The Scoring Is, And Is Not
Scored The Way A Trained Rater Scores. Audited Like A Measurement.
Impacter Pathway’s scoring pipeline uses transformer-based, rubric-aligned ordinal models to score open-ended student voice responses at scale. Model versions evolve over time and are versioned and audited for traceability and reproducible scoring.
Impacter Pathway routinely benchmarks automated scoring against human raters using standard agreement metrics, sets promotion thresholds, and monitors drift and subgroup fairness; exact figures vary by assessment, prompt design and cohort.
Results are expressed as scaled scores to support feedback, trend analysis and growth over time, not a single high-stakes label. No student-level data appears on this site. The evidence base is the subject of Deliverable 2: the screener landscape, language as a measurement signal, trustworthy automated scoring, and indicators in MTSS. Indicators, Outcomes & Metrics Brief →
Why A Screener Is The Outcomes Layer
See Investments Working, One Student At A Time.
Most behavioral health reporting counts what was delivered: sessions, referrals, staff hours, aggregated school data. That tells a district what it spent. It cannot tell a district whether a student is steadier, more connected, or better at asking for help than they were in the fall.
- Competency-Level, Not Service-Level. Six domains scored from a student's own words put an outcome next to every investment, at the individual student level, which service logs and school-wide averages cannot reach.
- Asset-Based, Growth-Oriented. The prompts ask what a student can do and how they have changed, not what is wrong with them. Scores are scaled for growth over time, not a single high-stakes label.
- What Is Working, So We Do More Of It. When a support is followed by growth in the domain it targets, that is evidence to extend it. When it is not, that is a reason to pivot, early and for that student.
- Still Counts The Services. Services provided, students served and utilization remain in the record: the Commission's reporting domains. The screener adds the fourth: outcomes and impact.