Test nationally, benchmark locally: using local dibels benchmarks to predict performance on the pssa

Test nationally, benchmark locally: using local dibels benchmarks to predict performance on the pssa. (2013). Test nationally, benchmark locally: using local dibels benchmarks to predict performance on the pssa.

Download PDF

Metadata

MODS Metadata


Title	Test nationally, benchmark locally: using local dibels benchmarks to predict performance on the pssa
Abstract	The Dynamic Indicators of Basic Early Literacy Skills (DIBELS) benchmarks are frequently used to make important decision regarding student performance. More information, however, is needed to understand if the nationally-derived benchmarks created by the DIBELS system provide the most accurate criterion for evaluating reading proficiency. The DIBELS benchmarks are calculated based on performance with a nationally-normed standardized achievement test (Good et al. 2011b). Therefore, it may not accurately represent the standard of performance on a state assessment. The DIBELS benchmarks may show a high number of false positives or false negatives when the benchmark is used to predict state test scores. A different criterion that more accurately reflects local expectations may be needed. A locally-generated benchmark expectation, established using a state assessment as a criterion for success, may provide a valid alternative to the DIBELS benchmark. DIBELS Oral Reading Fluency (ORF) data and Pennsylvania System of School Assessment (PSSA; PDE, 2010) scores were collected from two school districts in Pennsylvania. The collected data reflected fall, winter, and spring DIBELS ORF scores for students in grades 3 through 5 as well as their scores on the PSSA. Using logistic regression, locally-generated ORF benchmarks using PSSA performance as the criterion for successful outcomes were created for both school districts. Diagnostic accuracy statistics, including sensitivity, specificity, negative predictive power, and positive predictive power, and overall accuracy percentage as well as values for kappa and phi were calculated for each set of benchmarks. Contrary to the hypothesis, significant differences were not found between the locally-generated benchmarks and the DIBELS benchmarks in PSSA prediction accuracy. Significant differences between the locally-generated benchmarks and the DIBELS benchmarks levels of sensitivity, specificity, and positive predict power was produced in both school districts. Given these differences, the use of more than one set of benchmarks scores for instructional decision making is recommended. The author also recommends that school psychologists should learn how well the nationally-derived DIBELS benchmark corresponds with the local expectations to ensure that sound decision practices are used when determining how to best meet student needs.
Date	2013

Details

Title: Test nationally, benchmark locally: using local dibels benchmarks to predict performance on the pssa
Personal Name(s): Ferchalk, Matthew R.
Runge, Timothy J.
Corporate Name(s): Indiana University of Pennsylvania
Educational and School Psychology.
Note: Publisher info.: Dissertation/Thesis.
Advisors: Runge, Timothy J. Committee members: Joseph Kovaleski; David Lillenstein; Mark Staszkiewicz.
Topical Subject(s): Educational tests & measurements
Elementary education