Educators as Physicians Jan Hasbrouck, Ph.D. Educators as Physicians: Using Data from Reading Assessments for Effective Professional Decision-Making Educators as Physicians: Using RTI Data for Effective Decision-Making Jan Hasbrouck, Ph.D. Four Modules Framework for Intervention Benchmark/Screening Diagnosis Progress Monitoring Summary booklets sold in sets of 4 Presented by Jan Hasbrouck, Ph.D. Our DREAM$ Available online at www.gha-pd.com www.gha-pd.com My conclusions from reading research: Compelling evidence from a convergence of reading research is indicating that 90% to 95% of all students can achieve literacy skills at or approaching grade level. These statistics include students with dyslexia and other learning disabilities. Students succeed when they receive intensive, comprehensive, and high-quality prevention and early intervention instruction, provided by well-informed and well-supported teachers. This instruction must be systematic, explicit, and intensive, designed to appropriately integrate elements of oral language development, phonemic awareness, phonics and decoding, fluency, vocabulary development, and reading comprehension skills and strategies. Jan Hasbrouck, Ph.D. Torgesen, 2007; Vellutino & Fletcher, 2007; Rashotte, MacPhee, Torgeson, 2001; Al Otailba, Connor, Foorman, Schatschneider, Greulich, Sidler, 2009; Every Child Reading: An Action Plan and Every Child Reading: A Professional Development Guide. Available online from Learning First Alliance © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 1 Educators as Physicians Jan Hasbrouck, Ph.D. Old Response MORE Good News! While there is a recognized optimal age for early reading intervention9 “it is never too late” Shaywitz (2003) Overcoming Dyslexia “Wait to fail” I.Q./achievement discrepancy Hope & pray?? Today we have better responses$ RESPONSE TO INTERVENTION RTI / MTSS DEFINED: A process where a student’s response to appropriate, high-quality, evidence-based instruction and intervention is documented across tiered levels of services. © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com PURPOSE OF RTI / MTSS? GOAL K-3: Prevention! To reduce the number of students with academic or behavior problems incorrectly designated as “disabled” GOAL 4-12: Rescue! To find EVERY student with academic or behavioral needs and provide appropriate intervention services 2 Educators as Physicians Jan Hasbrouck, Ph.D. A Professional Parallel… RTI / MTSS Tier I Tier I Tier II Tier II Core Classroom Instruction ALL Students Supplementary Instruction Approx. 20-30 % Tier III Intensive Intervention Approximately 5-10% INCREASING Time & Intensity & Data Collection & Expertise RTI / MTSS CORE CONCEPTS Appropriate, high quality, Annual Check-up; Standard treatment; REGULAR physician Screening data Strategic, Supplemental Care Tier III SPECIALIST working with regular physician Intensive Care Diagnostic data TEAM of doctors, nurses, technicians, etc. Monitoring data INCREASING Time & Intensity & Data Collection & Expertise BIG IDEA of ALL ASSESSMENTS All assessments are conducted to answer a evidence-based core instruction in general education classrooms to address standards and skills Appropriate assessments QUESTION! (screening, diagnosis, progress monitoring) IMMEDIATE and appropriate instructional response to assessment data Collaboration with home www.ncld.org/publications Parent Guide to RTI © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 3 Educators as Physicians Jan Hasbrouck, Ph.D. My Personal Philosophy of Assessment in School (4 Parts) 1. We are doing TOO MUCH assessing! Educators as Physicians Benchmark/Screening 2. We MUST assess our students. 3. Let’s collect the RIGHT data, needed to answer IMPORTANT questions, as QUICKLY as possible. Diagnostic Progress Monitoring 4. If we spend resources collecting data, let’s USE it—correctly-- to inform our decisions. Educators as Physicians “So, how are you doing?” Benchmark/ Screening The Question? Which of our students MIGHT need help with their reading? “universal screening” © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 4 Educators as Physicians Jan Hasbrouck, Ph.D. Benchmark Screening 3x Year: Fall, Winter, Spring Common Assessments for Benchmark Screening: ORF DIBELS Benchmark Screener Dynamic Indicators of Basic Early Literacy Skills K-6 Reading Fluency Benchmark Assessor (RFBA) Significantly Below Benchmark Slightly Below Benchmark At or Above Benchmark Read Naturally K-8 AIMSWeb Edformation K-8 May Need Extra Assistance Likely On Track Additional assessments or other information should also be considered$ EasyCBM Riverside K-8 All are versions of CBM-R ORF assessments Concerns about ORF for Benchmark/Screening How can we rely on a very short measure of a single, isolated reading skill (fluency) to determine proficiency in the highly complex task of reading? So, why is FLUENCY used as a benchmark indicator for reading proficiency? Isn’t COMPREHENSION so much more important? © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 5 Educators as Physicians Jan Hasbrouck, Ph.D. Concerns about ORF for Benchmark/Screening How can we rely on a very short measure of a single, isolated reading skill (fluency) to determine proficiency in the highly complex task of reading? DO NOT ASSESS Three Responses #1: ORF is NOT a measure of the skill of reading fluency!! Oral Reading Fluency assessments were MISNAMED! More Accurate: Performance measure of ACCURACY + RATE Indicator of Reading Proficiency: © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com Oral Reading Fluency Assessments IRP? Fluency! The COMPLEX SKILL of reading fluency cannot be measured by ORF alone! 6 Educators as Physicians Jan Hasbrouck, Ph.D. DEFINING The SKILL of reading fluency What is Reading Fluency? accurate reading at an appropriate rate with suitable prosody Reasonably that leads to accurate and deep comprehension and motivation to read. Hasbrouck & Glaser (2012) What is Reading Fluency? accurate reading at an appropriate rate with suitable prosody Reasonably that leads to accurate and deep comprehension and motivation to read. What is Reading Fluency? Reasonably ACCURATE? Aim for at least _____ % accuracy (Rasinski, Reutzel, Chard, Thompson, 2011) Emerging readers: _____ % Hasbrouck & Glaser (2012) © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 7 Educators as Physicians Jan Hasbrouck, Ph.D. What is Reading Fluency? What is Reading Fluency? Appropriate RATE? Appropriate RATE? Fluent reading should sound like SPEECH Stahl & Kuhn (2002) _____th %ile on oral reading fluency (ORF) norms on unpracticed, grade-level text What is Reading Fluency? “REALLY?? Only AVERAGE ??” Appropriate RATE? # 1 LIMITED EVIDENCE from research or theory or practice that suggest a benefit of a reading rate significantly ABOVE the 50th%ile # 2 SIGNIFICANT EVIDENCE that it is crucial to help students read with FLUENCY (not just rate!) at or near the 50th%ile to support comprehension and motivation © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 8 Educators as Physicians Jan Hasbrouck, Ph.D. WHAT IS Reading Fluency? Reasonably accurate reading at an appropriate rate with suitable prosody that leads to accurate and deep comprehension and motivation to read. Hasbrouck & Glaser (2012) Concerns about ORF for Benchmark/Screening How can we rely on a very short measure of a single, isolated reading skill (fluency) to determine proficiency in the highly complex task of reading? Components: Accuracy, rate, & prosody PLUS Mechanics: Word decoding, text decoding, & comprehension A COMPLEX, MULTI-FACTED SKILL! QUICKLY provide information Reliable (accurate) Valid (relevant, useful, & important) Compared to benchmark BUT9 body temperature only one single indicator of Three Responses #2: CBM-R accuracy + rate measures (ORF) function like a thermometer$ Concerns about ORF for Benchmark/Screening How can we rely on a very short measure of a single, isolated reading skill (fluency) to determine proficiency in the highly complex task of reading? general health or illness: Normal? 103 degrees? CBM-R measures of accuracy + rate provide one reasonably dependable indicator of a student’s academic “health” or “illness”—NEVER a diagnosis for a treatment plan! © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com Three Responses #3: 30+ years of CBM research establishing reliability and validity 9 Educators as Physicians Jan Hasbrouck, Ph.D. CBM-R ORF Scores Correlate with Reading Comprehension Fuchs, Fuchs, Hosp, & Jenkins, SSR, 2001 Measure Validity Coefficients Oral Recall / Retell Cloze Question Answering Oral Reading Fluency How about renaming ORF? Indicator of Reading Proficiency IRP? accuracy + rate measures predict TOTAL reading skill Benchmark/Screening for Henry & Lupita Henry 7th grader • Mid-November • Home room teacher makes referral to reading specialist: low grades in most content classes + low test scores • English/L.A. teacher concerned about general literacy skills Diagnostic tests scheduled$ © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 10 Educators as Physicians Jan Hasbrouck, Ph.D. Lupita 3rd grader • Universal fall screening: Reading Fluency Benchmark Assessor • RFBA scores: 59, 65, 64 Mean = 62.66 = 63 wcpm Compare to norms9 Educators as Physicians “Let’s see what’s going on9” Lupita 3rd grader • Universal fall screening RFBA scores: 59, 65, 64 Mean: 63 wcpm YELLOW FLAG • Lupita’s teacher also sees concerns in daily work and behaviors • Discuss at assessment team meeting— further diagnosis Educators as Physicians “Treatment without diagnosis is malpractice.” Diagnostic Assessments © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 11 Educators as Physicians Jan Hasbrouck, Ph.D. DIAGNOSTIC ASSESSMENTS The Question? What are this student’s skill strengths and needs? Benchmark Screener Significantly Below Benchmark Slightly Below Benchmark Consider diagnostic assessments At or Above Benchmark Collect additional information as necessary Core + Intervention or Core Replacement Core + Supplementary Support Begin or Continue Core Instruction Tier 3 Tier 2 Tier 1 NRP Instructional Components CCSS Foundational Skills K-5 Phonemic Awareness Print Concepts Phonics Fluency Vocabulary Comprehension Strategies National Reading Panel (2000) © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com Phonological Awareness Phonics & Word Recognition Fluency National Governors’ Association CCSS (2010) 12 Educators as Physicians Jan Hasbrouck, Ph.D. DIAGNOSIS EXAMPLE: FALL Diagnosing Fluency You MUST listen to the student read aloud! And not just for 60 seconds! DIAGNOSIS EXAMPLE: WINTER 6th grader reading 5th grade passage frustration level 4th grader reading 4th grade passage 94% accuracy 5.5 / 7 comprehension instructional level IRP: 83 wcpm DIAGNOSIS EXAMPLE: WINTER 6th grader reading 4th grade passage 93% accuracy 6 / 8 comprehension Try 4th grade passage$ instructional level IRP: 113 wcpm © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 13 Educators as Physicians Jan Hasbrouck, Ph.D. Diagnostic Assessments for Henry & Lupita Henry 7th grader • Mid-November • Home room teacher makes referral to reading specialist: low grades in most content classes + low test scores • English/L.A. teacher concerned about general literacy skills Diagnostic tests scheduled$ Henry 7th grader IRI RESULTS Henry 7th grader IRI RESULTS Gr 4 INDEPENDENT 98% correct 6 / 8 questions correct Gr 5 INSTRUCTIONAL 93% correct 5.5 / 8 questions correct Gr 4 INDEPENDENT Gr 5 INSTRUCTIONAL Gr 6? 113 wcpm © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 14 Educators as Physicians Jan Hasbrouck, Ph.D. Skill Set 8: Advanced Consonants A: 5/10 nonsense words B: 7/10 words in context Skill Set 9: Vowel Digraphs & Diphthongs A: 5/10 nonsense words B: 6/10 words in context Skill Set 10: Common Prefixes & Suffixes 6/10 Skill Set 11: Two Syllables 4/10 Skill Set 12: Three Syllables STOP Lupita 3rd grader Henry 7th grader Reading two years below level IRI Fluency is OK at 5th grade IRI Phonics Vowel digraphs & diphthongs; prefixes & suffixes; multisyllable words QPS Lupita 3rd grader IRI RESULTS • Universal fall screening RFBA scores: 59, 65, 64 Mean: 63 wcpm YELLOW FLAG Gr 2 INDEPENDENT • Lupita’s teacher also sees concerns in daily work and behaviors Gr 3 INSTRUCTIONAL • Assessment team: Further diagnosis 96% correct 6.5 / 8 questions correct 91% correct 4.5 / 8 questions correct 62 wcpm © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 15 Educators as Physicians Jan Hasbrouck, Ph.D. Lupita 3rd grader IRI RESULTS Skill Set 5: CVCC & CCVC A: 8/10 nonsense words Gr 2 INDEPENDENT Gr 3 INSTRUCTIONAL B: 9/10 words in context Skill Set 6: Silent e SKIP Administer QPS Skill Set 7: R-Controlled Vowels A: 7/10 nonsense words B: 8/10 words in context Skill Set 8: Advanced Consonants A: 5/10 nonsense words B: 7/10 words in context Skill Set 9: Vowel Digraphs & Diphthongs A: 5/10 nonsense words B: 7/10 words in context © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com Skill Set 10: Prefixes & Suffixes 5/10 Skill Set 11: Two Syllables 4/10 nonsense words Skill Set 12: Three Syllables STOP 16 Educators as Physicians Jan Hasbrouck, Ph.D. Lupita 3rd grader Reading at grade level-barely; keep eye on comprehension IRI Fluency is a concern RFBA & IRI Phonics: USE THE RESULTS to Develop Instruction for Henry & Lupita Examine assessment results: Skill STRENGTHS? Skill NEEDS? Appropriate SERVICE DELIVERY: Classroom only/Tier 1? Intervention/Tier 3? Supplementary/Tier 2? Select proven instructional tools MATCHED identified needs-- Professional development & support concerns Prefixes & Suffixes; Multisyllable words QPS Plan for sufficient instructional TIME Educators as Physicians Available for download at: “This is what we’ve found9 www.gha-pd.com/resources 9and here’s what we can do.” © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 17 Educators as Physicians Jan Hasbrouck, Ph.D. Provide Effective INSTRUCTION! EFFECTIVE INSTRUCTION Systematic Systematic SCOPE of skills & content Explicit SEQUENCE easy-to-hard; separate confusions Active Frequent REVIEWS Intensive EFFECTIVE INSTRUCTION Explicit 3 Steps in Instruction: 1- DEMONSTRATION: I do EFFECTIVE INSTRUCTION Explicit 4 Steps in Instruction? 1- DEMONSTRATION: I do 2- GUIDED PRACTICE: We do 2- GUIDED PRACTICE: We do 3- COLLABORATION: Y’all do 3- INDEPENDENT PRACTICE: You do © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 4 - INDEPENDENT PRACTICE: You do 18 Educators as Physicians Jan Hasbrouck, Ph.D. EFFECTIVE INSTRUCTION Active Engagement EFFECTIVE INSTRUCTION Intensive • URGENT! – NO wasted time • RELENTLESS! – NO excuses • FOCUSED! – Data-driven instruction: Minimum teacher TALK Students “DOING”: • ORAL reading– most time on connected text • Encoding words, spelling, writing • Talking, discussing, collaborating, commenting, etc., etc. MATERIALS Age appropriate Matched to identified needs Skill-level appropriate Evidence of effectiveness Sufficient professional development provided What do students need? – KEY skills taught – Linked to standards Educators as Physicians “This is what we’ve found9 9and here’s what we can do.” Used with fidelity © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 19 Educators as Physicians Jan Hasbrouck, Ph.D. Educators as Physicians “How are things going? Are you feeling better?” The Question? Is the student making progress toward instructional goals? Monitor progress Progress Monitoring in Reading: 2 Forms CBM Progress Monitoring for Reading On-Level (Tier I) Repeat benchmark assessments 3x year + daily observation & in-program assessments Supplemental (Tier II) or Intervention (Tier III) Curriculum-based Measurement (CBM) ORF or maze Some adjustments in the procedures Scores compare students’ to individual goals rather than grade norms or benchmarks Major role in RTI decisions © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 20 Educators as Physicians Jan Hasbrouck, Ph.D. Research on CBM Progress Monitoring CBM-R Progress Monitoring DIFFERENCES Insufficient research. Level of passages? Schools must use multiple sources of information to support decisions about progress. Frequency? All CBM scores are estimates. Number of passages? Confidence intervals must be used. Graph results Ardoin & Christ (2009) CBM Monitoring Reading Progress CBM Monitoring Reading Progress using oral reading fluency using oral reading fluency 1 minute oral reading sample (IRP) Administered 1:1 Score for words correct per minute INSTRUCTIONAL or GOAL level (?) Assess 1x week or 2x month (?) 1 minute oral reading sample (IRP) Administered 1:1 Score for words correct per minute INSTRUCTIONAL or GOAL level (?) Assess 1x week or 2x month (?) One passage each time (?) One passage each time (?) Jenkins, Graff & Miglioretti (2009) suggest that 3 scores collected every 3 weeks may be the most accurate measure of student progress © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com Graph the results 21 Educators as Physicians Jan Hasbrouck, Ph.D. INTERPRETING Progress Monitoring Graphs What to “MODIFY”? General Rules: from National Center for Progress Monitoring Use 5 consecutive scores If all ABOVE goal-line: Keep current intervention and increase goal If all BELOW goal-line: Keep current goal and modify the instruction If NEITHER ABOVE OR BELOW goal-line: Maintain goal & instruction & continue monitoring Appropriate “MATCH” of instruction? QUALITY of program & instruction? FIDELITY of instruction? INTENSITY of instruction? DURATION of instruction? CBM Information Sources The ABCs of CBM Available for download at: Hosp, Hosp, & Howell (2007) CBM: From Skeptic to Advocate www.gha-pd.com/resources Hasbrouck & Ihnot (2007) National Center on Student Progress Monitoring www.studentprogress.org Fluent Reader.org www.fluentreader.org © 2014 Gibson Hasbrouck & Associates www.gha-pd.com www.jhasbrouck.com 22
© Copyright 2024 ExpyDoc
