Sunday, February 12, 2017

Week 5 Assessing for Comprehension

C& R Chapter 1

There is still much to research in regards to writing and best practices. However, currently there is also much to be learned from prior research. The authors suggested framing writing instruction around the standards.  The student’s learning should not be a mystery to them. They should know how to use certain traits or writing and when to use them. In my experience, the best way for me to do this has been to write kid friendly versions of the state writing rubrics and explain to students what each aspect is. Students have laminated copies that they can write on and check off as they write. We also spend time practicing each area of the 6 plus one writing traits. The authors also explain the importance of teacher modeling and think alouds, so that students can get an inside look into a writers thought process. It is also important to allow students time to practice writing daily whether it is in small groups or individually. It is a hope of the authors that students see how writers use different texts in the world. This made me think of how we need to provide our students with authentic writing opportunities that allow us to teach the different modes and offer them practice with writing to various audiences for a variety of reasons.  One of the research questions mentioned in this chapter had to do with when and how should students use invented spelling. The authors explained that not much research has been done in this area and that there still needs to be more done. I struggle with this as a teacher, because I have seen how spelling can become a roadblock for my weak spellers. They have great ideas, but sometimes get so caught up in spelling the words correctly that it stops the flow of ideas and keeps the paper from being as good as it could without these interruptions. However, sometimes their spelling strongly effects the readability of the text and to me seems to be a big issue. I try to help fix these readability issues by giving them key terms to use in their writing, access to our word wall, and their own personal dictionaries which have common words and their own words they’ve added that they struggle with.

Since there is a lack of research with the question above about invented spelling, the authors said they have relied on teacher experience for answers to that question. What are your suggestions as to when and how students should use invented spellings?

What types of authentic texts do you show your students that offer them a chance to see how writers use different texts in the real world?

What authentic writing purposes to your students engage in to practice the different texts that you might introduce them to?   

The authors also stressed the importance of creating an engaged community of writers? What are some ways you might establish this with students?

DS & G Chapter 8

This chapter discussed the importance of using multiple assessments to gain insight into students listening, viewing, and or reading comprehension. Commercial reading kits provide teachers with reliable benchmarks for readability levels. These texts are used to assess comprehension and fluency and to effectively find a reader-text match, so that students can read texts at their level. After analyzing the data, teachers can determine student’s instructional, independent and frustrational levels. When the teacher is scaffolding students with their comprehension and fluency, the students can use books at their instructional levels. I liked that the author suggested not using the retell portion of the DIBEL’s assessments. I have been required to use the DIBEL’s retell before, and I must say I agree with the author’s thoughts on its weaknesses. When I had to use this to asses my students retelling, we would mark off numbers for each word retold within a minute and then score the retelling with a scale. Like the authors explained, the students only were able to read the text for a minute where their focus is on accuracy and speed rather than comprehension. Then we would be asking them to orally retell in one minute what they speed read in a minute. I do not see how we can use that information to make decisions about a student’s comprehension!  As teachers, this made me think of the importance of making sure what we are doing is actually a best practice for our students despite what the product makers might say. Even though the makers of these assessments state that their assessments have evidence of strong reliability and validity, I think we have to use our experience as teachers as well as spend time researching the assessments ourselves to analyze their effectiveness for our students. 
Some common forms of assessments that can be used to check comprehension are: retellings, recall, reading scales, and running records. I liked that the author mentioned that young children might give more thorough retells to an individual or puppet that wasn’t present when they were reading. For children who can use written expression to retell, this made me think that they could write a retelling in the form of a letter to an absent classmate, friend in another class or their parents.  I found it interesting and never considered all of the information you can learn about a child’s comprehension even before they are able to read. After reading this chapter, I will also try to include some of the recall questions into my own guided reading groups. I can see how retelling a story or a video is not enough, and the importance of recalling making sure you are requiring students to tap into and use those higher level thinking skills that they may not use without you prompting them to do so.  The end of the chapter discussed standardized and standards based testing, and how we shouldn’t use these tests to inform our instruction or guide student learning. What frustrates me with this idea is why are we still using these tests to make decisions about whether or not are students can read. To me it makes more sense to make these evaluations with commercial kits like DRA that show growth over time, that give us more accurate information to go off of rather than the once a year test. Especially when these scores, can also be affected by so many other outside factors.

After reading this chapter, what do you believe is the best way for us to assess student’s reading comprehension when their scores are being used to make evaluations like grade placements?

What type of commercial kits have you used to assess reading comprehension and how effective are they at guiding your instruction and truly letting you know what your students know and still need to learn?

How often do you keep running records of your student’s progress? What is the most efficient and effective way to do this using MSV to analyze error patterns as the author suggested? MSV: (Meaning: Does it make sense? Error fits the context of the text. Syntax: Does it sound right? Error uses acceptable English. Visual: Does it look right? Error looks similar to the word in the text.).

H&F Chapter 2

This chapter discussed how teachers can use the TSI to gauge whether students are at the emergent, beginner, or transitional tier for word knowledge. This data can help teachers know what students already know and what needs to be learned. The author went on to discuss how progress monitoring students can help you see or not see growth over time which is also a reflection of how effective a teacher’s instruction is. We can progress monitor word knowledge by assessing how students can demonstrate, maintain, and transfer knowledge. I liked that the author mentioned how students will have words mastered the week of a test, but later forget how to spell them. In an effort to fix this problem, the authors suggest having cumulative spelling tests over previously learned skills about every six weeks. The end goal is for students to be able to transfer their word knowledge to be able to successfully encode and decode words when writing or spelling.  This chapter made me realize the importance of including dictation sentences on spelling tests to monitor transfer of knowledge. The authors mentioned that these sentences should require students to apply knowledge learned of the features being studied. 

What activities do you have your students do to demonstrate their transfer of word knowledge in reading or writing?

S&H Chapter 6

This chapter explained that vocabulary can be very tricky to assess and that those measures should be approached with caution because each has its strengths and weaknesses.  Student’s knowledge of words can be receptive or expressive. Receptive knowledge means students can understand words when they are read or said, whereas expressive knowledge relates to being able to use words in speech or writing.  This topic made me think of how I’ve experienced students saying that they know a word, but have trouble expressing its meaning with speech. Word knowledge measures can use criterion-referenced score interpretations (CR) or norm-referenced score interpretations (NR).  The CR interpretations are made by comparing how the student does in comparison to a certain level of mastery, whereas the NR interpretations are used to compare how students do in comparison with other individuals (norm group) that have taken the assessment. I thought it was important to note that although the criterion-referenced CBM’s are quick assessments used for screening and progress monitoring, they should be used with care. Since these measures also include some of the following skills: fluency, semantics, syntax, and decoding, the teacher needs to make sure that the scores are true reflections of the construct being assessed and not reflective of weaknesses in the skills mentioned above. I also liked that the authors mentioned that teaching without testing whether students have learned what has been taught is like cooking a meal without tasting it. This idea reiterates the importance of assessing vocabulary to determine what children have learned and what areas they are still lacking in. However, the assessments need to inform instruction, and not take up too much teaching time. Each measure mentioned had its pros and cons, and we need to be mindful of these as well as not rely too much on one single measure.

The chapter mentioned several activities that teachers can use to assess receptive and expressive words knowledge. Which activities or combination of activities do you think have the greatest effect size? 

What are some variations of these activities that you’ve used in your own classes to assess vocabulary?

What are some ways that you introduce new vocabulary to children prior to reading to decrease text complexity? In your opinion, what types of assessments are most useful in measuring how well the students learned these new words?

Jones et al Article

This article was very informative and interesting. I wish more teachers could read this!  I liked how the authors were very straightforward with what to focus on for small group interventions and whole group lessons. The author’s focused on three areas that students need interventions in the most: decoding, automaticity, and comprehension. The percentages of students struggling in these areas closely matched the characteristics of my current third grade class. The authors suggested using caution when timing students reading in one minute intervals. In every district that I’ve worked in this has always been something we were asked to do, and share/discuss this data with parents and colleagues. However, the authors of this article suggest using extended passages and texts to improve rate rather than the one minute timings. I liked the idea of explaining to students that their reading rate shouldn’t be too fast or too slow, and should match how we speak. I think the point about making sure that rate is not the central goal of comprehension is also important. The student’s rate and decoding should improve to the point that their cognitive energy can be used for comprehension. When thinking about independent, instructional, and frustration levels in regards to differentiated reading interventions mentioned in this article, I think the author gave some great ideas.  When students are being pulled in small groups to work on decoding, automaticity, or comprehension with the teacher, I think they should be practicing such skills at their instructional level. The authors mentioned using books above student’s current reading levels during classroom read alouds. Even though these books are at a level which might cause frustration if read alone, during read a read aloud time the teacher can assist students with applying  comprehension skills and in doing so also expose to them new vocabulary  and content at a higher reading level.


One part of the text that was a bit confusing for me was the part that talked about strategy instruction for comprehension. The author’s explained that often times teachers over teach the strategies when students only need to be reminded to use them. Furthermore, they explained how a study showed that teachers who used the content approach and asked general questions rather than use the strategies approach had students who outperformed students in the strategies groups. What are your thoughts of these two approaches? How will the results of that study influence how you teach various comprehension strategies? 

23 comments:

  1. Since chapter one indicated many question remain unanswered about assessing writing, Students should be allowed to use invented spelling to create sentence types and texts. As the teacher models and scaffolds (Pearson & Gallagher, 1983). Through continued explicit instruction, modeling and scaffolding and differentiation, (Tomlinson, 1999), students will learn the patterns and become independent in breadth and depth of existing curricula.

    Biographies, autobiographies, diaries, journals Newspaper commentaries, blogs, are challenging texts, with readability in authentic texts for a variety of purposes that allow students a chance to see how writers use different texts in the real world.

    Authentic writing purposes to engage students to practice using different texts that you might could include: Author’s chair, writing classroom books, journaling, retell stories from independent reading levels, character analysis and personal experiences.

    State and national standards concur with the importance of creating an engaged community of writers. Some ways we might establish these objectives are: blogs, challenging text that is valuable to students, interesting context, build upon students’ prior knowledge, invent stories, student illustrations, breadth & depth of existing curricula modeling/scaffolding (Pearson & Gallager, 1983). Use the strategies suggested in the text to include: think alouds, pair and share, scaffolding (guidance & support), sentence types and text, and differentiation (Tomlinson, 1999).

    Norm-referenced, Criterion- referenced assessments do not measure overall growth of my students who have received differentiated instruction, so I believe the best practice to assess students’ comprehension is progress monitoring. Compare to initial screening and diagnostics gives a clearer picture of student growth and knowledge. Chapter 8 states, reading comprehension is “complex and complicated”. Should their scores be used to make evaluations like grade placements?

    My class uses Fontas and Pennell, Level Literacy Intervention kits to assess reading comprehension. It is effective until it reaches the students’ frustration level then I have to modify my instruction to effectively support my students learning needs.

    My class uses running records to monitor students’ progress twice per week for each story from the Leveled Literacy Intervention Kit. Sometimes longer depending upon the text complexity.

    The most efficient and effective way to use MSV to analyze error patterns as the author suggested, MSV: (Meaning:
    Does it make sense? Oral Error fits the context of the text. Syntax: Does it sound right? Error uses acceptable English. Visual: Does it look right? Error looks similar to the word in the text.). Base the decision on scaffolding, Anecdotal notes, reading and writing conferences, text features and structures, discussion during guided reading, ask open ended questions, reader text match and provide scaffolding and differentiated instruction based on the student’s needs.

    H & F Ch2
    We use word mapping, context clues, games, jeopardy games, charades, activities do you have your students do to demonstrate their transfer of word knowledge in reading. We do quick writes and close sentences for writing.

    S & H shared the variations of the activities that I use in my classes to assess vocabulary depend on the purpose. At the beginning of the year (If I do not have prior assessment information) and when new students arrive, I do quick screening. Periodically, we do diagnostic if student is struggling, we do progress monitoring at least bi-weekly. Administration wants quarterly assessments. I do outcome measurement to determine whether students have an appropriate reader-text match for me to make instructional decisions.

    Some ways I introduce new vocabulary to children prior to reading to decrease text complexity include build on prior knowledge (word association), S & H mentioned challenging text should involve reading, writing, including pictures.

    ReplyDelete
  2. This comment has been removed by the author.

    ReplyDelete
  3. Jamie, in response to your questions,
    In my opinion, is the same as S & H as it relates to curriculum-based, progress monitoring, outcome measurement, using pictures, encourage expressive, receptive, oral language with written activities that allow me to look at student word knowledge from different perspectives when differentiating instruction according to my students’ needs. are most useful in measuring how well the students learned these new words?

    My understanding of the content approach and strategies group from the readings comprehension is the ultimate goal of reading. “Teach the strategies, remind students how to use them, ask general, open-ended questions. The students in this group significantly outscored the students in the strategies group.” (Jones, Et. al, p. 312) As a result, I am affirmed in my practice to continue to differentiate instruction by using questioning techniques as a form of comprehension assessment when we engage in dialogue after guided reading. Readability of text at an independent level is essential in responding to open-ended questions. The dialogue gives them a deeper understanding with challenging text, they use receptive and expressive language to demonstrate comprehension.


    ReplyDelete
  4. C & R Chapter 1
    In response to the questions posed- page 4 offers some approaches that are effective across domains and that will be addressed in the book: explicit instruction, modeling, then opportunities to engage, finally to work individually and differentitation. This is needed when teaching spelling and writing.

    ReplyDelete
    Replies
    1. Karen,

      I found page 4 and 5 of C&R very informative with effective strategies for teaching writing skills as well. As mentioned, providing explicit and clear to understand instruction is vital for children to understand what is expects from them. Modeling is also a strategy I use very often in my classroom, either through the projector, the smart board, anchor charts, and so much more. I have noticed that children understand what you want them to do when they can see it and replicate or imitate it. After providing explicit instruction and modeling, letting the children work independently or in pairs without teacher guidance, you are able to observe the depth of the skills understood and then can provide scaffolding questions.

      As for creating an engaging environment of creative writing, I do my best to focus writing prompts on topics that will interest the students. Topics they can relate to, have fun writing about, and want to share with the class seem to be very motivating and keep the students engaged and having fun.

      Delete
    2. Karen, we use some of the same strategies in class found in C & R on pp. 4-5. What challenges do your students face when working independently? My student's best work has been group work as indicated in research.

      Delete
    3. Theresa,

      I use modeling quite a bit in my classroom as well. I fade it out as their knowledge base and confidence levels grow but I think it's especially a great way to introduce a new skill. It's great that you use writing prompts that you know will interest your students. It still amazes me, after 3 years, that students produce so much more (and often times don't even realize it) when they are learning about a topic they are interested in. I know this knowledge will help me in my role as a reading specialist further down the road.

      Delete
    4. Karen-

      As far as the four approaches: explicit instruction, modeling, opportunities to engage, working individually, and differentiation- which do you find the most challenging for your student population? Or do you find them challenging is the first question of course! I am curious as I often wonder think of the special education population and how many of these approaches would work in different settings as we read these texts. As you mentioned in another post, obviously some of these students are likely going to have more trouble with inferencing, expressive communication, etc.

      Delete
  5. The authors state, " We encourage teachers to use evidence-based instructional practices in ways that match the needs of the students". Each one of my students is on a different level in regards to writing/spelling. We use strategies to try and spell the word correctly in our rough drafts--but then make corrections for our final drafts. Requiring proper spelling gives me an insight into how well my students are making sound/symbol connections to words we have learned and to those higher level words maybe we haven't addressed yet.

    ReplyDelete
    Replies
    1. Like Karen's students, we also use rough drafts to jot down ideas and develop our writing. The rough draft, in my classroom, can have as much inventive spelling as needed to allow for sentences of vast vocabulary and details. I don't like the idea of my students limiting themselves from including vocabulary words because they are unable to spell them correctly. My students will edit their own work a few times and then I will edit their drafts. After reviewing my edits, the students will see their spelling errors and we discuss the skills that need to be practiced. Final drafts will have no grammatical or spelling errors. This process surprisingly doesn't hurt their confidence levels, but motivates the students to try their best to not have any teacher corrections on their work.

      Like the four recommendations on p. 2 of C&R, my students are engaged in the writing process and also are practicing fluency of handwriting, spelling, sentence construction, and word processing during these lessons.

      Delete
    2. Theresa, like you and Karen's students, my students are also encouraged to engage in the writing process (C&R, p.2) when they read what they wrote, they say, "that does not look right." Drafting helps the use correct words spellings in their writings.

      Delete
  6. DS&G Ch 8
    I am thrilled the authors of this book discussed DIBELS. I am not the biggest fan of DIBELS-especially the retell portion. On page 153," We urge caution because their is no consideration of the content of the retelling". Our school uses it as one of the main reading criteria for qualifying for Reading Sufficiency.
    For your question about assessments and grade placement-are you referring to retention?

    ReplyDelete
    Replies
    1. That is crazy to me that it is used for the Reading Sufficiency Act. This is my first year back in third grade since my first year of teaching about six years ago. I am still trying to figure out everything that goes along with retaining the students if they don't pass the reading test. I think I understood that if you do not pass, a committee (teacher, parent, and principal) can sit down and use data from kits like DRA or Dibels to show proof that they can or can't do work at a fourth grade reading level. I just don't agree with using those state reading tests is the best measure of a student's reading comprehension. There is so much test-taker variability to factor in to the exam. If I had to choose, I think the DRA or some of the commercial kits are a much better way assess comprehension. I like the the idea of focusing on growth. I also don't like that the state tests don't allow students with the opportunity to use open response written expression. Whereas with the DRA, the students have to respond in writing. It just seems to me like a better reflection of where the student is.

      Delete
    2. Jamie,
      I completely see your point and agree of focusing on growth.
      I don't agree with retention anyways--which I am sure we all have different opinions about--and then to add a state test as "the measure" in which to base a child's advancement to the next grade level is outrageous--my opinion only.
      Also--I might have not been clear--we refer to our our reading specialist pullout as reading sufficiency. So, DIBELS scores are used as the measure in which students qualify to go see the reading specialist.

      Delete
  7. Jamie,

    In regards to your discussion question about complex vocabulary words in texts, with the Wonders literacy curriculum being used in Norman, vocabulary word definitions are provided before every short story of the week. I go over these words prior to reading the stories, so the children have an idea of what they mean. I also encourage the students to go back and refer to these resources if they ever forget the meanings. Along with providing the definition, it also gives a picture for the vocabulary word as well. Other strategies I use to introduce new vocabulary words is I may do a think, pair, share or I will do think alouds, like on p. 31 of H&F on sounding out phonemes of words.

    Honestly, I haven't been assessing my students on their vocabulary, however after reading the chapter from S&H, I could see myself using a few to guide my instruction with my students. The Yes/No Task seems easy to administer and I like how you can assess more than one student. The Cloze Sentence Task also seemed like an assessment that I could gain an understand of what tier of words my students know and how they construct their understanding of words using context clues. Of course, these assessments will have limitations, but it does give enough information to guide instruction for best practices.

    ReplyDelete
    Replies
    1. I liked the yes/no task as well and the fact that it is a way to assess the entire group all at once. I also like that the students get to practice hearing the word being used in context. I might like to write the sentences out. Especially since the author mentioned that it requires a lot of attention to comprehension from the students in order for them to focus on what the teacher says. I like that the definition task also gives students practice with using their expressive language. Another idea that I really liked that I had never thought about before was the morpholocial comprehension task. It seems that by giving students a non word with affixes is a great way to really see the transfer of knowledge and get an idea of whether or not they truly understand those word parts. This is a great way to teach them how they could use those affixes to help figure out an unknown word.

      Delete
  8. Thoughtful questions, Jamie. Thanks Karen, for breaking down your responses into different comments so we are not reading a long monologue but actually you are beginning a conversation on a topic. Cynthia, you have lots of information here but it seems like a monologue instead of beginning a conversation.

    ReplyDelete
  9. H & F Chapter 2
    I was interested in the TSI since I use a different spelling inventory from one the book mentioned-Words Their Way. It was interesting to notice the differences and similarities between the two inventories. I appreciate the book providing explicit steps ( following teaching guidelines!) and how to score and then next steps as well as examples of what an emergent tier TSI score of 0 would look like (page 31). In my classroom, we have weekly spelling tests along with dictation sentences and every three weeks a cumulative test over previous weeks words. I usually do an inventory at each 9 weeks. We also have a method for transferring this knowledge called COWS ( coding our words simply)- a file folder containing prefixes/suffixes/Greek and Latin roots we have covered as well as vowel patterns, digraphs/syllable types and other combinations we have covered. This helps us when we read or spell. For my younger students we have a rubric we review of 5 steps before we start writing
    . I also liked on page 51, the evidence of transferring word knowledge to reading and have similar inventories I use to assess this skill. For classroom teachers, do using inventories seem like an option you would use? Since I have small groups of many different levels, it is imperative I complete this since I don't have all one grade/level.

    ReplyDelete
  10. Jones et al Article
    Jamie, I would agree with you, I had to re-read the passage a few times to try and understand what the authors were describing. I think also, it depends on your group of students. In my reading groups, my older group seems to respond better to open ended questions, however, my younger group seems to need more modeling of strategies to gain comprehension. My students struggle most with making inferences. I think some has to do language delays how langue affects their ability to make inferences from conversations with others--and therefore hard to carry over to print.

    ReplyDelete
  11. Jamie,

    To answer your discussion question about which commercial comprehension kit used to guide instruction and assess comprehension, I have only had experience with using the DRA. As far as effectiveness, I believe it provides a good overall picture of what the child knows and that is what helps me develop individual instruction. I also like that it provides a word analysis that will help me understand what skills I will need to focus on with each child in the specific aspects of literacy like phonological awareness, phonemic awareness, structural analysis, syllabication, etc.

    In chapter 8 of DS&G, p. 158, it stresses the importance of using miscues as a form of assessing a student's understanding of text. When a child is self correcting, you can observe that they are self monitoring their reading and reading to make sense. In the DRA, noting miscues is supported and encouraged as you are scoring. The DRA also allows you to calculate the level of difficulty in text and will have you reassess the student if the text is not 90%-95% difficulty, as stated on p. 163. It's a very useful kit and provides an ample amount of information for individual instruction.

    ReplyDelete
    Replies
    1. I too like using the DRA and love the feedback I have received from it to further guide my instruction. The miscues truly are a great help because they act as windows into a child's inner thought processes of what skills they are or aren't using. I liked how the book provided examples of the teacher's running records of the student's miscues and how they used those notes to start to notice patterns. These patterns can then be used to target those areas of weakness. I plan on keeping a running record of miscue errors for my struggling decoders. I also see the importance of keeping a close eye on students spelling errors when encoding as well.

      Delete
    2. Jamie, I agree you on the DRA feedback. The running records shows a wealth of information. They can help with guidance, planning, and measuring growth in reading and spelling.

      Delete
  12. Jamie,

    I love how you broke down the writing standards for your students, laminate, and make them readily accessible. I know I would have loved having this resource back in 3rd grade! I often found it frustrating when lessons seemed like "secrets" and we would have try and decipher the purpose of the lesson if we wanted to understand why we were doing it. I think this will definitely help students take ownership of their learning and help them with understanding when, how, and why they should use different types of writing and other aspects of literacy.

    There were so many things in DS&G chapter that I found myself vehemently agreeing with. Using puppets for story retell instead of a peer or a teacher is a great idea. It is often less unnerving and more engaging for the child. I do an activity similar to this in speech therapy when we are working on listening comprehension, expressive communication, forming complete grammatically correct sentences, etc. The use of multiple assessments to evaluate a student makes complete sense. Each assessment has its strengths and weakness, as I've learned first hard during our first assessment task. We should not judge a child's knowledge on just one of these. Also children learn and express their knowledge in different ways so it only makes sense to assess them in different ways.

    ReplyDelete