Classroom observations and observer ratings were collected in both Tools and Comparison classrooms. Classrooms were observed three times during the fall and spring semesters of school years 2010-11 (cohort 1) and 2011-12 (cohort 2), with one observation in the fall and two in the spring semester. Two observers visited the classroom to record all classroom activities during the day. One observer completed the Narrative Record and Tools of the Mind fidelity measure (see Fidelity Measures page<\/a>)\u00a0as well as an environmental scan of the classroom materials. The second observer completed the Teacher Observation in Preschools (TOP) and the Child Observation in Preschool (COP). At the conclusion of the observation, each observer collaborated to complete the Post Observation Rating Scale (PRS). The classroom observation measures are described below.<\/p>\n The Narrative Record (Farran & Bilbrey 2004) <\/em>is an open-ended format for recording descriptive narrative data notes and also rating the activities occurring in the classroom. This system was used in both Tools and Comparison classrooms to determine similarities and differences among them. The focus of the Narrative Record <\/em>is the whole class; whatever the class as a whole (defined as at least 75% of the children) is doing is coded. The Narrative Record <\/em>consists of the following items:<\/p>\n Episodes of Time<\/strong>: Each instructional episode is coded for beginning and ending times.\u00a0 An episode is defined as beginning when there is a change in the method of instruction or a change in the focus of instruction. \u00a0Detailed notes are kept about each episode.<\/p>\n Codes for Content of Instruction (Learning Focus)<\/strong> occurring during the episode (e.g., math, reading, code-based language instruction, science, social studies, art, music & movement, and none).<\/p>\n Codes for Level of Instruction<\/strong> provided by the teacher across an episode.\u00a0 These range from no instruction (0) to highly inferential instruction (4). Inferential means asking open-ended questions; highly inferential involves several turns with inferential questions and follow-up.<\/p>\n Codes for Engagement Level of Students <\/strong>across an episode. These range from very low engagement (1) to extremely and consistently high engagement (5) across the entire episode.<\/p>\n Codes for Type of Activity (Learning Setting)<\/strong> during the episode.<\/p>\n Single setting: Whole Group with or without Teacher (WG), Small Group (SG), Meal, Transition<\/p>\n Multiple settings: Small Groups operating with Centers (SGC), Small Group with Teacher during Centers (SGTC), Out of Room (e.g., outdoors, bathroom, or specials, such as library)<\/p>\n The Narrative Record <\/em>was adapted to track the following Tools-specific behaviors that could be exhibited in Comparison classrooms as well:<\/p>\n Positive Behavior Reinforcement <\/strong>by the Teacher or Assistant<\/p>\n Behavior Reminders <\/strong>by the Teacher or Assistant<\/p>\n Choral Responses from the Children <\/strong>(children are encouraged to call out answers)<\/p>\n Teacher Paired Activities <\/strong>(meaning the teacher has assigned pairs of children to interact)<\/p>\n Individual Scaffolding by the Teacher or Assistant<\/strong><\/p>\n Teacher Directed PrivateSpeech <\/strong>(meaning the teacher has directed children to use private speech)<\/p>\n Intentional Teacher Mistakes<\/strong><\/p>\n Click to view Narrative Record Manual<\/a><\/p>\n Click to view screen shot of Narrative Record coding form <\/a><\/p>\n The TOP (Bilbrey,Vorhaus, & Farran, 2007)<\/em> is a system for observing the teacher and assistant\u2019s behaviors in preschool classrooms across a day-long visit when the children are in the classroom. The TOP<\/em> is based on a series of snapshots of the behaviors of both the teacher and assistant across a period of time when children and teachers are in the room.\u00a0 Each snapshot may be, by itself, an unreliable piece of information, but collectively, they combine to provide a picture of how the teacher and assistant are spending their time in a classroom. The teacher\u2019s behavior is observed for a 3-second window before scoring. Once scoring has been completed for the teacher, the same procedure is followed for the assistant in the classroom. Teacher and assistant are coded at the beginning of a \u201csweep;\u201d children are coded immediately afterward. At the end of an observation, a total of 20 sweeps each was collected on the teacher and the assistant. The TOP<\/em> measures:<\/p>\n How much and to whom the teacher talks and listens<\/strong><\/p>\n The types of tasks in which the teacher or assistant is engaged <\/strong>(Instruction or Assessment, Management, Administration, Monitoring, and Personal Care, Behavior Approving or Disapproving, Social, None<\/p>\n The level of ongoing instruction or assessment <\/strong>(None, Low, Basic Skills, Some Inferential, and Highly Inferential)<\/p>\n The areas of learning on which the teacher or assistant focuses <\/strong>(Specific Learning Focus: math, literacy, science, social studies,Other Learning Focus: art, music, fine motor, drama, etc., No Learning Focus: no instruction or assessment)<\/p>\n The tone of the interactions teacher or assistant <\/strong>has with the class, vibrant, pleasant, flat or negative<\/p>\n TOP<\/em> data are not collected when children are out of the room. Only one sweep is allowed during a meal inside the room. The TOP<\/em> focuses on times when teachers and children could interact in the classroom.<\/p>\n TOP<\/em> was adapted for use in Tools of the Mind Evaluation.<\/p>\n Click to view TOP Manual (paper coding form included)<\/a><\/p>\n Click to view screen shot of TOP on tablet coding form<\/a><\/p>\n The COP (Farran et al.2006, 2008 revision) <\/em>is a system for observing children\u2019s behaviors in preschool classrooms across a day-long visit. The COP <\/em>is based on a series of snapshots of children\u2019s behaviors across a period of time when children and teachers are in the room. Each snapshot may be, by itself, an unreliable piece of information, but collectively, they combine to provide a picture of how children are spending their time in a classroom (as an aggregate), as well as to provide information about individual differences among children in their activity preferences. A specific child is observed during a 3-second window and then coded across 9 dimensions before the observer moves to the next child. At the end of an observation, a total of 20 sweeps was collected on each child in the classroom. \u00a0Consented children are identified by name; all others are identified as \u201cExtra boy\u201d or \u201cExtra girl;\u201d this process ensures that the behaviors of all the children in the classroom are observed. The COP<\/em> measures:<\/p>\n How much and to whom the children talk and listen<\/strong><\/p>\n The learning settings <\/strong>in which children are found (Whole Group (with and without teacher) Small Group (with and without teacher), Centers, Transitions, Other: classroom activities not captured by above, such as book reading at the beginning of nap.)<\/p>\n The different types of learning foci of the activities <\/strong>in which children are engaged (eg. Specific Learning Focus: math, literacy, science, social studies Other Learning Focus: art, music, fine motor, drama, etc. No Learning Focus)<\/p>\n The level of involvement of the children: <\/strong>High, Medium High, Medium, Medium Low and Low<\/p>\n As with the TOP<\/em>, COP<\/em> codes are only collected when the children are in the room and learning interactions could take place. The COP<\/em> is not coded during naptime — stopping when the lights go off — or during meal times. \u00a0If meals happen in the room, one data collection sweep is allowed.<\/p>\n COP<\/em> was adapted for use in the Tools of the Mind Evaluation.<\/p>\n Click to view COP Manual (paper coding form included)<\/a><\/p>\nNarrative Record<\/h2>\n
Teacher Observation in Preschool (TOP)<\/h2>\n
Child\u00a0Observation in Preschool (COP)<\/h2>\n