tension between reliability and validity. As a second example, interrater reliability is increased by standardizing the scoring procedure (e.g., clearly defined rubrics and training) . This standardization can limit the definition of good writing by not including some types of writing in the rubric and thus, as a conse- quence, limit the breadth of the construct. As a result, it is important to consider the impact of any standardiza- tion on the validity of the test as well as the reliability so that the construct is still clearly being measured. Generalizability Theory and Estimates of Reliability Classical test theory examines errors of measurement with a single undifferentiated error that may represent multiple sources of error (e.g., alternate form test- retest reliability). In addition, classical test theory examines reliability only from a norm-referenced per- spective. That is, the methods rely solely on correla- tions that focus on rank ordering of scores. The correlations are sensitive to differences in rank order- ing but not to shifts in scale. Thus, the reliability can be high even when the scales for the two forms, raters, and so on, are substantially different. For example, Rater A could rate 10 points higher than Rater B, and the reliability would be equal to 1.0 as long as every essay was scored exactly 10 points higher by Rater B than Rater A. 850 Reliability Generalizability theory solves each of these issues by (a) modeling multiple sources of error and (b) dif- ferentiating between errors based on rank ordering (i.e., relative error) and errors based on point estima- tion (i.e., absolute error). Generalizability theory assumes that each examinee has a universe score that is his or her average score across all conditions in the universe of admissible observations. That universe is composed of measurement facets (e.g., raters, items) with a particular level of a facet being a condition (e.g., selected raters or items). The potential measure- ment conditions selected from the study are then considered to be the universe of generalization. Gen- eralizability theory is more complex statistically than classical test theory and is done in two stages: the G-study and the D-study. In the G-study (general- izability study), random effects analysis of variance (ANOVA) is used to estimate variance components for each of the effects in the model. The ANOVA, with the associated variance components, can be esti- mated with one or more facets (e.g., persons by items, or persons by items by raters). In the D-study (deci- sion study), alternative measurement models can be examined to optimize the measurement procedures or to examine a reasonable set of measurement condi- tions. The results of the D-study identify the universe of generalization. Similar to classical test theory, there are two types of indices computed in the D-study that show the con- sistency of the measurement procedure. The general- izability coefficient, or dependability index, is the ratio of the universe score variance to the universe score variance plus the error variance, and it is analo- gous to a reliability coefficient, whereas the second index is analogous to the SEM. The generalizability coefficient shows the ratio when using relative error variance and emphasizes the rank ordering of scores. Thus, it would be used for norm-referenced score reporting. The dependability index shows the ratio when using absolute error variance and emphasizes the absolute magnitude of the test scores. Thus, it would be used for criterion-referenced score report- ing. The second index is the standard error. The stan- dard error also can be computed for relative or absolute score reporting. The use and interpretations of the indices in generalizability theory are analogous to the indices in classical test theory. Absolute error is always greater than or equal to relative error. Consequently, the generalizability co- efficient is less than or equal to the dependability index, and the absolute standard error is greater than or equal to the relative standard error. As a result, more conditions (items, raters, etc.) may be needed when estimating examinee scores absolutely rather than relative standing. Consistency of Classification Each of the reliability coefficients, whether from classi- cal test theory or generalizab ility theory, is based on continuous variables. Ofte n, the measurement proce- dure is based on the classification of examinees. For example, the National Assessment of Educational Progress (NAEP) classifies students as Advanced, Pro- ficient, Basic, and Below Basic. Clearly, when the data are nominal or categorical, a different statistical proce- dure must be used to examine consistency. Decision consistency is a method of ex amining reliability and the exact agreement across measurement conditions when the data are categorical. Decision consistency can be calculated for each of the sources of error describedaboveinthesectiononclassicaltesttheory. Twoindicescommonlyre ported for decision con- sistency are the proporti on agreement and Cohen’s Kappa. Proportion agreement shows the proportion of the examinees that are classified the same across forms, time, and so on. For example, if two forms were given to a sample for the NAEP reading assessment in Grade 8, the proportion agreement would be equal to the sum of the proportions that were Advanced on both forms, Proficient on both forms, Basic on both forms, and Below Basic on both forms. The same calculations could be done with other sources of error (e.g., ratings are the same across two raters). Cohen’s Kappa is the proportion agreement after statistically adjusting for the expected agreement. Thus, Cohen’s Kappa shows the agreement above and beyond chance and generally has lower values than the proportion agreement. M. David Miller See also Assessment; Descriptive Statistics; Evaluation; Testing Further Readings American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association. Reliability 851 Brennan, R. L. (2001). Generalizability theory. New York: Springer-Verlag. Haertel, E. H. (2006). Reliability. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 65–110). Westport, CT: Praeger. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley. R ISK F ACTORS AND D EVELOPMENT Optimal child development may be compromised by several risk factors, includi ng poverty, poor nutrition, harsh/inconsistent parent ing, familial substance abuse, and low parental education, to name a few. Children developing within these maladaptive contexts often exhibit poor developmental outcomes across cognitive, social, and behavioral domains, such as low academic achievement and antisocial behavior. Some children exposed to great adversity, however, develop compe- tence, suggesting that some factors may protect (or buffer) high-risk children from experiencing negative developmental outcomes. The purpose of this entry is to (a) describe the theoretical framework guiding the research on the development of risk and protective factors; (b) identify how risk factors at the child, parent, family, and community level negatively affect developmental outcomes; and © describe how protec- tive factors may moderate negative outcomes in high- risk children. This entry also discusses the importance, capacity, and effectiveness of early intervention pro- grams that are designed to increase educational out- comes by reducing the nega tive consequences of risk factors. Ecological Systems Theory as a Guiding Theoretical Framework Ecological frameworks recognize that each person functions within a complex network of individual, fam- ily, community, and environmental contexts that influ- ence the availability of risk and opportunities to avoid risk. Urie Bronfenbrenner is a pioneer of the ecological model of human development, in which he describes development as the composite of individual genetic endowment, immediate family influences, and other components of the environmental context. According to Bronfenbrenner, the indi vidual is embedded in five interrelated, nested subsystems that simultaneously influence the process of human development. The innermost circle represents the microsystem of the individual. Within the microsystem are the indivi- dual’s interactions with his or her immediate settings. Bronfenbrenner refers to these interactions as proxi- mal processes. For most children, the family is the first and most important microsystem. As develop- ment proceeds through childhood and adolescence, additional microsystems might be sports teams, youth or church organizations, and work. Microsystems may overlap in that the same person may be a member of more than one system in a child’s life. For example, a friend may be a member of the child’s peer group, sports team, and class in school. Just as the individuals interact with others in their microsystem, separate microsystems interact with each other at the level of the mesosystem. The meso- system incorporates linkages between settings such as family, peers, teachers, and other school personnel. For example, an adolescent’s ability to excel in school may depend more on the interconnections between the school and the home rather than solely on ade- quate performance in the classroom. In this case, Bronfenbrenner posits that the breakdown of connec- tions between family, school, peer group, and neigh- borhood underlie the declin e of academic achievement more so than relationships within each of these con- texts alone. Continuing the progression to increasingly distal influences on the individual, the exosystem represents external environments that the individual may or may not experience; yet events that occur in these environ- ments affect what happens in the microsystem (an individual’s immediate setting). This system includes features of the community such as availability of ser- vices or employment, access to formal and informal support, and socioeconomic climate. Parental and teacher social networks are part of the exosystem, having the potential to influence interactions with the child even though they may not directly be experi- enced by that child. The overarching macrosystem represents the larger societal contexts, and influences differ across socio- economic, ethnic, religious, and other subcultural groups. For example, in the United States, macrosys- tem influences include American culture and the social policies and programs that affect American families, such as racial prejudice and discrimination, the media, and antipoverty social programs. Finally, 852 Risk Factors and Development each subsystem is embedded with time, the chrono- system, which represents that each of these subsys- tems functions within time and changes over time. Applying this model to one of the most researched child outcomes, low academic achievement, indicates that risks begin in the most proximal system. The microsystem includes risk factors such as impulsivity, poor attention, inadequate school readiness, poor physical health, low school attendance, and so on. In the mesosystem, low academic achievement relates to the interactions between the family and the school, and include such factors as parenting styles, parent involvement in academic endeavors, teaching styles, school environment, and so on. The community con- text also affects a child’s ability to perform well aca- demically, given such factors as community violence, neighborhood crime, parent employment, school poli- cies, transportation availability, and so on. Finally, through cultural values, governmental policies, and the political climate, the larger society also begins to influence academic achievement. Given the influences from multiple levels of children’s ecology, it becomes evident that the risks for low academic achievement cannot be understood from one context alone. Risk Factors Across the Ecological System The structure of the ecological model allows for understanding the influences on child development at multiple levels and informs the process by which con- textual factors influence child development. Although this framework identifies risk factors for child devel- opment, the concept of risk initially evolved from medical research examining the cause of cardiovascu- lar disease. A medical research study that began in 1948, called the Framingham Heart Study, followed multiple cohorts of individuals across several decades in an effort to identify the factors that put individuals at risk for developing cardiovascular disease. The same logic has been applied to human development and enhanced understanding of why some children facing adversities from multiple ecological levels develop into cognitively and socially competent adults, and others do not. Several longitudinal studies have documented risk factors and the decline of optimal child and adolescent development (e.g., the Perry Preschool Project, the Abecedarian Project, the Milwaukee Project, and Project CARE). As research studies began to investigate the cause of poor developmental outcomes and risky behavior (e.g., low academic achievement, teen pregnancy, juvenile delinquency), three categories emerged: child characteristics, parent/family characteristics, and com- munity characteristics. Although risk factors are often studied and discussed within these categories, the eco- logical framework informs the interrelated nature of each factor and ecological system. Child Characteristics The three main risk factors associated with poor developmental outcomes inc lude low birth weight, tem- perament, and child health. First, compared to infants born at normal weight ( > 5 lbs.), children born with low birth weight (1 to 4 lbs.) are more likely to have continual health and developmental problems (e.g., cerebral palsy); lower IQ; and pervasive neuropsycho- logical impairments in attention, memory, problem solving, reasoning, and language. Marked negative behavioral and academic outcomes are also evident, including higher incidence of conduct disorder, hyper- activity, attention problems, and learning disorders. Furthermore, the developmental consequences of low- birth-weight babies are particularly devastating for the extremely low-birth-weight babies (less than 2 lbs.). The second risk factor at the child level is tempera- ment. Children with difficult temperaments are at much higher risk for poor developmental outcomes than easy-temperament babies. Difficult children have a negative effect on their caregivers and thus are less likely to experience supportive relationships with them, which is a necessary component to counteract exposure to adversity. Difficult babies often develop into difficult adolescents, who have been shown to exhibit more emotional and behavior problems than adolescents who were easy babies. The third risk factor associated with poor develop- mental outcomes is poor child health. Frequent hospi- talizations, chronic medical conditions, and repeated illnesses increase the stre ss level within the family, which has been related to later psychosocial and aca- demic difficulties in school-age children. Poor health in childhood has a long-term impact on development across the life span and is related to early mortality rates. Parent/Family Characteristics Research has uncovered several parental and family-level risk factors associated with maladaptive Risk Factors and Development 853 development, including family structure and resources, parental background characteristics, and relationships within the family. One of the most pervasive negative effects on developmental outcomes is a family living in poverty. Research suggests that children raised in persistent poverty (as opposed to transitory poverty) perform much worse academically—as measured by achievement test scores, grade promotion, high school graduation, and completed years of schooling—than more affluent children. Furthermore, children in eco- nomically strained environments are almost twice as likely as nonpoor children to experience learning dis- abilities and developmental delays. Parent, teacher, and child self-reports also reveal that low-income children display more externalizing problems, such as fighting, difficulty getting along with others, and impulsivity, in comparison to higher-income children. Finally, researchers report that children of poor families have more emotional and behavioral problems than do children who have never been poor. Vonnie McLoyd reviewed the research on children of low-income families. Results indicate that family income produces the strongest relationship with aca- demic achievement of all other variables considered (e.g., parent’s occupation and parent’s education level). Even when the other indicators are summed together, they do not yield as high a correlation with academic achievement as does income alone. This line of research shows that economic hardship influ- ences the psychological well-being of parents and the relationships among family members. Studies reveal that the influence of economic stress on children and adolescents is mediated to a significant extent by dis- ruptions in family relationships and interactions, espe- cially parent–child interactions. In addition, families headed by single parents are also six times more likely to be poor than are families from two-parent households and therefore are more likely to be affected by poverty characteristics. Single parenthood disrupts the relationship between children and the noncustodial parent, usually the father. This may affect the extent to which supportive, caring rela- tionships can be developed and nurtured. Psychologi- cal problems and behavior problems are more likely in children from single-parent or remarried families. Another risk factor can be conceptualized as parental background characteristics, which includes parental substance abuse and low parent education. Each has been linked to increased internalizing and externalizing problems among children. Also, children with parents suffering from alcoholism are approxi- mately four to six times as likely as the general popu- lation to develop alcohol problems. Furthermore, anxiety, depression, and externalizing behavior disor- ders (e.g., conduct disorder) are more common among children with alcoholic parents than among children of nonalcoholics. In families where alcohol or other drugs are being abused, behavior is frequently unpre- dictable, communication is unclear, and family struc- ture is either nonexistent or inconsistent. Because parents who abuse alcohol or other drugs are more likely to be involved with domestic violence, divorce, unemployment, mental illness, and legal problems, their ability to parent effectively is severely compro- mised. There is a higher prevalence of depression, anxiety, eating disorders, and suicide attempts among children of parents who abuse drugs and alcohol than among their peers. Family background factors, such as parental educa- tion, have moderate effects on child development but larger effects on later adult outcomes. That is, parental education level affects later adult outcomes through transmission of educative values, such as not dropping out of school. Parent inco me and education level are associated with school drop- out rates, which drastically reduce the quality of later adu lt life, increasing the like- lihood of unemployment and poverty. The final risk factor to be discussed here includes the quality of the relationships within the family (i.e., parent–child, sibling, and marital relationships). In general, research reports that warm and supportive relationships within the family are associated with positive child and adolescent outcomes, whereas coer- cive and conflictual relationships are associated with the development of problems. One of the clearest and most replicated associations in this area is between conflictual parent–child relationships and child and adolescent maladjustment. For example, harsh, incon- sistent, and ineffective discipline is associated with later antisocial behavior, and insecure parent–child relationships, including parental rejection and force- fulness, are traced to later internalizing problems. Community Characteristics The community context can also influence a child’s developmental trajectory. Research has shown that poor neighborhoods can have detrimental effects on individ- ual health status through three types of pathways. First, concentration of poverty and re lated characteristics may 854 Risk Factors and Development create more detrimental social environments (e.g., vio- lence, stress and anxiety, exposure to drugs, limited social control). Second, poorer communities are less likely to have access to adequate health care and social services. Third, the physical environment (e.g., air pol- lutants, hazardous conditions leading to accidents, poorer sanitation) in poor communities may be worse than in more affluent communities. Existing research also points to a powerful connec- tion between residing in an adverse environment and participating in criminal acts. Inner-city neighborhoods provide limited economic, institutional, and social resources for families and adolescents. Disorganized neighborhoods have weak social control networks, which result in isolation among residents, high residen- tial turnover, and criminal activity that goes unmoni- tored. Few opportunities for youth to be monitored (such as programs where youth can contribute to the community), as well as the increased access to alcohol, drugs, and firearms, increas e the likelihood of youth engaging in risky and destructive behaviors. Neighbor- hoods with high crime, poverty, and physical disorder areassociatedwithyouthengagementinviolence, crime, and drugs and alcohol; low community attach- ment; and a feeling of being unsafe. The Impact of Cumulative Risk Although each risk factor across the ecological system has been related to a negative cognitive, social, or behavioral impairment, the impact of one risk factor tends to be relatively small in relation to the cumula- tive effect of multiple risk factors. That is, research suggests that children can handle some level of adver- sity, but when faced with three to four risk factors, developmental outcomes become drastically and neg- atively affected. Furthermore, the more risks to which children are exposed, the worse the developmental outcomes. Therefore, children’s optimal development is ultimately affected by the sheer number of risk fac- tors present, regardless of the nature of a particular risk factor. As the number of risk factors increases, the negative effect enlarges disproportionately. For example, having four or more risk factors, which relate to the child, parent, and sociodemographic situ- ation, can lead to a 10-fold increase in difficulties, a result that has been replicated numerous times across the psychological research. It is important to note that although poor develop- mental outcomes tend to relate to the presence of risk factors, the absence of risk factors does not predict healthy development. Appropriate opportunities must be presented for development to flourish and reach optimal levels. For example, opportunities afforded by high parental warmth, rather than just a lack of harsh and inconsistent parenting, are essential to pro- mote healthy development. Research indicates that development is a balance between opportunities for strengths and risks to develop. Within each of the eco- logical levels, there are risk factors that negatively influence development and there are protective factors that foster positive development. Risks, cumulative risks, and protective factors interacts generating a complex set of relationships that creates develop- ment. Knowledge of risks alone is not sufficient to understanding child development, although these fac- tors have received the most research attention. Modifying the Impact of Risk Factors on Development The negative impact of cumulative risks may be offset by understanding the conditions that promote success- ful development. Resiliency research has demonstrated that there are certain factors that protect against unde- sirable behavior. Resiliency has been defined as the capacity of the person, family, or community to pre- vent, minimize, overcome, or thrive in spite of negative or challenging circumstance s. There are three kinds of resiliency described in the research literature. The first involves an individual who overcomes all the odds, suggesting that this individual has a particular quality that allows him or her to withstand adversity. The sec- ond consists of coping in the face of sustained and acute negative circumstances, such as extremely high family conflict. Third, resilience can refer to recovery from trauma, such as the death of a sibling. All require risk to be present for resilience to emerge; however, most research tends to fall within the second group: success in the face of adversity. Identifying protective factors is one way that resil- iency can be measured. Protective factors are those that relate to positive developmental outcomes for youth exposed to high levels of risk or adversity only. If positive outcomes are observed across all levels of risk (high and low), the factor is termed an asset, compensatory, or promotive. Thus, protective factors are assets that particularly matter when risk or adver- sity is high. Protective factors moderate the impact of Risk Factors and Development 855 adversity on adaptation, changing the expected nega- tive child outcome. A landmark study on resiliency, conducted by Emmy Werner, has followed the development of chil- dren born on the Hawaiian island of Kauai since 1955. It has provided a wealth of data on protective factors for positive development in children with high cumulative risk. In this study, the risk group (about one third of the children) was defined by having four or more early risk factors that included poverty, peri- natal stress, family conflict, and low parental educa- tion. About one third of these high-risk children developed well in terms of getting along with parents and peers, doing fine in school, avoiding serious trou- ble, and having good mental health. The resilient group had more resources and fewer adversities from an early age, including (a) close attachment to at least one good parent, (b) family harmony (i.e., conflict- free environment), © lack of parental psychopathol- ogy, (d) more time before the next child in the family came along, (e) easier temperaments as babies, (f) better intellectual skills and competence, (g) more connections with prosocial adults, (h) fewer separa- tions from caregivers, and (i) better overall physical health. Children were also responsible, self-confident, and motivated to achieve. On the other hand, the nonresilient group exhibited many of the same negative developmental outcomes associated with high-risk youth described earlier. The follow-up study followed high-risk children who were exposed to chronic poverty, birth complications, parental psychopathology, and family discord into adulthood. With the exception of serious central ner- vous system damage, the impact of adversities during childhood diminished adult adaptation depending on the quality of the child-rearing environment and the emotional support provided by family members, friends, teachers, and adult mentors. Poorest outcomes at age 40 were associated with prolonged exposure to parental alcoholism and/or mental illness. Men and women who had encountered more stressful life events in childhood reported more health problems at age 40 than did those who had encountered fewer losses and less disruption in their family during the first decade of life. This study demonstrates the need for early attention to the health status of our nation’s children, especially those who are exposed to poverty, serious perinatal complications, and parental psycho- pathology. The policy implications are clear: Early access to good preventive and ameliorative health services and proper attention to the quality of early child care can result in improved quality of life in adulthood. Implications for Educational Psychology As a group, children who live in poverty tend to per- formworseinschoolthandochildrenfrommore privileged backgrounds. For the first half of the 20th century, researchers attributed this difference to inher- ent cognitive deficits. At the time, the prevailing belief was that the course of child development was dictated by biology and maturation. These preliminary results caught the attention of Sargent Shriver, Presi- dent Lyndon Johnson’s chief strategist in implement- ing an arsenal of antipoverty programs as part of the War on Poverty. His idea for a school readiness pro- gram for poor children focused on breaking the cycle of poverty. Shriver reasoned that if poor children could begin school on an equal footing with wealthier classmates, they would have a better chance of suc- ceeding in school and avoiding poverty in adulthood. He appointed a planning committee of 13 profes- sionals in physical and mental health, early education, social work, and developmental psychology. Their work helped shape what is now known as the federal Head Start program. The three developmental p sychologists in the group were Bronfenbrenner, Mamie Clark, and Edward Zigler. Bronfenbrenner co nvinced the other members that intervention would be most effective if it involved not just the child but the family and community that comprise the child-rearing environment. Parent involvement in school operations and administration was unheard of at the time, but it became a cornerstone of Head Start and proved to be a major contributor to its success. Zigler had been trained as a scientist and was distressed that the new program was not going to be field-tested before its nationwide launch. Arguing that it was not wise to base such a massive, innova- tive program on good ideas and concepts but little empirical evidence, he insisted that research and evaluation be part of Head Start. Although it is difficult to summarize the hundreds of empirical studies of Head Start outcomes, high-quality Head Start programs do produce a variety of benefits for most children. Although some studies have suggested that the intellec- tual advantages gained from participation in Head Start gradually disappear as children progress through 856 Risk Factors and Development elementary school, some of these same studies have shown more lasting benefits in the areas of school achievement and adjustment. Head Start began as a great experiment that has yielded prolific results over the years. Some 20 mil- lion children and families have participated in Head Start since the summer of 1965; current enrollment approaches one million annually, including those in the new Early Head Start, which serves families with children from birth to age 3. Psychological research on early intervention has proliferated, creating an expansive literature and sound knowledge base. Many research ideas designed and tested in the Head Start laboratory have been adapted in a variety of service delivery programs. These include family support ser- vices, home visiting, a credentialing process for early childhood workers, and education for parenthood. Head Start’s efforts in preschool education spotlighted the value of school readiness and helped spur today’s movement toward universal preschool. The existing literature also provides some guide- lines for program design. Arthur Reynolds suggests eight principles for designing effective interventions for children at risk for low academic achievement: 1. Target children and families who are at the highest risk of school difficulties. 2. Begin participation early and continue to the second or third grade. 3. Provide comprehensive child-development services. 4. Encourage active and multifaceted parent involvement. 5. Create a child-centered, structured curriculum approach. 6. Have small class sizes and teacher/child ratios. 7. Provide regular staff development and inservice training for certified teachers. 8. Evaluate and monitor the interventions systematically. These principles suggest that although it may be useful to intervene before 3 years of age, interven- tions for preschool and for school-age children can also be effective. Thus, the first 3 years should not be emphasized at the expense of interventions aimed at older children. Second, the effects of early inter- vention have often been found to be larger for more disadvantaged children, which provides a rationale for targeting very high-risk children in particular. In addition to focusing on low-income children, it might be useful to target other aspects of disadvantage, such as lack of maternal education. Third, the most important aspect of quality is likely to be the nature of the interaction between the teacher and the child. Small group sizes, better teacher training, and other regulable aspects of quality all make such interac- tions more likely. Moreover, even rather loose regu- lation of these observable aspects of quality by Head Start has been shown to be effective in eliminating poor-quality programs. Future of Risk Reduction Programs What we know from the field of intervention and pre- vention programming is reflected in research on effec- tive, risk-reducing, and resilience-building programs. Effective services provide contexts that both reduce the impact of risk factors and foster the development of new or existing protective factors. These programs build on inherent strengths within families, schools, and communities and enable these institutions to help children succeed. And more than just helping chil- dren, the best programs also support those who care for and provide services to these children, thereby enhancing their capacity to care. These programs address child development at a variety of stages, from prenatal care through postsecondary employment— stages that some would even say are too early or too late for appropriate intervention. These programs repeatedly demonstrate that resilience, rather than being solely dependent on individual characteristics, can be socially constructed. Tiffany Berry and Elise Arruda See also Head Start; Home Environment and Academic Intrinsic Motivation; Longitudinal Research; Social Class and Classism Further Readings Child Welfare League of America (The University of Illinois at Chicago), Reynolds, A. J., Wang, M. C., & Walberg, H. J. (Eds.). (2003). Early childhood programs for a new century. Washington, DC: CWLA Press. Goldstein, S., & Brooks, R. B. (Eds.). (2005). Handbook of resilience in children. New York: Kluwer. Groark,C.J.,Mehaffie,K.E.,McCall,R.,&Greenberg,M.T. (Eds.). (2006). Evidence-based practices and programs for Risk Factors and Development 857 early childhood care and education. Thousand Oaks, CA: Corwin. Lerner, R. M., Wertlieb, D., & Jacobs, F. (Eds.). (2005). Applied developmental science: An advanced textbook. Thousand Oaks, CA: Sage. R OSENTHAL E FFECT The term Rosenthal effect is defined in its most gen- eral form as the effect of interpersonal expectations (i.e., the finding that what one person has come to expect from another can come to serve as a self- fulfilling prophecy). This concept is relevant to educa- tional psychology in two distinct domains: the domain of research methodology (the experimenter expec- tancy effect) and the domain of learning and behavior (the teacher expectancy effect). The concept of interpersonal expectation effects has been investigated in a wide array of settings, including the relationship between judges’ expecta- tions and their nonverbal behavior as they address the jury, and juries’ subsequent verdicts of guilty or not guilty; the effects of managers’ expectations for the performance of their employees, and employees’ actual subsequent performance; and the effects of expecta- tions of health care providers for their patients’ subse- quent health outcomes and pa tients’ actual subsequent outcomes. Although interpersonal expectations have been studied in many domains, this entry gives primary attention to those domains of greatest relevance to students of educational psyc hology: the experimenter expectancy effect and the teacher expectancy effect. Experimenter Expectancy Effect The experimenter expectancy effect is one of the sources of artifact or error in scientific inquiry. Spe- cifically, it refers to the unintended effect of experi- menters’ hypotheses or expectations on the results of their research. Some expectation of how the research will turn out is virtually a constant in science. Social scientists, like other scientists generally, conduct research specifically to examine hypotheses or expectations about the nature of things. In the social and behavioral sciences, the hypothesis held by the investigators can lead them unintentionally to alter their behavior toward the research participants in such a way as to increase the likelihood that participants will respond so as to con- firm the investigator’s hypo thesis or expectations. We are speaking, then, of the investigator’s hypothesis as a self-fulfilling prophecy. One prophesies an event, and the expectation of the event then changes the behavior of the prophet in such a way as to make the prophesied event more likely. The history of science documents the occurrence of this phenomenon with the case of clever animals that were cued uninten- tionally to give correct answers in foot taps and in barking to questioners who believed the animals could respond with correct answers to, say, arithme- tic problems. The first experiments designed specifically to inves- tigate the effects of experimenters’ expectations on the results of their research em ployed human research par- ticipants. Graduate student s and advanced undergradu- ates in the field of psychology were employed to collect data from introductory psychology students. The experimenters showed a series of photographs of faces to research participants and asked participants to ratethedegreeofsuccessorfailurereflectedinthe photographs. Half the experimenters, chosen at ran- dom, were led to expect that their research partici- pants would rate the photos as being of more successful people. The remaining half of the experi- menters were given the opposite expectation—that their research participants would rate the photos as being of less successful people. Despite the fact that all experimenters were instructed to conduct a per- fectly standard experiment, reading only the same printed instructions to all their participants, those experimenters who had been led to expect ratings of faces as being of more successful people obtained such ratings from their randomly assigned partici- pants. Those experimenters who had been led to expect results in the opposite direction tended to obtain results in the opposite direction. These results were replicated dozens of times employing other human research participants. They were also replicated employing animal research sub- jects. In the first of these experiments, experimenters were employed who were told that their laboratory was collaborating with another laboratory that had been developing genetic strains of maze-bright and maze- dull rats. The task was exp lained as simply observing and recording the maze-lear ning performance of the maze-bright and maze-dull rats. Half the experimen- ters were told that they had been assigned rats that were maze-bright, and the r emaining experimenters 858 Rosenthal Effect were told that they had been assigned rats that were maze-dull. None of the rats had really been bred for maze-brightness or maze-dullness, and experimenters were told purely at random what type of rats they had been assigned. Despite the fac t that the only differences between the allegedly bright and dull rats were in the minds of the experimenters, those who believed their rats were brighter obtained brighter performance from their rats than did the experimenters who believed their rats were duller. Essentially, the same results were obtained in a replication of t his experiment employing Skinner boxes instead of mazes. Teacher Expectancy Effect If rats became brighter when their experimenters expected them to, then perhaps children could become brighter when expected to by their teacher. Accordingly, all of the children in the first study of the teacher expectancy effect were administered an obscure test of intelligence that was disguised as a test that would predict intellectual ‘‘blooming.’’ The test was labeled ‘‘The Harvard Test of Inflected Acquisition.’’ There were 18 classrooms in the school, three at each of the six grade levels. Within each grade level, the three classrooms comprised children with above-average ability, average ability, and below-average ability, respectively. Within each of the 18 classrooms, approximately 20 % of the chil- dren were chosen at random to form the experimen- tal group. Each teacher was given the names of the children from his or her class who were in the exper- imental condition. The teacher was told that these children had scored on the ‘‘Test of Inflected Acqui- sition’’ such that they would show surprising gains in intellectual competence during the next 8 months of school. The only difference between the experimen- tal group and the control group children, then, was in the mind of the teacher. At the end of the school year, 8 months later, all of the children were retested with the same test of intelligence. Considering the school as a whole, the children from whom the teachers has been led to expect greater intellectual gain showed a significantly greater gain than did the children of the control group. Robert Rosenthal See also Halo Effect; Teaching Strategies Further Readings Blanck, P. D. (Ed.). (1994). Interpersonal expectations: Theory, research, and applications. New York: Cambridge University Press. Pfungst, O. (1965). Clever Hans (C. L. Rahn, Trans.). New York: Holt, Rinehart & Winston. (Originally published in 1911) Rosenthal, R. (1966). Experimenter effects in behavioral research. New York: Appleton-Century-Crofts. Rosenthal, R., & Jacobson, L. (1968). Pygmalion in the classroom. New York: Holt, Rinehart & Winston. Rosnow, R. L., & Rosenthal, R. (1997). People studying people: Artifacts and ethics in behavioral research. New York: W. H. Freeman. R UBRICS A rubric is a measurement and instructional tool that communicates instructor expectations to learners and uses explicitly stated criteria to categorize levels of performance regarding various skill levels, behaviors, product quality, and/or process quality. Rubrics are useful when instructors assess work in which learners have constructed knowledge and the work may not be easily scored using an answer key. For example, rub- rics can be used to evaluate a performance of a task, a process such as problem solving, a written paper on a topic, a portfolio, and so on. In addition, a rubric enables both the instructor and the learners to identify desirable aspects of the work and areas needing improvement. A rubric often is a one- to two-page document containing a table or grid outlining criteria in categories that helps the learner identify the instructor’s expectations for a task or project and assists the instructor in evaluating the learner’s work. A rubric contains a Likert-type scale that helps to quantify performance decisions. Rubrics may be generic or task-specific. A generic rubric is used to evaluate a process such as collabora- tion and may be applied across disciplines or content areas. A task-specific rubric is used for a clearly defined task and therefore has a narrower application. In addition, rubrics may be classified as holistic or analytic. Holistic rubrics enable the instructor to judge the overall product or process as a whole without focusing on separate components. This provides a quick, evaluative picture but does not give specific or detailed feedback to the learner. In other words, holistic rubrics require instructors to evaluate the Rubrics 859 quality of learning through one performance level rather than multiple performance levels. In contrast, analytic rubrics have several indicator categories that instructors rate separately in order to differentiate performance levels within and among categories. Therefore, learners receive specific and detailed feedback that may be useful to them for improving performance. A scoring rubric is used by instructors exclu- sively for the purpose of assigning grades to lear- ners’ work. In contrast, an instructional rubric helps learners to understand the instructor’s expectations for an assignment and aids learners in focusing their efforts on the assignment. The same rubric may be used for both scoring and instructional purposes if desired. Instructors have found that instructional rubrics enable them to provide learners with more informative feedback without spending inordinate amounts of time. Also, instructional rubrics may help instructors to provide fair and unbiased evalua- tion of learners’ work. In addition, multiple instruc- tors can use the same rubric to attempt to have consistency in scoring. These rubrics can be used for learner self-evaluation and peer evaluation. Two key things to note when using instructional rubrics are that they should be provided to learners at the same time as the assignment and that the instructor should spend time explaining the rubric to the lear- ners. Some instructors co-construct rubrics with the learners by first helping them to brainstorm criteria for which their work may be evaluated. Rubrics can be obtained from a variety of print and Internet sources. If an appropriate rubric cannot be located, then an instructor may need to adapt an existing rubric or create a new one. The first step in creating a rubric is to examine examples of assign- ments to determine exemplary characteristics. These characteristics then can be grouped into categories. Next, levels of performance or gradations of quality are selected. Usually three to four levels are appro- priate, although a rubric may contain more levels. One disadvantage of having three levels is that when learners use the rubric for self-evaluation, they may have a tendency to place their performance in the middle level. Levels may be labeled in a variety of ways, such as below average, average, and above average, or novice, apprentice, proficient, and distin- guished. Point values also may be attached to each level of performance to help with scoring. Finally, indicators are identified for each category. Indicators are brief statements that describe the particular char- acteristics of products that demonstrate that learning has occurred. It is important to use language in posi- tive terms that learners, their family members, and other professionals will understand. Describing the best and worst levels of performance and then filling in the middle levels may be the easiest approach. Rubrics should be evaluated and refined continually if they are to be useful for all intended audiences. In order for a rubric to be of high quality, it must have clear criteria as designated by the performance indicators. In other words, what is to be measured shouldbeclearlydefined.Itisimportanttohave enough criteria (e.g., three to seven categories), but not so many that the rubric is difficult to manage. Using rich, descriptive language enables learners to understand the indicators, and the indicators clearly should differentiate among levels of performance in measurable terms. Also, a rubric should emphasize positive attainment of desired performance as opposed to lack of attainment. A high-quality rubric should be valid (i.e., measure key features related to quality of performance) and reliable (i.e., consistent results for different users). Also, it should be sequenced to corre- spond with the steps in the performance. A high- quality rubric should have clear instructions for scoring. For example, it should be noted whether all categories have equal weight and scores from all categories should be added or averaged, or whether one or more cate- gories should receive more weight. There are many reasons why rubrics should be used in instructional settings. First, they help to make instructor expectations for learners’ work clear and concrete. Second, rubrics provide learners with feedback regarding their strengths and weak- nesses. Third, rubrics help learners to evaluate their own work and foster metacognition. Learners can use rubrics to monitor their own progress as they work on an assignment and use the rubric as a final checkpoint before turning in the assignment. The benefits of rubrics to instructors include establishing standards, linking assessment and instruction, pro- viding a consistent and unbiased way of scoring work, and explaining those scores to learners and their family members. Martha J. Larkin See also Bloom’s Taxonomy of Educational Objectives; Evaluation; Grading; Testing 860 Rubrics Further Readings Andrade, H. G. (2000). Using rubrics to promote thinking and learning. Educational Leadership , 57 (5), 13–18. Andrade, H. G. (2005). Teaching with rubrics: The good, the bad, and the ugly. College Teaching , 53 (1), 27–30. Bargainnier, S. (2004). Fundamentals of rubrics. In D. Apple (Ed.), Faculty guidebook. Lisle, IL: Pacific Crest. Jackson, C. W., & Larkin, M. J. (2002). RUBRIC: Teaching students to use grading rubrics. Teaching Exceptional Children , 35 (1), 40–45. Whittaker, C. R., Salend, S. J., & Duhaney, D. (2001). Creating instructional rubrics for inclusive classrooms. Teaching Exceptional Children , 34 (2), 8–13. Rubrics 861 S First you take a drink, then the drink takes a drink, then the drink takes you. —Francis Scott Key Fitzgerald S CAFFOLDING Scaffolding is a process in which support is provided to an individual so that he or she can complete a task that could not be completed independently. The sup- port gradually is removed w hen the individual begins to demonstrate understanding of the task. The concept of scaffolding stems from the work of American psy- chologist Jerome Bruner and colleagues based on Lev Vygotsky’s zone of proximal development. Vygotsky described the zone of proximal development as the dis- tance between the actual developmental level where independent problem solving occurs and the potential developmental level where problem solving can occur with the guidance of an adult or more knowledgeable peer. Key to the zone of proximal development is social interaction and collaborative problem solving. Thus, the zone of proximal development bridges the gap between what an indivi dual can learn and do inde- pendently and what he or she can learn and do with support. The scaffolding process in education bears similarities with the traditional definition of scaffold- ing, which is a temporary framework that supports workers and materials until a building is constructed or repaired to stand on its own. When scaffolding is used in instruction, learners receive support as needed and then the support gradually is removed as they achieve independence in task mastery. Scaffolding instruction includes several essential elements that do not necessarily need to be followed in order. First, the teacher considers curriculum goals and standards along with student needs to select appropriate tasks. Second, the teacher works with students to estab- lish a shared goal. This involvement may result in stu- dents who are motivated and invested in learning. Third, the teacher actively diagnoses student needs and understandings to ensure that students are making prog- ress. Fourth, the teacher provides tailored assistance as needed through prompting, questioning, modeling, tell- ing, or discussing. Fifth, the teacher helps students to remain focused on the intended goal by asking ques- tions and providing clarification as well as offering praise and encouragement. Sixth, the teacher provides feedback in the form of a current progress summary and mention of specific behaviors that contributed to student success. Seventh, the teacher controls frustra- tion and risk by creating an environment in which stu- dents feel comfortable taking risks with their learning without fear of penalty. Finally, the teacher gives stu- dents opportunities to practice the task in a variety of contexts and helps them to be less dependent on the teacher in order for them to internalize the task and eventually be able to perform it independently. The following guidelines can help make the scaf- folding process effective. The teacher can plan instruc- tion by having students begin with tasks that they can perform successfully with little or no assistance in order for them to be aware of their strengths and feel 863 good about their abilities. Helping students to achieve success quickly may alleviate frustration. Then, more challenging tasks can be attempted with assistance. Peer acceptance is important to students, so it is important for the teacher to help students to appear like their peers when possible. Although practicing new and previously learned skills is essential, the teacher should recognize when too much practice may be contributing more to student frustration than to learning. The teacher should help the student with his or her current difficulties, redirecting the student’s intentions only if he or she is not using an effective strategy for task completion. The teacher should watch for student clues as to when and how much assistance is needed. The assistance should be pro- vided immediately to help the student perform the task, but also should be removed gradually as the stu- dent demonstrates task mastery. The following lesson framework may help teachers provide scaffolding for their students. When present- ing a new or difficult concept to students, it is likely that they will need more assistance at first. Therefore, the teacher may model how to perform the task while the students observe. Next, the teacher and students work together on the task. While the teacher demon- strates the task on the board, students may be per- forming the task on a handout while seated at their desks. The teacher may ask the students questions or prompt them to contribute to the class discussion on the task. At this point, the students gradually are tak- ing some responsibility for their learning. When ready, students will work with a partner or a small cooperative group to perform the task. The teacher monitors the group work while gradually turning over more responsibility for the task performance to the students. Finally, the teacher has the students perform the task individually. The four stages of (a) teacher modeling, (b) teacher and students working together, © students working with a partner or small group, and (d) students working independently do not all have to occur in one class period. It could take 1 day to several weeks or more depending on how long a student needs to master the task. Scaffolding is a challenging but beneficial process in instruction. One of the biggest challenges of effec- tive scaffolding is that it is time consuming, particu- larly for one teacher in a classroom. Another is that judging the zone of proximal development for each student may be difficult (i.e., finding the area where a student needs help, but making sure that area is not beyond the student’s abilities). A third challenge is knowing student needs, interests, and abilities in order for the teacher to provide appropriate modeling. A fourth challenge may be making sure that the teacher gradually begins to fade or withdraw assistance as the student begins to demonstrate task mastery. Despite the challenges, scaffolding can be beneficial to stu- dents. It may provide a better chance of a student mastering the intended task. Second, the structured nature of scaffolding may ensure more time on task and efficiency in task performance. Third, scaffolding engages the student, motivates him or her to learn, and reduces student frustration. Fourth, it provides individualized and possibly differentiated instruction. Martha J. Larkin See also Constructivism; Effective Teaching, Characteristics of; Teaching Strategies; Zone of Proximal Development Further Readings Hogan, K., & Pressley, M. (Eds.). (1997). Scaffolding student learning: Instructional approaches and issues. Cambridge, MA: Brookline Books. Larkin, M. J. (2001). Providing support for student independence through scaffolded instruction. Teaching Exceptional Children , 34 (1), 30–34. Larkin, M. J. (2002). Using scaffolded instruction to optimize learning (ERIC Digest No. 639). Arlington, VA: ERIC Clearinghouse on Disabilities and Gifted Education. (ERIC Document Reproduction Service No. EDO EC 02 17) Retrieved from http://eric.ed.gov/ERICDocs/data/ ericdocs2/content_storage_01/0000000b/80/2a/38/e0.pdf Lipscomb, L., Swanson, J., & West, A. (2004). Scaffolding. In M. Orey (Ed.), Emerging perspectives on learning, teaching, and technology. Retrieved from http:// www.coe.uga.edu/epltt/scaffolding.htm Verenikina, I. (1998). Understanding scaffolding and the ZPD in educational research. Retrieved from http:// www.aare.edu.au/03pap/ver03682.pdf S CHEMAS Although no universally agreed-upon definition of schemas exists, schemas are generally considered to be well-learned cognitive patterns of domain-specific information that are used as templates by individuals to help them explain, interpret, perceive, encode, and respond to complex tasks and experiences. Schemas also allow for predictions about what to expect in 864 Schemas future situations relevant to the particular schema. They create meaning from situations, data, and events by organizing and determining the patterns in com- plex sets of information. Schemas actually have a reciprocal relationship with data in that schemas may modify the meaning of information, but informa- tion or data may also lead to modifications in sche- mas. Both educators and counselors have interest in schemas because schemas help them understand how both informational and emotional learning occur. Various types of schemas have been postulated, such as schemas about other people (including role and person schemas), one’s self ( self-schemas), the sequence of various events ( script schemas ), context ( place or location schemas ),andthemeaningofdata ( information schemas). All of the various types of schemas facilitate the efficien t understanding and inter- pretation of information by organizing and assigning meaning to that informati on. As a concrete example, suppose you heard someone talking about seemingly highly disparate pieces of information, such as arran- ging things into groupings; making decisions about color; dealing with tedium; deciding about capacity and facilities to employ; avoiding mistakes; timing of mechanisms; sorting types; determining what could not be dealt with by one’s current equipment, which neces- sitates outsourcing; settin g temperatures in such a way as to avoid catastrophe; dealing with voluminous out- put; enlisting aid from oth ers; and making measure- ments of necessary additives. This list might sound rather convoluted, meaningless, and difficult to remem- ber unless you were first told that the pieces of infor- mation all concerned ‘‘doing laundry.’’ During the initial learning process, deliberate con- struction of schemas requires the use of significant amounts of working memory (WM) resources. Work- ing memory represents the brain’s capacity to tem- porarily hold limited amounts of information while manipulating that information. However, with practice and repetition, the use of schemas constructed during the learning process becomes virtually automatic. Thus, the development of schemas allows for a sub- stantial reduction in required WM resources as the schemas direct and guide individuals’ attention and focus. The result is often an increase in expertise or skill level within a particular knowledge domain. Schemas also provide an overall executive guidance system during high-level cognitive processing. Without this guidance (or without exter nal instruction), indivi- duals often default to weak pr oblem-solving strategies, such as trial and error and means-ends analysis. Strate- gies such as these can be both time consuming and inefficient, and thus interfere with the construction of new schemas because of the workload imposed on WM resources. Schemas are stored in long-term memory (LTM), which is virtually unlimited in both its capacity and dura- tion and allows individuals to process, organize, and retrieve vast reservoirs of know