Stafford Hood Presents… Carl A. Grant Scholars Lecture Series 2016-2017

Dr. Stafford Hood is lecturing at the University of Wisconsin-Madison April 6-7, 2017.

Come join us and hear about culturally responsive assessment and evaluation from one of the nation’s leading subject matter experts!  A lecture and brown bag provide opportunities for faculty, staff, and students to interact and visit with this warm, down to earth, and humble social justice scholar warrior.

As part of UW’s Carl A. Grant lecture series, Dr. Hood’s scholarly storytelling will provide a historical and practical way to understand and improve professional practice in this area.   “Continuing the Untold Legacy of African Americans in the History of American Evaluation: Another Installment in the Nobody Knows My Name Project” is Professor Hood’s research which continues to strongly influence the field of culturally responsive evaluation in education.

Dr. Hood is a recent American Evaluation Association Lazarsfeld Evaluation Theory awardee, the Founder/Director of the Center for Culturally Responsive Evaluation and Assessment, and Faculty at University of Illinois at Urbana-Champaign.

Continuing the Untold Legacy of African Americans in the History of American Evaluation: Another Installment in the Nobody Knows My Name Project

Professor Hood’s research has influenced the field of culturally responsive evaluation in education by extending the logic of cultural responsiveness from pedagogy and educational assessment to evaluation. His work provided the historical framework that created a bridge between culturally responsive assessment to culturally responsive evaluation.

Presented By:

Stafford Hood, Sheila M. Miller Professor

Professor, Curriculum & Instruction and Ed. Psychology

Founding Director, Center for Culturally Responsive Evaluation & Assessment (CREA)

College of Education University of Illinois at Urbana-Champaign

Thursday, April 6, 2017, Noon-1 pm University of Wisconsin – Madison, Ed Sciences Building, Room 259 1025 West Johnson Street

Pick up this Evaluation Book with a Chapter by Dr. Bowman!

Nicole Bowman coauthored a chapter in the NEW BOOK Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice.  Visit BPC’s YouTube channel for previews of the publication and interviews with the authors.

Visit InfoAge Publishing to buy your copy now!

new book pic

“Racial, ethnic, linguistic, and cultural diversity has become of global importance in places where many never would have imagined. Increasing diversity in the U.S., Europe, Africa, New Zealand, and Asia strongly suggests that a homogeneity-based focus is rapidly becoming an historical artifact. Therefore, culturally responsive evaluation (CRE) should no longer be viewed as a luxury or an option in our work as evaluators. The continued amplification of racial, ethnic, linguistic, and cultural diversity and awareness among the populations of the U.S. and other western nations insists that social science researchers and evaluators inextricably engage culturally responsive approaches in their work. It is unacceptable for most mainstream university evaluation programs, philanthropic agencies, training institutes sponsored by federal agencies, professional associations, and other entities to promote professional evaluation practices that do not attend to CRE. Our global demographics are a reality that can be appropriately described and studied within the context of complexity theory and theory of change (e.g., Stewart, 1991; Battram, 1999). And this perspective requires a distinct shift from “simple” linear cause-effect models and reductionist thinking to include more holistic and culturally responsive approaches.

The development of policy that is meaningfully responsive to the needs of traditionally disenfranchised stakeholders and that also optimizes the use of limited resources (human, natural, and financial) is an extremely complex process. Fortunately, we are presently witnessing developments in methods, instruments, and statistical techniques that are mixed methods in their paradigm/designs and likely to be more effective in informing policymaking and decision-making. Culturally responsive evaluation is one such phenomenon that positions itself to be relevant in the context of dynamic international and national settings where policy and program decisions take place. One example of a response to address this dynamic and need is the newly established Center for Culturally Responsive Evaluation and Assessment (CREA) in the College of Education at the University of Illinois at Urbana-Champaign.

CREA is an outgrowth of the collective work and commitments of a global community of scholars and practitioners who have contributed chapters to this edited volume. It is an international and interdisciplinary evaluation center that is grounded in the need for designing and conducting evaluations and assessments that embody cognitive, cultural, and interdisciplinary diversity so as to be actively responsive to culturally diverse communities and their aspirations. The Center’s purpose is to address questions, issues, theories, and practices related to CRE and culturally responsive educational assessment. Therefore, CREA can serve as a vehicle for our continuing discourse on culture and cultural context in evaluation and also as a point of dissemination for not only the work that is included in this edited volume, but for the subsequent work it will encourage.

Introduction: This Is Where We Continue to Stand, Stafford Hood, Rodney Hopson, and Henry Frierson. SECTION I: CRE THEORETICAL AND HISTORICAL LEGACIES AND EXTENSIONS. Culturally Responsive Theory-Driven Evaluation, Katrina L. Bledsoe and Stewart I. Donaldson. A Systems Approach to Culturally Responsive Evaluation Practice: Culturally Responsive Uses of the Systems Evaluation Protocol (SEP), Wanda D. Casillas and William M. Trochim. Cultural Views of Validity: A Conversation, Joan LaFrance, Karen E. Kirkhart, and Richard Nichols. An Analysis of Love My Children: Rose Butler Browne’s Contributions to Culturally Responsive Evaluation, Pamela Frazier-Anderson and Tamara Bertrand Jones. SECTION II: EVALUATORS’ JOURNEYS OF INTROSPECTION AND SELF-EXPLORATION. Culture and Evaluation: From a Transcultural Belvedere, Jennifer C. Greene. Culturally Responsive Evaluation as a Resource for Helpful-Help, Hazel Symonette. Peeling Open the Kiwi: Reterritorializing (Pākehā/White) Evaluation in Aotearoa New Zealand, Rae Torrie, Mathea Roorda, Robin Peace, Mark Dalgety, and Robyn Bailey. Beginning a Conversation About Spirituality in Māori and Pasifika Evaluation, Vivienne Kennedy, Fiona Cram, Kirimatao Paipa, Kataraina Pipi, Maria Baker, Laurie Porima, Pale Sauni and Clark Tuagalu. Cultural Reactivity vs. Cultural Responsiveness: Addressing Macro Issues Starting With Micro Changes in Evaluation, Dominica McBride. SECTION III: APPLICATIONS OF CRE IN GLOBAL AND INDIGENOUS SCHOOL CONTEXTS. Culture Changes, Irish Evaluation and Assessment Traditions Stay the Same? Exploring Peer- and Self-Assessment as a Means of Empowering Ethnic Minority Students, Joe O’Hara, Gerry McNamara, Kathy Harrison. Implementing Culturally Sensitive Assessment Tools for the Inclusion Of Roma Children in Mainstream Schools,S. Mitakidou, E. Tressou, and P. Karagianni. Evaluating Alch’i’ni Ba/For the Children: The Troubled Cultural Work of an Indigenous Teacher Education Project, Carolyne J. White and Guy Senese. SECTION IV: CLAIMING NEW TERRITORIES OF CRE: CULTURALLY SPECIFIC METHODS, APPROACHES, AND ECOLOGIES. A Transformative Framework for Culturally Responsive Evaluation, Donna M. Mertens and Heather Zimmerman. Being Culturally Responsive Through Kaupapa Māori Evaluation, Fiona Cram, Vivienne Kennedy, Kirimatao Paipa, Kataraina Pipi, and Nan Wehipeihana. Culturally Responsive Methods for Family Centered Evaluation, Kirimatao Paipa, Fiona Cram, Vivienne Kennedy, and Kataraina Pipi. Culturally Responsive Indigenous Evaluation: A Practical Approach for Evaluating Indigenous Projects in Tribal Reservation Contexts, Nicole R. Bowman, Carolee Dodge Francis, and Monique Tyndall. Partnering with Pacific Communities to Ground Evaluation in Local Culture and Context: Promises and Challenges, Joan LaFrance, Sharon Nelson-Barber, Elizabeth D. Rechebei, and Janet Gordon.Epilogue: Toward the Next Generation and New Possibilities of Culturally Responsive Evaluation, Stafford Hood, Rodney Hopson, and Henry Frierson.”

Evaluation Book Reviewed by Teachers College Record

new book picA review of Dr. Stafford’s book with a chapter by Dr. Bowman, Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice, was published in the prestigious Teachers College Record.

Teachers College Record, Date Published: June 22, 2016 ID Number: 21288, Date Accessed: 7/1/2016 9:06:14 AM

Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice

reviewed by Dhani Shah — June 22, 2016

Title: Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice
Author(s): Stafford Hood, Rodney Hopson & Henry Frierson
Publisher: Information Age Publishing, Charlotte
ISBN: 1623969352, Pages: 404, Year: 2014
Search for book at

Stafford Hood, Rodney Hopson, and Henry Frierson’s edited book, Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice, advocates that cultural, racial, and ethnic diversity is one of the most salient features of contemporary society. Hence, they believe it is the right time for Culturally Responsive Evaluation (CRE), “evaluations and assessments that embody cognitive, cultural, and interdisciplinary diversity that are actively responsive to culturally diverse communities and their academic performance goals” (p. xiii). The focus of CRE is studying the context, history, and culture of an evaluated program and its participants and includes Indigenous communities in decision making throughout the evaluation. Thus, CRE is a theoretical, conceptual, and inherently political evaluation model that brings culture to the forefront in evaluation theory and practice. CRE emphasizes evaluation practice, which aims to achieve social justice and “address human bias through inclusion, relationships, and an orientation to context” (p. 180). Generally, human bias is based on our values, relationships, decisions, context, and culture and it can undermine the validity of evaluation processes. CRE keeps in mind the cultural beliefs, practices, norms, and values of any specific culture in which an evaluation is being implemented.

This book is an extension of introductory work on CRE. Back in 2005, the same three editors (Hood, Hopson, and Frierson) published a book titled, The Role of Culture and Cultural Context: A Mandate for Inclusion, the Discovery of Truth, and Understanding in Evaluative Theory and Practice (2005). In the initial version of this book the authors had “reflected the rapidly emerging and frequently contentious discourse on this topic (Culturally Responsive Evaluation) during the early years of this new millennium” (Hood, Hopson, & Frierson, 2015, p. xi).

Continuing the Journey to Reposition Culture is organized into five distinct sections including: a) “CRE Theoretical and Historical Legacies and Extensions,” b) “Evaluators’ Journeys of Introspection and Self-Exploration,” c) “Applications of CRE in Global and Indigenous School Contexts,” d) “Claiming New Territories of CRE: Culturally Specific Methods, Approaches, and Ecologies,” and e) “Epilogue.” In total, 50 experienced contributors have authored 17 chapters within these five book sections. This review treats this text holistically.

The initial chapters are devoted to setting the background for the CRE model which comprises understanding program context, engaging stakeholders, identifying the purpose(s) of evaluation, framing evaluation questions, designing an evaluation, selecting instruments, and collecting, analyzing, and interpreting data. Extending this discussion, the book deliberates the need for a systems approach to CRE practices and suggests using a system evaluation protocol (SEP) framework. System evaluation “refers to the assessment of functions, products, outcomes, and impacts of a system (set of programs, activities, or interventions)” (Trochim et al., 2012, p. 1).

After setting the stage for CRE, the book discusses the concept of validity in CRE; describing that historically validity is defined by dominant groups and has remained a powerful tool for establishing their legitimization. However, as per the Indigenous Evaluation Framework (IEF), validity does not necessarily have the same meaning across different cultural contexts. The authors in Chapter Three argue that although culture-free assessment has long been abandoned, “meaningful inclusion of culture in validation has not consistently followed” (p. 51).

The book includes a thorough discussion about different CRE methods, strategies, and frameworks by giving several examples of evaluation studies in different Indigenous cultural communities across the world. The book dedicates five chapters to CRE practices for MāoriIndigenous communities in Antearoa, New Zealand. The chapter authors also reflect on how a replication of these practices can be conducted for Indigenous communities in the U.S. and elsewhere. These chapters state that engagement and relationship-building rituals have a prime importance in Māori culture and are “grounded in relational trust and acceptance” (p. 95). Therefore, developmental evaluation practice, which is based on the respect of local cultures, their voices, and acknowledgement of cultural strengths, is a favored approach for the evaluation of Māori projects.

Furthermore, the book depicts the Kaupapa Māori (Māori way) paradigm. “Kaupapa Māori evaluation is an assertion of the right of Māori to conduct culturally responsive evaluations that are by, with and for Māori (p. 296). Likewise, Kaupapa Māori relates to a worldview that the Māori people bring to evaluation; it is prescribed in their cultural terms and supports Māori development, societal transformation, and decolonization. Māori evaluators typically have different axiological, ontological, and epistemological foundations than western-oriented evaluators.

In Chapter Ten, authors O’Hara, McNamara, and Harrison share that CRE also has implications for educational assessment methods. Their discussion starts with a study aimed at investigating educational assessment in a multicultural Irish society. The traditional evaluation practices in Irish schools are based on an inflexible model that is exclusive of CRE practices. Irish teachers consider the traditional assessment neither culturally responsive nor sensitive. They share that they are trained as teachers to push students through a public end-of-schooling examination that is predominantly Irish and relates to Irish culture. Every child is assessed on the same model even if he or she comes from a different culture. Therefore, the assessment is not based on the principles of multiculturalism and the Irish system would not serve ethnic minorities in the country very well.

This book is a very serious effort at advocating for the importance, understanding, and application of CRE. Different case studies, descriptions of several projects and programs in several Indigenous communities of New Zealand, the U.S. and other global contexts explain that CRE is one vehicle by which to conduct culture- and context-friendly evaluation practices. The book contains notes and a glossary at the end of several chapters to help the reader understand the context but it does not contain any corresponding exercises.

Continuing the Journey to Reposition Culture and Cultural Context is written using technical and theoretical language and may pose challenges for some readers. Nevertheless, the book is a great in-depth resource for researchers, evaluators, practitioners, students, and teachers who are engaged in anthropological and ethnographic teaching, research, and evaluation. It systematically advocates the case for CRE, its framework, importance, relevance, and applicability in a culturally diverse world.


Hood, S., Hopson, R., & Frierson, H. (2005). The role of culture and cultural context: A mandate for inclusion, the discovery of truth, and understanding in evaluative theory and practice. Charlotte, NC: Information Age Publishing.

Trochim, W., Urban, J. B., Hargraves, M., Hebbard, C., Buckley, J., Archibald, T., Johnson, M.,

& Burgermaster, M. (2012). The guide to the systems evaluation protocol. Ithaca, NY: Cornell Digital Print Services.

Join Us! April 22nd Paper Panel with Bowman and Chamberlain

CREA 2016 Paper Panel, Perspectives in Evaluation Training, Thinking and Practice. Nicole R. Bowman (Bowman Performance Consulting, LLC) & Anne Chamberlain (IMPAQ International LLC), presenters.

April 22, 2016 | 9:00 am – 10:30 am | Room: Marshfield
Conference program

From the paper abstract: “Through an United States Department of Agriculture funded and congressionally mandated study that includes the 567 tribal governments and Alaskan Native villages in the United States, session participants will learn how the principals of Tribally Driven Participatory Research (TDPR) can be utilized in research and evaluation studies. The emphasis of this session will be not only on understanding the conceptual and theoretical foundations to TDPR but also the practical implementation of TDPR as an effective model for creating highly effective and culturally responsive Tribal/academic research partnerships. Participants will be engaged through active discussion, will learn about the strengths and challenges of this model, and will be given many resources to help inform their future practice.”

Nicole Bowman to Present CREA Pre-Conference Workshop

about us pageWorkshop Title:

Culturally Responsive Indigenous Evaluation

*more about CREA Conference

Presenters: Fiona Cram, PhD (Katoa Ltd., Aotearoa New Zealand) and
Nicole Bowman (President / Founder of Bowman Performance Consulting
based in Shawano, Wisconsin, USA)
Date and Time: Wednesday September 17, 2014 from 8:30 am – 4:30 pm
(with 1 hour lunch)
Level: Beginner-Intermediate
Instructional Method: Audio-visual, discussion, group instruction, and lecture
(with PowerPoint)
CE Credits: 7 credits


8:30 am      Welcome and introductions
9:00 am      Understanding the context for Indigenous evaluations:
disparities and wellness
9:30 am      Introduction to culturally responsive evaluation
10:00 am    Break
10:30 am    Ethical protocols – the push and pull of ethics in Indigenous settings
11:00 am    An Indigenous research paradigm
11:30 am    Collaborative ways of working in Indigenous settings
12:00 pm    Lunch (on you own)
1:00 pm      Theory of change and logic model – uses and limitations
2:00 pm      Selecting and mixing methods in Indigenous evaluation
3:00 pm      Break
3:15 pm      Strengthening the cultural responsiveness of evaluation
for Indigenous peoples
4:00 pm      Workshop Concludes

Learning Objectives:

This workshop is designed to help you:

  • Identify the principles and values of culturally responsive evaluation.
  • Explain the complexities of Indigenous circumstances along with the need for culturally responsive evaluation of Indigenous services and programme.
  • Describe the applications and limitations of culturally responsive evaluation within Indigenous communities and organizations.
  • Apply responsive strategies to the selection and mixing of methods for Indigenous evaluations.
  • Prepare a protocol for culturally responsive Indigenous evaluation.


This workshop focuses on the culturally responsive evaluation (CRE) of services and programs provided for and/or by Indigenous peoples. To establish the context for Indigenous evaluation the workshop begins with an overview of the determinants of disparities experienced by Indigenous peoples, introduces Indigenous models of health and wellbeing, and shares the various social, cultural, and political/legal lenses that a culturally responsive evaluator should consider when evaluating in Indigenous contexts. Using case studies about health promotion and diabetes prevention programming (USA case study example) and a service navigator initiative (New Zealand case study example), participants will process and practice through small group, demonstrations, and large group activities. The principles underpinning CRE will then be examined with attention paid to what CRE has to offer Indigenous peoples, and how it might develop to be truly inclusive of Indigenous evaluation and development agendas. The exploration of various ethical protocols for evaluation with Indigenous peoples (e.g., IRBs, Indigenous ethical principles) then sets the scene for discussion of an Indigenous evaluation paradigm. From here the workshop moves into the practicalities of undertaking CRE in Indigenous settings. Collaborative models of working with Indigenous organizations and communities will be considered, including tools that assist consultation and collaboration. Theory of change and logic model development will be examined as ways of initiating dialogue about the values and worldview underpinning Indigenous initiatives. The limitations of these tools within Indigenous communities will also be reflected upon. The consideration of qualitative and quantitative evaluation methods, as well as mixed methods, will look at decision-making about choice of method as well as procedures for the use of different methods in Indigenous contexts. Samples of actual indigenous tools, methodologies, shared memorandums of data agreements, and co-constructed evaluation plans will be included as examples for workshop participants to consider as they develop their own indigenous evaluation designs.  Throughout the workshop the presenters will call upon their own experiences as Indigenous evaluators and draw on the growing literature on Indigenous evaluation. Workshop participants will also be encouraged to share their knowledge and experience. The workshop will conclude with discussion of ways to make evaluation even more culturally responsive for Indigenous peoples.


*Custom training and technical assistance available. Call BPC at 715-526-9240