My Journey as an Aspiring Culturally Responsive Evaluator with Stafford Hood!

My Journey as an Aspiring

Culturally Responsive Evaluator

Stafford Hood

Professor, Curriculum & Instruction University of Illinois
College of Education

Graduate student brown bag (i.e., bring your own lunch)
Friday, April 7, 2016 • Noon – 1:30 pm
UW Madison, Ed Sciences Building, Room 259, 1025 West Johnson Street

Sponsored by: 

What was Trending at #Eval2016?

evaluation-trends-1CULTURAL RESPONSIVENESS!

The phrase “culturally responsive” was mentioned in the title of 16 AEA sessions while “cultural responsiveness” was mentioned in one other. Unfortunately, I think sometimes that’s where our attention to cultural responsiveness ends in evaluation – in the title or as a catch-phrase used in reports. But I noticed something different at Eval16 as compared to previous conferences; I heard colleagues talking about the intersection of culture and evaluation both inside and outside of conference sessions.

One of the things that really impacted me was when Dr. Nicole Bowman read A Cherokee Prayer during the Opening Plenary. The prayer reminded me of the importance of understanding the origins of our field of evaluation, the diverse backgrounds of our participants, our own backgrounds, as well as the history and culture of the organizations with which we work. As evaluators, we must continue to recognize, discuss, and be responsive to cultural context and the cultural diversity of individuals, communities, and organizations.

Want to learn more about cultural responsiveness in evaluation? Check out Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice or read the AEA Statement on Cultural Competence in Evaluation.

*Read the entire article, EVALUATION TRENDS: LESSONS FROM EVAL16.

Dr. Bowman presents “Indigenous by Design”

Dr. Bowman

Dr. Bowman

AEA 2016 TIG Panel Session, Indigenous by Design

 Chair/Discussant/Presenters:

  • Stafford Hood (University of Illinois at Urbana-Champaign)
  • Donna M Mertens (Independent Consultant – Independent Consultant)
  • Nicole R. Bowman (Mohican/Munsee, Research/Evaluation – Wisconsin Center for Education Research at the University of Wisconsin-Madison, President – Bowman Performance Consulting, LLC)
  • Fiona Cram (Director – Katoa Ltd, Aotearoa New Zealand)
  • Carolee Dodge Francis (Associate Professor/Executive Director American Indian Research & Education Center – University of Nevada Las Vegas)

Saturday, October 29, 2016 | 8:00 am – 9:30 am EST | Room: International South 1

Session Information

From the session abstract: “Culturally responsive Indigenous evaluation (CRIE) is evaluation that is by, for and with Indigenous peoples. It is evaluation that recognizes that being Indigenous by design is about program innovation that seeks inspiration from traditional models of practice and ways of being. The teaching of elders and the legal and sovereign status of Indigenous nations legitimate such program designs. CRIE rises to the challenges this presents by engaging with Indigeneity in evaluation design and implementation, evaluation capacity building, and the maintenance of relationships with Indigenous communities that continues beyond one-off evaluations. In this way we seek to make evaluation both relevant and useful to Indigenous initiatives. This panel presents reflections on CRIE, including questions we ask ourselves as well as the answers we have come up with. In this way we seek to broaden conversations on CRIE so that others may think along with us, for the benefit of Indigenous peoples.”

Conference website

Conference agenda

Conference registration

CREA Partners with Evaluation 2016 in Atlanta

BPC is very pleased to announce CREA’s second partnership with AEA to provide another outstanding  thread of pre-conference workshops pertinent to culturally responsive evaluation. Dr. Bowman will be a part of CREA’s team of presenters. Please take a look and we hope to see you there.

CREA Education Comes to Atlanta through Evaluation 2016

The Center for Culturally Responsive Evaluation and Assessment (CREA) has partnered with the American Evaluation Association (AEA) to offer a unique thread of professional development training options as part of the pre- and post-conference professional development workshops during Evaluation 2016 in Atlanta, Georgia. CREA has created six workshop opportunities that focus on evaluation theory, methods, and practice grounded in culturally responsive evaluation.

CREA Professional Development Workshops

Contemporary Culturally Responsive Evaluation and Latino Communities
Tuesday, October 25, 2016 | 9:00 a.m. – 4:00 p.m.
Presenters: Leah Christina Neubauer and Lisa Aponte-Soto

This workshop will focus on contemporary culturally responsive evaluation (CRE) practice with Latino communities. Latinos are the fastest growing population in the United States, accounting for 16.3 percent of the total population (2010 census). CRE with multinational, racial, and ethnic Latino communities demands highly skilled evaluators who can employ evaluation approaches which align and support diverse perspectives in all evaluation phases. The session will begin with a brief history of social justice oriented evaluation theories, CRE, and Latino Critical Race Theory (LatCrit). This paradigmatic framing will provide a foundation to discuss the nine-step CRE process in action with Latino communities. Facilitators will highlight synthesized literature and draw on their own indigenous praxis-oriented perspectives. Participants should come prepared to ‘dig deep’ and share their experiences with Latino-focused evaluation planning and practice.

Foundations of Culturally Responsive Evaluation
Wednesday, October 26, 2016 | 8:00 a.m. – 3:00 p.m.
Presenters: Rodney K. Hopson and Karen E. Kirkhart

This workshop addresses theoretical foundations of Culturally Responsive Evaluation (CRE) and the strategies that operationalize it in evaluation practice. Following opening introductions, presenters set the context with a brief history of how the evaluation profession is coming to a clearer appreciation of the centrality of culture. Against this backdrop, the history of CRE’s development is highlighted and key theoretical elements are identified. The workshop then transitions from theory to practice in three segments. The first segment pairs analysis of evaluation contexts with reflections on one’s own cultural location as an evaluator. This prepares participants to consider methods that are culturally congruent with their contexts of practice, noting potential strengths and limitations of each. CRE values the return of benefit to the community, and the third segment examines both methods and issues in communicating findings. Presenters pair examples from the literature with participants’ own examples to connect workshop content with participants’ contexts, interests, and concerns. The closing segment returns to Big Picture issues such as the fundamental grounding of CRE in social justice and how this poses important metaevaluation questions that connect to both ethics and validity.

Original Instructions: Utilizing Indigenous Knowledge, Frameworks, & Case Studies to Inform & Transform Evaluation Practice
Wednesday, October 26, 2016 | 8:00 a.m. – 3:00 p.m.
Presenters: Fiona Cram and Nicole R. Bowman

This workshop focuses on the culturally responsive evaluation of services and programs provided for and/or designed by Indigenous peoples. The workshop is structured to answer three key questions in Indigenous Evaluation (IE): 1.) Who should undertake IE? 2.) What do evaluators need to understand about Indigenous contexts? How should IE be done?

Cultural Responsiveness and Mixed Methods Research
Wednesday, October 26, 2016 | 8:00 a.m. – 11:00 a.m.
Presenters: Jori Hall

This engaging half-day workshop presents an introduction to mixed methods research, focusing on cultural responsiveness. Participants will explore key principles of cultural responsiveness and consider how these principles can be applied to mixed methods research. Topics covered related to mixed methods research include the benefits and challenges of mixed methods; when to use mixed methods; paradigmatic issues; research design conceptualization; and data integration. By attending the workshop, participants will be better able to apply cultural responsive understandings to the crafting of their own mixed methods project.

Culturally Relevant Evaluation and Research from a Quantitative Perspective
Wednesday, October 26, 2016 | 12:00 p.m. – 3:00 p.m.
Presenters: Toks Fashola

This workshop will address culturally relevant and evaluative research from a quantitative perspective. The workshop seeks to engage the workshop participants in the process of creating a culturally relevant topic, and exploring quantitative ways to address this topic. The process will involve creating culturally relevant and quantitatively sound methods to create constructs, surveys, data dictionaries, and to administer enter, and interpret data. The outcome(s) will help to create and produce data that are not only rigorous and robust, but also data that can address topics of social justice, culturally relevant evaluation, and theories of change. The workshop will use some examples of projects that currently exist, and projects that are in progress. Workshop participants will be encouraged and guided to become informed consumers of quantitative research.

Utilization of a Racial Equity Lens to help Guide Strategic Engagement and Evaluation
Wednesday, October 26, 2016 | 12:00 p.m. – 3:00 p.m.
Presenters: Paul Elam, Willard Walker, and LaShaune Johnson

This workshop focuses on the practical use of a racial equity lens when conducting evaluation. The framework argues that culture and race are important considerations when conducting an evaluation because we believe that there are both critical and substantive nuances that are often missed, ignored, and/or misinterpreted when an evaluator is not aware of the culture of those being evaluated. Participants will be provided with a Template for Analyzing Programs through a Culturally Responsive and Racial Equity Lens, designed to focus deliberately on an evaluation process that takes race, culture, equity, and community context into consideration.

Register for Evaluation 2016 and learn more about the CREA workshops by visiting the Evaluation 2016 website.

Looking for Case Studies Regarding Cultural Competence in Evaluation

call for case studiesGiven the importance of attending to culture and context in the evaluation field and that there are few practical examples of how this work is carried out in practice, Cindy Crusto and Osman Özturgut are soliciting case studies for a book entitled, Cultural Competence in Evaluation: Successes and Missteps in Addressing Culture and Context in Evaluation Practice. The book is under contract with Sage.

*Download the PDF for more information.

 

Add this to your Reading List!

Nicole Bowman coauthored a chapter in the NEW BOOK Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice.  Visit BPC’s YouTube channel for previews of the publication and interviews with the authors.

Visit InfoAge Publishing to buy your copy now!

new book pic

“Racial, ethnic, linguistic, and cultural diversity has become of global importance in places where many never would have imagined. Increasing diversity in the U.S., Europe, Africa, New Zealand, and Asia strongly suggests that a homogeneity-based focus is rapidly becoming an historical artifact. Therefore, culturally responsive evaluation (CRE) should no longer be viewed as a luxury or an option in our work as evaluators. The continued amplification of racial, ethnic, linguistic, and cultural diversity and awareness among the populations of the U.S. and other western nations insists that social science researchers and evaluators inextricably engage culturally responsive approaches in their work. It is unacceptable for most mainstream university evaluation programs, philanthropic agencies, training institutes sponsored by federal agencies, professional associations, and other entities to promote professional evaluation practices that do not attend to CRE. Our global demographics are a reality that can be appropriately described and studied within the context of complexity theory and theory of change (e.g., Stewart, 1991; Battram, 1999). And this perspective requires a distinct shift from “simple” linear cause-effect models and reductionist thinking to include more holistic and culturally responsive approaches.

The development of policy that is meaningfully responsive to the needs of traditionally disenfranchised stakeholders and that also optimizes the use of limited resources (human, natural, and financial) is an extremely complex process. Fortunately, we are presently witnessing developments in methods, instruments, and statistical techniques that are mixed methods in their paradigm/designs and likely to be more effective in informing policymaking and decision-making. Culturally responsive evaluation is one such phenomenon that positions itself to be relevant in the context of dynamic international and national settings where policy and program decisions take place. One example of a response to address this dynamic and need is the newly established Center for Culturally Responsive Evaluation and Assessment (CREA) in the College of Education at the University of Illinois at Urbana-Champaign.

CREA is an outgrowth of the collective work and commitments of a global community of scholars and practitioners who have contributed chapters to this edited volume. It is an international and interdisciplinary evaluation center that is grounded in the need for designing and conducting evaluations and assessments that embody cognitive, cultural, and interdisciplinary diversity so as to be actively responsive to culturally diverse communities and their aspirations. The Center’s purpose is to address questions, issues, theories, and practices related to CRE and culturally responsive educational assessment. Therefore, CREA can serve as a vehicle for our continuing discourse on culture and cultural context in evaluation and also as a point of dissemination for not only the work that is included in this edited volume, but for the subsequent work it will encourage.

CONTENTS
Introduction: This Is Where We Continue to Stand, Stafford Hood, Rodney Hopson, and Henry Frierson. SECTION I: CRE THEORETICAL AND HISTORICAL LEGACIES AND EXTENSIONS. Culturally Responsive Theory-Driven Evaluation, Katrina L. Bledsoe and Stewart I. Donaldson. A Systems Approach to Culturally Responsive Evaluation Practice: Culturally Responsive Uses of the Systems Evaluation Protocol (SEP), Wanda D. Casillas and William M. Trochim. Cultural Views of Validity: A Conversation, Joan LaFrance, Karen E. Kirkhart, and Richard Nichols. An Analysis of Love My Children: Rose Butler Browne’s Contributions to Culturally Responsive Evaluation, Pamela Frazier-Anderson and Tamara Bertrand Jones. SECTION II: EVALUATORS’ JOURNEYS OF INTROSPECTION AND SELF-EXPLORATION. Culture and Evaluation: From a Transcultural Belvedere, Jennifer C. Greene. Culturally Responsive Evaluation as a Resource for Helpful-Help, Hazel Symonette. Peeling Open the Kiwi: Reterritorializing (Pākehā/White) Evaluation in Aotearoa New Zealand, Rae Torrie, Mathea Roorda, Robin Peace, Mark Dalgety, and Robyn Bailey. Beginning a Conversation About Spirituality in Māori and Pasifika Evaluation, Vivienne Kennedy, Fiona Cram, Kirimatao Paipa, Kataraina Pipi, Maria Baker, Laurie Porima, Pale Sauni and Clark Tuagalu. Cultural Reactivity vs. Cultural Responsiveness: Addressing Macro Issues Starting With Micro Changes in Evaluation, Dominica McBride. SECTION III: APPLICATIONS OF CRE IN GLOBAL AND INDIGENOUS SCHOOL CONTEXTS. Culture Changes, Irish Evaluation and Assessment Traditions Stay the Same? Exploring Peer- and Self-Assessment as a Means of Empowering Ethnic Minority Students, Joe O’Hara, Gerry McNamara, Kathy Harrison. Implementing Culturally Sensitive Assessment Tools for the Inclusion Of Roma Children in Mainstream Schools,S. Mitakidou, E. Tressou, and P. Karagianni. Evaluating Alch’i’ni Ba/For the Children: The Troubled Cultural Work of an Indigenous Teacher Education Project, Carolyne J. White and Guy Senese. SECTION IV: CLAIMING NEW TERRITORIES OF CRE: CULTURALLY SPECIFIC METHODS, APPROACHES, AND ECOLOGIES. A Transformative Framework for Culturally Responsive Evaluation, Donna M. Mertens and Heather Zimmerman. Being Culturally Responsive Through Kaupapa Māori Evaluation, Fiona Cram, Vivienne Kennedy, Kirimatao Paipa, Kataraina Pipi, and Nan Wehipeihana. Culturally Responsive Methods for Family Centered Evaluation, Kirimatao Paipa, Fiona Cram, Vivienne Kennedy, and Kataraina Pipi. Culturally Responsive Indigenous Evaluation: A Practical Approach for Evaluating Indigenous Projects in Tribal Reservation Contexts, Nicole R. Bowman, Carolee Dodge Francis, and Monique Tyndall. Partnering with Pacific Communities to Ground Evaluation in Local Culture and Context: Promises and Challenges, Joan LaFrance, Sharon Nelson-Barber, Elizabeth D. Rechebei, and Janet Gordon.Epilogue: Toward the Next Generation and New Possibilities of Culturally Responsive Evaluation, Stafford Hood, Rodney Hopson, and Henry Frierson.”

http://www.infoagepub.com/products/Continuing-the-Journey-to-Reposition-Culture-and-Cultural-Context-in-Evaluation-Theory-and-Practice

Webinar! Indigenous Evaluation 101: Designing Evaluations that Are Culturally Responsive & Scientifically Rigorous

webinar imageIndigenous Evaluation 101:  Designing Evaluations that Are Culturally Responsive & Scientifically Rigorous Three Part Webinar

Webinar website

  • Part 1-Evaluation 101 and Importance for Tribal Planning & Infrastructure

Monday June 20th, 2016 | 1:00 pm -2:00 pm CDT |

  • Part 2-Evaluation Designs for Tribal Communities

Tuesday June 21st, 2016 | 1:00 pm -2:00 pm CDT |

  • Part 3-Protecting Tribal Data, Knowledge & Other Types of Property

Wednesday June 22nd, 2016 | 1:00 pm -2:00 pm CDT |

Training Description:

Do you want to show the impact your project /programming is having?  Is meeting the technical evaluation reporting requirements while still including of culture within evaluation a challenge?  If so, this three-part webinar series is for you! Addressing scientific “rigor” of evaluation for “evidence-based” reports and including culturally-responsive evaluation IS possible!  This NEW three-part evaluation series training will give you the foundation that you need to become more comfortable with project or program evaluation.  Session 1 will give an overview of evaluation basics, commonly used evaluation designs by funders, and describes the important role of data collection and evaluation to the Tribal planning process and measuring long-term strategic impacts.  Session 2 expands on basic evaluation designs and offers innovative Indigenous and culturally and contextually responsive evaluation designs that can be used in Indigenous communities on the Reservation, in urban areas, or in rural contexts.  Session 3 concludes by discussion of evaluation ethics, protections, and strategies for keeping data, intellectual and cultural property with the Tribal Government or organization as they keep in control of their information and build research/evaluation partnerships with non-Tribal agencies and funding sources.  Many resources and concrete examples will be provided to deepen the meaning and applicability of each workshop’s content.

Training Objectives:

  • Part 1-Evaluation 101 and Importance for Tribal Planning & Infrastructure

Monday June 20th, 2016 | 1:00 pm -2:00 pm CDT | 1.5 hours

Evaluation 101 and Importance for Tribal Planning & Infrastructure

General overview on evaluation terms and commonly used evaluation designs by funding agencies (non-Tribal) is covered.  Connecting the important of data collection and evaluation to the tribal planning and measuring long term strategic impacts is also included.

  • Part 2-Evaluation Designs for Tribal Communities

Tuesday June 21st, 2016 | 1:00 pm -2:00 pm CDT | 1.5 hours

Culturally Responsive Indigenous Evaluation Designs

Information and tips to develop culturally responsive evaluation designs that can be used for Indigenous populations in the Reservation, rural, or urban context will be shared.  CR Indigenous evaluation expands on basic evaluation designs used by non-Tribal funding agencies and gives participants strategies that will meet the community’s cultural requirements as well as the funder’s technical or scientific requirements.

  • Part 3-Protecting Tribal Data, Knowledge & Other Types of Property

Wednesday June 22nd, 2016 | 1:00 pm -2:00 pm CDT | 1.5 hours

Protecting Tribal Data, Knowledge, & Intellectual or Cultural Property

Identify and document best practices to help organizations protect their Tribal data, knowledge, intellectual and/or cultural property. Then learn how to obtain positive change and leverage resources with said data. Information on how to assist Tribal Governments or organizations in maintaining control of their information by learning about; Indigenous evaluation ethics, protections, strategies for keeping data, addressing intellectual and cultural property rights.  Strategies for finding and building research/evaluation partnerships with non-Tribal agencies and funding sources will also be shared.

Objectives (overall):

  1. Participants will understand basic evaluations, designs, and purposes.
  2. Participants will understand the role of data collection and evaluation on Tribal planning and measuring long term strategic impacts.
  3. Participants will understand what an Indigenous and culturally responsive evaluation design is and how to use culture within a larger basic evaluation design to meet community and funder’s needs for evaluation.
  4. Participants will be aware and have examples and resources for Tribal protection of data, including: cultural and intellectual property protections, sample Tribal IRB policies, and example data sharing agreements so Tribal participants can effectively negotiate with non-Tribal research or evaluation partners and non-Tribal funding agencies.

Tomorrow! Dr. Bowman with Dr. Beverly Anderson Parsons (InSites) “Addressing Structural Racism through Systems-Oriented Evaluation”

Dr. Parsons

Dr. Parsons

CREA 2016 Symposium Session, Addressing Structural Racism through Systems-Oriented Evaluation, Patricia Jessup (Jessup & Associates), chair. What Evaluators Need to Know About Structural Racism, Nicole R. Bowman (Bowman Performance Consulting, LLC) & Beverly Anderson Parsons (InSites), presenters.

April 21, 2016 | 10:00 am – 11:30 am | Room: Chicago

Conference program

From the symposium abstract: “The session includes a description of four evaluation designs that are being incorporated into the evaluation guidebook. The designs highlight critical points in the complex and often unpredictable processes of changing the basic paradigms on which our social systems are built in regard to race. The designs are grounded within communities but reach inward and outward from that pivotal point with attention to honoring all voices. Investment design, implementation, and evaluation all work together to increase racial equity that generates significant practical returns in the form of improved social and economic outcomes for vulnerable populations.”

2016 Culturally Responsive Evaluation and Assessment (CREA) International Conference

April 20-22, 2016 | Chicago, IL

Conference website

Conference schedule

From the website: CREA 3rd International Conference The Next Generation of Theory and Practice: Rethinking Equity through Culturally Responsive Evaluation and Assessment will demonstrate the kinds of interventions in education, health care, criminal justice, and social services that are being undertaken to address inequities. What has been attempted? What are the results? What works for whom, why, and in what circumstances? This year’s theme includes, broadening participation in STEM and beyond; capacity building in global and local communities and neighborhoods; development of equitable measures, methods and metrics; policies and practices of influence and consequence; and examples of effective models of collaborations and networks.”

Come See Dr. Bowman and Dr. Cram Tomorrow! Culturally Responsive Indigenous Evaluation (CRIE): Indigenous Knowledge, Frameworks, & Case Studies to Inform/Transform Evaluation Practice

dr cram dr bowmanDr. Nicole Bowman and Dr. Fiona Cram will present Culturally Responsive Indigenous Evaluation (CRIE): Indigenous Knowledge, Frameworks, & Case Studies to Inform/Transform Evaluation Practice as an all day pre-conference workshop Tuesday April 19, 2016 from 9am to 4pm.

CREA 2016 Pre-Conference Workshop, Culturally Responsive Indigenous Evaluation (CRIE): Indigenous Knowledge, Frameworks, & Case Studies to Inform/Transform Evaluation Practice. Fiona Cram (Centre for Social Impact, New Zealand) & Nicole R. Bowman (Bowman Performance Consulting, LLC), presenters.

April 19, 2016 | 9:00 am – 4:00 pm | Chicago, IL

Workshop description & agenda

From the website: “The workshop will provide real-world application of Indigenous Evaluation models, strategies, and tools using examples of collaborative models for working with Indigenous organizations and communities.”

 

 

Register now to see Dr. Bowman at CREA!

chicagoDr. Nicole Bowman-Farrell will present “Promising Practices in Tribally Driven Participatory Research: An Effective Model for Tribal and Non-Tribal Research Partnerships”, at the 3rd International Center for Culturally Responsive Evaluation and Assessment (CREA) conference that will be held April 20-22, 2016 at the Chicago Palmer House Hilton hotel.

Session Details:
Session Title: Paper 5b: Perspectives In Evaluation Training, Thinking And Practice
Date and Time: 22/Apr/2016, 9:00am – 10:30am

Registration and more info:

http://education.illinois.edu/CREA/conference