Evaluation as Reflective Practice

Czasopismo

---

• Autorzy: Paulina Kubera

Warianty tytułu

Ewaluacja jako refleksyjna praktyka

• Języki publikacji: EN

Abstrakty

EN

Reflective practice has become an influential concept in the evaluation field. A greater use of reflective practice is advocated in reference to both evaluators' own professional development, and as a means to enhance dialogue, stakeholders' involvement and organisational learning in the evaluation process. The aim of the paper is to examine the evaluation endeavour from the latter perspective, i.e. to present evaluation approaches which offer the opportunity for collaborative reflective practice. To this end, evaluation as reflective practice is discussed at three levels: (1) the organisational level - the model of single, double and triple-loop learning is discussed in reference to formative, summative and developmental evaluation, (2) the evaluator's level - different roles performed by the evaluator are considered from the point of view of promoting collaborative reflective practice, and (3) the broader socio-political level, in relation to the concept of civil society, as evaluation can contribute not only to a greater rigour and effectiveness of public spending but to social empowerment, to appreciating diversity or building trust (improving democratic policy-making). (original abstract)

Zagadnienia refleksyjnej praktyki stanowią ważny obszar zainteresowań w dziedzinie ewaluacji. Zaleca się jej szersze wykorzystanie zarówno w odniesieniu do samodoskonalenia zawodowego ewaluatorów, jaki i jako środek wzmocnienia dialogu, zaangażowania interesariuszy i uczenia się organizacyjnego w procesie ewaluacji. Celem artykułu jest ukazanie procesu ewaluacji właśnie z tej drugiej perspektywy, czyli zaprezentowanie takich podejść stosowanych w ewaluacji, które sprzyjają praktyce refleksyjnej opartej na współpracy. Ewaluacja jako praktyka refleksyjna jest rozważana na trzech poziomach: (1) organizacji - w tym celu model uczenia się w pojedynczej, podwójnej i potrójnej pętli odniesiono do trzech podstawowych typów ewaluacji: formatywnej, sumatywnej i rozwojowej, (2) ewaluatora - różne role odgrywane przez ewaluatora są rozpatrywane z punktu widzenia promowania refleksyjnej praktyki wśród głównych odbiorców ewaluacji (interesariuszy), oraz (3) szerszego socjopolitycznego poziomu - w odniesieniu do społeczeństwa obywatelskiego, ponieważ ewaluacja może przyczyniać się nie tylko do większej dyscypliny i efektywności wydatków publicznych, lecz także do wzmocnienia zaangażowania społecznego, docenienia różnorodności czy budowania zaufania (wsparcia demokratycznego procesu tworzenia polityki). (abstrakt oryginalny)

Słowa kluczowe

EN

Civic society; Learning organisations; Evaluation

PL

Społeczeństwo obywatelskie; Organizacje uczące się; Ewaluacja

• Czasopismo: ---
• Strony: 23--38

Twórcy

autor

Paulina Kubera

• Poznań University of Technology

Bibliografia

• Alkin, M. (2013). Evaluation Roots. A Wider Perspective of Theorists' Views and Influence. Thousand Oaks, CA: SAGE Publications.
• Argyris, C. & Schön, D. (1978). Organizational learning: A theory of action perspective. Reading, Mass: Addison Wesley.
• Bateson, G. (1973). Steps to an Ecology of Mind: Collected Essays in Anthropology, Psychiatry, Evolution and Epistemology. London: Paladin, Granada.
• Campbell, D. (1984). Can we be scientific in applied social science. Evaluation Studies Review Annual, 9. Beverly Hills, CA: Sage Publications.
• Chen, H.-T. (1996). A comprehensive typology for program evaluation. Evaluation Practice, 17(2), 121-130. https://doi.org/10.1177/109821409601700204.
• Cruise, P. (1999). Values, Program Evaluation and the New Public Management. International Journal of Organization Theory and Behavior, (2/3&4), 383-412.
• De Laat B. & Williams, K. (2014). Evaluation Use Within the European Commission (EC): Lessons for the Evaluation Commissioner. In: M. Loud, J. Mayne (eds), Enhancing Evaluation Use. Insights from Internal Evaluation Units (p. 147-174). Beverly Hills, CA: Sage Publications.
• Dickson, R. & Saunders, M. (2014). Developmental evaluation: Lesson for evaluative practice from the SEARCH Program. Evaluation, 20(2), 176-194.
• Donaldson, S. & Picciotto, R. (2016). Evaluation for an Equitable Society. Charlotte, NC: Information Age Publishing, Inc.
• Fiol, C. & Lyles, M. (1985). Organizational Learning. The Academy of Management Review, (10/4), 803-813.
• Flood, R. & Romm, N. (1996). Diversity Management: Triple-loop Learning. Chichester: John Wiley & Sons.
• Gamble, J. (2008) A Developmental Evaluation Primer. Ottawa: The J.W. McConnell Family Foundation.
• Horsch, K. (1998). Evaluation in the 21st Century. Interview with Carol H. Weiss. The Evaluation Exchange, (IV/2), 5-6.
• Isaacs, W. (1993). Taking flight: Dialogue, collective thinking, and organizational learning. Organizational Dynamics, 22(2), 24-39.
• Jones, D. & Stubbe, M. (2004). Communication and the reflective practitioner: A􀁢shared perspective from sociolinguistics and organisational communication. International Journal of Applied Linguistics, (14/2), 185-211. https://doi.org/10.1111/j.1473- 4192.2004.00059.x.
• Kubera, P. (2017). Conceptual Framework for Evaluation of Economic Impacts of RDI Instruments. Journal Association SEPIKE, 17, 90-96.
• Luo, H. (2010). The Role for an Evaluator: A Fundamental Issue for Evaluation of Education and Social Programs. International Education Studies, (3/2), 42-50.
• Markiewicz, A. & Patrick, I. (2016). Developing Monitoring and Evaluation Frameworks. USA: SAGE Publications Inc.
• Mc David, J., Huse I. & Hawthorn, L. (2013). Program Evaluation and Performance Measurement. An Introduction to Practice (2nd ed.). Thousand Oaks: SAGE Publications.
• Morabito, S. (2002). Evaluator Roles and Strategies for Expanding Evaluation Process Influence. American Journal of Evaluation, 23(3), 321-330.
• OECD. (2010). Glossary of Key Terms in Evaluation and Results Based Management. Paris: OECD.
• Patton, M. (1996). A world larger than formative and summative. Evaluation Practice, 17(2), 131-144. https://doi.org/10.1177/109821409601700205.
• Patton, M. (2007). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: Sage.
• Patton, M. (2011). Developmental evaluation. Applying Complexity Concepts to Enhance Innovation and Use. New York: Guliford Press.
• Patton, M. (2012a). Developmental Evaluation: Applying complexity concepts to enhance innovation and use. Report from an Expert Seminar with Dr Michael Quinn Patton, Centre for Development Innovation, Wageningen University & Research centre.
• Patton, M. (2012b). Essentials of Utilization-Focused Evaluation (3rd ed.). Thousand Oaks, CA: SAGE Publications.
• Patton, M. (2017). Developmental evaluation. In: J. Pokorski, Z. Popis, K. Herman- Pawłowska (eds), Theory-based evaluation in complex environments (pp. 7-19). Warsaw: PARP.
• Patton, M.Q. (2007). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: Sage.
• Preskill, H. & Torres, R. (1999). Evaluative Inquiry for Learning in Organizations. Thousand Oaks, CA: SAGE Publications.
• Preskill, H., Zuckerman, B. & Matthews, B. (2003). An exploratory study of process use: Findings and implications for future research. American Journal of Evaluation, 24(4), 423-442. https://doi.org/10.1177/109821400302400402.
• Reynolds, M. & Holwell, S. (2010). Introducing Systems Approaches. In: M. Reynolds, S. Holwell (eds), Systems Approaches to Managing Change: A Practical Guide (pp.􀁢 1-24). London: Springer.
• Reynolds, M. & Williams, B. (2012). Systems thinking and Equity-focused evaluations. In: M. Segone, M. Bamberger (eds), Evaluation for equitable development results (pp.􀁢 115-141). New York: UNICEF.
• Reynolds, M. (2007). Evaluation based on critical systems heuristics. In: B. Williams, I. Imam, (eds), Using Systems Concepts in Evaluation: An Expert Anthology (p. 101- 122). Point Reyes CA, USA: Edge Press.
• Reynolds, M. & Holwell, S. (2010). Introducing Systems Approaches. In: M. Reynolds, S. Holwell (eds), Systems Approaches to Managing Change: A Practical Guide, Springer, 1-23.
• Reynolds, M. & Williams, B. (2012). Systems thinking and Equity-focused evaluations. In: M. Segone, M. Bamberger (eds), Evaluation for equitable development results (p. 115-141). New York: UNICEF.
• Rossi P, Freeman, H. & Lipsey, M. (2004). Evaluation. A Systemic Approach (7t ed.). Thousand Oaks: SAGE Publications.
• Schön, D. (1983). The reßective practitioner. New York: Basic Books.
• Schwandt, T. (2001). Dictionary of qualitative inquiry (2nd ed.). Thousand Oaks, CA: SAGE.
• Scriven, M. (1986). New frontiers of evaluation. Evaluation Practice, 7, 7-44.
• Scriven, M. (1991). Beyond formative and normative evaluation. In: G. McLaughlin, D. Philips (eds), Evaluation and Education: At quarter century (pp.19-64). Chicago, Il: University of Chicago Press.
• Shadish, W., Cook, T. & Leviton, L. (1991). Foundations of program evaluation. Newbury Park, CA: Sage.
• Skolits, G., Morrow, J. & Burr, E. (2009). Reconceptualizing Evaluator Roles. American Journal of Evaluation, 30(3), 275-295.
• Smith, T., (2014). Reflective Practice, Collaboration, and Stakeholder Communication: Where Does the Field of Evaluation Stand? PhD diss. University of Tennessee. Retrieved from: http://trace.tennessee.edu/utk_graddiss/2860/.
• Stake, R. & Trumbull, D. (1982). Naturalistic generalizations. Review Journal of Philosophy & Social Science, 7, 1-12.
• Stame, N. (2004). Theory-based Evaluation and Types of Complexity. Evaluation, (10/1), 58-76.
• Stevahn, L., King, J., Ghere, G. & Minnema, J. (2005). Establishing essential competencies for program evaluators. American Journal of Evaluation, 26(1), 43-59, http:// dx.doi.org/10.1177/1098214004273180.
• Stufflebeam, D., Madaus, G. & Scriven, M. (2000). Program Evaluation. A Historical Overview. In: D. Stufflebeam, G. Madaus, T. Kellaghan (eds), Evaluation Models Viewpoints on Educational and Human Services Evaluation (2nd ed., p. 3-18). Boston: Springer, Kluwer.
• Thompson, N. & Pascal, J. (2012). Developing critically reflective practice. Reflective Practice, (13/2), 311-325. http://dx.doi.org/10.1080/14623943.2012.657795.
• Thompson, N. (2000). Theory and practice in the human services (2nd ed.). Buckingham: Open University Press.
• Tosey, P., Visser, M. & Sounders, M. (2012). The origins and conceptualizations of 'triple-loop' learning: A critical review. Management Learning, (43/3), 291-307.
• Ulrich, W. (2000). Reflective Practice in Civil Society: The Contribution of Critically Systemic Thinking. Reflective Practice, (1/2), 247-268. Retrieved from: http://wulrich. com/downloads/ulrich_2000a.pdf.
• Ulrich, W. (2005). A brief introduction to critical systems heuristics (CSH). Web site of the ECOSENSUS project, Open University, Milton Keynes, UK, 14 October 2005. Retrieved from: http://www.ecosensus.info/about/index.html.
• Ulrich, W. (2008). Reflections on Reflective Practice. The Mainstream Concept of Reflective Practice, (1/7). Retrieved from: http://www.wulrich.com/bimonthly_march2008.html.
• Vince, R. (2002). Organizing Reflection. Management Learning, (33/1), 63-78. https:// doi.org/10.1177/1350507602331003.
• Weiss, C. (1988). If Program Decisions Hinged Only on Information: A Response to Patton. Evaluation Practice, (9/3), 15-28.
• Yuthas, K., Dillard, J. & Rogers, R. (2004). Beyond agency and structure: Triple-loop learning. Journal of Business Ethics, 51(2), 229-243.

Identyfikatory

DOI

10.7172/1644-9584.80.2