Do We Learn How to Learn? Evolution of Functions of Evaluation Systems - The Case of Polish Regional Administration

• Autorzy: Tomasz Kupiec

Warianty tytułu

Czy uczymy się uczyć? Ewolucja funkcji systemów ewaluacji - przykład polskich samorządów województwa

• Języki publikacji: EN

Abstrakty

EN

The article examines the evolution of functions of evaluation systems. It is based on the comparison of evaluation studies conducted in eight evaluation systems in the Polish regional administration in two periods: 2007-13 and 2014-20. The findings are to some extent contradictory to the expectations formed on the basis of the existing literature of the subject. Although the analysed systems were established in response to external pressures, they support accountability as well as learning. These systems do not focus on procedural issues only, and generation of strategic knowledge increases over time. Numerous regulations imposed on the analysed systems suggest, however, that the use of evaluation in the analysed systems may be symbolic in nature.(original abstract)

Autor analizuje, jak ewoluowały funkcje systemów ewaluacji. Bazuje na porównaniu badań ewaluacyjnych realizowanych w ośmiu systemach ewaluacji w polskim samorządzie województwa w dwóch okresach: 2007-2013 i 2014-2020. Uzyskane wyniki podważają w pewnym stopniu oczekiwania wynikające z dotychczasowej literatury przedmiotu. Choć badane systemy powstały w odpowiedzi na zewnętrzną presję, to wspierają zarówno rozliczanie, jak i uczenie. Systemy nie koncentrują się tylko na zagadnieniach proceduralnych, a produkcja wiedzy strategicznej wzrasta w czasie. Liczne przepisy regulujące sposób funkcjonowania sugeruje jednak, że wykorzystanie ewaluacji w badanych systemach może mieć charakter symboliczny.(abstrakt oryginalny)

Słowa kluczowe

EN

Evaluation; Studying

PL

Ewaluacja; Uczenie się

• Czasopismo: Studia Regionalne i Lokalne
• Rocznik: 2020
• Numer: nr 3
• Strony: 7--22

Twórcy

autor

Tomasz Kupiec

• Uniwersytet Warszawski

Bibliografia

• Ahonen, P., 2015, "Aspects of the institutionalization of evaluation in Finland: Basic, agency, process and change", Evaluation, 21(3), 308-324.
• Argyris, C., and Schön, D. A., 1978, Organizational Learning, Reading, MA: Addison--Wesley Pub. Co.
• Batterbury, S. C. E., 2006, "Principles and purposes of European Union Cohesion policy evaluation", Regional Studies, 40(2), 179-188.
• Boswell, C., 2008, "The political functions of expert knowledge: knowledge and legitimation in European Union immigration policy", Journal of European Public Policy, 15, 471-488.
• Chelimsky, E., and Shadish W. R., 1997, Evaluation for the 21st Century: A Handbook, Thousand Oaks, CA: SAGE.
• Christie, C. A., 2007, "Reported influence of evaluation data on decision makers' actions: An empirical examination", American Journal of Evaluation, 28(1), 8-25.
• Cronbach, L. J., 1980, Toward Reform of Program Evaluation: Aims, Methods, and Institutional Arrangements, San Francisco: Jossey-Bass Publication.
• Dahler-Larsen, P., 2012, The Evaluation Society, Stanford, CA: Stanford University Press.
• Dunlop, C. A., and Radaelli, C. M., 2013, "Systematising policy learning: From monolith to dimensions", Political Studies, 61, 599-619.
• Eckhard, S., and Jankauskas, V., 2019, "The politics of evaluation in international organizations: A comparative study of stakeholder influence potential", Evaluation, 25(1), 62-79.
• Fiol, M., and Lyles, M., 1985, "Organizational learning", Academy of Management Review, 10(4), 803-813.
• Friedman, V. J., 2001, "Designed blindness: An action science perspective on program theory evaluation", American Journal of Evaluation, 22(2), 161-181.
• Hall, P., 1993, "Policy paradigms, social learning, and the state: The case of economic policymaking in Britain", Comparative Politics, 25(3), 275-296.
• Hanberger, A., 2006, "Evaluation of and for democracy", Evaluation, 12(1), 17-37.
• Hanberger,A., 2011, "The real functions of evaluation and response systems", Evaluation, 17(4), 327-349.
• Højlund, S., 2014, "Evaluation use in the organizational context - changing focus to improve theory", Evaluation, 20(1), 26-43.
• Huber, G., 1991, "Organizational learning: The contributing processes and the literatures", Organization Science, 2(1), 88-115.
• King, J. A., and Alkin, M. C., 2018, "The centrality of use: Theories of evaluation use and influence and thoughts on the first 50 years of use research", American Journal of Evaluation, 40(3).
• Kupiec, T., 2014a, "Użyteczność ewaluacji jako narzędzia zarządzania regionalnymi programami operacyjnymi", Studia Regionalne i Lokalne, 2, 52-67.
• Kupiec, T., 2014b, "Evaluation practice of regional operational programmes in Poland", Management and Business Administration. Central Europe, 23(3), 135-151.
• Kupiec, T., 2015, "Program evaluation use and its mechanisms: The case of Cohesion Policy in Polish regional administration", Zarządzanie Publiczne, 3, 67-83.
• Ledermann, S., 2012, "Exploring the necessary conditions for evaluation use in program change", American Journal of Evaluation, 33(2), 159-178.
• Leeuw, F. L., and Furubo, J. E., 2008, "Evaluation systems: What are they and why study them?", Evaluation, 14(2), 157-169.
• Liverani, A., and Lundgren, H. E., 2007, "Evaluation systems in development aid agencies: An analysis of DAC peer reviews 1996-2004", Evaluation, 13(2), 241-256.
• Mark, M. M., Henry, G. T., and Julnes, G., 1999, "Toward an integrative framework for evaluation practice", American Journal of Evaluation, 20(2), 177-198.
• Martinaitis, Ž., Christenko, A., and Kraučiūnienė, L., 2019, "Evaluation systems: How do they frame, generate and use evidence?", Evaluation, 25(1), 46-61.
• Olejniczak, K., 2008, Mechanizmy wykorzystania ewaluacji. Studium ewaluacji średniookresowych INTERREG III, Warszawa: Wydawnictwo Naukowe Scholar.
• Olejniczak, K., Kupiec, T., and Newcomer, K., 2017, "Learning from evaluation - the knowledge users' perspective", Evaluation Theory and Practice, 5(2): 49-74.
• Patton, M. Q., 1996, "A world larger than formative and summative", American Journal of Evaluation, 17(2), 131-144.
• Patton, M. Q., 1997, Utilization-Focused Evaluation: The New Century Text, Thousand Oaks, CA: SAGE.
• Pawson, R., and Tilley, N., 1997, Realistic Evaluation, London: SAGE.
• Picciotto, R., 2016, "Evaluation and bureaucracy: The tricky rectangle", Evaluation, 22(4): 424-434. Political Studies 61: 599-619.
• Powell,W.W., and DiMaggio, P. J. (eds.), 1991, The New Institutionalism in Organizational Analysis, Chicago, MA: University of Chicago Press.
• Raimondo, E., 2018, "The power and dysfunctions of evaluation systems in international organizations", Evaluation, 24(1): 26-41.
• Rist, R., and Stame, N. (eds.), 2006, From Studies to Streams: Managing Evaluative Systems, London: Transaction Publishers.
• Van der Knaap, P., 1995, "Policy evaluation and learning: Feedback, enlightenment or argumentation?", Evaluation, 1(2), 189-216.
• Van Der Meer, F.-B., and Edelenbos, J., 2006, "Evaluation in multi-actor policy processes: Accountability, learning and co-operation", Evaluation, 12(2), 201-218.
• Widmer, T., and Neuenschwander, P., 2004, "Embedding evaluation in the Swiss federal administration", Evaluation, 10(4), 388-409.
• Wojtowicz, D., and Kupiec, T., 2018, "Reluctant to learn? The use of evaluation to improve EU cohesion policy implementation in Polish and Spanish regions", Evidence & Policy, 14(1), 103-120.