What's Being Tested and What's Being Learnt? A Contribution to Lessons Learned Evaluation Methods for Community-based Sustainability Initiatives

• Autorzy: Andrew Mitchell , Mark Lemon , Gavin Fletcher
• Języki publikacji: EN

Abstrakty

EN

Aim: There is little good practice guidance with respect to methods and skills for conducting lessons learned evaluations of community-based development projects. In this paper we utilise a mixed methods approach to evaluate the lessons learned by the team members and stakeholders of a funded five year "test-and-learn" UK-based sustainability initiative. The approach combines a statistical and a qualitative thematic analysis of transcribed textual data and presents an analytic framework with which to track the lessons learned by community development projects. Design/Research methods: A mixed methods approach combining text and sentiment mining complemented by a qualitative thematic analysis is applied to the same data collected from stakeholder responses to an on-line survey and the transcribed audio recordings of four focus groups in which stakeholders participated. Conclusions/findings: Employing replicable tools, augmented by qualitative research methods, provide a framework for a systematic approach to elicit and capture lessons learned by a sustainable community development project. These bear on how project activities, from engagement to supporting the local food economy, have been experienced by stakeholders and their learning acquired over the course of the project. Implications for future project design and funding options are considered. Originality/value of the article: Despite the evident value of its contribution to improving project design and funding options, the evaluation of lessons learned in community-based sustainability work remains under-researched. This paper reflects a double description of the same data through the novel combination of text and sentiment mining techniques with more traditional qualitative thematic analysis, which demonstrates an alternative method of evaluation in this field.(original abstract)

Słowa kluczowe

EN

Sustainable development; Evaluation; Project management

PL

Rozwój zrównoważony; Ewaluacja; Zarządzanie projektem

• Czasopismo: Central European Review of Economics and Management
• Rocznik: 2019
• Tom: 3
• Numer: nr 3 Skills, Competences and Mind-sets for Sustainability
• Strony: 129--167

Twórcy

autor

Andrew Mitchell

• De Montfort University, United Kingdom

autor

Mark Lemon

• De Montfort University, United Kingdom

autor

Gavin Fletcher

• De Montfort University, United Kingdom

Bibliografia

• Anbari F.T., Carayannis E.G., Voetsch R.J. (2008), Post-project reviews as a key project management competence, "Technovation", vol. 28 no. 10, pp. 633-643.
• Argyris C., Schön D. (1978), Organizational learning. A theory of action perspective, Addison-Wesley Publishing Company, Cambridge MA.
• Bartsch V., Ebers M., Maurer I. (2013), Learning in project-based organizations. The role of project teams' social capital for overcoming barriers to learning, "International Journal of Project Management", vol. 31 no. 2, pp. 239-251.
• Big Lottery Fund (2012), £12m lifeline for vulnerable facing fuel and food poverty, Big Lottery Fund: News and Events, https://www.biglotteryfund.org.uk/global-content/press-releases/england/archive/12m-lifeline-for-vulnerable-facing-fuel-and-food-poverty [03.042016].
• Boisot M.H. (1999), Knowledge assets. Securing competitive advantage in the information economy, Oxford University Press, New York.
• Braun V., Clarke V. (2006), Using thematic analysis in psychology, "Qualitative Research in Psychology", vol. 3 no. 2, pp. 77-101.
• Bruner J. (1986), Actual minds, possible worlds, Harvard University Press, Cambridge MA.
• Bryman A. (2012), Social research methods, 4th ed., Oxford University Press, New York.
• Carrillo P., Ruikar K., Fuller P. (2013), When will we learn? Improving lessons learned practice in construction, "International Journal of Project Management", vol. 31 no. 4, pp. 567-578.
• Davenport T.H., Prusak L. (1998), Working knowledge. How organizations manage what they know, Harvard Business School Press, Boston.
• Duffield S.M., Whitty S.J. (2016), Application of the systemic lessons learned knowledge model for organisational learning through projects, "International Journal of Project Management", vol. 34 no. 7, pp. 1280-1293.
• Feinerer I., Hornik K. (2014), tm: Text Mining Package, http://cran.r-project.org/package=tm [02.11.2018].
• Feinerer I., Hornik K., Meyer D. (2008), Text mining infrastructure in R', "Journal Of Statistical Software", vol. 25 no. 5, pp. 1-54.
• Grimmer J., Stewart B.M. (2013), Text as data. The promise and pitfalls of automatic content analysis methods for political texts', "Political Analysis", https://web.stanford.edu/~jgrimmer/tad2.pdf [02.11.2018].
• Guba E.G., Lincoln Y.S. (1989), Fourth generation evaluation, Sage, Newbury Park, CA.
• Hahn U., Mani I. (2000), The challenges of automatic summarization, "Computer", vol. 33 no. 11, pp. 29-36.
• Hillard D., Purpura S, Wilkerson J. (2007), Computer-assisted topic classification for mixed-methods social science research, "Journal of Information Technology & Politics", vol. 4 no. 4, pp. 31-46.
• Jockers M. (2017), Package "syuzhet". Extracts sentiment and sentiment-derived plot arcs from text, https://cran.r-project.org/web/packages/syuzhet/syuzhet.pdf [03.11.2018].
• Kayser V., Blind K. (2017), Extending the knowledge base of foresight. The contribution of text mining, "Technological Forecasting & Social Change", vol. 116 no. C, pp. 208-215.
• Kumar B.S., Ravi V. (2016), A survey of the applications of text mining in financial domain, "Knowledge-Based Systems", vol. 114 no. C, pp. 128-147.
• Laver M., Benoit K., Garry J. (2003), Extracting policy positions from political texts using words as data, "The American Political Science Review", vol. 97 no. 2, pp. 311-331.
• Levitt B., March J.G. (1988), Organizational learning, "Annual Review of Sociology", vol. 14, pp. 319-340.
• Lindner F., Wald A. (2011), Success factors of knowledge management in temporary organizations, "International Journal of Project Management", vol. 29 no. 7, pp. 877-888.
• Love P.E.D., Teo P., Davidson M., Cumming S., Morrison J. (2016), Building absorptive capacity in an alliance. Process improvement through lessons learned, "International Journal of Project Management", vol. 34 no. 7, pp. 1123-1137.
• Makrakis V., Kostoulas-Makrakis N. (2016), Bridging the qualitative - quantitative divide. Experiences from conducting a mixed methods evaluation in the RUCAS programme, "Evaluation and Program Planning", vol. 54, pp. 144-151.
• Maurer I., Bartsch V., Ebers M. (2011), The value of intra-organizational social capital. How it fosters knowledge transfer, innovation performance, and growth, "Organization Studies", vol. 32 no. 2, pp. 157-185.
• McClory S., Read M., Labib A. (2017), Conceptualising the lessons-learned process in project management. Towards a triple-loop learning framework, "International Journal of Project Management", vol. 35 no. 7, pp. 1322-1335.
• Meaney C., Moineddin R., Voruganti T., Ann M., Brien O., Krueger P., Sullivan F. (2016), Text mining describes the use of statistical and epidemiological methods in published medical research, "Journal of Clinical Epidemiology", vol. 74, pp. 124-132.
• Mohammad S.M., Turney P.D. (2013), Crowdsourcing a word-emotion association lexicon, "Computational Intelligence", vol. 29 no. 3, pp. 436-465.
• Moustaghfir K., Schiuma G. (2013), Knowledge, learning, and innovation. Research and perspectives, "Journal of Knowledge Management", vol. 17 no. 4, pp. 495-510.
• Newton J., Franklin A., Middleton J., Marsden T. (2012), (Re-)negotiating access. The politics of researching skills and knowledge for "sustainable communities", "Geoforum", vol. 43 no. 3, pp. 585-594.
• Nonaka I., Takeuchi H. (1995), The knowledge-creating company. How Japanese companies create the dynamics of innovation, Oxford University Press, New York.
• Office of Government Commerce (OGC) (2009), Managing successful projects with PRINCE2, TSO (The Stationery Office), London.
• Patton M.Q. (1997), Utilization-focused evaluation, 3rd ed., Sage, Thousand Oaks.
• Patton M.Q. (2001), Evaluation, knowledge management, best practices, and high quality lessons learned, "American Journal of Evaluation", vol. 22, pp. 329-336.
• Powell J.H., Bradford J.P. (2000), Targeting intelligence gathering in a dynamic competitive environment, "International Journal of Information Management", vol. 20 no. 3, pp. 181-195.
• Putnam R.D. (2000), Bowling alone. The collapse and revival of American community, Simon and Schuster, New York.
• RCC-L (2012), Project delivery plan. Sustainable Harborough challenge: SRC/1/010428951, Leicester.
• R Core Team (2014), R: A language and environment for statistical computing, Foundation for Statistical Computing, Vienna, http://www.r-project.org/ [03.11.2018].
• Rennie D.L. (2012), Qualitative research as methodical hermeneutics, "Psychological Methods", vol. 17 no. 3, pp. 385-398.
• Rittel H.W.J., Webber M.M. (1973), Dilemmas in a general theory of planning, "Policy Sciences", vol. 4 no. 2, pp. 155-169.
• Rolstadås A., Tommelein I., Morten Schiefloe P., Ballard G. (2014), Understanding project success through analysis of project management approach, "International Journal of Managing Projects in Business", vol. 7 no. 4, pp. 638-660.
• Saif H., He Y., Alani H. (2012), Alleviating data sparsity for Twitter sentiment analysis, "CEUR Workshop Proceedings", vol. 838, pp. 2-9.
• Schein E.H. (1996), Three cultures of management. The key to organizational learning, "Sloan Management Review", vol. 38 no. 1, pp. 9-20.
• Sutcliffe K.M., Weber K. (2003), The high cost of accurate knowledge, "Harvard Business Review", vol. 81 no. 5, pp. 74-82.
• Thomas W.H. (2015), The basics of project evaluation and lessons learned, 2nd ed, CRC Press, Boca Raton.
• Ur-Rahman N., Harding J.A. (2012), Textual data mining for industrial knowledge management and text classification. A business oriented approach, "Expert Systems With Applications", vol. 39 no. 5, pp. 4729-4739.
• Williams T. (2003), Learning from projects, "The Journal of the Operational Research Society", vol. 54, pp. 443-451.