Combining Qualitative and Quantitative Software Process Evaluation: A Proposed Approach

• Autorzy: Sylvie Trudel , Alex Turcotte
• Języki publikacji: EN

Abstrakty

EN

This paper presents a method that combines a qualitative assessment method based on CMMI to uncover improvement areas of an organization's software process, and a quantitative approach to measure the software process productivity rate. The evaluation scope is first established: a list of projects and a list of CMMI key process areas to assess. The measurement of the productivity rate is obtained by measuring the functional size of the software developed and/or enhanced through projects, and then compared with the recorded project effort. The main reason for combining the approaches is to gain a deeper understanding of the organization's software process by examining the software requirements artefacts, which reveals the weaknesses of the requirements engineering portion of the software process. As a proof of the concept, a field trial of the combined method has been applied successfully in an organization developing financial trading systems.(original abstract)

Słowa kluczowe

EN

Software; ISO/IEC standard; Quality assessment; Benchmarking

PL

Oprogramowanie; Norma ISO/IEC; Ocena jakości; Benchmarking

• Czasopismo: Roczniki Kolegium Analiz Ekonomicznych / Szkoła Główna Handlowa
• Rocznik: 2016
• Numer: nr 43
• Strony: 135--153

Twórcy

autor

Sylvie Trudel

• Université du Québec à Montréal, Montreal, Canada

autor

Alex Turcotte

• Université de Sherbrooke, Longueuil, Canada

Bibliografia

• Abran A., Software Metrics and Software Metrology, Wiley 2010.
• Abran A. et al., The COSMIC Functional Size Measurement Method, Version 4.0.1, Measurement Manual, The COSMIC Group 2015, http://www.cosmicon.com/dl_manager4.asp?id=532
• Abran A. et al., Guideline for Assuring the Accuracy of Measurements, Version 1.0, The COSMIC Group 2011, http://www.cosmicon.com
• Chrissis M. B., Konrad M., Shrum S., CMMI Guidelines for Process Integration and Product Improvement, Addison-Wesley 2003.
• The CMMI Product Team, Capability Maturity Model Integration © for Development, Version 1.3, The CMMI Institute 2010, CMU/SEI-2010-TR-033.
• The CMMI Institute, Standard CMMI Appraisal Method for Process Improvement (SCAMPI) Version 1.3b: Method Definition Document for SCAMPI A, B, and C, Technical Report, The CMMI Institute 2014.
• Desharnais J.-M., Abran A., Assessment of the Quality of Functional User Requirements Documentation Using Criteria Derived from a Measurement with COSMIC-ISO 19761, International Workshop on Software Measurement - IWSM 2010, Stuttgart, November 2010, pp. 481-496.
• Garcia-Miller S., Lessons Learned from Adopting CMMI in Small Organizations, Software Engineering Institute 2005, http://resources.sei.cmu.edu/library/asset-view. cfm?assetid=19950 International Software Benchmarking Standards Group (ISBSG), Development and Enhancement Data Set 2015, Release 13, Obtained from http://www.isbsg.org
• ISO/IEC 14598-5, Information Technology - Software Product Evaluation - Part 5: Process for Evaluators, ISO 1998.
• ISO/IEC 14143-1, Information Technology - Software Measurement - Functional Size Measurement - Part 1: Definition of Concepts, ISO 2007.
• ISO/IEC 20926, Software and Systems Engineering - Software Measurement - IFPUG Functional Size Measurement Method 2009, ISO 2009.
• ISO/IEC 24570, Software Engineering - NESMA Functional Size Measurement Method Version 2.1 - Definitions and Counting Guidelines for the Application of Function Point Analysis, ISO 2005.
• ISO/IEC 29881, Information Technology - Systems and Software Engineering - FiSMA 1.1 Functional Size Measurement Method, ISO 2010.
• ISO/IEC 20968, Software Engineering - Mk II Function Point Analysis - Counting Practices Manual, ISO 2002.
• ISO/IEC 19761, Software Engineering - COSMIC: A Functional Size Measurement Method, ISO 2011.
• ISO/IEC 29110-1, Software Engineering - Lifecycle Profiles for Very Small Entities (VSEs) - Part 1: Overview, ISO 2011.
• ISO/IEC 29110-2, Software Engineering - Lifecycle Profiles for Very Small Entities (VSEs) - Part 2: Framework and Taxonomy, ISO 2011.
• ISO/IEC 29110-3, Software Engineering - Lifecycle Profiles for Very Small Entities (VSEs) - Part 3: Assessment Guide, ISO 2011.
• ISO/IEC 15504-3, Information Technology - Process Assessment - Part 3: Guidance on Performing an Assessment, ISO 2004.
• ISO/IEC 25000, Systems and Software Engineering - Systems and Software Quality Requirements and Evaluation (SQuaRE) - Guide to SQuaRE, ISO 2014, http:// www.iso.org
• ISO/IEC 15504-4, Information Technology - Process Assessment - Part 4: Guidance on Use for Process Improvement and Process Capability Determination, ISO 2004, http://www.iso.org
• Marciniak J. J., Software Engineering. A Historical Perspective, Encyclopedia of Software Engineering, Wiley 2002.
• Nguyen F., Estimated Cost for SCAMPI Class A, B, or C Appraisal, 2010, http://cmmirocks. ning.com/forum/topics/estimated-cost-for-scampi (08/07/2015).
• Paulk M. C., SW-CMM V1.1, Software Engineering Institute 1992.
• Trudel S., Using the COSMIC Functional Size Measurement Method (ISO 19761) as a Software Requirements Improvement Mechanism, Thesis, École de Technologie Supérieure 2012.
• Trudel S., Abran A., Functional Size Measurement Quality Challenges for Inexperienced Measurer, in: Software Process and Product Measurement, International Conferences IWSM 2009 and Mensura 2009 Amsterdam, 4-6.11.2009, proceedings vol. 5891, Springer Science & Business Media, pp. 157-169.
• Trudel S., Lavoie J. M., Paré M. C., Suryn W., PEM: The Small Company-dedicated Software Process Quality Evaluation Method Combining CMMISM and ISO/IEC 14598,"Software Quality Journal" 2006, vol. 14, no. 1, pp. 7-23.
• Ungan E., Demirörs O., Top Ö. Ö., Özkan B., An Experimental Study on the Reliability of COSMIC Measurement Results, in: Software Process and Product Measurement, Springer, Berlin Heidelberg 2009, pp. 321-336.