We focused on the “runaway” software projects and tried to characterize them using software process metrics.
During the process of software development, senior managers often find indications that projects are risky and take appropriate actions to recover them from this dangerous status. If senior managers fail to detect such risks, it is possible that such projects may collapse completely.
We proposed a new scheme for the characterization of risky projects based on an evaluation by the project manager. In order to acquire the relevant data to make such an assessment, we first designed a questionnaire from five viewpoints within the projects: requirements, estimations, team organization, planning capability and project management activities. Each of these viewpoints consisted of a number of concrete questions. We then analyzed the responses to the questionnaires as provided by project managers by applying a logistic regression analysis. That is, we determined the coefficients of the logistic model from a set of the questionnaire responses. The experimental results using actual project data in Company A showed that 27 projects out of 32 were predicted correctly. Thus we would expect that the proposed characterizing scheme is the first step toward predicting which projects are risky at an early phase of the development.
Related paper
- T. Menzies, O. Mizuno, Y. Takagi, and T. Kikuno, "Explanation Vs Performance in Data Mining: a Case Study with Predicting Runaway Projects," Journal of Software Engineering and Applications, 2(4), pp. 221-236, November 2009.
- Y. Takagi, O. Mizuno, and T. Kikuno, "An Empirical Approach to Characterizing Risky Software Projects Based on Logistic Regression Analysis," Empirical Software Engineering, 10(4), pp. 495-515, December 2005. (JCR: 0.966 (2005))
- S. Amasaki, Y. Hamano, O. Mizuno, and T. Kikuno, "Characterization of Runaway Software Projects Using Association Rule Mining," In Proc. of 7th International Conference on Product Focused Software Process Improvement (PROFES2006), LNCS 4034, pp. 402-407, June 2006. (Amsterdam, The Netherlands) (Acceptance rate: 47.2%, 26/55)
- S. Abe, O. Mizuno, and T. Kikuno, "Predicting Runaway Projects for Reliable Software Developments Using Bayesian Classifier," In Proc. of 15th International Symposium on Software Reliability Engineering (ISSRE2004), Supplemental proceedings, pp. 23-24, November 2004. (Saint-Malo, France)
- O. Mizuno, T. Hamasaki, Y. Takagi, and T. Kikuno, "An Empirical Evaluation of Predicting Runaway Software Projects Using Bayesian Classification," In Proc. of 5th International Conference on Product Focused Software Process Improvement (PROFES2004), LNCS 3009, pp. 263-273, April 2004. (Nara, Japan)
- O. Mizuno, T. Adachi, T. Kikuno, and Y. Takagi, "On Prediction of Cost and Duration for Risky Software Projects Based on Risk Questionnaire," In Proc. of 2nd Asia-Pacific Conference on Quality Software (APAQS2001), pp. 120-128, December 2001. (HongKong, China.) (Acceptance rate: 34%, 34/100)
- O. Mizuno, T. Kikuno, Y. Takagi, and K. Sakamoto, "Characterization of Risky Projects Based on Project Managers Evaluation," In Proc. of 22nd International Conference on Software Engineering (ICSE2000), pp. 387-395, June 2000. (Limerick, Ireland.) (Acceptance rate: 14%, 49/339)
- T. Kondo, S. Abe, O. Mizuno, T. Kikuno, "A Prototype of Software Project Management Tool Based on Runaway Prediction Using Bayesian Classifier," IPSJ SIGSE Technical Report, 2007(33, 2007-SE-155), pp. 57-64, March 2007. (東京)
- K. Kudou, O. Mizuno, T. Kikuno, "Prediction of Runaway Software Projects with Multiple Classification Methods -- Comparison of Accuracy among Classification Methods --," 電子情報通信学会技術報告, 104(467, SS2004-36), pp. 13-18, November 2004. (山梨)