Measuring the success of Lean and Agile projects: Are cost, time, scope and quality equally important?

Itai Lishner, Avraham Shtub


This study presents the results of a survey conducted among managers from organizations that use Agile/Lean methodology for new product development. The study focused on the way these organizations measure the success of their projects. We found that most of the Agile/Lean projects failed to achieve the top criterion their organizations selected to evaluate the project success. We propose some tools designed to increase the probability of success based on the criteria selected by Lean and Agile project managers.


Agile; Lean; Project Management; New Product Development; Success Criteria


Agile Manifesto: Manifesto for Agile Software Development. [online] Available at: http://www.agilemanifesto.org/ [Accessed 10 Jul. 2018].

Atkinson, R. (1999). Project management: Cost, time and quality, two best guesses and a phenomenon, its time to accept other success criteria. International Journal of Project Management, 17(6), 337–342.

Azizyan, G., Magarian, M., & Kajko-Matsson, M. (2011). Survey of agile tool usage and needs. 2011 AGILE Conference.

Ballesteros-Pérez, P., Larsen, G., & González-Cruz, M. (2018). Do projects really end late? On the shortcomings of the classical scheduling techniques. Journal of Technology and Science Education, 8(1), 17–33.

Conforto, E., Salum, F., Amaral, D., da Silva, S., & de Almeida, L. (2014). Can agile project management be adopted by industries other than software development? Project Management Journal, 45(3), 21–34.

Conforto, E., & Amaral, D. (2010). Evaluating an agile method for planning and controlling innovative projects. Project Management Journal, 41(2), 73–80.

Drury-Grogan, M. (2014). Performance on agile teams: Relating iteration objectives and critical decisions to project management success factors. Information and Software Technology, 56(5), 506–515.

Ika, L. (2009). Project success as a topic in project management journals. Project Management Journal, 40(4), 6–19.

Larman, C., & Vodde, B. (2008). Scaling lean & agile development. Upper Saddle River, NJ: Addison-Wesley.

Lim, C., & Mohamed, M. (1999). Criteria of project success: An exploratory re-examination. International Journal of Project Management, 17(4), 243–248.

Lima, G. L., Ferreira, G. A., Saotome, O., Cunha, A. M., & Dias, L. A. (2015). Hardware development: Agile and co-design. 12th International Conference on Information Technology—New Generations, 784–787.

Lindsjørn, Y., Sjøberg, D., Dingsøyr, T., Bergersen, G., & Dybå, T. (2016). Teamwork quality and project success in software development: A survey of agile development teams. Journal of Systems and Software, 122, 274–286.

Oppenheim, A. N. (1996). Questionnaire design, interviewing and attitude measurement. Pinter Publishers, new edn.

Pettigrew, A. (1990). Longitudinal field research on change: Theory and practice. Organization Science, 1(3), 267–292.

Poppendieck, M., & Poppendieck, T. (2013). Lean software development. Boston, MA: Addison Wesley.

Project Management Institute (2017). Guide to the project management body of knowledge (PMBOK® Guide) (6th Edition). Project Management Institute.

Project Management Institute. (2012). Guide to the project management body of knowledge (PMBOK® Guide) (5th Edition). Project Management Institute.

Rodríguez, P., Markkula, J., Oivo, M., & Turula, K. (2012). Survey on agile and lean usage in Finnish software industry. Proceedings of the ACM-IEEE International Symposium on Empirical Software Engineering and Measurement - ESEM '12.

Serrador, P., & Turner, R. (2015). The relationship between project success and project efficiency. Project Management Journal, 46(1), 30–39.

Sillitti, A., Ceschi, M., Russo, B., & Succi, G. (2005). Managing uncertainty in requirements: A survey in documentation-driven and agile companies, 11th IEEE International Software Metrics Symposium, p. 17.

Turner, R., & Zolin, R. (2012). Forecasting success on large projects: Developing reliable scales to predict multiple perspectives by multiple stakeholders over multiple time frames. Project Management Journal, 43(5), 87–99.

Vega-Velázquez, M., García-Nájera, A., & Cervantes, H. (2018). A survey on the software project scheduling problem. International Journal of Production Economics, 202, 145–161.

VersionOne. (2017). 11th annual state of agile report. Retrieved from: https://versionone.com/pdf/VersionOne-11th-Annual-State-of-Agile-Report.pdf

Ward, A., Shook, J., & Sobek, D. (2009). Lean product and process development. Cambridge, MA: Lean Enterprise Institute.

Zhang, W., Liu, X., & Yang, Y. (2017). Let smart ants help you reduce the delay penalty of multiple software projects. 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C), 271–273.

Full Text: PDF


  • There are currently no refbacks.

Comments on this article

View all comments


The Journal of Modern PM (ISSN: 2317-3963) | info@journalmodernpm.com