AI Approaches to Software Quality Assessment: From Defect Prediction to Test Coverage Optimization
Keywords:
AI, large language models, quality assurance, test automation, predictive prioritization, semantic log analysis, CI/CD, empirical studyAbstract
The article addresses the problem of growing inefficiency in traditional approaches to software quality assurance (QA) under accelerated cycles of continuous integration and delivery (CI/CD). The aim of the study is to present and evaluate a new integrated platform that leverages large language models (LLMs) to automate and optimize key QA processes. The methodology is based on an industrial case study of a system utilizing Claude 4 and Amazon Q CLI for semantic log analysis and predictive test prioritization. The paper presents key quantitative results, including an increase in nightly build stability from ~70% to over 90%, a one-third reduction in regression testing time, and a halving of pull request verification time. Additionally, it is emphasized that the adoption of such solutions enhances testing transparency, improves collaboration between development and QA teams, and accelerates release cycles while ensuring higher product quality. The main contribution of the article is the provision of empirical evidence from a large corporate environment, confirming that modern AI-driven approaches can significantly improve the efficiency, accuracy, and strategic value of software testing. The article will be useful for researchers, quality engineers, CI/CD architects, and DevOps practitioners interested in applying LLMs to optimize testing processes.
References
[1]. Ding, Y. (2024). Artificial Intelligence in Software Testing for Emerging Fields: A Review of Technical Applications and Developments. Applied and Computational Engineering, 112(1), 161–175. https://doi.org/10.54254/2755-2721/2025.18116
[2]. Narwal. (2024). Revolutionizing Software Testing: The Role of AI Powered Quality Engineering in Driving Innovation. Narwal. https://narwal.ai/revolutionizing-software-testing-the-role-of-ai-powered-quality-engineering-in-driving-innovation/
[3]. Trudova, A., Dolezel, M., & Buchalcevova, A. (2020). Artificial Intelligence in Software Test Automation: A Systematic Literature Review. In Proceedings of the 15th International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE 2020), Volume 1 (pp. 181–192). SCITEPRESS. https://doi.org/10.5220/0009417801810192
[4]. IEEE Computer Society. (2025). Next-Generation Software Testing: AI-Powered Test Automation. IEEE Software, 42(4), 25–33. https://www.computer.org/csdl/magazine/so/2025/04/11024091/27gSQcKD6jC
[5]. Ideas2IT. (n.d.). AI's Role in Enhancing Quality Assurance in Software Testing. Retrieved September 10, 2025, from https://www.ideas2it.com/blogs/ai-redefining-qa-software-testing
[6]. Battina, D. S. (2019). Artificial Intelligence in Software Test Automation: A Systematic Literature Review. International Journal of Emerging Technologies and Innovative Research, 6(12), 1329–1332. http://www.jetir.org/papers/JETIR1912176.pdf
[7]. Baqar, M., & Khanda, R. (2024). The Future of Software Testing: AI-Powered Test Case Generation and Validation. arXiv. https://doi.org/10.48550/arXiv.2409.05808
[8]. Islam, M., Khan, F., Alam, S., & Hasan, M. (2023, September). Artificial Intelligence in Software Testing: A Systematic Review. In Proceedings of the IEEE TENCON 2023 Conference (pp. 1–6). IEEE. Retrieved from https://www.researchgate.net/publication/374263724_Artificial_Intelligence_in_Software_Testing_A_Systematic_Review
[9]. Karhu, K., Kasurinen, J., & Smolander, K. (2025). Expectations vs Reality -- A Secondary Study on AI Adoption in Software Testing. arXiv. https://doi.org/10.48550/arXiv.2504.04921
[10]. Khalid, A., Badshah, G., Ayub, N., Shiraz, M., & Ghouse, M. (2023). Software Defect Prediction Analysis Using Machine Learning Techniques. Sustainability, 15(6), 5517. https://doi.org/10.3390/su15065517
[11]. Ponnala, R., & Reddy, C. R. K. (2021). Software Defect Prediction using Machine Learning Algorithms: Current State of the Art. Solid State Technology, 64(2), 6541–6556. Retrieved from https://www.researchgate.net/publication/351746329_Software_Defect_Prediction_using_Machine_Learning_Algorithms_Current_State_of_the_Art
[12]. Albattah, W., & Alzahrani, M. (2024). Software Defect Prediction Based on Machine Learning and Deep Learning Techniques: An Empirical Approach. AI, 5(4), 1743–1758. https://doi.org/10.3390/ai5040086
[13]. Harsh, H., Santoshi, H., & Singh, P. (2025). Comparative Study of Machine Learning Based Defect Prediction Models for Python Software. In Proceedings of the 2025 6th International Conference on Inventive Research in Computing Applications (ICIRCA). IEEE. https://doi.org/10.1109/ICIRCA65293.2025.11089647
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Taras Buriak

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who submit papers with this journal agree to the following terms.