Progressive Delivery for Models with Quality KPIs
DOI:
https://doi.org/10.63282/3117-5481/AIJCST-V5I4P104Keywords:
Progressive Delivery, Machine Learning Deployment, Quality Kpis, Model Monitoring, A/B Testing, Canary Releases, Mlops, Continuous ValidationAbstract
Progressive delivery, a technique that has been in use for a long time in software engineering, gradually gets essential applications in ML and AI model deployment scenarios, where the risks of performance drift, ethical lapses, or bias amplification require cautious and measurable release strategies. This article discusses the use of gradual delivery concepts in ML models, which are mainly controlled, incremental rollouts regulated by well-defined Quality Key Performance Indicators (KPIs). Progressive delivery allows for staged exposure thus, a model is not immediately deployed to full production, but it is exposed only to limited user segments or traffic percentages from the very beginning and the real-time validation metrics such as precision, latency, fairness, and stability are used to make the decisions on promotion or rollback. Before they may get a chance to interact with the model, progressive delivery principles ensure that ML-based changes are tested, verified, and monitored for quality on a smaller scale and with the possibility of rapid rollback. Accordingly, the paper offers a well-thought-out approach that mixes CI/CD principles with ML observability frameworks to build a smart, feedback-driven delivery pipeline. The paper presents a case study that shows how companies can put this framework into practice, managing the trade-off between innovation speed and performance assurance. The experimental evidence conveys that the suggested model deployment pipeline not only encourages implementation trust but also leads to the performance anomalies' early and quick recovery, eventually raising model robustness and business impact to higher levels. Ultimately, the paper conceptualizes progressive delivery as a core capability for the deployment of responsible AI through this synthesis of engineering rigor and statistical governance, thus enabling a smooth transition from experimentation to production at scale.
References
[1] Făgărășan, Cristian, et al. "Key performance indicators used to measure the adherence to the iterative software delivery model and policies." IOP Conference Series: Materials Science and Engineering. 2022.
[2] Zheng, Mengze, et al. "Key Performance Indicators for the Integration of the Service‐Oriented Architecture and Scrum Process Model for IOT." Scientific Programming 2021.1 (2021): 6613579.
[3] Nedeliakova, Eva, et al. "Progressive management tools for quality improvement." 2016 International Conference on Engineering Science and Management. Atlantis Press, 2016.
[4] Housawi, Abdulrahman, et al. "Evaluation of key performance indicators (KPIs) for sustainable postgraduate medical training: an opportunity for implementing an innovative approach to advance the quality of training programs at the Saudi Commission for Health Specialties (SCFHS)." Sustainability 12.19 (2020): 8030.
[5] Yung, Jason, et al. "Impact of a layered learning practice model on delivery of clinical pharmacy key performance indicators under a tertiary care center oncology service." The Canadian Journal of Hospital Pharmacy 72.3 (2018): 202.
[6] Guntupalli, Bhavitha, and Surya Vamshi Ch. "My Favorite Design Patterns and When I Actually Use Them." International Journal of Emerging Trends in Computer Science and Information Technology 3.3 (2022): 63-71.
[7] Alemanni, Marco, et al. "Key performance indicators for PLM benefits evaluation: The Alcatel Alenia Space case study." Computers in Industry 59.8 (2008): 833-841.
[8] Herrera-Garcia, Ana, et al. "Modeling of key quality indicators for end-to-end network management: Preparing for 5G." IEEE Vehicular Technology Magazine 14.4 (2019): 76-84.
[9] Shirouyehzad, Hadi, Farimah Mokhatab Rafiei, and Elmira Shahgholi. "Performance evaluation of organizational units based on key performance indicators with agility approach by using MADM, QFD; a case study in Darakar Company." International journal of productivity and quality management 17.2 (2016): 198-214.
[10] Boyd, Lisa, Emma Baker, and Joe Reilly. "Impact of a progressive stepped care approach in an improving access to psychological therapies service: An observational study." PLoS One 14.4 (2019): e0214715.
[11] Parakala, Adityamallikarjunkumar. "Vendor Highlights–IoT, AI, and Process Mining." International Journal of Emerging Trends in Computer Science and Information Technology 4.4 (2023): 135-146.
[12] Beatham, Simon, et al. "KPIs: a critical appraisal of their use in construction." Benchmarking: an international journal 11.1 (2004): 93-117.
[13] Guntupalli, Bhavitha. "Writing Maintainable Code in Fast-Moving Data Projects." International Journal of Emerging Trends in Computer Science and Information Technology 3.2 (2022): 65-74.
[14] 14. Izima, Obinna, Ruairí de Fréin, and Ali Malik. "A survey of machine learning techniques for video quality prediction from quality of delivery metrics." Electronics 10.22 (2021): 2851.
[15] Al-Baomar, Istejdad, et al. "Gaining Value from Complete Automation of Progressive Cavity Pumps Well Models through Improved Optimization Processes." SPE Middle East Artificial Lift Conference and Exhibition. SPE, 2018.
[16] Parakala, Adityamallikarjunkumar. "Role Evolution: Developer, Analyst, Lead, Senior." American International Journal of Computer Science and Technology 4.3 (2022): 11-19.
[17] Staron, Miroslaw, et al. "A key performance indicator quality model and its industrial evaluation." 2016 Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement (IWSM-MENSURA). IEEE, 2016.
[18] Dhote, Prashant, et al. "KPI Based Standardizing Static Geomodeling Practices for QA and QC of Models." International Petroleum Technology Conference. IPTC, 2019.
[19] Franco Jr, José G., et al. "Key performance indicators score (KPIs-score) based on clinical and laboratorial parameters can establish benchmarks for internal quality control in an ART program." JBRA assisted reproduction 21.2 (2017): 61.
