Evaluating Application Integration Success Using DeLone McLean and CSF Model
Keywords:
information systems, application integration, DeLone & McLean, Critical Success Factors, SEM-PLSAbstract
Digital transformation in the financial industry has encouraged organizations to adopt application integration systems to improve operational efficiency and effectiveness. However, not all information system implementation projects succeed in meeting expectations, particularly in guarantee institutions with complex business processes. This study evaluates the success of an application integration system project in a guarantee company using a combined approach based on the DeLone and McLean (2003) Information System Success Model and Critical Success Factors (CSF). By explicitly incorporating CSF variables as antecedents of system quality, information quality, and service quality, this study extends the conventional application of the DeLone and McLean model by integrating key managerial perspectives into the evaluation of integration success. A quantitative method was employed using survey data collected from 120 respondents of the Penjaminan Application Integration (PAI) system at PT XYZ. The data were analyzed using Partial Least Squares Structural Equation Modeling (PLS-SEM). The results indicate that CSF variables, including top management support, internal communication, user training, and project risk management, significantly affect system quality, information quality, and service quality. Furthermore, these three quality dimensions within the D&M model notably influence the intention to use and user satisfaction, which ultimately impact the perceived net benefits for the organization. In conclusion, considering both managerial and system quality perspectives provides a more comprehensive understanding of the success factors in application integration projects. These findings can serve as a basis for improving IT project implementation strategies in the guarantee sector and other industries with similar characteristics.
References
Adywiratama, A. D., Ko, C., Raharjo, T., & Wahbi, A. (2022). Critical success factors for ICT projects: A case study in project colocation government data centre. Procedia Computer Science, 197, 385-392. https://doi.org/10.1016/j.procs.2021.12.154
Anaam, E. A., Alyam, A. A. H., Ali, Y., Ali, A., Dauwed, M., Alshahrani, A., & Al-nidawi, W. J. A. (2023). Application of the updated DeLone and McLean (IS) success method to investigate e-CRM effectiveness. International Journal of Advanced and Applied Sciences, 10(2), 128–138. https://doi.org/10.21833/ijaas.2023.02.016
Azzahra, S. F., Ramadani, L., & Rahmad, B. (2023). Integrating system quality, information quality, and service quality for evaluating IS quality. In Proceedings of the International Conference on Enterprise & Industrial Systems (ICOEINS 2023) (Advances in Economics, Business and Management Research, Vol. 270, pp. 217–229). Atlantis Press. https://doi.org/10.2991/978-94-6463-340-5_19
Bashiri, A., Shirdeli, M., Niknam, F., Naderi, S., & Zare, S. (2023). Evaluating the success of Iran electronic health record system (SEPAS) based on the DeLone and McLean model: A cross-sectional descriptive study. BMC Medical Informatics and Decision Making, 23(1), 1–7. https://doi.org/10.1186/s12911-023-02100-y
Fahmi, T. (2024). Transformasi digital dan pengaruhnya terhadap budaya organisasi: Tinjauan literatur sistematis. Jurnal Manajemen Akuntansi dan Ilmu Ekonomi, 1(2), 101–109. https://doi.org/10.70585/jumali.v1i2.46
Hadi, I., Ghozali, A., & Handoko, A. R. (2023). Exploration of the project risk management framework for information technology companies. CogITo Smart Journal, 9(2), 266–279. https://doi.org/10.31154/cogito.v9i2.517.266-279
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2021). A primer on partial least squares structural equation modeling (PLS-SEM) (3rd ed.). SAGE Publications. https://uk.sagepub.com/en-gb/eur/a-primer-on-partial-least-squares-structural-equation-modeling-pls-sem/book270548
Jeyaraj, A. (2020). DeLone & McLean models of information system success: Critical meta-review and research directions. International Journal of Information Management, 54, 102139. https://doi.org/10.1016/j.ijinfomgt.2020.102139
Loureiro, E., Gomes, B., Varajão, J., & Silva, C. (2024). Information systems project success surveys – Insights from the last 30 years. Heliyon, 10(23), e40619. https://doi.org/10.1016/j.heliyon.2024.e40619
Millenia, S., Prasetyo, T., & Utami, R. (2022). The success factors of e-Filing tax reporting in Indonesia: An empirical analysis using the DeLone & McLean IS success model. In Proceedings of the 2022 6th International Conference on Computing and Data Engineering (CDE) (pp. 55–60). ACM. https://doi.org/10.1145/3512676.3512691
Mu, S., & Metalica, D. P. (2022). Measurement of successful implementation of institution-level financial application system (SAKTI) web full module with DeLone and McLean model in the Directorate General of Military Courts and State Administrative Courts. SITEKIN: Jurnal Sains, Teknologi, dan Industri, 20(1), 54–61. https://ejournal.uin-suska.ac.id/index.php/sitekin/article/view/19308
Mustafa, S. Z., Kar, A. K., & Janssen, M. F. W. H. A. (2020). Understanding the impact of digital service failure on users: Integrating Tan’s failure and DeLone and McLean’s success model. International Journal of Information Management, 53, 102119. https://doi.org/10.1016/j.ijinfomgt.2020.102119
Nadella, G. S., Meduri, K., Satish, S., Maturi, M. H., & Gonaygunta, H. (2024). Examining E-learning tools impact using IS-impact model: A comparative PLS-SEM and IPMA case study. Journal of Open Innovation: Technology, Market, and Complexity, 10(3), 100351. https://doi.org/10.1016/j.joitmc.2024.100351
Omari, M. (2025). Assessing e-learning success at the Higher Institute of Nursing Professions and Health Techniques of Casablanca: A cross-sectional study. The Open Nursing Journal, 19, e18744346400244. https://doi.org/10.2174/0118744346400244250724043052
Panjaitan, I. R., & Nasution, M. I. P. (2024). Integrasi sistem informasi bisnis dengan teknologi machine learning. Jurnal Penelitian Sistem Informasi (JPSI), 2(2), 99–110. https://doi.org/10.54066/jpsi.v2i2.1916
Pereira, G. S., Novaski, O., Santos Neto, N. F., & Silva Mota, F. A. S. (2022). Study on the state of the art of critical success factors and project management performance. Gestão & Produção, 29, e4722. https://doi.org/10.1590/1806-9649-2022v29e4722
Portman, H. (2021, January 6). CHAOS 2020: Beyond infinity. Standish Group. https://hennyportman.wordpress.com/2021/01/06/review-standish-group-chaos-2020-beyond-infinity/
Rabih, L., & Yammine, E. (2025). E-learning success evaluation in Lebanon during wartime: An extension of the DeLone and McLean IS success model. F1000Research, 14, 468. https://doi.org/10.12688/f1000research.163914.1
Riady, Y., Sofwan, M., Mailizar, M., Alqahtani, T. M., Nurul Yaqin, L., & Habibi, A. (2023). How can we assess the success of information technologies in digital libraries? Empirical evidence from Indonesia. International Journal of Information Management Data Insights, 3(2), 100192. https://doi.org/10.1016/j.jjimei.2023.100192
Vrchota, J., Řehoř, P., Mařiková, M., & Pech, M. (2020). Critical success factors of project management in relation to industry 4.0 for sustainability of projects. Sustainability, 13(1), 281. https://doi.org/10.3390/su13010281
Wagiman, A. N., Aspasya, G. S., & Prawati, L. D. (2023). Net benefit on e-invoice implementation: Applying the DeLone & McLean information systems success model. E3S Web of Conferences, 388, 04054. https://doi.org/10.1051/e3sconf/202338804054
Yudiawan, A., Rokhmah, S., Umkabu, T., Safitri, F., & Arifin, A. (2022). Factors affecting the success of e-learning-based training using learning management system platforms: Adaptations of updated DeLone and McLean models. Journal of Education and e-Learning Research, 9(3), 192–198. https://doi.org/10.20448/jeelr.v9i3.4186
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Al Aziizu Putra Hendriana, Tanty Oktavia
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
a. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License - Share Alike that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
b. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
c. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
 USER RIGHTS
 All articles published Open Access will be immediately and permanently free for everyone to read and download. We are continuously working with our author communities to select the best choice of license options, currently being defined for this journal as follows:
