Performance Measurement of Academic Information Systems using Performance Prism and ISO/IEC 25010
DOI:
https://doi.org/10.21512/tw.v21i2.6505Keywords:
Academic Information Systems, Performance Measurement, Performance Prism, ISO / IEC 25010Abstract
The aim of the research was to measure system performance information in terms of system quality using the ISO/IEC 25010 model and involve stakeholders using the Performance Prism (PP) model. The research applied an action research approach where researchers developed performance measurement models and solved existing problems. The research produced 41 performance indicators, which were used to measure academic information system. The results in general academic information systems have a performance value of 5,522.
Plum Analytics
References
Adams, C., & Neely, A. (2000). The performance prism to boost M&A success. Measuring Business Excellence, 4(3), 19-23. https://doi.org/10.1108/13683040010377818.
Agani, M. A., Munadi, R., & Subianto, M. (2018). Evaluasi kinerja sistem informasi akademik menggunakan IT balanced scorecard pada universitas Serambi Mekkah Banda Aceh. Jurnal Informatika Upgris, 4(1). https://doi.org/10.26877/JIU.V4I1.2071.
Al-Hudhaif, S. A., & Arabia, S. (2010). Measuring quality of information system services in manufacturing organizations in Riyadh. JKAU: Econ. & Adm, 24(1), 151-171. https://doi.org/10.4197/Eco.
Chang, J. C-J & King W. R. (2005). Measuring the performance of information system: A functional scorecard. Journal of Mangement Information Systems, 22(1), 85-115. https://doi.org/10.1080/07421222.2003.11045833.
Coats, M. (2005). Action research a guide for associate lecturers. UK: Walton Hall Milton Keynes. http://repositorio.minedu.gob.pe/bitstream/handle/123456789/3590/Action%20Research%20A%20Guide%20for%20Associate%20Lecturers.pdf?sequence=1&isAllowed=y.
Coghlan, D. (2005). Doing action research in your own organization. SAGE Publications.
Darwish, M., & Shehab, E. (2017). Framework for engineering design systems architectures evaluation and selection: Case study. Procedia CIRP, 60, 128-132. https://doi.org/10.1016/j.procir.2017.01.058.
Davies, B., Baron, S., Gear, T. & Read, M. (1999). Measuring and managing service quality. Marketing Intelligence & Planning. 17(1), 33-40. https://doi.org/10.1108/02634509910253795.
Delnoij, D. M. J., Rademakers, J. J. D. J. M., & Groenewegen, P. P. (2010). The Dutch consumer quality index: An example of stakeholder involvement in indicator development. BMC Health Services Research, 10. https://doi.org/10.1186/1472-6963-10-88.
Estrada, R., Sousa, S., & Lopes, I. (2018). Performance assessment system development based on performance prism in social services. IEEE International Conference on Industrial Engineering and Engineering Management, 2017-December, 855-859. https://doi.org/10.1109/IEEM.2017.8290013.
Farbey, B., Land, F., & Targett, D. (1999). Moving IS evaluation forward: Learning themes and researchissues. Journal of Strategic Information Systems, 8(2), 189-207. https://doi.org/10.1016/S0963-8687(99)00021-9.
Farbey, B., Land, F., & Targett, D. (1993). How to assess your IT investment. UK: Butterworth-Heinemann Ltd.
Gardoni, F. L. (2017). Double performance prism: Innovation performance measurement systems for manufacturing SMEs. International Journal of Innovative Research in Advanced Engineering, 4(3), 113-128.
Haslinda, H., Fahmy, F., Sukinah, S., Roslina, R., Fariha, F., Suhana, S., Azliza, A., & Shiratuddin, N. (2015). Evaluation of e-Book applications using ISO 25010. 2nd International Symposium on Technology Management and Emerging Technologies, ISTMET 2015 - Proceeding, December, 114-118. https://doi.org/10.1109/ISTMET.2015.7359012.
Huda, D. N. (2012). Peningkatan kualitas sistem informasi akademik dan keuangan berdasarkan Webqual 4.0 dan ISO/IEC 25010: Studi kasus Sekolah Tinggi Teknologi Indonesia Tanjungpinang. Jurnal Bangkit Indonesia, 6(2), 37-39. https://journal.sttindonesia.ac.id/index.php/bangkitindonesia/article/view/21.
ISO/IEC 25010. (2011). ISO/IEC. Systems and software engineering-Systems and software Quality Requirements and Evaluation (SQuaRE) - System and software quality models. BSI Standards Publication. https://www.iso.org/standard/35733.html
ISO/IEC IS 9126-1. (2001). Software Engineering - Product Quality – Part 1: Quality Model. International organization for standarization. https://www.iso.org/standard/22749.html
ISO. (2011). Systems and software engineering Systems and software Quality Requirements and Evaluation. 6(1.3.2011), 1-44. https://www.iso.org/obp/ui/#iso:std:iso-iec:25010:ed-1:v1:en.
Jun, S. (2011). BMEI 2011 - Proceedings 2011 International Conference on Business Management and Electronic Information. BMEI 2011 - Proceedings 2011 International Conference on Business Management and Electronic Information, 1.
Kara, M., Lamouchi, O., & Ramdane-Cherif, A. (2017). A quality model for the evaluation AAL systems. Procedia Computer Science, 113, 392-399. https://doi.org/10.1016/j.procs.2017.08.354.
Karnouskos, S., Sinha, R., Leitão, P., Ribeiro, L., & Strasser, T. I. (2018). The applicability of ISO/IEC 25023 measures to the integration of agents and automation systems. IECON 2018 - 44th Annual Conference of the IEEE Industrial Electronics Society, January 2019, 2927–2934. https://doi.org/10.1109/IECON.2018.8592777.
Laili, V. B. (2012). Perancangan sistem pengukuran kinerja progam e-KTP sebagai media analisis investasi IT dengan menggunakan metode performance prism. Institut Teknologi Sepuluh Nopember. http://digilib.its.ac.id/ITS-paper-52021120000168/19415.
Laudon, K. & Laudon, J. (1996). MILS. Organization and Technology. New Jersey: Prentice Hall.
Lesmideyarti, D., Rochimah, S., & Yuhana, U. L. (2017). Penyusunan dan pengujian metrik operabilitas untuk sistem informasi akademik berdasarkan ISO 25010. Inspiration: Jurnal Teknologi Informasi dan Komunikasi, 7(2), 92-100. https://doi.org/10.35585/inspir.v7i2.2442.
May, T. (2001, March 12th). Annual IT Budget? Kill It: CIOs need Net-style flexibility for enterprise projects. Computer World. https://www.computerworld.com/article/2590963/annual-it-budget--kill-it.html
Neely, A. & Adams, C. (2000). Perspectives on performance: The performance prism. Focus Magazine for the Performance Management Professional, 4. https://www.som.cranfield.ac.uk/som/dinamic-content/research/cbp/prismarticle.pdf.
Neely, A., Adams, C., & Crowe, P. (2001a). The performance prism in practice. Measuring Business Excellence, 5(2), 6-13. https://doi.org/10.1108/13683040110385142.
Neely, A., Adams, C., & Crowe, P. (2001b). The performance prism in practice. Measuring Business Excellence, 5(2), 6-13. https://doi.org/10.1108/13683040110385142.
Neely, A. D., Gregory, M., & Platts, K. (1995). Performance measurement system design: a literature review and research agenda. International Journal of Operations & Production Management, 15(4), 80-116. https://doi.org/10.1108/01443579510083622.
Puspaningrum, A. S., Rochimah, S., & Akbar, R. J. (2017). Functional suitability measurement using goal-oriented approach based on ISO/IEC 25010 for Academics Information System. Journal of Information Systems Engineering and Business Intelligence, 3(2), 68. https://doi.org/10.20473/jisebi.3.2.68-74.
Ravichandran, T., & Lertwongsatien, C. (2005). Effect of information systems resources and capabilities on firm performance: A resource-based perspective. Journal of Management Information Systems, 21(4), 237-276. https://doi.org/10.1080/07421222.2005.11045820.
Riggs, J. L. (1987). Production system: Planning, analysis & control. New York: Jhon Wiley & Sons.
Sarosa, S. (2017). Penelitian Kualitatif Dasar-Dasar, Edisi 2 (2nd Ed.). Indeks Jakarta.
Seddon, P. B., Graeser, V., & Willcocks, L. (2000). Measuring IS effectiveness: Senior IT management perspectives. Oxford Institute of Information Management.
Sedera, D., & Tan, F. T. C. (2005). User Satisfaction: An overarching measure of Enterprise System success. 9th Pacific Asia Conference on Information Systems: I.T. and Value Creation, PACIS 2005, 2, 963-976.
Severgnini, E., Galdamez, E. V. C., & Camacho, R. R. (2019). Applicability of Performance Prism in SMEs: a multiple case study. Gestão & Produção, 26(4). https://doi.org/10.1590/0104-530x3014-19.
Smulowitz, S. (2015). Evidence for the performance prism in higher education. Measuring Business Excellence, 19(1), 70-80. http://dx.doi.org/10.1108/MBE-11-2014-0043.
Sulaiman, A. (1996). A review of information systems performance evaluation measures. Journal of Business and Social Sciences, 11(1), 1-16.
Sulistiani, I., Syarif, S., Yusran & Dewiani. (2018). Quality Models Engineering for Evaluation of Academic Information System Quality Instrument (AISQI). Proceedings - 2018 International Conference on Applied Science and Technology, ICAST 2018, 30-34. https://doi.org/10.1109/iCAST1.2018.8751525.
Symons V. J. (1990). A review of IS evaluation: Content, context and process. European Journal of IS, 1(3), 205.212.
Thatcher, M. E., & Oliver, J. R. (2001). The impact of technology investments on a firm’s production efficiency, product quality, and productivity. Journal of Management Information Systems, 18(2), 17-45.
Vaidya R., Myers M.D., & Gardner L. (2011). The design – reality gap: The impact of stakeholder strategies on IS implementation in developing countries. In Nüttgens M., Gadatsch A., Kautz K., Schirmer I., Blinn N. (eds) Governance and sustainability in information systems. Managing the Transfer and Diffusion of IT. TDIT 2011. IFIP advances in information and communication technology, 366. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24148-2_8.
Wasitarini, D. E., & Sembiring, J. (2017). Performance measurement framework of E-Library using modified quantitative models for performance measurement system (QMPMS) method for ICT infrastructure. 2016 International Conference on Information Technology Systems and Innovation, ICITSI 2016 - Proceedings. https://doi.org/10.1109/ICITSI.2016.7858192.
Youngbantao, U., & Rompho, N. (2015). The uses of measures in Performance Prism in different organizational cultures. Journal of Accounting & Finance, 15(6), 122-128. https://www.researchgate.net/publication/285826230_The_Uses_of_Measures_in_Performance_Prism_in_Different_Organizational_Cultures.
Yu, B. & Zhu, B. (2011). Design of performance evaluation system for the informatization of chemical enterprise based on Performance Prism. 2011 IEEE 3rd International Conference on Communication Software and Networks, Xi’an, pp. 394-396. https://doi.org/10.1109/ICCSN.2011.6013857.
Zhu, K. (2004). The complimentary of Information Technology infrastructrure and E-Commerce Capability: A resource-based assessment of their business value. Journal of Management Information Systems, 21(4), 167-202. https://doi.org/10.1080/07421222.2004.11045794.
Downloads
Published
Issue
Section
License
Copyright (c) 2020 Liulliyah Liulliyah, Apol Pribadi Subriadi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
a. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License - Share Alike that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
b. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
c. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
USER RIGHTS
All articles published Open Access will be immediately and permanently free for everyone to read and download. We are continuously working with our author communities to select the best choice of license options, currently being defined for this journal as follows: Creative Commons Attribution-Share Alike (CC BY-SA)
