Perbandingan Pengujian Manual dan Otomatis Playwright dengan dan tanpa Page Object Model
Abstrak
Pengujian perangkat lunak adalah tahapan kritis dalam siklus pengembangan sistem informasi. Website Skripsweet platform untuk manajemen skripsi mahasiswa saat ini masih mengandalkan pengujian manual yang terbukti tidak efisien dan rentan terhadap human error. Penelitian ini membandingkan tiga skenario pengujian: (1) pengujian manual, (2) automation testing tanpa Page Object Model (POM), dan (3) automation testing dengan POM menggunakan framework Playwright. Total 26 test case dikembangkan mencakup modul landing page, autentikasi, forgot password, onboarding, dashboard, pricing & checkout, settings, dan AI checker, setiap test case dieksekusi sebanyak lima kali untuk memperoleh rata-rata waktu eksekusi yang representatif. Metrik yang digunakan meliputi execution time, lines of code (LOC), cyclomatic complexity, dan code reusability. Hasil penelitian menunjukkan bahwa automation testing mencapai efisiensi waktu 91,0% (tanpa POM) dan 83,8% (dengan POM) dibandingkan pengujian manual. Menariknya, automation tanpa POM menunjukkan throughput eksekusi mentah yang lebih cepat (mean 49,82 detik) dibandingkan automation dengan POM (mean 89,75 detik) karena lapisan abstraksi method call tambahan, namun automation dengan POM menunjukkan konsistensi yang jauh lebih tinggi (SD = 1,12 detik) dibandingkan automation tanpa POM (SD = 2,77 detik) maupun pengujian manual (SD = 13,11 detik). Penerapan POM menurunkan LOC file spesifikasi pengujian sebesar 31,2% (dari 461 menjadi 317 baris), mempertahankan cyclomatic complexity rata-rata dari 1,37 menjadi 1,22, dan mencapai reusability dengan 9 page object class yang diinstansiasi di seluruh test suite, dengan BasePage diwarisi oleh seluruh 9 subclass. Kontribusi utama penelitian ini adalah kerangka evaluasi kuantitatif yang membandingkan tiga skenario pengujian secara bersamaan pada empat metrik, memberikan bukti nyata bagi praktisi pada praktik pengujian platform manajemen skripsi.
Referensi
G. Murazvu, S. Parkinson, S. Khan, N. Liu, and G. Allen, “A Survey on Factors Preventing the Adoption of Automated Software Testing: A Principal Component Analysis Approach,” Software, vol. 3, no. 1, pp. 1–27, 2024, doi: 10.3390/software3010001.
R. Haas, R. Nömmer, E. Juergens, and S. Apel, “Optimization of Automated and Manual Software Tests in Industrial Practice: A Survey and Historical Analysis,” IEEE Transactions on Software Engineering, vol. 50, no. 8, pp. 2005–2020, 2024, doi: 10.1109/TSE.2024.3418191.
M. Leotta, B. García, F. Ricca, and J. Whitehead, “Challenges of End-to-End Testing with Selenium WebDriver and How to Face Them: A Survey,” in Proceedings of the 16th IEEE International Conference on Software Testing, Verification and Validation (ICST), 2023, pp. 339–350. doi: 10.1109/ICST57152.2023.00039.
C. Ragkhitwetsagul, J. Krinke, M. Choetkiertikul, T. Sunetnanta, and F. Sarro, “Adoption of Automated Software Engineering Tools and Techniques in Thailand,” Empir. Softw. Eng., vol. 29, no. 4, p. 90, 2024, doi: 10.1007/s10664-024-10472-6.
S. Balsam and D. Mishra, “Web Application Testing—Challenges and Opportunities,” Journal of Systems and Software, vol. 219, p. 112186, 2025, doi: 10.1016/j.jss.2024.112186.
U. Sa’adah et al., “Framework Testing Otomatis Berbasis Serenity dan Jenkins,” Jurnal Ilmiah Teknologi Informasi (JUTI), vol. 19, no. 2, pp. 102–110, 2021, doi: 10.12962/j24068535.v19i2.a1017.
A. Amalia and A. B. Cahyono, “Analisis Pemanfaatan Playwright untuk Automasi Pengujian Aplikasi Berbasis Web (Studi Kasus: Sistem Manajemen Jaringan),” AUTOMATA, vol. 3, no. 1, pp. 1–8, 2022, [Online]. Available: https://journal.uii.ac.id/AUTOMATA/article/view/21896
M. Corporation, “Playwright Documentation: Core Concepts.” [Online]. Available: https://playwright.dev/docs/intro
S. Software, “State of Software Quality | Testing 2024.” [Online]. Available: https://smartbear.com/state-of-software-quality/testing/2024/
M. Leotta, F. Ricca, A. Marchetto, and D. Olianas, “An empirical study to compare three web test automation approaches: NLP‐based, programmable, and capture&replay,” Journal of Software: Evolution and Process, vol. 36, no. 5, May 2024, doi: 10.1002/smr.2606.
“ISO/IEC/IEEE International Standard - Software and systems engineering --Software testing --Part 1:General concepts,” Dec. 2021, doi: 10.1109/IEEESTD.2022.9698145.
Y. Wang, M. V Mäntylä, Z. Liu, J. Markkula, and P. Raulamo-Jurvanen, “Improving Test Automation Maturity: A Multivocal Literature Review,” Software Testing, Verification and Reliability, vol. 32, no. 3, p. e1804, 2022, doi: 10.1002/stvr.1804.
B. Karagöz, F. Ricca, M. Biagiola, and A. Stocco, “Towards Automated Page Object Generation for Web Testing using Large Language Models,” in 2026 IEEE International Conference on Software Testing, Verification and Validation (ICST), IEEE, May 2026, pp. 352–363. doi: 10.1109/ICST69053.2026.00055.
F. Ricca and A. Stocco, “Web Test Automation: Insights from the Grey Literature,” in Proceedings of the 47th International Conference on Current Trends in Theory and Practice of Computer Science (SOFSEM 2021), Lecture Notes in Computer Science, vol. 12607, Springer, 2021, pp. 472–485. doi: 10.1007/978-3-030-67731-2_35.
C. Wohlin, “Case Study Research in Software Engineering—It is a Case, and it is a Study, but is it a Case Study?,” Inf. Softw. Technol., vol. 133, p. 106514, May 2021, doi: 10.1016/j.infsof.2021.106514.
Rahmat Fauzan, Ferina Putri Soedjono, Annisa Ayu Permadani, and Muhammad Ainul Yakin, “Perbandingan Pengujian Manual dan Terotomasi pada Software Enterprise Resource Planning,” Journal of Advances in Information and Industrial Technology, vol. 5, no. 1, pp. 23–30, May 2023, doi: 10.52435/jaiit.v5i1.318.
A. U. Afidah and D. G. P. Putri, “Studi Komparasi Teknik Pengujian End-to-End pada E-payment: Studi Kasus Travelink (Sistem Web E-ticketing),” Journal of Internet and Software Engineering, vol. 5, no. 2, pp. 50–58, Nov. 2024, doi: 10.22146/jise.v5i2.11741.
C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, and A. Wesslén, Experimentation in Software Engineering. Berlin, Heidelberg: Springer Berlin Heidelberg, 2024. doi: 10.1007/978-3-662-69306-3.
Dewandra Sapto Prasetyo and W. Silfianti, “ANALISIS PERBANDINGAN PENGUJIAN MANUAL DAN AUTOMATION TESTING PADA WEBSITE E-COMMERCE,” Jurnal Ilmiah Teknik, vol. 2, no. 2, pp. 127–131, May 2023, doi: 10.56127/juit.v2i2.516.
M. Stavtsev and Y. Bugayenko, “Evaluating the Dependency Between Cyclomatic Complexity and Response For Class,” pp. 1–5, Oct. 2024.
