Development of a Web-Based ETL Automation System to Support Monthly Reports
DOI:
https://doi.org/10.62535/2nepa911Keywords:
centralized repository, data cleansing, ETL, monthly report, rapid application development method, schema validationAbstract
The process of preparing monthly reports in the Asset Accounting Department of PT RS was hampered by manual data transformation and the lack of centralized storage, which caused historical data to be scattered, difficult to track, and vulnerable to human error. This condition prompted the development of a web-based Extract, Transform, Load automation system that integrates data cleansing, schema validation, a centralized repository, and a reporting dashboard as a replacement for external Business Intelligence tools. The methodology used was Rapid Application Development with Python (Flask) and MySQL. The system was tested through Alpha Testing with Black Box Testing using the Equivalence Partitioning technique for 34 test cases resulting in a validation percentage of 100%. Beta Testing to 8 respondents resulted in a feasibility of 96.4% (Admin) and 99.1% (User) in the "Very Feasible" category, as well as Performance Testing with an error rate of 0.00% at normal load and 0.30% at high load, as well as a stable throughput of 3.1 transactions per minute. These test results confirmed that the system met all acceptance criteria and was suitable to support a more efficient monthly report process.
References
Agarwal, P., Singhal, A., & Garg, A. (2017). SDLC Model Selection Tool and Risk Incorporation. International Journal of Computer Applications, 172(10), 6–10. https://doi.org/10.5120/ijca2017915143
Basid, I. A. M., Islamiyah, N., Zuleika, R. A., Inka, A., Andarini, S., & Kusumasari, I. R. (2024). Peran Teknologi Informasi dalam Perencanaan dan Pengembangan Bisnis di Era Digital: Tantangan dan Peluang. Economics And Business Management Journal, 3(1).
Fatha, M. K., Wati, S. F. A., Dewa, B. S., & Prasetyo, K. E. (2023). Peran Big Data Pada Intelijen Bisnis Sebagai Sistem Pendukung Keputusan (Systematic Literature Review). Prosiding Seminar Nasional Teknologi dan Sistem Informasi, 3(1), 318–326. https://doi.org/10.33005/sitasi.v3i1.612
Firdaus, M., & Shedriko, S. (2024). Implementasi ETL dan Pengolahan Data Pelaporan Basel-III OJK di Bank Umum. Seminar Nasional Riset dan Inovasi Teknologi, 8(01). https://doi.org/10.30998/semnasristek.v8i01.7131
Fitriawan, M. D. (2024). Analisis dan Visualisasi Data Penjualan di Toko Baju Sederhana Menggunakan Power BI (Pt. 783-793). Jurnal Sistem Informasi, 2(10).
Hakky, M. K., Wirasasmita, R. H., & Uska, M. Z. (2018). Pengembangan Media Pembelajaran Berbasis Android untuk Siswa Kelas X Pada Mata Pelajaran Sistem Operasi. Jurnal Pendidikan Informatika, 2(1), 24. https://doi.org/10.29408/edumatic.v2i1.868
Hambling, B., & Goethem, P. van. (2013). User Acceptance Testing: A step-by-step guide. BCS Learning and Development Ltd.
Hardika, B., Kurniawan, M. D., Adzka, M., Prastowiyono, D., Banyubasa, A., Wicaksono, A., & Nasir, M. (2024). Pengujian Blackbox Testing Website Garuda Farm Menggunakan Teknik Equivalence Partitioning. Jurnal Kridatama Sains dan Teknologi, 6(02), 740–753. https://doi.org/10.53863/kst.v6i02.1420
Hidayat, A., Martini, R., Ristianingrum, A., Priatna, W. B., Indrawan, P., Manalu, D. S. T., Wiraguna, E., Dewi, H., Dewi, S. P., Pratama, A. J., Ratnawati, B., Putri, R. G. H., Manaf, I., Balqis, N., Hanafi, M. H., Ginting, K. J., Rizkialita, A., Darma, R. Y. B., Darmawan, M. D. M., & Siskandar, R. (2024). Predictions and Policies on Carbon Footprint Release Data at the College of Vocational Studies, IPB University (SV IPB) Based on the Contribution of Campus Operational Activities. Environment and Ecology Research, 12(1), 40–53. https://doi.org/10.13189/eer.2024.120105
Hidayat, A. P., Wiyoto, W., Julio Pratama, A., Vibowo, H., Husen Santosa, S., & Siskandar, R. (2023). Fuzzy Analytical Hierarchy Process (AHP) Model for Chicken Egg Supply and Demand Management Strategies Through SAFCES Application Development. E3S Web of Conferences, 454, 03004. https://doi.org/10.1051/e3sconf/202345403004
Hosen, M. S., Islam, R., Naeem, Z., Folorunso, O., Chu, T. S., Al, M. A., & Orunbon, N. O. (2024). Data-Driven Decision Making: Advanced Database Systems for Business Intelligence. Nanotechnology Perceptions, 20(S3). https://doi.org/10.62441/nano-ntp.v20iS3.768
Irzaman, Suryana, Y., Pambudi, S., Widayanti, T., Jenie, R. P., Prastowo, B., Har, N. P., Rahmawaty, V., Dahrul, M., Aminullah, Kurniawan, A., Siskandar, R., Hardyanto, I., Iskandar, J., Nurdin, N. M., Ardidarma, A., Rahayu, S. K., & Alatas, H. (2022). Development of blood hemoglobin level early detection device based on a noninvasive optical platform. Heliyon, 8(11), e11260. https://doi.org/10.1016/j.heliyon.2022.e11260
Kusuma, A. P., & Yufron, A. (2024). Analysis of User Acceptance Testing on A Shipping Application to Determine The Quality of The System. Antivirus : Jurnal Ilmiah Teknik Informatika, 18(2), 234–243. https://doi.org/10.35457/antivirus.v18i2.4002
Listy, V., & Ilham. (2025). Revolusi Sistem Informasi Manajemen di Era AI dan Big Data Mengubah Cara Bisnis Bekerja. Jurnal Sistem Informasi Dan Informatika, 5(1). https://doi.org/10.31294/simpatik.v5i1.7621
Manik, J. S. R., Yuaziva, A., Maulidya, I., Farah Fakhirah, S., & Siskandar, R. (2026). Digitalization of Forestry Museum Visiting Services Through the Implementation of a Reservation and Scheduling Platform. Journal of Applied Science, Technology & Humanities, 3(3), 1185–1217. https://doi.org/10.62535/h1seca22
Maulidya, I., Salma, C. O. P., Ramadhani, K. A., Farizi, A., Beda, G. H. K., Wirawisesa, R. B. A., Wicaksono, A., & Nasir, M. (2024). Pengembangan Sistem Pencatatan Pesanan Berbasis Website dengan Pendekatan Equivalence Partitioning pada Tahap Pengujian Black Box. Bina Insani ICT Journal, 11(2), 154. https://doi.org/10.51211/biict.v11i2.3233
Mindara, G. P., Sholihah, W., Novianty, I., Marcelita, F., Siskandar, R., Ariyanto, D., Setiawan, A., & Firdaus, N. R. (2025). Calibration of Dissolved Oxygen Sensors in IoT Systems for Water Quality Monitoring in Aquaculture. Jurnal Fisika Dan Aplikasinya, 10(3). https://doi.org/doi.org/10.21009/SPEKTRA
Muku, I. D. G. D. B., Bayupati, I. P. A., & Susila, A. A. N. H. (2023). Pengembangan Sistem Business Intelligence Dalam Monitoring Performa Perusahaan Multi Company. SINTECH (Science and Information Technology) Journal, 6(2), 99–106. https://doi.org/10.31598/sintechjournal.v6i2.1394
Muzahra, N., & Nasution, M. I. P. (2025). Strategi Untuk Menjaga Konsistensi dan Akurasi Data Dalam Pengambilan Keputusan. Jurnal Ilmiah Nusantara, 2(4). https://doi.org/10.61722/jinu.v2i4.5023
Novianty, I., Ferdika, A., Sholihah, W., Siskandar, R., & Sari, I. P. (2019). Design of Portable Weather Station Using MQTT Protocol. 2019 2nd International Conference of Computer and Informatics Engineering (IC2IE), 199–202. https://doi.org/10.1109/IC2IE47452.2019.8940893
Nuryana, M. L., Ibrahim, T., & Arifudin, O. (2024). Implementasi dan Transformasi Sistem Informasi Manajemen Di Era Digital. Jurnal Tahsinia, 5(9). https://doi.org/10.57171/jt.v5i9.614
Prasetia, I. P. W., & Kurniawan, I. N. H. (2021). Implementasi ETL (Extract, Transform, Load) pada Data warehouse Penjualan Menggunakan Tools Pentaho. Information Technology Journal, 2(1). https://doi.org/10.38043/tiers.v2i1.2844
Santosa, S. H., Hidayat, A. P., & Siskandar, R. (2021). SAFEA application design on determining the optimal order quantity of chicken eggs based on fuzzy logic. IAES International Journal of Artificial Intelligence (IJ-AI), 10(4), 858. https://doi.org/10.11591/ijai.v10.i4.pp858-871
Santosa, S. H., Prayudha Hidayat, A., Siskandar, R., & Rizkiriani, A. (2023). Production Scheduling Based on Smart Forecasting Model of Bottled Mineral Water Products. E3S Web of Conferences, 454, 03003. https://doi.org/10.1051/e3sconf/202345403003
Sartika, I. E., & Aritonang, R. DP. (2025). Pengaruh Input Data yang Akurat, Input Data Secara Tepat Waktu, Kejelasan Data yang Diinputdan Kelengkapan Data yang Diinput pada Aplikasi Sakti Terhadap Kualitas Laporan Keuangan di Direktorat Jenderal Pendidikan Anak Usia Dini, Pendidikan Dasar dan Menengah. Journal of Accounting and Finance Management, 6(2). https://doi.org/10.38035/jafm.v6i2.1941
Siskandar, R., Dio, F. C., & Irzaman. (2021). Application Of Ba0.5Sr0.5TiO3 (Bst) Film Doped With RuO2 (0%, 2%, 4% and 6%) On A Rice-Stalk Cutting Robot Model Based On A Line Follower With Hc-05 Bluetooth Control. Biointerface Research in Applied Chemistry, 12(2), 2138–2151. https://doi.org/10.33263/BRIAC122.21382151
Siskandar, R., Hidayat, A., Martini, R., Ristianingrum, A., Manalu, D. S. T., Priatna, W. B., Indrawan, P., Wiraguna, E., Dewi, H., Dewi, S. P., Pratama, A. J., Ratnawati, B., Kharismatunnisaa, F., Darmawan, M. D. M., Nurfadillah, F., Sitompu, E. A., Sabilla, C. H., Assariy, M. F., & Zulqisthi, D. (2024). SoltarinE: Solar charging station eco friendly as a charging solution for electric farm machinery. E3S Web of Conferences, 577, 01011. https://doi.org/10.1051/e3sconf/202457701011
Siskandar, R., Indrawan, N. A., Kusumah, B. R., Santosa, S. H., Irmansyah, I., & Irzaman, I. (2020). PENERAPAN REKAYASA MESIN SORTIR SEBAGAI PENENTU KEMATANGAN BUAH JERUK DAN TOMAT MERAH BERBASIS IMAGE PROCESSING. Jurnal Teknik Pertanian Lampung (Journal of Agricultural Engineering), 9(3), 222. https://doi.org/10.23960/jtep-l.v9i3.222-236
Siskandar, R., & Kusumah, B. R. (2019). Control Device Engineering for Aquaponic Monitoring System. Aquacultura Indonesiana, 20(2), 72. https://doi.org/10.21534/ai.v20i2.151
Siskandar, R., Mandang, T., Hermawan, W., & Irzaman, I. (2023a). Engineering of Information Monitoring System Sensor Reading Data Based on Smart Wireless using NVDIA Jetson Nano and Arduino Mega on Agricultural Spraying Machines. Jurnal Teknik Pertanian Lampung (Journal of Agricultural Engineering), 12(4), 921. https://doi.org/10.23960/jtep-l.v12i4.921-936
Siskandar, R., Mandang, T., Hermawan, W., & Irzaman, I. (2023b). Thin Film Potential Ba0.5Sr0.5TiO3 (BST) doped with RuO2 6% as a Light Detecting Sensor at Solar Tracker ALSINTAN System in Microcontroller-Based. Biointerface Research in Applied Chemistry, 13(6), 545. https://doi.org/10.33263/BRIAC136.545
Siskandar, R., Santosa, S. H., Hidayat, A. P., Suwanda, B. S., Vibowo, H., Barokah, W. T., Habiburrahman, M., Faqihhudin, M. R., & Nerol, I. D. (2025). Pelatihan Pengembangan Alat Komunikasi Cerdas Keamanan Lingkungan Berbasis Smartphone di Karang Taruna Desa Pakapasan Girang, Kabupaten Kuningan, Jawa Barat. Jurnal Pengabdian Masyarakat Bhinneka, 3(4), 774–784. https://doi.org/10.58266/jpmb.v3i4.259
Siskandar, R., Santosa, S. H., Wiyoto, W., Kusumah, B. R., & Hidayat, A. P. (2022). Control and Automation: Insmoaf (Integrated Smart Modern Agriculture and Fisheries) on The Greenhouse Model. Jurnal Ilmu Pertanian Indonesia, 27(1). https://doi.org/10.18343/jipi.27.1.141
Siskandar, R., Wiyoto, W., Hendriana, A., Ekasari, J., Kusumah, B. R., Halim, G., & Nugraha, I. J. (2022). Automated Redox Monitoring System (ARMS): An Instrument for Measuring Dissolved Oxygen Levels Using a Potential Redox Sensor (ORP) in a Prototype of Shrimp Farming Pond with an Internet-Based Monitoring System. Journal of Aquaculture and Fish Health, 11(2), 238–246. https://doi.org/10.20473/jafh.v11i2.31487
Siskandar, R., Wiyoto, W., Santosa, S. H., Hidayat, A. P., Kusumah, B. R., & Darmawan, M. D. M. (2023). Prediction of Freshwater Fish Disease Severity Based on Fuzzy Logic Approach, Arduino IDE and Proteus ISIS. Universal Journal of Agricultural Research, 11(6), 1089–1101. https://doi.org/10.13189/ujar.2023.110616
Siskandar, R., Wiyoto, W., Santosa, S. H., Sari, J. E., Darmawangsa, G. M., Hidayat, A. P., Dardanella, D., & Kusumah, B. R. (2023). Potential Readings of Water Turbidity Values Based on Optical Sensors on Fish-Rearing Biofloc Media. Photonics Letters of Poland, 15(1), 1–3. https://doi.org/10.4302/plp.v15i1.1176
Stephens, R. (2012). Beginning Software Engineering (1st ed.). Wiley. https://doi.org/10.1002/9781119209515
Sudiantini, D., Naiwasha, A., Izzati, A., W, A. A., A, B. P., & Rindiani, C. (2023). Penggunaan Teknologi Pada Manajemen Sumber Daya Manusia Di Dalam Era Digital Sekarang. Digital Bisnis: Jurnal Publikasi Ilmu Manajemen dan E-Commerce, 2(2), 262–269. https://doi.org/10.30640/digital.v2i2.1082
Syaifullah, M. H. (2024). Visualisasi Data Kebencanaan Kabupaten Jepara Menggunakan Microsoft Power BI. Journal of Information System and Computer, 4(1). https://doi.org/10.34001/jister.v4i1.835
