Modeling of publication performance using a system dynamics approach: Evidence from Kazakhstan
-
DOIhttp://dx.doi.org/10.21511/kpm.09(2).2025.13
-
Article InfoVolume 9 2025, Issue #2, pp. 184-199
- 18 Views
-
1 Downloads
This work is licensed under a
Creative Commons Attribution 4.0 International License
Type of the article: Research Article
Scientific productivity is one of the key benchmarks to evaluate the development of a country in terms of innovation potential and competitiveness in the global academic environment. This study investigates the impact of key factors such as faculty workload and satisfaction, career dynamics, institutional environment, and research funding on publication performance. The methodology is based on system dynamics (SD), a simulation approach that assesses the dynamic impact of multiple factors on the publication performance. The approach combines causal-loop analysis, stock-and-flow diagrams, sensitivity testing, and Monte Carlo simulations, with Kazakhstan serving as a case country. The data on the factors, including from the global literature and statistics from Kazakhstan, were simulated to forecast publication performance and research output through 2030. Sensitivity analysis identified six dominant factors affecting the number of researchers: average wage growth rate, Ph.D. growth rate, average author tenure, normal workload, job satisfaction, and productivity rate. In contrast, the number of publications was most influenced by the research expenditure per paper, government investment growth rate, and private sector investment growth rate. The study findings from Kazakhstan can serve as “lessons learned” and assist researchers and policymakers working in the science policy and evaluation area in identifying high-impact factors and formulating more effective strategies to enhance the scientific knowledge creation of a country.
Acknowledgments
This paper has been funded by the Science Committee MSHE RK (Grant “Modernization of the quality assurance system of higher education in Kazakhstan based on digitalization: development of approaches, mechanisms and information base” BR24992974).
- Keywords
-
JEL Classification (Paper profile tab)C63, E37, I23
-
References48
-
Tables6
-
Figures7
-
- Figure 1. Factors affecting publication performance (SD modeling created)
- Figure 2. Sensitivity analysis of the subsystem (Authors)
- Figure 3. Sensitivity analysis of the subsystem (Papers published)
- Figure 4. MC simulation results for the number of authors under ±10% variation
- Figure 5. MC simulation results for the number of authors under ±20% variation
- Figure 6. MC sensitivity graphs of the stock variable Papers published under ±10% variation
- Figure 7. MC sensitivity graphs of the stock variable Papers published under ±20% variation
-
- Table 1. Variables in the subsystem (Authors)
- Table 2. Variables in the subsystem (Papers published)
- Table 3. Control limits for the MC simulation of the Authors and Papers published
- Table 4. MC forecast of the number of authors in 2030
- Table 5. MC forecast of the Papers published in 2030
- Table A1. Critical factors used for SD modeling
-
- Abramo, G., D’Angelo, C. A., & Di Costa, F. (2009). Research collaboration and productivity: Is there correlation? Higher Education, 57(2), 155-171.
- Amirbekova, D., Narbaev, T., & Kussaiyn, M. (2022). The research environment in a developing economy: reforms, patterns, and challenges in Kazakhstan. Publications, 10(4), 37.
- Bornmann, L., & Mutz, R. (2014). Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references. Journal of the Association for Information Science and Technology, 66(11), 2215-2222.
- Bureau of National Statistics of the Republic of Kazakhstan (BNSRK). (2024). Zarabotnaya plata vo vtorom kvartale 2024 goda [Wages in the second quarter of 2024]. (In Russian).
- Castelblanco, G., Guevara, J., Mangano, G., & Rafele, C. (2024a). Financial system dynamics model for multidimensional flexibility in toll road PPPs: a life-cycle analysis. Construction Management and Economics, 42(9), 802-821.
- Castelblanco, G., Narbaev, T., Osei-Kyei, R., Serikbay, D., Mukashev, Y., & Guevara, J. (2024b). Pandemic risks in PPPs: comparative analysis within developing countries. International Journal of Construction Management, 25(4), 456-468.
- Chatterjee, B., Cordery, C. J., De Loo, I., & Letiche, H. (2020). The spectacle of research assessment systems: Insights from New Zealand and the United Kingdom. Accounting, Auditing & Accountability Journal, 33(6), 1219-1246.
- Cole, J. R., & Cole, S. (1973). Social stratification in science. Chicago: University of Chicago Press.
- De Marco, A., & Narbaev, T. (2021). Factors of schedule and cost performance of tunnel construction megaprojects. Open Civil Engineering Journal, 15(1), 38-49.
- De Marco, A., Ottaviani, F. M., & Bolognesi, F. (2024). Time series-based project cost forecasting framework. Procedia Computer Science, 239, 105-113.
- Ding, T., Zhang, Y., Zhang, D., & Li, F. (2023). Performance evaluation of Chinese research universities: A parallel interactive network DEA approach with shared and fixed sum inputs. Socio-Economic Planning Sciences, 87, 101582.
- Dundar, H., & Lewis, D. R. (1998). Determinants of research productivity in higher education. Research in Higher Education, 39(6), 607-631.
- Erkoc, T. E. (2015). Assessing the research performance in higher education with stochastic distance function approach. International Journal of Education Economics and Development, 6(4), 366.
- Fishman, G. S. (1996). Monte Carlo: Concepts, algorithms, and applications. New York, NY: Springer.
- Garfield, E. (1972). Citation analysis as a tool in journal evaluation. Science, 178(4060), 471-479.
- Ghabban, F., Selamat, A., Ibrahim, R., Krejcar, O., Maresova, P., & Herrera-Viedma, E. (2019). The influence of personal and organizational factors on researchers’ attitudes towards sustainable research productivity in Saudi universities. Sustainability, 11(17), 4804.
- Graf, H., & Kalthaus, M. (2018). International research networks: Determinants of country embeddedness. Research Policy, 47(7), 1198-1214.
- Green, R. G., Baskind, F. R., & Bellin, M. H. (2002). Results of the doctoral faculty publication project: Journal article productivity and its correlates in the 1990s. Journal of Social Work Education, 38(1), 135-152.
- Heilig, L., & Voß, S. (2015). A scientometric analysis of public transport research. Journal of Public Transportation, 18(2), 111-141.
- Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. PNAS, 102(46), 16569-16572.
- Jamali, D., Samara, G., & Meho, L. I. (2024). Determinants of research productivity and efficiency among the Arab world’s accredited business schools. Management Review Quarterly, 74(4), 2511-2543.
- Kancs, A., & Siliverstovs, B. (2016). R&D and non-linear productivity growth. Research Policy, 45(3), 634-646.
- Karlsson, M., Trygg, L., & Elfström, B. O. (2004). Measuring R&D productivity: Complementing the picture by focusing on research activities. Technovation, 24(3), 179-186.
- Kleijnen, J. (1995). Sensitivity analysis of system dynamics models: Regression analysis and statistical design. System Dynamics Review, 11(4), 275-288.
- Larivière, V., Haustein, S., & Mongeon, P. (2015) The oligopoly of academic publishers in the digital era. PLOS ONE, 10(6).
- Menon, B. G., Ghatak, S. K., Mahanty, B., & Sahadev, S. (2018). Modeling doctoral population growth in premier technology institutions in India. Systems Research and Behavioral Science, 35(6), 738-745.
- Merton, R. K. (1968). The Matthew effect in science. Science, 159(3810), 56-63.
- Narbaev, T., & Amirbekova, D. (2021). Research productivity in emerging economies: empirical evidence from Kazakhstan. Publications, 9(4), 51.
- Narbaev, T., Hazir, Ö., Khamitova, B., & Talgat, S. (2024). A machine learning study to improve the reliability of project cost estimates. International Journal of Production Research, 62(12), 4372-4388.
- National Center of Science and Technology Evaluation (NCSTE). (2020). Nauka Kazakhstana v Tsifrakh 2015–2019 [Science of Kazakhstan in Numbers 2015–2019]. (In Russian).
- National Center of Science and Technology Evaluation (NCSTE). (2023). Nauka Kazakhstana v Tsifrakh 2018–2022 [Science of Kazakhstan in Numbers 2018–2022]. (In Russian).
- Negash, M., Lemma, T. T., & Samkin, G. (2019). Factors impacting accounting research output in developing countries: An exploratory study. The British Accounting Review, 51(2), 170-192.
- Ottaviani, F. M., Rebuglio, M., & De Marco, A. (2023). Project management information system data model development and explanation. Proceedings of the 13th International Conference on Simulation and Modeling Methodologies, Technologies and Applications SIMULTECH, Vol. 1 (pp. 210-217). Rome, Italy.
- Pajo, A. T., Espiritu, A. I., & Jamora, R. D. G. (2020). Scientific impact of movement disorders research from Southeast Asia: A bibliometric analysis. Parkinsonism & Related Disorders, 81, 205-212.
- Panikarova, S., Vlasov, M., & Boyko, I. (2017). Assessing research productivity in university environment: Institutional approach. Journal of Information & Knowledge Management, 16(02), 1750016.
- Pastor, J. M., Serrano, L., & Zaera, I. (2015). The research output of European higher education institutions. Scientometrics, 102(3), 1867-1893.
- Price, D. J. de S. (1963). Little science, big science. New York, NY: Columbia University Press.
- Rørstad, K., & Aksnes, D. W. (2015). Publication rate expressed by age, gender and academic position: A large-scale analysis of Norwegian academic staff. Journal of Informetrics, 9(2), 317-333.
- Samoilov, A., Narbaev, T., Castelblanco, G., & Mukashev, Y. (2024a). Evaluating public-private partnership dynamics: the Kazakhstan toll road case. Eurasian Journal of Economic and Business Studies, 68(1), 131-141.
- Samoilov, A., Osei-Kyei, R., Kussaiyn, M., Mamyrbayev, A., & Mukashev, Y. (2024b). Cross-country comparison of risk factors in public–private partnerships in infrastructure development: Evidence from Colombia, Kazakhstan, and Ghana. Sustainability, 16(13), 5712.
- Shkarupa, O., Vlasenko, D., Makedon, H., Bilan, S., & Serafimova, D. (2022). Economy of knowledge and transfer of innovations: Ukraine’s progress through the lens of European development trends. Knowledge and Performance Management, 6(1), 100-113.
- Sterman, J. (2000). System Dynamics: Systems thinking and modeling for a complex world. Boston: McGraw Hill.
- Uyar, A., Kuzey, C., & Karamahmutoglu, M. K. (2022). Macroeconomic factors, R&D expenditure and research productivity in economics and finance. Managerial Finance, 48(5), 733-759.
- Ventana Systems, Inc. (Vensim). (2019). Introduction & Tutorials. Electronic documentation.
- Ventana Systems, Inc. (Vensim). (2025). Vensim PLE Plus.
- Vuong, Q.H., Napier, N. K., Ho, T. M., Nguyen, V. H., Vuong, T. T., Pham, H. H., & Nguyen, H. K. T. (2019). Effects of work environment and collaboration on research productivity in Vietnamese social sciences: evidence from 2008 to 2017 Scopus data. Studies in Higher Education, 44(12), 2132-2147.
- Wamala, R., & Ssembatya, V. A. (2015). Productivity in academia. Quality Assurance in Education, 23(2), 184-195.
- Zhang, L. (2017). The knowledge spillover effects of FDI on the productivity and efficiency of research activities in China. China Economic Review, 42, 1-14.