Data-Driven Evaluation of AI Tool-Specific Impacts, Equity Disparities, and Sustainable Adoption Framework for AI-Enhanced Learning in Pakistani Higher Education

Abstract

Artificial intelligence (AI) is transforming higher education, yet adoption in developing countries such as Pakistan remains constrained by limited empirical evidence, unequal access, and a lack of context-specific implementation frameworks. Existing Pakistani studies rely largely on self-reported perceptions from single urban regions, treat diverse AI tools as one category, and provide generalized recommendations without quantifiable impact analysis. This study proposes a data-driven, multi-region, twelve-month longitudinal evaluation of AI-enhanced learning across public and private universities in Punjab, Sindh, Khyber Pakhtunkhwa, Balochistan, and Islamabad Capital Territory. Using stratified random sampling, it distinguishes four tool classes: generative AI assistants, intelligent tutoring systems, NLP-based feedback tools, and predictive analytics platforms. Actual usage logs will be correlated with objective outcomes, including grade point averages, assessment scores, course completion rates, and retention metrics. The study will also examine disparities by gender, socioeconomic status, urban-rural location, and discipline, while evaluating risks of algorithmic bias, privacy breaches, and exclusion. Findings will inform a sustainable adoption framework comprising a cost-effective institutional implementation model, a tiered teacher-training roadmap, and a privacy- and ethics-compliant governance protocol aligned with Pakistan’s regulatory context. The study offers two contributions: a quantified, tool-specific evidence base on AI’s differential effects on teaching and learning, and a practical framework for policymakers and university leaders to scale AI integration equitably and sustainably. By connecting verified usage patterns with measurable outcomes across diverse institutions, the research moves beyond perception-based advocacy toward accountable, evidence-driven adoption in resource-constrained higher education systems while supporting accountability, educational quality, and inclusive digital transformation nationwide.

REFERENCES

[1] O. Zawacki-Richter, V. I. Marin, M. Bond, and F. Gouverneur, "Systematic review of research on artificial intelligence applications in higher education—where are the educators?" Int. J. Educ. Technol. Higher Educ., vol. 16, no. 1, art. 39, 2019.

[2] W. Holmes, M. Bialik, and C. Fadel, Artificial Intelligence in Education: Promises and Implications for Teaching and Learning. Boston, MA, USA: Center for Curriculum Redesign, 2019.

[3] I. Roll and R. Wylie, "Evolution and revolution in artificial intelligence in education," Int. J. Artif. Intell. Educ., vol. 26, no. 2, pp. 582–599, 2016.

[4] K. VanLehn, "The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems," Educ. Psychologist, vol. 46, no. 4, pp. 197–221, 2011.

[5] A. T. Corbett and J. R. Anderson, "Knowledge tracing: Modeling the acquisition of procedural knowledge," User Model. User-Adapt. Interact., vol. 4, no. 4, pp. 253–278, 1994.

[6] C. Piech et al., "Deep knowledge tracing," in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), vol. 28, 2015.

[7] K. R. Koedinger, J. R. Anderson, W. H. Hadley, and M. A. Mark, "Intelligent tutoring goes to school in the big city," Int. J. Artif. Intell. Educ., vol. 8, no. 1, pp. 30–43, 1997.

[8] B. Williamson and R. Eynon, "Historical threads, missing links, and future directions in AI in education," Learn. Media Technol., vol. 45, no. 3, pp. 351–359, 2020.

[9] N. Selwyn, Education and Technology: Key Issues and Debates, 2nd ed. London, U.K.: Bloomsbury, 2017.

[10] UNESCO, Artificial Intelligence in Education: Challenges and Opportunities for Sustainable Development. Paris, France: UNESCO, 2021.

[11] UNESCO, Guidance for Generative AI in Education and Research. Paris, France: UNESCO, 2023.

[12] OECD, AI and the Future of Skills: Outlook 2030. Paris, France: OECD Publishing, 2021.

[13] E. Kasneci et al., "ChatGPT for good? On opportunities and challenges of large language models for education," Learn. Individ. Differ., vol. 103, art. 102274, 2023.

[14] J. Rudolph, S. Tan, and S. Tan, "ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?" J. Appl. Learn. Teach., vol. 6, no. 1, pp. 1–11, 2023.

[15] A. Tlili et al., "What if the devil is my guardian angel: ChatGPT use in higher education," Int. Rev. Res. Open Distrib. Learn., vol. 24, no. 2, pp. 1–21, 2023.

[16] H. Crompton and D. Burke, "The use of ChatGPT in higher education: A scoping review," Int. J. Educ. Technol. Higher Educ., vol. 20, art. 23, 2023.

[17] R. S. Baker and P. S. Inventado, "Educational data mining and learning analytics," in Learning Analytics: From Research to Practice. New York, NY, USA: Springer, 2014, pp. 61–75.

[18] G. Siemens, "Learning analytics: The emergence of a discipline," Am. Behav. Sci., vol. 57, no. 10, pp. 1380–1400, 2013.

[19] R. Ferguson, "Learning analytics: Drivers, developments and challenges," Int. J. Technol. Enhanc. Learn., vol. 4, nos. 5–6, pp. 304–317, 2012.

[20] A. J. van Deursen and J. A. van Dijk, "The digital divide shifts to differences in usage," New Media Soc., vol. 21, no. 3, pp. 509–526, 2019.

[21] W. Holmes and I. Tuomi, Artificial Intelligence in Education: A Guide for Policy-Makers. Seville, Spain: European Commission, Joint Research Centre, 2022.

[22] World Bank, World Development Report 2018: Learning to Realize Education's Promise. Washington, DC, USA: World Bank, 2018.

[23] Higher Education Commission of Pakistan, HEC Yearbook / Annual Report. Islamabad, Pakistan: HEC, 2023.

[24] B. P. Woolf, "A roadmap for education AI," AI Mag., vol. 31, no. 3, pp. 59–71, 2010.

[25] B. D. Nye, "Global intelligent tutoring systems," in Handbook of Research on Educational Communications and Technology, 4th ed. New York, NY, USA: Springer, 2014, pp. 1023–1035.

[26] J. R. Anderson, A. T. Corbett, K. R. Koedinger, and R. Pelletier, "Cognitive tutors: Lessons learned," J. Learn. Sci., vol. 4, no. 2, pp. 167–207, 1995.

[27] A. C. Graesser, D. S. McNamara, and K. VanLehn, "Scaffolding deep comprehension strategies through Point&Query, AutoTutor, and iSTART," Educ. Psychologist, vol. 40, no. 4, pp. 225–234, 2005.

[28] B. Maryam, A. Akbar, M. Farooq, M. Ali, T. Fatima, and A. Mujeeb, "Artificial intelligence in education: Advancing teaching methodologies and student learning performance," Academia Int. J. Social Sciences, vol. 4, no. 3, pp. 5527–5542, 2025, doi: 10.63056/ACAD.004.03.0816.

[29] A. Al Kium, S. Sarker, S. A. Shikha, M. A. T. Kamal, M. I. K. Jabed, N. K. Munifa, ... D. B. John, "Health equity and digital disparities in cancer screening and cardiovascular care across socioeconomic and ethnic groups: A systematic review," Vascular and Endovascular Review, vol. 6, no. 2, pp. 35–44, 2023.

[30] P. S. Ponduru, "Decision intelligence for AI and emerging technologies: The AEGIS-DM framework for trustworthy, cost-aware, and low-latency decision making," 2024.

[31] P. K. Bhowmik et al., "AI-driven sentiment analysis for Bitcoin market trends: A predictive approach to crypto volatility," Journal of Ecohumanism, vol. 4, no. 4, pp. 266–288, 2025.

[32] M. R. Hasan et al., "Building robust AI and machine learning models for supplier risk management: A data-driven strategy for enhancing supply chain resilience in the USA," Advances in Consumer Research, vol. 2, no. 4, pp. 1152–1171, 2025.

[33] M. I. K. Jabed, M. Imran, C. A. Gomes, and P. S. Ponduru, "Machine learning-based prediction of poor self-rated health among U.S. adults using behavioral and socioeconomic factors," World Journal of Advanced Research and Reviews, vol. 27, no. 1, pp. 2817–2829, 2025, doi: 10.30574/wjarr.2025.27.1.2649.

[34] M. I. K. Jabed, "Stock market price prediction using machine learning techniques," American International Journal of Sciences and Engineering Research, vol. 7, no. 1, pp. 1–6, Feb. 2024, doi: 10.46545/ajiser.v7i1.308.

[35] P. S. Ponduru, "Road accident prediction using LSTM-GRU neural networks," Doctoral dissertation, California State University, Northridge, 2023.

[36] V. Gummadavelli, U. Imtiaz, P. A. S. H. Kolla, N. S. Bavirisetty and S. R. Kondapalli, "Discovering and repairing blind spots in LLM-as-a-judge evaluation of multi-turn AI systems," in Proc. 2026 Int. Conf. Intell. Sustain. AI Syst. (ICOSAAS), Bali, Indonesia, 2026, pp. 1611–1618, doi: 10.1109/ICOSAAS68663.2026.11648543.

[37] U. Imtiaz, "Ghost signals: Ethical RF adversarial testing of consumer alarm ecosystems," in Data Science and Security, S. Shukla, H. Sayama, K. Tiwari, J. P. George, and J. V. Kureethara, Eds. Cham, Switzerland: Springer, 2026, Lecture Notes in Networks and Systems, vol. 1945, doi: 10.1007/978-3-032-24075-0_21.

[38] F. Amin, "Adaptive cyber risk management framework for critical infrastructures: Integrating IDS, SOC, and CSIRT for resilient threat mitigation," in Data Science and Security, S. Shukla, H. Sayama, K. Tiwari, J. P. George, and J. V. Kureethara, Eds. Cham, Switzerland: Springer, 2026, Lecture Notes in Networks and Systems, vol. 1945, doi: 10.1007/978-3-032-24075-0_20.

[39] F. Amin, "Adversarial vulnerability assessment of social data models for defensive cyber operations," in Data Science and Security, S. Shukla, H. Sayama, K. Tiwari, J. P. George, and J. V. Kureethara, Eds. Cham, Switzerland: Springer, 2026, Lecture Notes in Networks and Systems, vol. 1945, doi: 10.1007/978-3-032-24075-0_16.

[40] F. Amin, "Binary flaw detection: A security analysis paper," in Proc. 2025 Int. Conf. Advances in Machine Intelligence and Cybersecurity Technologies (AMICT), Kota Kinabalu, Sabah, Malaysia, 2025, pp. 325–330, doi: 10.1109/AMICT65811.2025.11402666.

[41] M. A. Rahman, R. K. Devnath, S. B. Niloy, C. M. Mehedi, T. H. Chowdhury, and M. I. K. Jabed, "A stacking ensemble framework for predicting employee turnover: Explainable AI with SHAP," in Proc. 2025 IEEE 2nd Int. Conf. Computing, Applications and Systems (COMPAS), Oct. 2025, pp. 1–6.

[42] M. I. K. Jabed, M. Imran, C. A. Gomes, P. S. Ponduru, S. Mandal, and S. Hassan, "Deep learning and explainable AI framework for predicting lung cancer severity," Journal of Computer Science and Technology Studies, vol. 7, no. 12, pp. 573–598, 2025.

[43] C. A. Gomes, M. I. K. Jabed, T. Ahammad, S. Mandal, S. Hassan, M. K. Sejan, et al., "Operational and financial evidence for generative AI in United States healthcare administrative workflows," Frontiers in Computer Science and Artificial Intelligence, vol. 4, no. 4, pp. 138–145, 2025.

[44] M. I. K. Jabed, M. Imran, A. A. Khan, M. Mehedi, A. Islam, and R. Pervez, "Explainable machine learning framework for early heart disease detection using SMOTE and SHAP," Vascular and Endovascular Review, vol. 9, no. 1, pp. 316–324, 2026.

[45] M. I. K. Jabed, M. R. M. Sirazy, S. Mandal, S. A. Akter, A. Hassan, and H. Esa, "Developing AI-based financial forecasting and cybersecurity systems for the US digital economy," Frontiers in Computer Science and Artificial Intelligence, vol. 5, no. 5, pp. 30–38, 2026.

[46] M. A. Rahman, M. I. K. Jabed, R. K. Devnath, C. M. Mehedi, M. Begum, and T. Mahmud, "MSRFF: An interpretable CNN-Vision Transformer framework for diabetic retinopathy detection," in Proc. 2026 2nd Int. Conf. Computational Intelligence Approaches and Applications (ICCIA), May 2026, pp. 1–7.

[47] M. M. R. Akash, "Cardiotoxicity prediction models in cancer patients using artificial intelligence and genomics," International Journal of Drug Delivery Technology, vol. 16, pp. 60–73.

[48] M. I. K. Jabed, M. A. Manzoor, F. M. Tofa, and M. H. Khan, "Interpretable ensemble learning approach for breast cancer diagnosis using SHAP-based explainable AI," Journal of Computer Science and Technology Studies, vol. 8, no. 8, pp. 244–255, 2026.

[49] M. I. K. Jabed, M. P. Ahmed, F. M. Tofa, M. F. Islam, C. A. Gomes, and R. M. Sirazy, "Federated intrusion detection for Internet of Medical Things networks: Differential privacy, non-IID robustness, and cross-device generalization," Journal of Computer Science and Technology Studies, vol. 8, no. 8, pp. 303–315, 2026.

[50] P. S. Ponduru, P. P. V. Nandanavanam, and S. K. K. Ponduru, "Ecological proportionality in generative AI: The ethics of marginal capability and environmental sufficiency," 2026.

[51] P. S. Ponduru, "SAFE-HealCloud: Safety-aware, agentic self-healing for cloud infrastructure," International Journal of Scientific Research in Computer Science, Engineering and Information Technology, vol. 12, no. 4, pp. 163–188, 2026.

[52] M. Akram, W. Khan, M. D. Rasheed, M. Imran, M. W. Iqbal, A. Delshadi, and M. Sultana, "Cybersecurity risk assessment model for Internet of Medical Things (IoMT) devices in healthcare systems," Spectrum of Engineering Sciences, vol. 4, no. 3, pp. 312–326, 2026.

[53] M. D. Rasheed, M. Akram, M. Imran, R. H. Ahmed, and A. Rauf, "Towards human-centric smart manufacturing: A digital twin enabled affective ergonomic framework for adaptive human robot collaboration," International Journal of Advances in Signal and Image Sciences, pp. 1544–1555, 2025.

[54] M. D. Rasheed, W. Khan, M. Imran, N. Ahmad, Y. Khan, M. Akram, and M. Sultana, "Leveraging artificial intelligence for advance data networking and cybersecurity," Spectrum of Engineering Sciences, vol. 4, no. 3, pp. 286–298, 2026.

[55] N. M. Ali, M. E. Ahmed, M. Fakhrul Islam, C. A. Gomes, and M. S. Islam, "Toward a circular US economy: Green and artificial intelligence innovation, renewable energy, and domestic material consumption," Energy Sources, Part B: Economics, Planning, and Policy, vol. 21, no. 1, Art. no. 2685043, 2026.