Developing Temporal Machine Learning Approaches to Support Modeling, Explaining, and Sensemaking of Academic Success and Risk of Undergraduate Students

Search for this publication on Google Scholar
Nur, N. (2021). Developing Temporal Machine Learning Approaches to Support Modeling, Explaining, and Sensemaking of Academic Success and Risk of Undergraduate Students. Unc Charlotte Electronic Theses And Dissertations.
Download PDF

Analytics

37 views ◎
12 downloads ⇓


Abstract

The main goal of learning analytics and early detection systems is to extract knowledge from student data to understand students’ trends of activities towards success and risk and design intervention methods to improve learning performance and experience. However, many factors contribute to the challenge of designing and building effective learning analytics systems. Because of the complexity of heterogeneous stu- dent data, models designed to analyze it frequently neglect temporal correlations in the interest of convenience. Moreover, the performance descriptions gained from the student data model or prediction results from the analytical models do not always help explain the "why" and "how" behind it. Furthermore, domain specialists cannot participate in the knowledge discovery process since it necessitates significant data science abilities, and an analytical model appears as a black box to them.This research aims to develop analytical models that enable domain experts to study their students’ performance behavior and explore trustworthy sources of in- formation with the help of explanations on the analytics. The work demonstrates various approaches to using the temporal aspect of heterogeneous student data to build analytical models: weighted network analysis, unsupervised cluster analysis, and recurrent neural network analytics. The description, implementation process, and findings of each method are presented as technical contributions to the temporal analysis of student data. All these analytical models highlight the complexity of heterogeneous-temporal data, model building, decision-making tasks, and the need for a more in-depth focus on visual information of analytics with state-of-art explainable AI tools and techniques.This dissertation work underscores a need for developing a robust way to integrate the possibilities inherent within each approach. To achieve this goal, a comprehensive yet flexible and empirical framework named FIND is presented to support the design and development of analytical models to extract meaningful insights about students’ academic performance and identify early actionable interventions to improve the learning experience. The framework is illustrated on three applications (e.g., student network model, unsupervised clustering model, and recurrent neural network analytics) to demonstrate the value of this framework in addressing the challenges of using student data for learning analytics. These applications present vast opportunities to benefit students’ learning experience by implementing flexible educational data representations, fitting different predictive models, and extracting insights for designing prescriptive analytics and building strategies to overcome perceived limitations.An academic institution’s culture drives its ability to accept, leverage, and deploy predictive and prescriptive analytics to enhance the workflow of maximizing pedagogical outcomes. This dissertation may aid in developing or refining a set of design standards for learning analytics systems.

Details
Author

Nur, Nasheen

Title

Developing Temporal Machine Learning Approaches to Support Modeling, Explaining, and Sensemaking of Academic Success and Risk of Undergraduate Students

Physical Description

1 online resource (165 pages) : PDF

Date

2021

Degree Granting Institution

University of North Carolina at Charlotte

Abstract

The main goal of learning analytics and early detection systems is to extract knowledge from student data to understand students’ trends of activities towards success and risk and design intervention methods to improve learning performance and experience. However, many factors contribute to the challenge of designing and building effective learning analytics systems. Because of the complexity of heterogeneous stu- dent data, models designed to analyze it frequently neglect temporal correlations in the interest of convenience. Moreover, the performance descriptions gained from the student data model or prediction results from the analytical models do not always help explain the "why" and "how" behind it. Furthermore, domain specialists cannot participate in the knowledge discovery process since it necessitates significant data science abilities, and an analytical model appears as a black box to them.This research aims to develop analytical models that enable domain experts to study their students’ performance behavior and explore trustworthy sources of in- formation with the help of explanations on the analytics. The work demonstrates various approaches to using the temporal aspect of heterogeneous student data to build analytical models: weighted network analysis, unsupervised cluster analysis, and recurrent neural network analytics. The description, implementation process, and findings of each method are presented as technical contributions to the temporal analysis of student data. All these analytical models highlight the complexity of heterogeneous-temporal data, model building, decision-making tasks, and the need for a more in-depth focus on visual information of analytics with state-of-art explainable AI tools and techniques.This dissertation work underscores a need for developing a robust way to integrate the possibilities inherent within each approach. To achieve this goal, a comprehensive yet flexible and empirical framework named FIND is presented to support the design and development of analytical models to extract meaningful insights about students’ academic performance and identify early actionable interventions to improve the learning experience. The framework is illustrated on three applications (e.g., student network model, unsupervised clustering model, and recurrent neural network analytics) to demonstrate the value of this framework in addressing the challenges of using student data for learning analytics. These applications present vast opportunities to benefit students’ learning experience by implementing flexible educational data representations, fitting different predictive models, and extracting insights for designing prescriptive analytics and building strategies to overcome perceived limitations.An academic institution’s culture drives its ability to accept, leverage, and deploy predictive and prescriptive analytics to enhance the workflow of maximizing pedagogical outcomes. This dissertation may aid in developing or refining a set of design standards for learning analytics systems.

Genre

doctoral dissertations

Subjects--Topics

Artificial intelligence
Education

Degree

Ph.D.

Keywords

Ai In Education
Explainable Ai
Insights Discovery
Retention
Student Success
Temporal Learning Analytics

Subject Area

Computer Science

Advisor(s)

Dou, Wenwen

Committee Members

Maher, Mary Lou
Dorodchi, Mohsen
Niu, Xi
Buch, Kim

Degree Note

Thesis (Ph.D.)--University of North Carolina at Charlotte, 2021.

Rights Statement

This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). For additional information, see http://rightsstatements.org/page/InC/1.0/.

Rights Holder Information

Copyright is held by the author unless otherwise indicated.

Identifier

Nur_uncc_0694D_12878

Permalink

http://hdl.handle.net/20.500.13093/etd:2874