DECODING DEPTH:
Engineering Education through SOLO Taxonomy
DECODING DEPTH:
Engineering Education through SOLO Taxonomy
by: the Coordinator of the Engineering Education, FKJ
Credit to:
AP. Ts. Dr. Mohd Kamaruddin bin Abd Hamid (Deputy Dean - Academics & International, FKJ)
This magazine presents the evaluation of the UMS-ALIEN active learning ecosystem (2021–2025) using the SOLO Taxonomy as a pioneering analytical framework. Moving beyond traditional grading, the study retroactively codes student evidence; reflective journals and performance data; to measure cognitive depth in Chemical Engineering. Findings reveal a significant transition from surface-level (multi-structural) recall to deep-level (relational/extended abstract) synthesis. This data-driven approach validates the faculty’s Continuous Quality Improvement (CQI) and COPPA accreditation alignment, proving that structured active learning successfully transforms how students process complex engineering problems.
Introduction
In the rapidly evolving landscape of technical education, the Faculty of Engineering at Universiti Malaysia Sabah (UMS) is moving beyond traditional metrics to measure true intellectual growth. This magazine explores a landmark five-year study (2021–2025) that utilizes the SOLO (Structure of Observed Learning Outcomes) Taxonomy not just as a teaching tool, but as a sophisticated analytical lens.
By retroactively evaluating student performance within the UMS-ALIEN ecosystem, this initiative shifts the focus from "what grade was achieved" to "how deeply was the concept understood," ensuring our future engineers possess the relational and extended abstract thinking required for global industry challenges.
Beyond the Surface
While the Faculty of Engineering has widely adopted Active Learning (AL) and Blended Learning (BL) to engage students, a critical gap remains: How do we actually measure the depth of a student’s thought process?.
Traditional assessments often fall short in three areas:
Perception vs. Reality: Many evaluations rely on student satisfaction surveys, which may not accurately reflect actual cognitive development or learning outcomes.
Hidden Progression: Simple implementation of active learning does not guarantee that students reach the higher cognitive levels required for complex engineering problem-solving.
Lack of Empirical Evidence: At UMS, there has been limited data-driven evidence to show if SOLO-aligned active learning effectively enhances performance across different cohorts when measured by authentic academic indicators.
Mapping the Cognitive Journey
The main mission of this study is to evaluate the effectiveness of the existing SOLO-structured active learning framework within the Chemical Engineering programme.
The specific goals are:
Document and Map: Systematically trace how SOLO-based active learning is enacted in courses like Engineering Programming and Process Simulation by mapping activities and assessment evidence across multiple years.
Performance Analysis: Compare academic results—specifically Course Learning Outcome (CLO) attainment and grade distributions—before and after the structured use of SOLO-aligned practices.
Evaluate Cognitive Growth: Analyze reflective journals and student work using the SOLO Taxonomy levels to identify genuine cognitive progression and pinpoint areas for Continuous Quality Improvement (CQI).
CLO Attainment Trends: Rising to the Challenge
Over the five-year period, both core courses Engineering Problem Solving & Programming (KC06603) and Process Simulation & Integration (KC32603), showed a steady and significant increase in Course Learning Outcome (CLO) attainment.\
KC06603: Performance in programming fundamentals (CLO 1) rose from 75% in 2021 to 82% in 2024, while modern tool usage (CLO 3) saw a marked increase to over 75% by 2025.
KC32603: Critical mass and energy integration (CLO 3) improved to ≥ 75% in 2024, following a dip below target in earlier years.
Outcome: These trends reflect a more balanced achievement across both procedural and higher-order engineering competencies.
Grade Distribution: Moving Toward Mastery
The quantitative data shows a clear shift in performance consistency across cohorts.
Narrowing the Gap: Early years (2021–2023) displayed wider grade spreads, but by 2025, student performance concentrated in the A to B+ range.
Success Metric: In Process Simulation, for example, achieving A or A− increased by 14 percentage points in 2025 compared to 2023.
SOLO Coding: From Surface to Depth
The most innovative finding comes from the SOLO-coded analysis of reflective journals. This qualitative lens reveals exactly how student thinking changed:
The Shift: Later "SOLO-structured" cohorts (2024–2025) moved away from Multi-structural (sequential, unlinked steps) recall.
Deep Learning: There was a distinct rise in Relational (integrated reasoning) and Extended Abstract (critical synthesis and self-evaluation) levels.
Why it Matters: This proves that students are not just following simulation steps but are now justifying optimization decisions and performing complex trade-off analyses.
The CQI Impact: Closing the Loop
Every data point was used to drive Continuous Quality Improvement (CQI). Documented actions—such as introducing scaffolded problem-solving tasks, revising project rubrics, and embedding guided reflection prompts—were directly linked to these performance gains.
This systematic approach ensures that the Faculty of Engineering meets the highest standards for COPPA accreditation, providing traceable evidence that UMS-ALIEN is effectively building the engineers of tomorrow.
The five-year evaluation of the UMS-ALIEN ecosystem confirms that integrating the SOLO Taxonomy significantly elevates engineering education. By moving beyond traditional assessment to analyze cognitive depth, the study demonstrates a clear progression from surface-level memorization to complex, relational understanding. With CLO attainment reaching 90% and a marked increase in high-tier SOLO levels, the framework proves its efficacy in fostering the higher-order thinking essential for modern engineers. This data-driven approach not only validates our Continuous Quality Improvement (CQI) processes but also ensures the Faculty of Engineering remains a benchmark for excellence in alignment with national COPPA standards.