15-16 Jan 2026 University of Fribourg, Miséricorde (Switzerland)
The OrChemSTAR Project: Supporting Representational Competence in Chemistry with AI-Enhanced Augmented Reality – Preliminary Results from a Large-Scale Study
Lars-Jochen Thoms  1, 2@  , Frieder Loch  3@  , Johannes Huwer  1, 2@  
1 : Thurgau University of Teacher Education  (PHTG)
2 : University of Konstanz  -  Website
78457 Konstanz -  Germany
3 : University of Applied Sciences of Eastern Switzerland = Ostschweizer Fachhochschule  (OST)  -  Website

Representational competence in chemistry—the ability to read, draw, and translate between structural formulas and three-dimensional models—is a key prerequisite for conceptual understanding, yet it poses persistent challenges for learners. Students often struggle with conventions of different notations, translating between representation levels, and avoiding common mistakes such as octet rule violations, incorrect bonding, or misinterpretation of stereochemistry. OrChemSTAR explores how the combination of Artificial Intelligence (AI) and Augmented Reality (AR) can address these difficulties. The OrChemSTAR App, a mobile AR application that recognizes both printed and hand-drawn structural formulas, detects typical learner errors using deep-learning–based image recognition, and provides adaptive feedback by overlaying multiple representations (e.g., Lewis, wedge-dash, ball-and-stick). The app offers three modes: (i) AR mode for interactive recognition and visualization of formulas, (ii) scan mode for error diagnosis in hand-drawn structures, and (iii) practice mode with individualized exercises and feedback. We report preliminary results from a classroom study with 536 students from Switzerland, Germany, and Austria. First analyses indicate that students benefited from real-time feedback on their structural drawings and from adaptive visualizations linking 2D and 3D perspectives. Teachers emphasized the app's potential to increase practice opportunities, which are often limited by time constraints in traditional lessons. Moreover, acceptance was high across student groups, with indications that adaptive error recognition supports individualized learning paths. These findings demonstrate the potential of combining AI-based error diagnosis with AR-enhanced representations to foster representational competence in chemistry education. The OrChemSTAR App thus provides a promising approach to bridging gaps between abstract representations and student understanding in classroom practice.


Loading... Loading...