The research aims to study the efficacy of random forest algorithm modelling student grades in software engineering education and compares the predictions made by the model with actual student grades. The data are collected from 88 students from Sanda University in the course "Software Testing Practice" including both subjective ratings by teachers and team leaders across five dimensions: testing requirements, testing plans, testing cases, defect discovery, and testing reports; and students' actual grades in the course "Software Engineering and Project Management" which are objective assessment criteria. It will be compared between two models, Random Forest versus AdaBoost, to determine which is better predicting the students' grades. The overall model designed in this study with subjective ratings from a single course to predict future grades in related courses can be demonstrated to show different performance using their respective different performance models. It has been shown through correlation studies that the random forest model exhibits a greater correlation with actual scores (0.629) than does the AdaBoost model (0.475). More evaluation with measurements such as MAE, MPE, MAPE, as well as R² confirmed the advantages of the random forest model in terms of accuracy and reliability. The model can be further enhanced and made adaptable to various learning environments to more accurately reflect and inform better decision-making in the future and ongoing software engineering education improvements.