Comparative Analysis of Integrated OSPE Versus Conventional OSPE in Assessing First-Year BDS Students’ Competence

Fatima Shaukat; Rizwan  Sultan; Saba Farooq; Aeman  Choudhary; Saman  Mailk; Alina  Qamar

doi:10.36283/ziun-pjmd14-2/070

Authors

Fatima Shaukat Dental College, HITEC Institute of Medical Sciences, Taxila, Pakistan.
Rizwan Sultan Medical College, HITEC Institute of Medical Sciences, Taxila, Pakistan
Saba Farooq Margalla Institute of Health Sciences, Rawalpindi, Pakistan.
Aeman Choudhary Dental College, HITEC Institute of Medical Sciences, Taxila, Pakistan.
Saman Mailk Dental College, HITEC Institute of Medical Sciences, Taxila, Pakistan.
Alina Qamar Dental College, HITEC Institute of Medical Sciences, Taxila, Pakistan.

DOI:

https://doi.org/10.36283/ziun-pjmd14-2/070

Keywords:

Conventional OSPE, Dental Education , student performance , focus groups , Integrated OSPE, implementation challenges, OSPE

Abstract

Background: Objective Structured Practical Examinations (OSPEs) are widely utilized in medical and dental education to assess students' practical skills and clinical knowledge. This study aimed to examine the effectiveness of Integrated and Conventional Objective Structured Practical Examinations (OSPE) in evaluating first-year BDS students at Dental College Hitec-IMS, focusing on identifying disparities in performance outcomes and analyzing implementation challenges.

Methods: The retrospective study employed a mixed-methods approach and was conducted at HITEC-IMS Dental College. It investigated assessments completed in June 2022 (Integrated OSPE) and October 2022 (Conventional OSPE). The research included the same cohort of 51 first-year BDS students using a purposive sampling technique. Student performance data were statistically analyzed using mean scores for descriptive analysis and p-values for inferential analysis on SPSS 27. Qualitative data were gathered through focus group discussions involving students and faculty (n=35)The study used a significance level of 0.05, with the comparison yielding a p-value of < 0.001.

Results: Using an independent sample t-test, the findings revealed a statistically significant difference between the two evaluation styles. The Conventional OSPE group achieved a mean score of 68.57 (+/-9.85), outperforming the Integrated OSPE group, which had a mean score of 55.42 (+/-12.34). The performance of the two groups differed significantly (p-value < 0.001), indicating that the conventional OSPE format enhanced overall student performance. Qualitative findings further elucidated key factors influencing these outcomes.

Conclusion: The Conventional OSPE demonstrated greater effectiveness and viability than the Integrated OSPE, which faced logistical and resource constraints. Addressing these challenges may enhance the future viability of the Integrated OSPE success.

Author Biographies

Fatima Shaukat , Dental College, HITEC Institute of Medical Sciences, Taxila, Pakistan.

Department of Dental Education
Rizwan Sultan, Medical College, HITEC Institute of Medical Sciences, Taxila, Pakistan

Department of Surgery,
Saba Farooq, Margalla Institute of Health Sciences, Rawalpindi, Pakistan.

Department of Medical Education,
Aeman Choudhary, Dental College, HITEC Institute of Medical Sciences, Taxila, Pakistan.

Department of Pharmacology
Saman Mailk, Dental College, HITEC Institute of Medical Sciences, Taxila, Pakistan.

Department of Oral Biology,
Alina Qamar, Dental College, HITEC Institute of Medical Sciences, Taxila, Pakistan.

Department of Physiology

References

Prasad HLK, Prasad HVK, Sajitha K, Bhat S, Shetty KJ. Comparison of Objective Structured Practical Examination (OSPE) Versus Conventional Pathology Practical Examination Methods Among the Second-Year Medical Students Cross-sectional Study. Med Sci Educ. 2020 Jul 10;30(3):1131-1135. doi: 10.1007/s40670-020-01025-9. PMID: 34457775; PMCID: PMC8368153.

Dymek, J., Kowalski, T.M., Golda, A. et al. The influence of OSPE and PBL on competency-based pharmacy student self-assessment. BMC Med Educ 22, 190 (2022). https://doi.org/10.1186/s12909-022-03246-5.

Atta, K., & Iftikhar, E. (2020). Come to the dark side- Make your own OSPE’S: A Pilot study. Health Professions Educator Journal, 3(1), 48–52. https://doi.org/10.53708/hpej.v3i1.97.

Asad, Munazza & Iqbal, Khadija & Asim, Aisha & Farman, Sabir. (2017). Integrated Performance Assessment: Students’ Perception and Its Relevance To Clinical Practice As Compared With Traditional OSPES. The Professional Medical Journal. 24. 972-976. 10.17957/TPMJ/17.3980. DOI:10.17957/TPMJ/17.3980.

Gupta, Pratibha & Chaudhary, Anjuman & Priya, Adity & Srivastava, Arshita & Kumar, Awadhesh & Singh, Parul. (2024). Perception of the teachers and Phase III (part 1) MBBS students regarding objective structured practical examination (OSPE) and traditional practical examination method. Research and Development in Medical Education. 13. 8. 10.34172/rdme.33208.doi: I:10.34172/rdme.33208.

Lakum NR, Maru AM, Algotar CG, Makwana HH. Objective Structured Practical Examination (OSPE) as a Tool for the Formative Assessment of Practical Skills in the Subject of Physiology: A Comparative Cross-Sectional Analysis. Cureus. 2023 Sep 28;15(9):e46104. doi: 10.7759/cureus.46104. PMID: 37900514; PMCID: PMC10612540.

Malik VS, Ghalawat N, Garsa VK, Soni G. Study of OSPE as a Method of Assessment in the Anatomy: Implementation and Attitude among MBBS students. International Journal of Anatomy and Research ISSN (E) 2321-4287 | ISSN (P) 2321-8967 https://www.ijmhr.org/ijar.htm DOI-Prefix: https://dx.doi.org/10.16965/ijar

Iqbal MJ, Zafar MW, Batool W, Ghaffar A, Zahid R. Objectively Structured Practical Examination (OSPE) in traditional examination system versus integrated modular system: Perception of teaching faculty at a Public Sector Medical College of Punjab. The Professional Medical Journal. 2024;31(07):1012-7. : https://doi.org/10.29309/TPMJ/2024.31.07.8189

Ramachandra SC, Vishwanath P, Ojha VA, Prashant A. Objective Structured Practical Examination (OSPE) Improves Student Performance: A Quasi-Experimental Study. JK Science [Internet]. 2021 Aug. 20 [cited 2025 Mar. 27];23(3):149-54. Available from: https://journal.jkscience.org/index.php/JK-Science/article/view/77

Malik VS, Ghalawat N, Garsa VK, Soni G. Study of OSPE as a method of assessment in the anatomy: implementation and attitude among MBBS students. International Journal of Anatomy and Research. 2024;12(2):8910-6. International Journal of Anatomy and Research, Int J Anat Res 2024, Vol 12(2):8910-16. ISSN 2321-4287 DOI: https://dx.doi.org/10.16965/ijar.2024.113

Radke SA, Wankhade JS, Manekar VS, Warhadpande M, Dakshindas D, Khatri S. Undergraduate dentistry student’s perception on objective structured practical examination (OSPE): A cross-sectional study. Journal of Education Technology in Health Sciences. 2023;9(1):3-6. https://doi.org/10.18231/j.jeths.2022.002

Reddy R. Comparative Evaluation of the OSPE and Conventional Methods in Biochemistry Department. Journal of Clinical & Diagnostic Research. 2022;16.

Dymek, Justyna & Kowalski, Dr N Farm Tomasz & Skowron, Agnieszka & Nowakowski, Michal & Gołda, Anna. (2021). Pharmacy students’ feedback about objective structured practical examination (OSPE) after the pharmaceutical care course in Poland.. Acta Poloniae Pharmaceutica - Drug Research. 78. 583-588. Doi.10.32383/appdr/141299.

Harden RM, Cairncross RG. Assessment of practical skills: the objective structured practical examination (OSPE). Studies in Higher Education. 1980;5(2):187-96. https://doi.org/10.18203/2320-6012.ijrms20162947

Malik S, Hasan S, Hamad A, Khan H, Bilal M. Conventional/traditional practical examination (CPE/TDPE) versus objective structured practical evaluation (OSPE)/semi objective structured practical evaluation (SOSPE). Pakistan Journal of Physiology. 2009;5(1). http://www.pps.org.pk/PJP/5-

Feroze M, Jacob AJ. OSPE in pathology. Indian J Pathol Microbiol. 2002 Jan;45(1):53-7. PMID: 12593565..

Mohan R. Measurement, evaluation and assessment in education. PHI Learning Pvt. Ltd.; 2023 Apr 1.

Rai N, Nair SK. Evaluation of perception regarding feasibility of introducing objective structured practical examination (OSPE) in the department of anatomy. Indian J Clin Anat Physiol. 2019;6:315-20. https://doi.org/10.18231/j.ijcap.2019.069

Brown N, Doshi M. Assessing professional and clinical competence: the way forward†. Advances in Psychiatric Treatment. 2006;12(2):81–9. doi:10.1192/apt.12.2.81

.

Verma M, Soni A, Sachdeva A, Sethi S. Change in knowledge, perception, and attitude of faculty toward designing Objective Structured Practical Examinations (OSPE). International Medicine ISSN: 2667-7008. 2024;10(1). https://doi.org/10.21802/e-GMJ2024-A26

Haq MM, Kulkarni SD, Desai HT, Kaushik RV. Implementing objective structured practical examination as a formative assessment tool for practical skills in 1st-year MBBS students: A comparative study in the physiology department at Surat Municipal Institute of Medical Education and Research, Surat. National Journal of Physiology, Pharmacy and Pharmacology. 2024;14(10):2124-. 10.5455/njppp.2024.14.04168202415062024

Rathi B, Rathi R. Perception of Teachers and Students Towards OSCE and OSPE as an Assessment Tool. Journal of Indian System of Medicine. 2017;5(2):147-54.

Ismail NAS, Sani NA, Tan JK, Alias E, Damanhuri MA, Arifin KT, et al., editors. The effectiveness of Objective Structured Performance Evaluation (OSPE)-Based Setting versus conventional practical in enhancing knowledge among medical students. EDULEARN17 Proceedings; 2017: IATED. https://doi.org/10.21125/edulearn.2017.2089

Elov O, Ismatullayeva F. Quality Assessment and Monitoring Systems In The Education. Академические исследования в современной науке. 2024;3(45):168-73.

Rout AJ, Dasgupta P, Saha TK, Biswas D. Is Objective Structured Practical Examination a Better Option than Conventional Practical Examination in Assessing Students’ Competency? An Analytical Research. Indian Journal of Community Medicine. 2025;50(1):143-6. DOI: 10.4103/ijcm.ijcm_519_2

Rajani M, BABAJI GHEWADE M. Comparison of student performance by assessment through Objective Structured Practical Examination versus the Conventional Method for second year MBBS students in Microbiology. Journal of Advances in Medical Education & Professionalism. 2020;8(3):121. https://doi.org/10.30476/jamp.2020.86029.1210.