Students’ opinion concerning alterations to undergraduate medical education during the COVID-19 pandemic: a narrative review

REVIEW ARTICLE

Hippokratia 2024, 28(3): 83-92

Gournelli M1, Nena E2, Serif-Damadoglou E1, Arvaniti A1
1 Department of Psychiatry
2 Laboratory of Social Medicine
Faculty of Medicine, Democritus University of Thrace, Alexandroupolis, Greece

Abstract

Background: During the Coronavirus disease 2019 (COVID-19) pandemic, various changes occurred regarding undergraduate students’ medical education. Although some research on the matter has been done, to the authors’ knowledge, very few reviews consider medical students’ overall point of view during the pandemic’s first and second years.

Methods: We systematically searched the PubMed database twice using the “Advanced” settings; the last search was on 9th October 2022. The keywords used to search relevant literature included: i) (Distance learning) AND (COVID-19) AND (medical students’ perception) and ii) (medical education) AND (SARS-CoV-2) AND (online learning opinion). All in all, 47 publications met the inclusion criteria for this review.

Results: In most cases, the medical curriculum was modified to an online format, and clinical placements were canceled, which exhibited several advantages for the students, such as more personal time and a sense of flexibility and comfort. Nonetheless, the student’s overall point of view regarding distance learning tends to be rather negative than positive. That is mainly due to the variety of difficulties they faced because of it. The biggest issue that arose at the first (response) and the second (recovery) phase of the pandemic seems to be the lack of interaction between students and their professors and the non-existent student-to-student interactions.

Conclusions: Most students stated that once the pandemic was over, they would wish for either a full return to conventional teaching or the implementation of a blended strategy. Medical students appreciate the ability to continue their education amidst the pandemic. Nonetheless, they expressed various issues that must be addressed if online learning needs to be continued. Medical educators need to be aware of these issues to ensure the best didactic tactics in case a health crisis of a similar magnitude appears in the future. HIPPOKRATIA 2024, 28 (3):83-92. 

Keywords: Distance learning, Coronavirus disease 2019, COVID-19, severe acute respiratory syndrome coronavirus 2, SARS-CoV-2, medical students’ perception, medical education, online learning opinion 

Corresponding author: Evangelia Nena, MD, PhD, Associate Professor of Social and Occupational Medicine, Laboratory of Hygiene and Environmental Protection, Laboratory of Social Medicine, Faculty of Medicine, Democritus University of Thrace, Dragana, 68100, Alexandroupolis, Greece, tel: +30 2551030638, e-mail: enena@med.duth.gr

Introduction

The Coronavirus disease 2019 (COVID-19) pandemic has, among other effects, a serious impact on medical education. In most countries, the traditional educational curriculum of medical students is based on lectures and face-to-face teaching. Following the pre-clinical years, students attend clinical rotations and clerkships accompanied by bedside teaching1-3.

During the COVID-19 pandemic, the mode of teaching strategies was modified several times, depending on the periods of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) peak transmission, and numerous changes were implemented regarding medical education for students to be able to resume their theoretical and practical training4-7.

Most available literature focuses on a certain period of the pandemic. This review article aims to explore and display medical students’ point of view on education alterations, referring to both the first and the second year of the pandemic, as both theoretical education and practical training were severely affected. Medical students’ overall point of view should be carefully considered in case a health crisis of a similar magnitude occurs in the future.

Methods

A systematic search of PubMed database was conducted twice using the “Advanced” settings; the last search was on 9th October 2022. The keywords used to search relevant literature included: i) (Distance learning) AND (COVID-19) AND (medical students’ perception) and ii) (medical education) AND (SARS-CoV-2) AND (online learning opinion).

The inclusion criteria for the articles were: i) full text, freely available articles written in English language, ii) both qualitative and quantitative studies reporting medical students’ opinions on changes that took place in the curriculum of Medical Schools during the COVID-19 pandemic, iii) review articles summarizing the above-mentioned changes, iv) articles in the reference list of the previous categories, that also adhere to the previously mentioned inclusion criteria.

We used the following exclusion criteria: i) articles that did not refer to undergraduate medical education, ii) articles that examined health students in general (e.g., School of dentistry, pharmacy, nursing, etc.), and did not focus on and differentiate between medical students’ opinion from others’, iii) studies focusing on research questions that did not concern medical education (e.g., articles about medical students’ psychology), iv) articles not referring to medical students’ opinion on their education but on other matters, and v) specialized articles, for example, students’ opinion on online radiology class.

Results

Initially, 206 articles were identified (96 from the first search combination and 110 from the second one). Out of these, 47 original articles were eligible, based on the aforementioned criteria (Figure 1). The studies were conducted in Asian countries (26), Europe (12), Africa (6), USA (2), and one study was a collaboration between scientists from different continents (Table 1). Regarding their publication date, 17 were from 2020, 17 from 2021, and 13 from 2022.

Figure 1: Flowchart of data collection and study selection process in this review exploring medical students’ point of view on education alterations during the COVID-19 pandemic.

Background of medical education during the pandemic

The highly contagious COVID-19 disease urged the need for radical reform of undergraduate medical education during the pandemic. The literature search showed various curriculum changes were applied; online lectures and digital training activities replaced in-person training activities4,8. Most universities postponed their academic calendars for several weeks to achieve an e-learning’ implementation9. The two forms of online medical education during the acute phase of the pandemic described in the available literature are synchronous and asynchronous e-learning.

Synchronous e-learning consists of real-time live transmissions and virtual student-teacher interactions. Small group classrooms offering interaction, active participation, and live large group teaching and chat rooms have often been utilized10,11. The most used platforms for online learning are Zoom, Microsoft Teams8, Google Meet, Skype for Business, Adobe connect12, WebX10, Google classroom12, and WhatsApp Groups13. Asynchronous e-learning primarily consists of online articles, slide decks, and pre-recorded slide-based lectures14.

Students were also suspended from university hospitals, as they posed potential targets and transmitters of the virus2,15. Their practical courses were either postponed or indefinitely cancelled2,9,10. To continue their practical education, practical training was reestablished online2,16. To do that, universities used virtual patient cases and online case simulations, allowing students to practice using them2,10,17-21. Teachers also introduced online videos of patient examinations, as well as remote patient care environments and telemedicine10,22-24. Case-Based, Problem-Based, and Team-Based learning were also used, as well as “gamification” (a concept involving game attitudes to influence learning-related behaviors in non-game contexts)13,25-27. Even before the COVID-19 pandemic, many universities had already begun applying telemedicine or hybrid learning in their curriculums (such as phone triage, ambulatory electronic visits, conferencing platforms, email, and phone calls), facilitating the implementation of e-learning1,3,6,12,21,28–31.

According to the literature, the education of final-year medical students was prioritized in some countries. No changes in their education were applied. Instead of providing digital training, several teaching hospitals relied upon medical student trainees to cope with the constantly increasing healthcare problems arising from the evolving pandemic14.

Several studies showed that final-year medical students’ assessment was accelerated, and they were promoted to their career’s next step before completing the required medical education. This was reported in some countries, such as Italy, the United Kingdom (UK), the USA, and Brazil, and was due to the essentiality of these students to the understaffed healthcare systems5,8,14,32.

Following the suspension of face-to-face education, exams were also conducted online. Objective clinical skills examinations were either postponed or cancelled1,4,5. The exams usually consisted of multiple-choice questions, theory examinations (pen-and-paper), and oral tests. Some universities applied Open Book Examinations5. A significant challenge for the universities was finding fool-proof examination systems so students could not cheat during their exams33,34.

Additionally, hospitals in some countries attempted to reinforce their health staff, enlisting medical students by calling them out to perform tasks according to their level of knowledge; that could be considered an alternative way for students to gain clinical competencies2,33. Students had to volunteer of their own free will and fulfill a number of tasks under supervision33. 

Moreover, medical students offered their help to healthcare workers and community members during the first year of the COVID-19 pandemic35,36. Apart from volunteering in call centers, some students chose to help citizens by assisting them with their shopping, educating peers, patients, and communities regarding the SARS-Cov-2 virus via social media2, providing social services such as support and assistance to senior citizens, offering free childcare and pet care, running errands, as well as collecting personal protective equipment (PPE) and donating it to health care centers and hospitals in need35. Medical students also assisted in contact tracing, applied their lab skills in research, and volunteered in centers that provided information on the SARS-CoV-2 virus. Some examples of students’ volunteering groups are Harvard’s Medical Students Response Team #GetMePPE, Co-op, and Covid sitters33,35.  As stated, medical students have realized that the education procedure does not solely involve classes and clerkships. It is a relatively constant learning that integrates different principles and constantly adapts to changing circumstances35.

Medical student’s opinion concerning the new teaching methods enforced due to the high prevalence of the SARS-CoV-2 virus

Medical students’ point of view on the changes that the COVID-19 pandemic enforced were diverse; students pointed out both positive and negative aspects of them. The following section summarizes the advantages and disadvantages of online medical education, as assessed by the students.

Advantages of online medical education versus conventional education

I. Studies showed that online medical education eliminated the need for leaving home and driving long distances. As a result, it improved students’ time management and personal productivity36,37. This fact also reduced expenditures and contributed to better financial handling20,38. The reduction in air pollution was another positive aspect of tele-education based on the literature38.

II. Medical students utilized the resulted extra free time to undertake new hobbies and spend time with their families. Moreover, they studied for their classes and residency tests, prepared for clinical placements and improved their physical and mental health14,20,39,40.

III. Furthermore, students studying abroad had the chance to return home20, observed at a large scale in universities with great numbers of international students, such as universities in the UK or China41. E-learning was also helpful for international students due to the flexibility of the provided asynchronous learning, resulting in the ability to keep up with their classes while being in a completely different time zone20.

IV. This flexibility of the e-classes was helpful for the majority of the students regardless of their origin. Asynchronous learning especially offered students the ability to organize their schedules independently and attend their classes from almost anywhere (with most students feeling more relaxed from the comfort of their homes)8,12,20,38,39. Several students stated that they had the chance to develop time management skills8,14,20. Medical students also reported more straightforward access to a significant quantity of information they could explore at their own pace during their e-learning experience38,39,42. E-learning was a self-directed educational process and a student-centered way of gaining knowledge20.

V. Lastly, the pandemic provided medical students with volunteering opportunities14,20,33,35. Students reported that by volunteering, gaining medical knowledge was easier due to the lack of performance anxiety. In some cases, the reduction in the clinical personnel of the hospitals offered the students the opportunity to a better training of their practical skills in a real-life setting14.

Disadvantages of online medical education against conventional amphitheater and bedside teaching

I. At the beginning of their e-learning experience, students faced serious problems regarding technological equipment and other technical issues, such as lagging e-learning platforms. Studies showed that the most commonly reported problems were a range of technical difficulties12,20,21,38,39,43. Students reported an inability to access the online lectures at the beginning of e-learning training. Problems such as poor internet connectivity, software failure, and audio problems during e-classes disturbed the students as well as their professors39,44,45. Outdated equipment and poor computer literacy on behalf of the teaching stuff were also mentioned14. After a month of online teaching, though, most students gradually got sufficiently equipped with electronic means. Subsequently, the earlier technical problems were substituted by the lack of learning motivation39,46–48.

II. Furthermore, medical students, in the clinical years of their education, expressed a rising concern about the reduction of their clinical skills. They voiced the opinion that online learning was insufficient in providing them with clinical knowledge and competencies12,14,20,33,39,42,49-52. To be more precise, students mentioned that there were defects in the online discussion sessions of clinical cases during e-classes14. Problem-Based, Team-Based, Case-Based learning, clinical skills practice, and physical examination could not be successfully taught online39. Medical students’ dissatisfaction with clinical skills e-classes was also expressed because their opinions concerning e-learning were influenced by their year of study. Students in advanced years (clinical or closer to clinical years) were less satisfied with e-lectures compared to students from earlier years4,53. In addition, even students who were having clinical rotations in hospitals were often left unsupervised49.

III. Another major drawback of e-classes was the poor student-student and student-professor interactions. Specifically, many students mentioned that during e-lectures, communication with their teachers worsened4,14,20,38,39,54,55. Class interactions, discussions, and chances for students to express their questions demanded great effort14,56. Medical students also missed peer interaction, peer instruction, and face-to-face Team-based learning12,39. Many people mentioned that they also missed body language, something that troubled kinesthetic learners a lot39. Articles showing rates of students who were asked about interactivity are listed in Table 2.

IV. Additionally, many students experienced financial issues during the pandemic. It is important to keep in mind that university students are a financially vulnerable socioeconomic group. They had to purchase expensive technological equipment to participate in their classes, which may have worsened their economic situation and caused them anxiety10,57-59. Some students were even afraid that after the pandemic, they would no longer be able to afford college costs32, especially those living in developing countries where high-speed internet packages and technological means such as computers and phones are expensive to buy57,60.

V. Many students also felt the flexibility afforded by the e-learning status was harming them, as they had problems with self-motivation and self-discipline. As a result, they found it hard to manage their time correctly and to study the content needed10,21,61. Students also faced problems finding a quiet place to study, participate in their classes, or take exams. They were easily distracted by their parents or other family members12,20,39,46,49. Especially those students trying to manage children, siblings, or elders who are present at the house at the same time, who seemed to have experienced a significant amount of difficulty32.

VI. Students also experienced adaptation stress to the electronic means unfamiliarity with them and technophobia, even if scarcely mentioned39,62. The higher workload was mentioned, too, provoking laziness or burnout syndrome20,39,63. Furthermore, a feeling regarding the insufficiency of online medical education to replace their in-person classes was highly expressed42.

VII. Other disadvantages of e-learning were the following: patient discomfort and detached interaction with the students via e-visits, difficulty in maintaining academic integrity during e-exams due to the resourcefulness of the students when it comes to cheating, problems with the timing of the tutorials and its frequent change on behalf of the professors20,39.

It is notable that the majority of the students, when asked, stated that in the future, they would either prefer a full return to traditional teaching methods or integrate a hybrid strategy13,32,44,64-66. A smaller proportion expressed their wish to continue participating in distance learning techniques32,44,64.

Discussion

This review of the literature aimed to investigate medical students’ point of view regarding the necessary changes in undergraduate medical education during both years of the COVID-19 pandemic worldwide. The pandemic has had a severe effect on medical education. Its curriculum was, in most cases, radically transformed. In-person lectures were replaced by online learning. This fact led to a wide range of mixed reactions and feelings. Medical students have mainly appreciated the chance to continue and/or complete their education amidst the pandemic. They identified a variety of advantages of the changes, such as reduced commuting costs, increased personal time, returning to their homes, comfortability, and flexibility afforded, and voluntary activities available for them at the time12,14,20,21,33,39.

Nevertheless, students described the significant difficulties resulting from the integration of online teaching techniques. These can mainly be summarized as the reduction in students’ clinical exposure, poor student-student and student-professor interactions, financial issues, problems with self-motivation, as well as technical issues10,39,64. Concerning the latter, though, hope abides in that most of the survey respondents belonged to the millennial and post-millennial generations, resulting in an increased familiarity of the students with the usage of electronic means, as only a limited number of the responders admitted having insufficient computer skills (2 %)31.  Increased familiarity with advanced technology and computer science simplified the use of online medical learning31,66.

Concerning the interactivity of online lectures, most students expressed that during e-classes, the communication between them and their professors worsened. Students were also concerned about their significantly reduced interaction with the patients in real-life clinical settings. Even though some stated that interactivity was achievable through electronic means, communication during e-lectures still posed a challenge for several students (Table 1).

Interestingly, the available literature presents some major areas of agreement and disagreement. Some studies document the free time students gain due to online learning and the opportunity to organize their own time as a positive aspect14,36-38, while there is also evidence that other students had difficulties managing their time without supervision and could not focus sufficiently on their lectures10,21. Furthermore, even though most students were pleased to return to their homes8, they eventually started feeling uncomfortable due to lack of personal space, slow internet connectionetc2,12,20,31. Nonetheless, the existing studies agree that due to online classes, medical students have lost the opportunity to practice their clinical skills, resulting in rising anxiety among them20,31,33,39,49–52. Also, many studies note the lack of technological infrastructure at the beginning of online learning as an important aspect12,20,21,31. Interestingly, papers written in developing countries express rising concern about online learning, as internet packages are very expensive and not everyone can access them, causing a considerable economic burden on universities and students in these countries57,60. Therefore, a question arises regarding whether online learning is, in fact, accessible to everyone. What is intriguing, though, is that the available literature seems to agree mostly on the negative aspects of medical education during the COVID-19 pandemic and to contradict itself regarding the positive ones.

The previously mentioned disadvantages led to a sense of rising anxiety among students regarding their skills and concerns about wasting time that could be dedicated to mastering clinical knowledge5,10,12,14,20,31,33,59.

The results of this review demonstrated that the vast majority of the students prefer the traditional teaching methods or a hybrid strategy to e-learning. A small percentage of students prefer to continuously join distance learning methods, which is intriguing, as young adults prefer electronic teaching over face-to-face. Results proved medical students’ urge to return to in-person education and attend lectures in the classroom. They also wish to integrate the knowledge they earned during e-lectures into their future learning strategies. Undoubtedly, medical universities and teaching hospitals should properly integrate digital learning methods into a well-structured teaching curriculum. The aim of this change should be to combine the advantages of in person and e-learning methods and improve the quality of medical education globally13,32,44,64,65-69. Universities across the world should also be able to adapt to different circumstances without affecting the quality of education.

This review article has several strengths and limitations. The strength of this paper is the fact that the findings are based on a large number of papers published during the pandemic. Also, it considers the literature on the first and second years of the COVID-19 crisis, which is important as the medical students’ overall point of view on the matter is being presented. Regardless, the current study’s design is subject to limitations; only the PubMed database was searched, and methods of statistical analysis used by the article’s authors were not considered. Further studies need to be conducted to report and compare medical students’ perceptions concerning medical education during the different stages of the COVID-19 outbreak, aiming to develop a high-quality medical education program in the post-COVID-19 era.

Conclusions

During the COVID-19 crisis, medical education underwent many changes, most demanding innovative technological infrastructure, as well as medical students’ and their professors’ willingness to participate in them. Most of the available literature agrees on the negative aspects of the pandemic on medical education. The fact that medical students’ opinion regarding their education was more likely to be negative than positive is in line with that. The greatest disadvantage of tele-education, implemented by the universities during both years of the pandemic, is the lack of student-teacher and student-patient interaction. All in all, the majority of medical students tend to agree that after the COVID-19 crisis is over, they prefer either a full return to conventional classrooms or the implementation of a blended strategy. The university education system should develop new technologies and innovative educational strategies for similar future crises.

Conflict of interest

The authors declare that they have no conflicts of interest. 

Acknowledgements

We would like to express our gratitude to Professor Paschalis Steiropoulos MD, PhD (Professor of Pulmonology, Medical School, Democritus University of Thrace) for his valuable guidance and support.

References

  1. Tokuç B, Varol G. Medical Education in Turkey in Time of COVID-19. Balkan Med J. 2020; 37: 180-181.
  2. Rose S. Medical Student Education in the Time of COVID-19. JAMA. 2020; 323: 2131-2132.
  3. Motte-Signoret E, Labbé A, Benoist G, Linglart A, Gajdos V, Lapillonne A. Perception of medical education by learners and teachers during the COVID-19 pandemic: a cross-sectional survey of online teaching. Med Educ Online. 2021; 26: 1919042.
  4. Tsiartas E, Kontopyrgou D, Kyprianou H, Haidich AB, Dardavessis T. Impact of COVID-19 pandemic on medical education in Greece: A cross-sectional study. Hippokratia. 2022; 26: 55-61.
  5. Tolsgaard MG, Cleland J, Wilkinson T, Ellaway RH. How we make choices and sacrifices in medical education during the COVID-19 pandemic. Med Teach. 2020; 42: 741-743.
  6. Birch E, de Wolf M. A novel approach to medical school examinations during the COVID-19 pandemic. Med Educ Online. 2020; 25: 1785680.
  7. Iancu AM, Kemp MT, Alam HB. Unmuting Medical Students’ Education: Utilizing Telemedicine During the COVID-19 Pandemic and Beyond. J Med Internet Res. 2020; 22: e19667.
  8. Mortagy M, Abdelhameed A, Sexton P, Olken M, Hegazy MT, Gawad MA, et al. Online medical education in Egypt during the COVID-19 pandemic: a nationwide assessment of medical students’ usage and perceptions. BMC Med Educ. 2022; 22: 218.
  9. Agyei-Nkansah A, Adjei P, Torpey K. COVID-19 and medical education: an opportunity to build back better. Ghana Med J. 2020; 54: 113-116.
  10. Kim SM, Park SG, Jee YK, Song IH. Perception and attitudes of medical students on clinical clerkship in the era of the Coronavirus Disease 2019 pandemic. Med Educ Online. 2020; 25: 1809929.
  11. Sharma S, Sharma V. Medical Education During the COVID-19 Pandemics – Challenges Ahead. Indian Pediatr. 2020; 57: 772.
  12. Camargo CP, Tempski PZ, Busnardo FF, Martins MA, Gemperli R. Online learning and COVID-19: a meta-synthesis analysis. Clinics (Sao Paulo). 2020; 75: e2286.
  13. Menon UK, Gopalakrishnan S, Unni C SN, Ramachandran R, Baby P, Sasidharan A, et al. Perceptions of undergraduate medical students regarding institutional online teaching-learning programme. Med J Armed Forces India. 2021; 77: S227-S233.
  14. Ansar F, Ali W, Khattak A, Naveed H, Zeb S. Undergraduate students’ perception and satisfaction regarding online learning system amidst COVID-19 Pandemic in Pakistan. J Ayub Med Coll Abbottabad. 2020; 32: S644-S650.
  15. Chinelatto LA, Costa TRD, Medeiros VMB, Boog GHP, Hojaij FC, Tempski PZ, et al. What You Gain and What You Lose in COVID-19: Perception of Medical Students on their Education. Clinics (Sao Paulo). 2020; 75: e2133.
  16. Park J, Park H, Lim JE, Rhim HC, Lee YM. Medical students’ perspectives on recommencing clinical rotations during coronavirus disease 2019 at one institution in South Korea. Korean J Med Educ. 2020; 32: 223-229.
  17. Wang R, Han J, Liu C, Wang L. Relationship between medical students’ perceived instructor role and their approaches to using online learning technologies in a cloud-based virtual classroom. BMC Med Educ. 2022; 22: 560.
  18. Al-Yateem N, Dias JM, Subu MA, Abraham MS, Abd El-Baky F, AlMarzouqi A, et al. Reflections on the transition to online teaching for health science education during the COVID-19 pandemic. Int J Med Educ. 2021; 12: 154-159.
  19. Zottmann JM, Horrer A, Chouchane A, Huber J, Heuser S, Iwaki L, et al. Isn’t here just there without a “t” – to what extent can digital Clinical Case Discussions compensate for the absence of face-to-face teaching? GMS J Med Educ. 2020; 37: Doc99.
  20. De Ponti R, Marazzato J, Maresca AM, Rovera F, Carcano G, Ferrario MM. Pre-graduation medical training including virtual reality during COVID-19 pandemic: a report on students’ perception. BMC Med Educ. 2020; 20: 332.
  21. Dost S, Hossain A, Shehab M, Abdelwahed A, Al-Nusair L. Perceptions of medical students towards online teaching during the COVID-19 pandemic: a national cross-sectional survey of 2721 UK medical students. BMJ Open. 2020; 10: e042378.
  22. Sun M, Rallis KS. Medical Education Adjustments Amid COVID-19: UK Medical Students’ Views. Indian Pediatr. 2020; 57: 1086.
  23. Fischbeck S, Hardt J, Malkewitz C, Petrowski K. Evaluation of a digitized physician-patient-communication course evaluated by preclinical medical students: a replacement for classroom education? GMS J Med Educ. 2020; 37: Doc85.
  24. Skrzypek A, Perera I, Szeliga M, Cebula G. Modification of teaching during the COVID-19 pandemic at the Department of Medical Education of Jagiellonian University Medical College. Folia Med Cracov. 2020; 60: 113-121.
  25. Stanton B. Medical Education in the Age of COVID-19. Acad Med. 2021; 96: e21.
  26. Nieto-Escamez FA, Roldán-Tapia MD. Gamification as Online Teaching Strategy During COVID-19: A Mini-Review. Front Psychol. 2021; 12: 648552.
  27. Arain SA, Ali M, Arbili L, Ikram MF, Kashir J, Omair A, et al. Medical Students and Faculty Perceptions About Online Learning During COVID-19 Pandemic: Alfaisal University Experience. Front Public Health. 2022; 10: 880835.
  28. Ohn MH, Ohn KM. An evaluation study on gamified online learning experiences and its acceptance among medical students. Tzu Chi Med J. 2019; 32: 211-215. Erratum in: Tzu Chi Med J. 2019; 32: 222.
  29. Back DA, Behringer F, Haberstroh N, Ehlers JP, Sostmann K, Peters H. Learning management system and e-learning tools: an experience of medical students’ usage and expectations. Int J Med Educ. 2016; 7: 267-273.
  30. Chen J, Zhou J, Wang Y, Qi G, Xia C, Mo G, et al. Blended learning in basic medical laboratory courses improves medical students’ abilities in self-learning, understanding, and problem solving. Adv Physiol Educ. 2020; 44: 9-14.
  31. Scott Kruse C, Karem P, Shifflett K, Vegi L, Ravi K, Brooks M. Evaluating barriers to adopting telemedicine worldwide: A systematic review. J Telemed Telecare. 2018; 24: 4-12.
  32. Rajab MH, Gazal AM, Alkattan K. Challenges to Online Medical Education During the COVID-19 Pandemic. Cureus. 2020; 12: e8966.
  33. Olum R, Kajjimu J, Kanyike AM, Chekwech G, Wekha G, Nassozi DR, et al. Perspective of Medical Students on the COVID-19 Pandemic: Survey of Nine Medical Schools in Uganda. JMIR Public Health Surveill. 2020; 6: e19847.
  34. Kaul V, Gallo de Moraes A, Khateeb D, Greenstein Y, Winter G, Chae J, et al. Medical Education During the COVID-19 Pandemic. Chest. 2021; 159: 1949-1960.
  35. Snekalatha S, Marzuk SM, Meshram SA, Maheswari KU, Sugapriya G, Sivasharan K. Medical students’ perception of the reliability, usefulness and feasibility of unproctored online formative assessment tests. Adv Physiol Educ. 2021; 45 :84-88.
  36. Li HO, Bailey AMJ. Medical Education Amid the COVID-19 Pandemic: New Perspectives for the Future. Acad Med. 2020; 95: e11-e12.
  37. Suzuki T, Murayama A, Kotera Y, Bhandari D, Senoo Y, Tani Y, et al. Cross-Country Student Perceptions about Online Medical Education during the COVID-19 Pandemic. Int J Environ Res Public Health. 2022; 19: 2840.
  38. Alkalash SH, Alabdali JA, Aldabli AO, Alnashri ZA, Almqaadi AK, Alabdali AH, et al. Perceptions of distance learning among Al-Qunfudhah medical students during the COVID-19 pandemic. J Taibah Univ Med Sci. 2022; 17: 516-522.
  39. Bączek M, Zagańczyk-Bączek M, Szpringer M, Jaroszyński A, Wożakowska-Kapłon B. Students’ perception of online learning during the COVID-19 pandemic: A survey study of Polish medical students. Medicine (Baltimore). 2021; 100: e24821.
  40. Khalil R, Mansour AE, Fadda WA, Almisnid K, Aldamegh M, Al-Nafeesah A, et al. The sudden transition to synchronized online learning during the COVID-19 pandemic in Saudi Arabia: a qualitative study exploring medical students’ perspectives. BMC Med Educ. 2020; 20: 285.
  41. Kang YJ, Kim DH. Pre-clerkship students’ perception and learning behavior of online classes during coronavirus disease 2019 pandemic. Korean J Med Educ. 2021; 33: 125-131.
  42. Gupta S, Dabas A, Swarnim S, Mishra D. Medical education during COVID-19 associated lockdown: Faculty and students’ perspective. Med J Armed Forces India. 2021; 77: S79-S84.
  43. Sandhaus Y, Kushnir T, Ashkenazi S. Electronic Distance Learning of Pre-clinical Studies During the COVID-19 Pandemic: A Preliminary Study of Medical Student Responses and Potential Future Impact. Isr Med Assoc J. 2020; 22: 489-493.
  44. Muflih S, Abuhammad S, Al-Azzam S, Alzoubi KH, Muflih M, Karasneh R. Online learning for undergraduate health professional education during COVID-19: Jordanian medical students’ attitudes and perceptions. Heliyon. 2021; 7: e08031.
  45. Li L, Wu H, Xie A, Ye X, Liu C, Wang W. Students’ initial perspectives on online learning experience in China during the COVID-19 outbreak: expanding online education for future doctors on a national scale. BMC Med Educ. 2021; 21: 584.
  46. Shabila NP, Alkhateeb NE, Dauod AS, Al-Dabbagh A. Exploring the perspectives of medical students on application of e-learning in medical education during the COVID-19 pandemic. Work. 2021; 70: 751-762.
  47. Wang Y, Yu R, Liu Y, Qian W. Students’ and Teachers’ Perspective on the Implementation of Online Medical Education in China: A Qualitative Study. Adv Med Educ Pract. 2021; 12: 895-903.
  48. Tuma F, Nassar AK, Kamel MK, Knowlton LM, Jawad NK. Students and faculty perception of distance medical education outcomes in resource-constrained system during COVID-19 pandemic. A cross-sectional study. Ann Med Surg (Lond). 2021; 62: 377-382.
  49. Cowan E, Altschafl B, Foertsch J, Barnes D, Lasarev M, Pelley E. A New Normal: Assessment Outcomes and Recommendations for Virtual Versus In-Person Curricula in Post-COVID-19 Times. Med Sci Educ. 2022; 32: 379-387.
  50. Tayem YI, Almarabheh AJ, Abo Hamza E, Deifalla A. Perceptions of Medical Students on Distance Learning During the COVID-19 Pandemic: A Cross-Sectional Study from Bahrain. Adv Med Educ Pract. 2022; 13: 345-354.
  51. Elshaer IA, Sobaih AEE. FLOWER: An Approach for Enhancing E-Learning Experience Amid COVID-19. Int J Environ Res Public Health. 2022; 19: 3823.
  52. Dyrek N, Wikarek A, Niemiec M, Owczarek AJ, Olszanecka-Glinianowicz M, Kocełak P. The perception of e-learning during the SARS-CoV-2 pandemic by students of medical universities in Poland – a survey-based study. BMC Med Educ. 2022; 22: 529.
  53. Shahrvini B, Baxter SL, Coffey CS, MacDonald BV, Lander L. Pre-clinical remote undergraduate medical education during the COVID-19 pandemic: a survey study. BMC Med Educ. 2021; 21: 13.
  54. Steiner-Hofbauer V, Grundnig JS, Drexler V, Holzinger A. Now, I think doctors can be heroes … Medical student’s attitudes towards the COVID-19 pandemic’s impact on key aspects of medical education and how the image of the medical profession has changed due to the COVID-19 pandemic. Wien Med Wochenschr. 2022; 172: 90-99.
  55. Rotar-Pavlic D, Erzar A, Uštar B, Maksuti A. Medical students’ perception of distance-based education during the COVID-19 pandemic in Slovenia: A qualitative study. Int J Educ Res Open. 2022; 3: 100135.
  56. Virumbrales M, Elorduy M, Graell M, Mezquita P, Brotons P, Balaguer A. COVID-19: Making the Best out of a Forced Transition to Online Medical Teaching-a Mixed Methods Study. Med Sci Educ. 2022; 32: 337-347.
  57. Hanafy SM, Jumaa MI, Arafa MA. A comparative study of online learning in response to the coronavirus disease 2019 pandemic versus conventional learning. Saudi Med J. 2021; 42: 324-331.
  58. Bhattarai B, Gupta S, Dahal S, Thapa A, Bhandari P. Perception of Online Lectures among Students of a Medical College in Kathmandu: A Descriptive Cross-sectional Study. JNMA J Nepal Med Assoc. 2021; 59: 234-238.
  59. Chalise GD, Bharati M, Bajracharya J, Kc A, Pradhan S, Adhikari B, et al. Undergraduate Medical Science Students’ Positive Attitude towards Online Classes during COVID-19 Pandemic in a Medical College: A Descriptive Cross-sectional Study. JNMA J Nepal Med Assoc. 2021; 59: 134-140.
  60. Alsoufi A, Alsuyihili A, Msherghi A, Elhadi A, Atiyah H, Ashini A, et al. Impact of the COVID-19 pandemic on medical education: Medical students’ knowledge, attitudes, and practices regarding electronic learning. PLoS One. 2020; 15: e0242905.
  61. Gismalla MD, Mohamed MS, Ibrahim OSO, Elhassan MMA, Mohamed MN. Medical students’ perception towards E-learning during COVID 19 pandemic in a high burden developing country. BMC Med Educ. 2021; 21: 377.
  62. Pokryszko-Dragan A, Marschollek K, Nowakowska-Kotas M, Aitken G. What can we learn from the online learning experiences of medical students in Poland during the SARS-CoV-2 pandemic? BMC Med Educ. 2021; 21: 450.
  63. Rohila J, Kapoor K, Singh J, Rohilla R, Bansal P, Chhabra P. Online medical teaching during COVID-19: Perspectives from teachers and taught. J Educ Health Promot. 2022; 11: 247.
  64. Song Y, Wang S, Liu Y, Liu X, Peng A. Online education at the medical School of Tongji University during the COVID-19 pandemic: a cross-sectional study. BMC Med Educ. 2021; 21: 512.
  65. Singh K, Srivastav S, Bhardwaj A, Dixit A, Misra S. Medical Education During the COVID-19 Pandemic: A Single Institution Experience. Indian Pediatr. 2020; 57: 678-679.
  66. Nepal S, Atreya A, Menezes RG, Joshi RR. Students’ Perspective on Online Medical Education Amidst the COVID-19 Pandemic in Nepal. J Nepal Health Res Counc. 2020; 18: 551-555.
  67. Wang C, Xie A, Wang W, Wu H. Association between medical students’ prior experiences and perceptions of formal online education developed in response to COVID-19: a cross-sectional study in China. BMJ Open. 2020; 10: e041886.
  68. Sandhu P, de Wolf M. The impact of COVID-19 on the undergraduate medical curriculum. Med Educ Online. 2020; 25: 1764740.
  69. Hammond D, Louca C, Leeves L, Rampes S. Undergraduate medical education and Covid-19: engaged but abstract. Med Educ Online. 2020; 25: 1781379.