ABSTRACT BACKGROUND: The longitudinal evaluation of students seems to be a better way to assess their knowledge compared with that of the traditional methods of evaluation, such as modular and final tests. Currently, progress testing is the most consolidated type of longitudinal testing method. However, despite being well consolidated as an assessment tool in medical education, the use of this type of test in residency programs is scarce. OBJECTIVES: This study aimed to investigate residents’ knowledge growth regarding residency training and to describe the implementation of a longitudinal evaluation test in ophthalmological residency training across several medical schools in Brazil. Finally, the study aimed to check whether performance in the tests can be used as a predictor of the results of the specialist title test. DESIGN AND SETTING: This was a prospective observational study. This study was conducted using an online platform. METHODS: Online tests were developed following the same pattern as the Brazilian Ophthalmology Council specialist tests. All the residents performed the test simultaneously. The tests were conducted once a year at the end of the school year. RESULTS: A progress test was conducted across 13 services with 259 residents. Our results demonstrated that resident scores improved over the years (P < 0.0001) and had a moderate correlation with the Brazilian Opthalmology Council specialist test (P = 0.0156). CONCLUSION: The progress test can be considered a valuable tool to assess knowledge, meaning their knowledge increased over residency training. In addition, it can be used as a predictor of the result in the specialist title test.

ABSTRACT Objective To investigate if there is knowledge improvement over the Residency years, as well as students’ satisfaction about progress test. Finally, to describe the implementation of the online progress test in some Ophthalmological Residency programs in Brazil. Methods It was an observational cross-section study. The participants were all Ophthalmology residents who accepted to join the study. They did an online test and answered demographic and satisfaction questionnaires. Results Two hundred and fifty-nine residents joined the study. 42,86% of the residents answered the demographic questionnaire and 6,95% answered the satisfaction questionnaire. In general, the residents approved the website as a tool for self-learning and to improve residency programs. Conclusion Over the years, the residents acquired knowledge during the residency program. In general, residents were satisfied with the test. The implementation of the online progress test system in the Ophthalmological Residency schools in Brazil was successful.

RESUMO Objetivo Avaliar se ocorre melhora do desempenho na prova dos residentes ao longo dos anos de curso e o grau de satisfação dos residentes com o teste de progresso. Além disso, descrever a implementação do teste de progresso em alguns serviços de residência em oftalmologia no Brasil. Métodos Estudo observacional prospectivo. Os participantes foram todos os residentes de Oftalmologia que aceitaram participar do estudo. Eles fizeram um teste online e responderam a um questionário pessoal e um de satisfação. Resultados Duzentos e cinquenta e nove residentes participaram do estudo. 42,86% dos residentes responderam o questionário pessoal e 6,95% responderam o questionário de satisfação. Em geral, os residentes aprovaram o site como instrumento de autoaprendizado e como instrumento para melhoria dos programas de residência. Conclusão Houve aquisição de conhecimento dos residentes ao longo do curso. De um modo geral, os residentes ficaram satisfeitos com o teste. A implementação do teste de progresso nos serviços de residência de Oftalmologia foi bem-sucedida.

ABSTRACT BACKGROUND: Because of the social isolation and distancing measures that were imposed to stop the spread of coronavirus disease 19 (COVID-19), new ways of teaching were implemented. OBJECTIVES: To describe the implementation of telesimulation and seek to assess students’ perceptions regarding telesimulation. DESIGN AND SETTING: Retrospective quantitative study conducted within the hospital simulation at a private medical school in São Paulo, Brazil. METHODS: After telesimulation training, students answered a questionnaire that provided an overall assessment of this activity, self-assessment and assessments of the facilitators and infrastructure provided by the University. RESULTS: Among the students, 50% reported that the activity was below expectations and 45% reported that it was in line with their expectations. The strong points of the activity were the clinical cases, workload and teachers. The main challenge was students’ difficulty in reflecting on their learning and the infrastructure. CONCLUSIONS: Since students have less experience and fewer clinical encounters than residents or professionals, they also face more difficulty. Although telesimulation may have provided a valid alternative to replace simulation training during the COVID-19 pandemic, more face-to-face activities should be offered to students, when possible.

ABSTRACT BACKGROUND: The longitudinal evaluation of students seems to be a better way to assess their knowledge compared with that of the traditional methods of evaluation, such as modular and final tests. Currently, progress testing is the most consolidated type of longitudinal testing method. However, despite being well consolidated as an assessment tool in medical education, the use of this type of test in residency programs is scarce. OBJECTIVES: This study aimed to investigate residents’ knowledge growth regarding residency training and to describe the implementation of a longitudinal evaluation test in ophthalmological residency training across several medical schools in Brazil. Finally, the study aimed to check whether performance in the tests can be used as a predictor of the results of the specialist title test. DESIGN AND SETTING: This was a prospective observational study. This study was conducted using an online platform. METHODS: Online tests were developed following the same pattern as the Brazilian Ophthalmology Council specialist tests. All the residents performed the test simultaneously. The tests were conducted once a year at the end of the school year. RESULTS: A progress test was conducted across 13 services with 259 residents. Our results demonstrated that resident scores improved over the years (P < 0.0001) and had a moderate correlation with the Brazilian Opthalmology Council specialist test (P = 0.0156). CONCLUSION: The progress test can be considered a valuable tool to assess knowledge, meaning their knowledge increased over residency training. In addition, it can be used as a predictor of the result in the specialist title test.

ABSTRACT BACKGROUND: Coronavirus disease-19 (COVID-19) has imposed a new reality that presents several challenges for healthcare professionals. The main challenge has been the lack of proper training in relation to an unknown disease. OBJECTIVE: To investigate healthcare professionals’ acquisition of knowledge of a new airway management protocol for COVID-19 through their participation in simulation training. DESIGN AND SETTING: Pre and post-test study with purpose sampling, carried out in a tertiary-level hospital in the city of Campinas, state of São Paulo, Brazil. METHODS: This was a cross-sectional pre and post-test intervention among healthcare professionals working in the intensive care unit and emergency department of a large hospital. The training was carried out using an in situ simulation scenario and the participants answered pre and post-tests consisting of a 20-item questionnaire about the new protocol. RESULTS: The paired-sample t test demonstrated that there was a significant increase in test score (t = −19.06; P < 0.001), from before the training (M = 8.62; standard deviation, SD = 3.53) to after the simulation training (M = 17.02; SD = 1.76). CONCLUSIONS: The simulated training had a positive impact on the healthcare professionals’ acquisition of the COVID-19 protocol. We also demonstrated that in situ simulation training was an efficient tool for implementing new protocols, thus bringing benefits to healthcare systems, professionals and patients.

SUMMARY INTRODUCTION: The challenge of facing COVID-19 falls under all health care structures, and without specific training to health care professionals they are probably the professionals with the highest level of exposure. Regardless of the level of health care, the training of professionals aims to optimize resources and attend patients while assuring quality and security. POINT OF VIEW: This report proposes simulation training for health care professionals to update professionals for attending patients during the pandemic. This training was built with five simulated stations, considering different stages of a patient with COVID-19. This report takes advantage of different simulation techniques, such as skills training, standardized patient, medium- and high-fidelity simulator, rapid cycle of deliberate practice, and in situ simulation. DISCUSSION: Medical procedures for COVID-19 patients offer additional risk for health care professionals, especially considering exposure to procedures that generate aerosols, such as compression, mask ventilation, and orotracheal intubation. Thus, finding educational strategies that allow training is essential to simulate the evolution of COVID-19 patients in a safe manner. CONCLUSION: Simulation has proven to be a useful and effective form of training around the world for training health teams on the front lines for patient care in COVID-19.

ABSTRACT BACKGROUND: Progress tests are longitudinal assessments of students’ knowledge based on successive tests. Calibration of the test difficulty is challenging, especially because of the tendency of item-writers to overestimate students’ performance. The relationships between the levels of Bloom’s taxonomy, the ability of test judges to predict the difficulty of test items and the real psychometric properties of test items have been insufficiently studied. OBJECTIVE: To investigate the psychometric properties of items according to their classification in Bloom’s taxonomy and judges’ estimates, through an adaptation of the Angoff method. DESIGN AND SETTING: Prospective observational study using secondary data from students’ performance in a progress test applied to ten medical schools, mainly in the state of São Paulo, Brazil. METHODS: We compared the expected and real difficulty of items used in a progress test. The items were classified according to Bloom’s taxonomy. Psychometric properties were assessed based on their taxonomy and fields of knowledge. RESULTS: There was a 54% match between the panel of experts’ expectations and the real difficulty of items. Items that were expected to be easy had mean difficulty that was significantly lower than that of items that were expected to be medium (P < 0.05) or difficult (P < 0.01). Items with high-level taxonomy had higher discrimination indices than low-level items (P = 0.026). We did not find any significant differences between the fields in terms of difficulty and discrimination. CONCLUSIONS: Our study demonstrated that items with high-level taxonomy performed better in discrimination indices and that a panel of experts may develop coherent reasoning regarding the difficulty of items.

Este artigo teve como objetivo verificar as diferenças de condutas agressivas entre um grupo de pessoas que cometeram delitos (grupo 1) e um grupo de universitários com as maiores pontuações na Escala de Avaliação de Tendência a Agressividade (grupo 2). O grupo 1 foi constituído por 41 jovens com idades entre 18 e 19 anos, enquanto o grupo 2 foi composto por 42 participantes universitários com idades entre 18-29 anos. Os resultados mostraram o grupo 1 caracterizou-se por condutas relacionadas a enganar para prejudicar, obter sexo ou não perceberem minha culpa; desafiar pessoas, descarregar a raiva em alguém e andar armado, enquanto o grupo 2 apresentou apenas o fato falar alto quando não atendido ou entendido.

This article aims to verify the differences in aggressive behaviors in a group of people who committed crimes (group 1) and a group of college students with the highest scores on the Escala de Avaliação de Tendência a Agressividade (group 2). Group 1 consisted of 41 18-19 years persons, while Group 2 was composed of 42 18-29 year-old participating students. The results showed that group 1 was characterized by conduct related to injury, sex, or it is not my fault; defying people, raging at someone and carrying a gun. Group 2 showed only the fact "speak loud" when misunderstood.

Este artículo tiene como objetivo verificar las diferencias de conductas agresivas entre un grupo de personas que cometieron delitos (grupo 1) y un grupo de universitarios con los más altos puntajes en la Escala de Avaliação de Tendência a Agressividade (grupo 2). El grupo fue compuesto por 41 jóvenes de edades comprendidas entre 18 y 19 años, mientras que el grupo 2 fue compuesto por 42 universitarios de edades entre 18-29 años. Los resultados mostraron que el grupo 1 se caracterizó por conductas relacionadas a engañar para perjudicar, tener sexo, o no darse cuenta de mi culpa; desafiar a la gente; descargar la ira en alguien y estar armado, mientras que el grupo 2 presentó solamente el facto de hablar alto cuando no atendidos o entendidos.