1. A brief review on benchmarking for large language models evaluation in healthcareLeona Cilar Budler, Hongyu Chen, Aokun Chen, Maxim Topaz, Wilson Tam, Jiang Bian, Gregor Štiglic, 2025, pregledni znanstveni članek Opis: This paper reviews benchmarking methods for evaluating large language models (LLMs) in healthcare settings. It highlights the importance of rigorous benchmarking to ensure LLMs' safety, accuracy, and effectiveness in clinical applications. The review also discusses the challenges of developing standardized benchmarks and metrics tailored to healthcare-specific tasks such as medical text generation, disease diagnosis, and patient management. Ethical considerations, including privacy, data security, and bias, are also addressed, underscoring the need for multidisciplinary collaboration to establish robust benchmarking frameworks that facilitate LLMs' reliable and ethical use in healthcare. Evaluation of LLMs remains challenging due to the lack of standardized healthcare-specific benchmarks and comprehensive datasets. Key concerns include patient safety, data privacy, model bias, and better explainability, all of which impact the overall trustworthiness of LLMs in clinical settings. Ključne besede: artificial intelligence, benchmarking, chatbots, healthcare, large language models, natural language processing Objavljeno v DKUM: 12.05.2025; Ogledov: 0; Prenosov: 0
Povezava na datoteko |
2. Surveying healthcare workers to improve the design, wearer experience and sustainability of PPE isolation gownsSonja Šterman, Katherine Townsend, Eloise Salter, Karen Harrigan, 2022, izvirni znanstveni članek Opis: This protective clothing design project responds to the urgent need for research into the redesign of personal protective equipment (PPE) isolation gowns, to be more fit for purpose and reusable to enhance the experiences of healthcare workers treating patients with COVID-19 and variants. Funded by the Arts and Humanities Research Council (AHRC) the research addresses the engineering question: “What new materials, design and manufacturing approaches should we start to consider in preparation for pandemics e.g. reusable PPE to replace single use?” The article focuses on the online questionnaire/ survey, its main findings and the ‘participatory clothing design’ methodology which prioritises the lived experiences and expressed needs of healthcare workers wearing disposable and reusable PPE in acute care scenarios. Research methods include literature and gown reviews, selected interviews and survey directed at nurses, to acquire first-hand qualitative data about the impact of current gown design and procurement policies on wearers. Selected results and commentary from the ongoing survey are presented and thematically analysed to inform the development of reusable gowns. Semi-structured interviews with clinical leads and caregivers, as well as responses from users, will be important to integrate expertise in fashion, textile and uniform design, clinical practice, and manufacturing. Further design will be based on a complex design brief that balances the needs of wearers and critical care providers while considering regulations, protection, comfort, sustainability, and cost. This research focuses on enhancing an overlooked area of critical care clothing and the people who wear it while reducing its detrimental impact on the planet. Ključne besede: zdravstveni delavci, ankete, izolacijske obleke, oblačila za večkratno uporabo, izkušnje uporabnika, kvalitativno raziskovanje, healthcare workers, surveys, isolation gowns, reusable PPE, wearer experience, qualitative research Objavljeno v DKUM: 26.03.2025; Ogledov: 0; Prenosov: 3
Povezava na celotno besedilo Gradivo ima več datotek! Več... |
3. Siting of healthcare care facilities based on the purpose of their operation, demographic changes, environmental characteristics, and the impact on public healthMarko Jaušovec, Nande Korpnik, Branko Gabrovec, Vanja Skalicky Klemenčič, 2022, pregledni znanstveni članek Opis: A contemporary approach to the spatial design of healthcare care facilities faces numerous
challenges at the crossroads of multidisciplinary topics of architecture and urbanism, healthcare,
security, and organisational sciences. Due to the unique combination of uses, users and architectural
expression, they are defined as urban nodes. With their inclusion, architects facilitate a better
placing of healthcare facilities, indirectly improving human health. The purpose of the article is
to seek guidelines for the siting of healthcare facilities to provide suitable and equal healthcare to
different social structures, and for the optimal and fair spatial distribution of healthcare services.
The descriptive method was used to review literature on the siting of healthcare facilities based on
the purpose of their operation, demographic changes, environmental characteristics, and the impact
on public health. This method was selected as it facilitates data acquisition from various sources
and a comprehensive understanding of the topic discussed. The results of the research show how
important the impact of the healthcare care facilities siting on human health and the wider social
significance of the topic discussed is. The findings may provide guidelines and proposals for future
spatial decisions. Ključne besede: healthcare facility location, healthcare facility location modelling, hospital geographic location, healthcare facility location planning, healthcare facility spatial plannin Objavljeno v DKUM: 13.03.2025; Ogledov: 0; Prenosov: 9
Celotno besedilo (528,91 KB) Gradivo ima več datotek! Več... |
4. Burnout and job satisfaction of healthcare workers in Slovenian nursing homes in rural areas during the COVID-19 pandemicLjiljana Leskovic, Karmen Erjavec, Robert Leskovar, Goran Vukovič, 2020, izvirni znanstveni članek Opis: Introduction and objective: Since there is no study on burnout and job satisfaction in Slovenian nursing homes during the COVID-19 pandemic, this study aims to analyse job satisfaction and burnout levels of healthcare professionals working in Slovenian nursing homes in rural areas during the COVID-19 pandemic, and make a comparison with the results of the same services in 2013.
Material and methods: The study is based on a cross-organisational and descriptive quantitative study conducted in spring 2013 (n = 556) and spring 2020 at the peak of the pandemic in Eastern Europe (n = 781) to identify the relationships and the changes in the satisfaction and burnout levels of healthcare professionals working in Slovenian nursing homes in rural areas, and on a qualitative study conducted in 2020, to identify in-depth relationships and changes in both studies during the COVID-19 pandemic.
Results: An increase in burnout syndromes between 2013 – 2020 was observed. The respondents experienced intensified emotional exhaustion and lack of personal accomplishment during the COVID-19 pandemic; however, depersonalisation did not differ statistically over the years. During the pandemic crisis, healthcare workers were less satisfied with their job than in spring 2013. Their job satisfaction was related to satisfaction with the work of nursing homes and with the work of state institutions and politicians who directly affected their working conditions and recognition in society.
Conclusions: The COVID-19 pandemic significantly exacerbated already existing burnout syndromes of nursing homes healthcare workers in Slovenian rural areas. Job satisfaction proved to be a relevant predictor of burnout syndrome. A negative correlation was observed between job satisfaction in 2020 and emotional exhaustion and personal accomplishment in 2013 and 2020. Ključne besede: job satisfaction, professional burnout, healthcare workers, nursing homes, COVID-19 pandemic Objavljeno v DKUM: 28.01.2025; Ogledov: 0; Prenosov: 7
Celotno besedilo (380,01 KB) Gradivo ima več datotek! Več... |
5. Safety culture at primary healthcare level : a cross-sectional study among employees with a leadership roleZalika Klemenc-Ketiš, Tonka Poplas-Susič, 2020, izvirni znanstveni članek Opis: Introduction: An effective leadership is critical to the development of a safety culture within an organization. With this study, the authors wanted to assess the self-perceived level of safety culture among the employees with a leadership function in the Ljubljana Community Health Centre.
Methods: This was a cross-sectional study in the largest community health centre in Slovenia. We sent an invitation to all employees with a leadership role (N=211). The Slovenian version of the SAQ – Short Form as a measurement of a safety culture was used. The data on demographic characteristics (gender, age, role, work experience, working hours, and location of work) were also collected. An electronic survey was used.
Results: The final sample consisted of 154 (69.7%) participants, out of which 136 (88.3%) were women. The mean age and standard deviation of the sample was 46.2±10.5 years. The average scores for the safety culture domains on a scale from 1 to 5 were 4.1±0.6 for Teamwork Climate, Safety Climate, and Working Conditions and Satisfaction, 3.7±0.5 for Perception of Management, 3.6±0.4 for Communication, and 3.5±0.6 for Stress Recognition.
Conclusion: The safety culture among leaders in primary healthcare organizations in Slovenia is perceived as positive. There is also a strong organizational culture. Certain improvements are needed, especially in the field of communication and stress recognition with regards to safety culture. Ključne besede: safety culture, primary healthcare, organizational culture Objavljeno v DKUM: 24.01.2025; Ogledov: 0; Prenosov: 4
Celotno besedilo (293,47 KB) Gradivo ima več datotek! Več... |
6. Scaling-up an integrated care for patients with non-communicable diseases : an analysis of healthcare barriers and facilitators in Slovenia and BelgiumČrt Zavrnik, Katrien Danhieux, Miriam Hurtado Monarres, Nataša Stojnić, Majda Mori-Lukančič, Monika Martens, Zalika Klemenc-Ketiš, Edwin Wouters, Josefien Van Olmen, Tonka Poplas-Susič, 2021, izvirni znanstveni članek Opis: Introduction: Although the concept of integrated care for non-communicable diseases was introduced at the primary level to move from disease-centered to patient-centered care, it has only been partially implemented in European countries. The aim of this study was to identify and compare identified facilitators and barriers to scale-up this concept between Slovenia and Belgium.
Methods: This was a qualitative study. Fifteen focus groups and fifty-one semi-structured interviews were conducted with stakeholders at the micro, meso and macro levels. In addition, data from two previously published studies were used for the analysis. Data collection and analysis was initially conducted at country level. Finally, the data was evaluated by a cross-country team to assess similarities and differences between countries.
Results: Four topics were identified in the study: patient-centered care, teamwork, coordination of care and task delegation. Despite the different contexts, true teamwork and patient-centered care are limited in both countries by hierarchies and a very heavily skewed medical approach. The organization of primary healthcare in Slovenia probably facilitates the coordination of care, which is not the case in Belgium. The financing and organization of primary practices in Belgium was identified as a barrier to the implementation of task delegation between health professionals.
Conclusions: This study allowed formulating some important concepts for future healthcare for non-communicable diseases at the level of primary healthcare. The results could provide useful insights for other countries with similar health systems. Ključne besede: scale-up, noncommunicable diseases, patientcentered care, primary healthcare, integrated healthcare Objavljeno v DKUM: 22.10.2024; Ogledov: 0; Prenosov: 7
Celotno besedilo (428,11 KB) Gradivo ima več datotek! Več... |
7. Implementation of a savvy mobile ECG sensor for heart rhythm disorder screening at the primary healthcare levelStaša Vodička, Tonka Poplas-Susič, Erika Zelko, 2021, izvirni znanstveni članek Opis: Introduction: The Jozef Stefan Institute developed a personal portable electrocardiogram (ECG) sensor Savvy that works with a smartphone, and this was used in our study. This study aimed to analyze the usefulness of telecardiology at the primary healthcare level using an ECG personal sensor.
Methods: We included 400 patients with a history of suspected rhythm disturbance who visited their family physician at the Healthcare Center Ljubljana and Healthcare Center Murska Sobota from October 2016 to January 2018.
Results: The study found that there was no statistically significant difference between the test and control groups in the number of present rhythm disorders and actions taken to treat patients with either observation or administration of a new drug. However, in the test group, there were significantly fewer patients being referred to a cardiologist than in the control group (p < 0.001).
Discussion: The use of an ECG sensor helps family physicians to distinguish between patients who need to be referred to a cardiologist and those who can be treated by them. This method is useful for both physicians and patients because it shortens the time taken to start treatment, can be used during pandemics such as COVID-19, and reduces unnecessary cost. Ključne besede: heart rhythm disorders, palpitations, primary healthcare, personal mobile ECG sensor, referrals Objavljeno v DKUM: 21.10.2024; Ogledov: 0; Prenosov: 1
Celotno besedilo (1,09 MB) Gradivo ima več datotek! Več... |
8. The safety culture of the Ljubljana community health centre's employeesŠpela Tevžič, Tonka Poplas-Susič, Zalika Klemenc-Ketiš, 2021, izvirni znanstveni članek Opis: Introduction: Patient safety is one of the key aspects of healthcare quality and a serious global public health concern. Patient safety culture is a part of the patient safety concept. In Slovenia, primary care is easily accessible, and for medical care, it serves as a gatekeeper to hospital care. For several years, the quality and safety at the primary healthcare level have been the focus of several studies. The present study aimed to assess patient safety culture among all employees of the Community Health Centre Ljubljana.
Methods: We conducted a cross-sectional study in 2017 using the Slovene version of “Medical Office Survey on Patient Safety Culture” from the Agency for Healthcare Research and Quality. Mean percent positive scores on all items in each composite were calculated according to a user guide.
Results: The final sample contained 1021 participants (67.8% response rate), of which 909 (89.0%) were women. The mean age of the sample was 43.0±11.0 years. The dimensions most highly rated by the respondents were: teamwork and patient care tracking/follow-up. The lowest scores came from leadership support for patients’ safety and work pressure and pace.
Conclusion: Patient safety culture in the Community Health Centre Ljubljana is high, but there are certain areas of patient safety that need to be evaluated further and improved. Our study revealed differences between professions, indicating that a customized approach per profession group might contribute to the successful implementation of safety strategies. Patient safety culture should be studied at national levels. Ključne besede: patient safety, safety culture, family medicine, primary healthcare, Slovenia Objavljeno v DKUM: 18.10.2024; Ogledov: 0; Prenosov: 5
Celotno besedilo (415,12 KB) Gradivo ima več datotek! Več... |
9. Working conditions and satisfaction with working conditions among Slovenian family medicine trainees : a cross-sectional studyKlemen Pašić, Vojislav Ivetić, 2021, izvirni znanstveni članek Opis: Introduction: In order to achieve a high standard in training programmes for future family medicine specialists, it is essential to have good tutors with well-organised family medicine practices. Proper working conditions for young doctors are essential for their satisfaction and future professional development. The aim of our study was to check the current working conditions of family medicine trainees in the practical modular part of the training programme in Slovenia, and to determine their satisfaction with working conditions.
Methods: A cross-sectional study was conducted. The data was collected through a questionnaire distributed to 105 family medicine trainees undergoing the practical modular part of their training programme.
Results: The study showed that the following 7 out of 25 organisational and labour law factors are significantly associated with a trainee's general satisfaction with working conditions: the location where work with patients takes place, the privacy of the premises, the accessibility of the main tutor, a constant patient population, suitable places for rest, paid out-of-hours substitutions, and appropriate pay grade.
Conclusion: The results we obtained can be used to address certain aspects of trainee's working conditions in Slovenia that need improvement. By determining which working conditions significantly affect a trainee's satisfaction, we have the opportunity to modify these conditions and thereby improve the training programme. This could result in a less stressful and more efficient residency programme. Ključne besede: family medicine, primary healthcare, trainees, working conditions, satisfaction Objavljeno v DKUM: 08.10.2024; Ogledov: 0; Prenosov: 7
Celotno besedilo (385,25 KB) Gradivo ima več datotek! Več... |
10. Mapping users' experience of a family history and genetic risk algorithm tool in primary careŠpela Miroševič, Kaja Krajc, Zalika Klemenc-Ketiš, Polona Selič-Zupančič, 2022, izvirni znanstveni članek Opis: Introduction: The development of a family history (FH) questionnaire (FHQ) provides an insight into a patient's familiarity of a trait and helps to identify individuals at increased risk of disease. A critical aspect of developing a new tool is exploring users' experience.
Objective: The objective of this study was to examine users' experience, obstacles and challenges, and their views and concerns in the applicability of a new tool for determining genetic risk in Slovenia's primary care.
Methods: We used a qualitative approach. The participants completed a risk assessment software questionnaire that calculates users' likelihood of developing familial diseases. Audio-taped semi-structured telephone interviews were conducted to evaluate their experience. There were 21 participants, and analyses using the constant comparative method were employed.
Results: We identified 3 main themes: obstacles/key issues, suggestions for improvements, and coping. The participants were poorly satisfied with the clarity of instructions, technical usability problems, and issues with the entry of relatives' data. They expressed satisfaction with some of the characteristics of the FHQ (e.g., straightforward and friendly format, easy entry, and comprehension). They suggested simpler language, that the disease risk should be targeted toward the disease, that the FHQ should include patient-specific recommendations, and that it should be part of the electronic medical records. When discussing what would they do with the results of the FHQ, the participants used different coping strategies: active (e.g., seeking information) or passive (e.g., avoidance).
Discussion/conclusion: User experience was shown to be a synthesis of obstacles, overcoming them with suggestions for improvements, and exploration of various coping mechanisms that may emerge from dealing with the stressor of "being at risk." Ključne besede: primary healthcare, family history, qualitative methodology Objavljeno v DKUM: 01.10.2024; Ogledov: 0; Prenosov: 6
Celotno besedilo (361,59 KB) Gradivo ima več datotek! Več... |