1. Controllable speech-driven gesture generation with selective activation of weakly supervised controlsKarlo Crnek, Matej Rojc, 2025, original scientific article Abstract: Generating realistic and contextually appropriate gestures is crucial for creating engaging embodied conversational agents. Although speech is the primary input for gesture generation, adding controls like gesture velocity, hand height, and emotion is essential for generating more natural, human-like gestures. However, current approaches to controllable gesture generation often utilize a limited number of control parameters and lack the ability to activate/deactivate them selectively. Therefore, in this work, we propose the Cont-Gest model, a Transformer-based gesture generation model that enables selective control activation through masked training and a control fusion strategy. Furthermore, to better support the development of such models, we propose a novel evaluation-driven development (EDD) workflow, which combines several iterative tasks: automatic control signal extraction, control specification, visual (subjective) feedback, and objective evaluation. This workflow enables continuous monitoring of model performance and facilitates iterative refinement through feedback-driven development cycles. For objective evaluation, we are using the validated Kinetic–Hellinger distance, an objective metric that correlates strongly with the human perception of gesture quality. We evaluated multiple model configurations and control dynamics strategies within the proposed workflow. Experimental results show that Feature-wise Linear Modulation (FiLM) conditioning, combined with single-mask training and voice activity scaling, achieves the best balance between gesture quality and adherence to control inputs. Keywords: gesture generation, objective evaluation, selective control activation, transformers, weakly supervised learning Published in DKUM: 09.09.2025; Views: 0; Downloads: 3
Full text (1,63 MB) |
2. User evaluation of a machine learning-based student performance prediction platformArbër H. Hoti, Xhemal Zenuni, Mentor Hamiti, Jaumin Ajdari, 2025, original scientific article Abstract: Background/Purpose: The integration of machine learning in education has opened new possibilities for predicting student performance and enabling early interventions. While most of the work has been focused on prediction algorithms design and evaluations, little work has been done on user-centric evaluations. Methodology: This study evaluates a web-based platform designed for student performance prediction using various machine learning algorithms. Users, including students, professors, and career counselors, tested the platform and provided feedback on usability, accuracy, and recommendation likelihood. Results: Results indicate that the platform is user-friendly, requires minimal technical support, and delivers reliable predictions. Conclusion: Users strongly endorsed its adoption, highlighting its potential to assist educators in identifying at-risk students and improving academic outcomes. Keywords: student performance, machine learning, system evaluation Published in DKUM: 05.09.2025; Views: 0; Downloads: 0
Full text (2,00 MB) This document has many files! More... |
3. Communication with disabled fans at sports events : approaches, challenges, and opportunitiesMartin Koželj, Iztok Podbregar, Maja Meško, Irena Nančovska Šerbec, 2025, original scientific article Abstract: This study investigates how effectively European football clubs communicate
and implement accessibility features for disabled fans, aiming to develop a comprehensive
framework for evaluating these practices. Using a multi-phase research design, the study
analyzes disability support systems through semi-structured interviews with representatives from eleven European football clubs and a systematic analysis of club documentation.
The methodology combined traditional qualitative analysis with large language model
(LLM)-assisted content analysis, enabling robust identification of thematic patterns and
performance indicators. Our findings reveal significant disparities in disability support
practices, with larger clubs demonstrating structured approaches through dedicated Disability Access Officers (DAOs) and comprehensive communication strategies. Analysis
identified three distinct performance tiers: Elite Performers, primarily well-resourced clubs
with advanced systems; Solid Performers, mid-tier clubs with established frameworks; and
Developing Systems, smaller organizations with emerging support structures. We present
a validated Fan Communication Model incorporating key weighted criteria, including
infrastructure, dedicated personnel, engagement, specific adaptations, ticketing, challenge
management, and feedback systems. This model provides a standardized framework
for evaluating disability support communication in football organizations. The research
demonstrates the importance of integrating technological solutions with human-centered
approaches while maintaining universal design principles. Our findings contribute to the
sports accessibility literature and provide evidence-based recommendations for football
organizations seeking to enhance their communication with disabled fans.
Keywords: disability access, football organizations, fan communication, communication strategies, sport accessibility, inclusive design, performance evaluation Published in DKUM: 26.08.2025; Views: 0; Downloads: 2
Full text (1,96 MB) This document has many files! More... |
4. Student perception of assessment in the teaching and learning process of art educationBea Tomšič Amon, 2024, original scientific article Abstract: This paper discusses the importance of the learning and teaching process in art education in light of the accepted methods for establishing criteria for evaluating student achievement. The complex experience of art education is difficult to measure based on scales that use ambiguous verbal categories and standardize the image of the student in an activity intended for the opposite: to express what is unique to each individual in an artistic way. Some assessment strategies are presented, as well as a questionnaire with various student opinions about assessment, alongside the factors that influence these opinions. Keywords: art education, assessment, evaluation, learning styles, grades Published in DKUM: 30.07.2025; Views: 0; Downloads: 0
Full text (368,92 KB) This document has many files! More... |
5. Metacognitive skills of pupils in primary mathematics educationEva Nováková, 2024, original scientific article Abstract: In educational theory and research, metacognition is increasingly seen as an important predictor of successful learning – it is the key to learning and academic achievement. The study investigates "off-line" metacognition (i.e. the level of prediction and the level of self-evaluation) in relation to the solving of mathematical problems by primary school pupils. The research was carried out on a group of 311 pupils of 16 classes of primary schools. We used the test consisting of five tasks, which also included questions aimed at finding out the level of pupils' prediction and their level of self-evaluation. We processed the obtained data with the intentions of a quantitative methodological approach. It follows from the research findings that students who were successful in solving the tasks achieved a higher level of prediction and self-assessment than students who were not successful. Keywords: metacognition, prediction, self-evaluation, solving of problems Published in DKUM: 29.07.2025; Views: 0; Downloads: 4
Full text (491,50 KB) This document has many files! More... |
6. Task-oriented evaluation of the feasible kinematic directional capabilities for robot machiningSaša Stradovnik, Aleš Hace, 2022, original scientific article Abstract: Performing the machining of complex surfaces can be a challenging task for a robot, especially in terms of collaborative robotics, where the available motion capabilities are greatly reduced
in comparison with conventional industrial robot arms. It is necessary to evaluate these capabilities
prior to task execution, for which we need efficient algorithms, especially in the case of flexible
robot applications. To provide accurate and physically consistent information about the maximum
kinematic capabilities while considering the requirements of the task, an approach called the Decomposed Twist Feasibility (DTF) method is proposed in this study. The evaluation of the maximum
feasible end-effector velocity is based on the idea of decomposition into the linear and angular motion
capabilities, considering a typical robot machining task with synchronous linear and angular motion.
The proposed DTF method is presented by the well-known manipulability polytope concept. Unlike
the existing methods that estimate the kinematic performance capabilities in arbitrarily weighted
twist space, or separately in the translation and the rotation subspace, our approach offers an accurate
and simple solution for the determination of the total kinematic performance capabilities, which is
often highly required, especially in the case of robot machining tasks. The numerical results obtained
in this study show the effectiveness of the proposed approach. Moreover, the proposed DTF method
could represent suitable kinematic performance criteria for the optimal placement of predefined tasks
within the robot workspace Keywords: robot surface machining, task feasibility, task-dependent kinematic capability, kinematic performance evaluation, manipulability index, manipulability polytope, motion decomposition, Decomposed Twist Feasibility method, DTF method Published in DKUM: 01.04.2025; Views: 0; Downloads: 5
Full text (9,47 MB) This document has many files! More... |
7. Probability and certainty in the performance of evolutionary and swarm optimization algorithmsNikola Ivković, Robert Kudelić, Matej Črepinšek, 2022, original scientific article Abstract: Reporting the empirical results of swarm and evolutionary computation algorithms
is a challenging task with many possible difficulties. These difficulties stem from the stochastic
nature of such algorithms, as well as their inability to guarantee an optimal solution in polynomial
time. This research deals with measuring the performance of stochastic optimization algorithms, as
well as the confidence intervals of the empirically obtained statistics. Traditionally, the arithmetic
mean is used for measuring average performance, but we propose quantiles for measuring average,
peak and bad-case performance, and give their interpretations in a relevant context for measuring
the performance of the metaheuristics. In order to investigate the differences between arithmetic
mean and quantiles, and to confirm possible benefits, we conducted experiments with 7 stochastic
algorithms and 20 unconstrained continuous variable optimization problems. The experiments
showed that median was a better measure of average performance than arithmetic mean, based on
the observed solution quality. Out of 20 problem instances, a discrepancy between the arithmetic
mean and median happened in 6 instances, out of which 5 were resolved in favor of median and
1 instance remained unresolved as a near tie. The arithmetic mean was completely inadequate
for measuring average performance based on the observed number of function evaluations, while
the 0.5 quantile (median) was suitable for that task. The quantiles also showed to be adequate for
assessing peak performance and bad-case performance. In this paper, we also proposed a bootstrap
method to calculate the confidence intervals of the probability of the empirically obtained quantiles.
Considering the many advantages of using quantiles, including the ability to calculate probabilities
of success in the case of multiple executions of the algorithm and the practically useful method of
calculating confidence intervals, we recommend quantiles as the standard measure of peak, average
and bad-case performance of stochastic optimization algorithms. Keywords: algorithmic performance, experimental evaluation, metaheuristics, quantile, confidence interval, stochastic algorithms, evolutionary computation, swarm intelligence, experimental methodology Published in DKUM: 28.03.2025; Views: 0; Downloads: 9
Full text (490,48 KB) This document has many files! More... |
8. Framing the tourist spatial identity of a city as a tourist productMelita Rozman Cafuta, 2022, original scientific article Abstract: Purpose – The purpose of this paper is to develop a methodology for shaping the tourist spatial identity of the city and to take advantage of it to discover alternative urban outdoor spaces. As the number of indoor visitors has been limited due to the COVID-19 pandemic, open urban areas such as streets, squares and parks have become more important tourist locations. Design/methodology/approach – The assessment methodology consists of two basic steps. In the first step, the authors look for places or points that are carriers of spatial identity. For this purpose, the method of mental mapping is used. In the second step, statistical methods are used to evaluate the spatial suitability for the most common tourist activities. To obtain a holistic picture, a temporal component is included. Findings – The application of the methodology is presented in the form of a case study. The obtained research results provide an insight into the spatial situation of the city of Maribor (Slovenia, Europe). Tourist spatial identity of a city depends on time. Based on the value of spatial sensitivity indicator and the suitability of activities, it is possible to adapt the tourist offer to the temporal component. Originality/value – To the best of the authors’ knowledge, this is an original perspective on the spatial identity of tourists. The presented approach could be integrated as a good practice in any other city worldwide. It supports the identification of suitable outdoor tourist places that are memorable, cosy, multifunctional and can be recommended by city guides (mobile or printed books). Every city has many hidden gems that tourists have yet to discover Keywords: urban tourism, evaluation methodology, image of the city, mental mapping, spatial identity Published in DKUM: 12.03.2025; Views: 0; Downloads: 8
Full text (611,33 KB) This document has many files! More... |
9. A framework for the evaluation of the cultural heritage information ontologyAndrej Tibaut, Sara Guerra de Oliveira, 2022, original scientific article Abstract: The intelligent management of built cultural heritage, including heritage buildings, requires common semantics in the form of standardized ontologies to achieve semantic interoperability. Foundational ontologies should be reused when building new ontologies, as they provide high-level terms; however, candidate foundational ontologies should be evaluated for quality and pitfalls. Simple metrics (e.g., number of concepts) are easy to obtain with existing tools. Complex metrics such as quality of ontology structure, functional adequacy, transferability, reliability, compatibility, maintainability, and operability, are defined in recent ontology evaluation frameworks; however, these do not evaluate interoperability features. The paper proposes an improved framework for an automated ontology evaluation based on the OQuaRE framework. Our approach improved some of the metrics of the OQuaRE framework and introduced three metrics for assessing the interoperability of the ontology in question (Externes, Composability, and Aggregability). In the experimental section, the framework is validated in an evaluation of cultural heritage information ontology (CIDOC CRM—ISO 12217:2014) with the use of new software for ontology evaluation. The detailed results reveal that the ontology is minimally acceptable and that the improved evaluation framework efficiently integrated interoperability metrics. Recommendations for the improvement of the cultural heritage information ontology are described in the Discussion and Conclusions section. Keywords: ontology evaluation, interoperability metrics, cultural heritage, heritage buildings, cultural heritage information ontology, systematic evaluation, cultural heritage domain ontologies, BIM Published in DKUM: 11.03.2025; Views: 0; Downloads: 8
Full text (1,06 MB) This document has many files! More... |
10. Process simulate versus inertial Mocap system in human movement evaluationD. Lanzoni, Gregor Harih, Borut Buchmeister, Nataša Vujica-Herzog, 2024, original scientific article Abstract: There are various tools for evaluating physical ergonomics. Two main computer-assisted approaches can be recognized in the literature: analytical evaluation using simulation software like Siemens Jack or Process Simulate, and empirical evaluation by tracking human body movement. Both methods have their own advantages and disadvantages. This article compares an analytical method using Process Simulate software and an empirical evaluation using an inertial motion tracking system and highlights the strengths and limitations of both approaches. The information from the tracking system is processed by the Process Simulate software and an ad-hoc ergonomic analysis module developed in Unity. Given the limited license of Process Simulate, the ergonomic comparison is performed using two indices, RULA and OWAS. Other comparison metrics discussed in the article are the time required for the analysis, the additional functionality each solution offers and the possibility of augmenting the assessment with virtual or augmented reality solutions. The results show some limitations of using Process Simulate with the tracking data and the great versatility of the solution developed in Unity Keywords: ergonomics, simulation, analytical evaluation, empirical evaluation Published in DKUM: 11.03.2025; Views: 0; Downloads: 9
Full text (622,81 KB) This document has many files! More... |