1. Cephalometric landmark detection in lateral skull X-ray images by using improved spatialconfiguration-netMartin Šavc, Gašper Sedej, Božidar Potočnik, 2022, izvirni znanstveni članek Opis: Accurate automated localization of cephalometric landmarks in skull X-ray images is the
basis for planning orthodontic treatments, predicting skull growth, or diagnosing face discrepancies.
Such diagnoses require as many landmarks as possible to be detected on cephalograms. Today’s
best methods are adapted to detect just 19 landmarks accurately in images varying not too much.
This paper describes the development of the SCN-EXT convolutional neural network (CNN), which
is designed to localize 72 landmarks in strongly varying images. The proposed method is based
on the SpatialConfiguration-Net network, which is upgraded by adding replications of the simpler
local appearance and spatial configuration components. The CNN capacity can be increased without
increasing the number of free parameters simultaneously by such modification of an architecture.
The successfulness of our approach was confirmed experimentally on two datasets. The SCN-EXT
method was, with respect to its effectiveness, around 4% behind the state-of-the-art on the small ISBI
database with 250 testing images and 19 cephalometric landmarks. On the other hand, our method
surpassed the state-of-the-art on the demanding AUDAX database with 4695 highly variable testing
images and 72 landmarks statistically significantly by around 3%. Increasing the CNN capacity
as proposed is especially important for a small learning set and limited computer resources. Our
algorithm is already utilized in orthodontic clinical practice. Ključne besede: detection of cephalometric landmarks, skull X-ray images, convolutional neural networks, deep learning, SpatialConfiguration-Net architecture, AUDAX database Objavljeno v DKUM: 27.03.2025; Ogledov: 0; Prenosov: 0
Celotno besedilo (2,46 MB) Gradivo ima več datotek! Več... |
2. Deeply-supervised 3D convolutional neural networks for automated ovary and follicle detection from ultrasound volumesBožidar Potočnik, Martin Šavc, 2022, izvirni znanstveni članek Opis: Automated detection of ovarian follicles in ultrasound images is much appreciated when
its effectiveness is comparable with the experts’ annotations. Today’s best methods estimate follicles
notably worse than the experts. This paper describes the development of two-stage deeply-supervised
3D Convolutional Neural Networks (CNN) based on the established U-Net. Either the entire U-Net
or specific parts of the U-Net decoder were replicated in order to integrate the prior knowledge into
the detection. Methods were trained end-to-end by follicle detection, while transfer learning was
employed for ovary detection. The USOVA3D database of annotated ultrasound volumes, with its
verification protocol, was used to verify the effectiveness. In follicle detection, the proposed methods
estimate follicles up to 2.9% more accurately than the compared methods. With our two-stage CNNs
trained by transfer learning, the effectiveness of ovary detection surpasses the up-to-date automated
detection methods by about 7.6%. The obtained results demonstrated that our methods estimate
follicles only slightly worse than the experts, while the ovaries are detected almost as accurately as
by the experts. Statistical analysis of 50 repetitions of CNN model training proved that the training
is stable, and that the effectiveness improvements are not only due to random initialisation. Our
deeply-supervised 3D CNNs can be adapted easily to other problem domains.
Ključne besede: 3D deep neural networks, 3D ultrasound images of ovaries, deep supervision, detection of follicles and ovaries, U-Net based architecture Objavljeno v DKUM: 27.03.2025; Ogledov: 0; Prenosov: 0
Celotno besedilo (1,28 MB) Gradivo ima več datotek! Več... |
3. A waste separation system based on sensor technology and deep learning: a simple approach applied to a case study of plastic packaging wasteRok Pučnik, Monika Dokl, Yee Van Fan, Annamaria Vujanović, Zorka Novak-Pintarič, Kathleen B. Aviso, Raymond R. Tan, Bojan Pahor, Zdravko Kravanja, Lidija Čuček, 2024, izvirni znanstveni članek Ključne besede: waste management, smart waste bin system, central post-sorting, sensor technology, deep learning, convolutional neural networks Objavljeno v DKUM: 23.08.2024; Ogledov: 51; Prenosov: 9
Celotno besedilo (3,64 MB) |
4. UAV Thermal Imaging for Unexploded Ordnance Detection by Using Deep LearningMilan Bajić, Jr., Božidar Potočnik, 2023, izvirni znanstveni članek Opis: A few promising solutions for thermal imaging Unexploded Ordnance (UXO) detection were proposed after the start of the military conflict in Ukraine in 2014. At the same time, most of the landmine clearance protocols and practices are based on old, 20th-century technologies. More than 60 countries worldwide are still affected by explosive remnants of war, and new areas are contaminated almost every day. To date, no automated solutions exist for surface UXO detection by using thermal imaging. One of the reasons is also that there are no publicly available data. This research bridges both gaps by introducing an automated UXO detection method, and by publishing thermal imaging data. During a project in Bosnia and Herzegovina in 2019, an organisation, Norwegian People's Aid, collected data about unexploded ordnances and made them available for this research. Thermal images with a size of 720 x 480 pixels were collected by using an Unmanned Aerial Vehicle at a height of 3 m, thus achieving a very small Ground Sampling Distance (GSD). One of the goals of our research was also to verify if the explosive war remnants' detection accuracy could be improved further by using Convolutional Neural Networks (CNN). We have experimented with various existing modern CNN architectures for object identification, whereat the YOLOv5 model was selected as the most promising for retraining. An eleven-class object detection problem was solved primarily in this study. Our data were annotated semi-manually. Five versions of the YOLOv5 model, fine-tuned with a grid-search, were trained end-to-end on randomly selected 640 training and 80 validation images from our dataset. The trained models were verified on the remaining 88 images from our dataset. Objects from each of the eleven classes were identified with more than 90% probability, whereat the Mean Average Precision (mAP) at a 0.5 threshold was 99.5%, and the mAP at thresholds from 0.5 to 0.95 was 87.0% up to 90.5%, depending on the model's complexity. Our results are comparable to the state-of-the-art, whereat these object detection methods have been tested on other similar small datasets with thermal images. Our study is one of the few in the field of Automated UXO detection by using thermal images, and the first that solves the problem of identifying more than one class of objects. On the other hand, publicly available thermal images with a relatively small GSD will enable and stimulate the development of new detection algorithms, where our method and results can serve as a baseline. Only really accurate automatic UXO detection solutions will help to solve one of the least explored worldwide life-threatening problems. Ključne besede: unmanned aerial vehicle, unexploded ordnance, thermal imaging, UXOTi_NPA dataset, convolutional neural networks, deep learning Objavljeno v DKUM: 12.02.2024; Ogledov: 389; Prenosov: 26
Celotno besedilo (16,94 MB) Gradivo ima več datotek! Več... |
5. Accuracy is not enough: optimizing for a fault detection delayMatej Šprogar, Domen Verber, 2023, izvirni znanstveni članek Opis: This paper assesses the fault-detection capabilities of modern deep-learning models. It highlights that a naive deep-learning approach optimized for accuracy is unsuitable for learning fault-detection models from time-series data. Consequently, out-of-the-box deep-learning strategies may yield impressive accuracy results but are ill-equipped for real-world applications. The paper introduces a methodology for estimating fault-detection delays when no oracle information on fault occurrence time is available. Moreover, the paper presents a straightforward approach to implicitly achieve the objective of minimizing fault-detection delays. This approach involves using pseudo-multi-objective deep optimization with data windowing, which enables the utilization of standard deep-learning methods for fault detection and expanding their applicability. However, it does introduce an additional hyperparameter that needs careful tuning. The paper employs the Tennessee Eastman Process dataset as a case study to demonstrate its findings. The results effectively highlight the limitations of standard loss functions and emphasize the importance of incorporating fault-detection delays in evaluating and reporting performance. In our study, the pseudo-multi-objective optimization could reach a fault-detection accuracy of 95% in just a fifth of the time it takes the best naive approach to do so. Ključne besede: artificial neural networks, deep learning, fault detection, accuracy, multi-objective optimization Objavljeno v DKUM: 30.11.2023; Ogledov: 363; Prenosov: 29
Celotno besedilo (478,93 KB) Gradivo ima več datotek! Več... |