1. LLM in the loop: a framework for contextualizing counterfactual segment perturbations in point cloudsVeljka Kočić, Niko Lukač, Dzemail Rozajac, Stefan Schweng, Christoph Gollob, Arne Nothdurft, Karl Stampfer, Javier Del Ser, Andreas Holzinger, 2025, izvirni znanstveni članek Opis: Point Cloud Data analysis has seen a major leap forward with the introduction of PointNet algorithms, revolutionizing how we process 3D environments. Yet, despite these advancements, key challenges remain, particularly in optimizing segment perturbations to influence model outcomes in a controlled and meaningful way. Traditional methods struggle to generate realistic and contextually appropriate perturbations, limiting their effectiveness in critical applications like autonomous systems and urban planning. This paper takes a bold step by integrating Large Language Models into the counterfactual reasoning process, unlocking a new level of automation and intelligence in segment perturbation. Our approach begins with semantic segmentation, after which LLMs intelligently select optimal replacement segments based on features such as class label, color, area, and height. By leveraging the reasoning capabilities of LLMs, we generate perturbations that are not only computationally efficient but also semantically meaningful. The proposed framework undergoes rigorous evaluation, combining human inspection of LLM-generated suggestions with quantitative analysis of semantic classification model performance across different LLM variants. By bridging the gap between geometric transformations and high-level semantic reasoning, this research redefines how we approach perturbation generation in Point Cloud Data analysis. The results pave the way for more interpretable, adaptable, and intelligent AI-driven solutions, bringing us closer to realworld applications where explainability and robustness are paramount.
Ključne besede: explainable AI, point cloud data, counterfactual reasoning, LiDAR, 3D point cloud data, interpretability, human-centered AI, large language models, K-nearest neighbors
Objavljeno v DKUM: 19.05.2025; Ogledov: 0; Prenosov: 3
 Celotno besedilo (7,24 MB) |
2. Novel Half-Spaces Based 3D Building Reconstruction Using Airborne LiDAR DataMarko Bizjak, Domen Mongus, Borut Žalik, Niko Lukač, 2023, izvirni znanstveni članek Opis: Automatic building reconstruction from laser-scanned data remains a challenging research topic due to buildings’ roof complexity and sparse data. A novel automatic building reconstruction methodology, based on half-spaces and a height jump analysis, is presented in this paper. The proposed methodology is performed in three stages. During the preprocessing stage, the classified input point cloud is clustered by position to obtain building point sets, which are then evaluated to obtain half-spaces and detect height jumps. Half-spaces represent the fundamental shape for generating building models, and their definition is obtained from the corresponding segment of points that describe an individual planar surface. The detection of height jumps is based on a DBSCAN search within a custom search space. During the second stage, the building point sets are divided into sub-buildings in such a way that their roofs do not contain height jumps. The concept of sub-buildings without height jumps is introduced to break down the complex building models with height jumps into smaller parts, where shaping with half-spaces can be applied accurately. Finally, the sub-buildings are reconstructed separately with the corresponding half-spaces and then joined back together to form a complete building model. In the experiments, the methodology’s performance was demonstrated on a large scale and validated on an ISPRS benchmark dataset, where an RMSE of 0.29 m was obtained in terms of the height difference.
Ključne besede: LiDAR point cloud, building reconstruction, half-spaces, Boolean operations
Objavljeno v DKUM: 01.12.2023; Ogledov: 388; Prenosov: 25
Celotno besedilo (13,79 MB)
Gradivo ima več datotek! Več... |
