| Naslov: | LLM in the loop: a framework for contextualizing counterfactual segment perturbations in point clouds |
|---|
| Avtorji: | ID Kočić, Veljka (Avtor)
ID Lukač, Niko (Avtor)
ID Rozajac, Dzemail (Avtor)
ID Schweng, Stefan (Avtor)
ID Gollob, Christoph (Avtor)
ID Nothdurft, Arne (Avtor)
ID Stampfer, Karl (Avtor)
ID Del Ser, Javier (Avtor)
ID Holzinger, Andreas (Avtor) |
|---|
| Datoteke: |  LLM_in_the_Loop_A_Framework_for_Contextualizing_Counterfactual_Segment_Perturbations_in_Point_Clouds.pdf (7,24 MB)
MD5: 19B58061989BF92CB7C80EDBA041C477
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Članek v reviji |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: | FERI - Fakulteta za elektrotehniko, računalništvo in informatiko
|
|---|
| Opis: | Point Cloud Data analysis has seen a major leap forward with the introduction of PointNet algorithms, revolutionizing how we process 3D environments. Yet, despite these advancements, key challenges remain, particularly in optimizing segment perturbations to influence model outcomes in a controlled and meaningful way. Traditional methods struggle to generate realistic and contextually appropriate perturbations, limiting their effectiveness in critical applications like autonomous systems and urban planning. This paper takes a bold step by integrating Large Language Models into the counterfactual reasoning process, unlocking a new level of automation and intelligence in segment perturbation. Our approach begins with semantic segmentation, after which LLMs intelligently select optimal replacement segments based on features such as class label, color, area, and height. By leveraging the reasoning capabilities of LLMs, we generate perturbations that are not only computationally efficient but also semantically meaningful. The proposed framework undergoes rigorous evaluation, combining human inspection of LLM-generated suggestions with quantitative analysis of semantic classification model performance across different LLM variants. By bridging the gap between geometric transformations and high-level semantic reasoning, this research redefines how we approach perturbation generation in Point Cloud Data analysis. The results pave the way for more interpretable, adaptable, and intelligent AI-driven solutions, bringing us closer to realworld applications where explainability and robustness are paramount. |
|---|
| Ključne besede: | explainable AI, point cloud data, counterfactual reasoning, LiDAR, 3D point cloud data, interpretability, human-centered AI, large language models, K-nearest neighbors |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Datum objave: | 08.05.2025 |
|---|
| Založnik: | IEEE XPLORE |
|---|
| Leto izida: | 2025 |
|---|
| Št. strani: | 17 str. |
|---|
| PID: | 20.500.12556/DKUM-92856  |
|---|
| UDK: | 004.7 |
|---|
| COBISS.SI-ID: | 236009987 |
|---|
| DOI: | 10.1109/ACCESS.2025.3568052 |
|---|
| ISSN pri članku: | 2169-3536 |
|---|
| Datum objave v DKUM: | 19.05.2025 |
|---|
| Število ogledov: | 0 |
|---|
| Število prenosov: | 3 |
|---|
| Metapodatki: |    |
|---|
| Področja: | Ostalo
|
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
