Pubblicazioni

Autori:

Girella, Federico; Liu, Ziyue; Fummi, Franco; Setti, Francesco; Cristani, Marco; Capogrosso, Luigi

Titolo:

Leveraging Latent Diffusion Models for Training-Free in-Distribution Data Augmentation for Surface Defect Detection

Anno:

2024

Tipologia prodotto:

Contributo in atti di convegno

Tipologia ANVUR:

Contributo in Atti di convegno

Lingua:

Inglese

Formato:

Elettronico

Titolo del Convegno:

International Conference on Content-Based Multimedia Indexing (CBMI)

Luogo:

Reykjavik, Iceland

Periodo:

18-20 September 2024

Intervallo pagine:

1-7

Parole chiave:

Diffusion Models, Data Augmentation, Surface Defect Detection

Breve descrizione dei contenuti:

Defect detection is the task of identifying defects in production samples. Usually, defect detection classifiers are trained on ground-truth data formed by normal samples (negative data) and samples with defects (positive data), where the latter are consistently fewer than normal samples. State-of-the-art data augmentation procedures add synthetic defect data by superimposing artifacts to normal samples to mitigate problems related to unbalanced training data. These techniques often produce out-of-distribution images, resulting in systems that learn what is not a normal sample but cannot accurately identify what a defect looks like. In this work, we introduce DIAG, a training-free Diffusion-based In-distribution Anomaly Generation pipeline for data augmentation. Unlike conventional image generation techniques, we implement a human-in-the-loop pipeline, where domain experts provide multimodal guidance to the model through text descriptions and region localization of the possible anomalies. This strategic shift enhances the interpretability of results and fosters a more robust human feedback loop, facilitating iterative improvements of the generated outputs. Remarkably, our approach operates in a zero-shot manner, avoiding time-consuming fine-tuning procedures while achieving superior performance. We demonstrate the efficacy and versatility of DIAG with respect to state-of-the-art data augmentation approaches on the challenging KSDD2 dataset, with an improvement in AP of approximately 18 % when positive samples are available and 28 % when they are missing. The source code is available at https://github.com/intelligolabs/DIAG.

Pagina Web:

https://ieeexplore.ieee.org/abstract/document/10858875

Id prodotto:

144322

Handle IRIS:

11562/1154587

ultima modifica:

14 febbraio 2025

Citazione bibliografica:

Girella, Federico; Liu, Ziyue; Fummi, Franco; Setti, Francesco; Cristani, Marco; Capogrosso, Luigi, Leveraging Latent Diffusion Models for Training-Free in-Distribution Data Augmentation for Surface Defect Detection  in Proceedings of the International Conference on Content-Based Multimedia Indexing (CBMI) , Atti di "International Conference on Content-Based Multimedia Indexing (CBMI)" , Reykjavik, Iceland , 18-20 September 2024 , 2024 , pp. 1-7

Consulta la scheda completa presente nel repository istituzionale della Ricerca di Ateneo