Publications

Authors:

Girella, Federico; Liu, Ziyue; Fummi, Franco; Setti, Francesco; Cristani, Marco; Capogrosso, Luigi

Title:

Leveraging Latent Diffusion Models for Training-Free in-Distribution Data Augmentation for Surface Defect Detection

Year:

2024

Type of item:

Contributo in atti di convegno

Tipologia ANVUR:

Contributo in Atti di convegno

Language:

Inglese

Format:

Elettronico

Congresso:

International Conference on Content-Based Multimedia Indexing (CBMI)

Place:

Reykjavik, Iceland

Period:

18-20 September 2024

Page numbers:

1-7

Keyword:

Diffusion Models, Data Augmentation, Surface Defect Detection

Short description of contents:

Defect detection is the task of identifying defects in production samples. Usually, defect detection classifiers are trained on ground-truth data formed by normal samples (negative data) and samples with defects (positive data), where the latter are consistently fewer than normal samples. State-of-the-art data augmentation procedures add synthetic defect data by superimposing artifacts to normal samples to mitigate problems related to unbalanced training data. These techniques often produce out-of-distribution images, resulting in systems that learn what is not a normal sample but cannot accurately identify what a defect looks like. In this work, we introduce DIAG, a training-free Diffusion-based In-distribution Anomaly Generation pipeline for data augmentation. Unlike conventional image generation techniques, we implement a human-in-the-loop pipeline, where domain experts provide multimodal guidance to the model through text descriptions and region localization of the possible anomalies. This strategic shift enhances the interpretability of results and fosters a more robust human feedback loop, facilitating iterative improvements of the generated outputs. Remarkably, our approach operates in a zero-shot manner, avoiding time-consuming fine-tuning procedures while achieving superior performance. We demonstrate the efficacy and versatility of DIAG with respect to state-of-the-art data augmentation approaches on the challenging KSDD2 dataset, with an improvement in AP of approximately 18 % when positive samples are available and 28 % when they are missing. The source code is available at https://github.com/intelligolabs/DIAG.

Web page:

https://ieeexplore.ieee.org/abstract/document/10858875

Product ID:

144322

Handle IRIS:

11562/1154587

Last Modified:

February 14, 2025

Bibliographic citation:

Girella, Federico; Liu, Ziyue; Fummi, Franco; Setti, Francesco; Cristani, Marco; Capogrosso, Luigi, Leveraging Latent Diffusion Models for Training-Free in-Distribution Data Augmentation for Surface Defect Detection  in Proceedings of the International Conference on Content-Based Multimedia Indexing (CBMI) , Proceedings of "International Conference on Content-Based Multimedia Indexing (CBMI)" , Reykjavik, Iceland , 18-20 September 2024 , 2024 , pp. 1-7

Consulta la scheda completa presente nel repository istituzionale della Ricerca di Ateneo