Defect-Aware Image Denoising and Deblurring Network

EE5179 - Deep Learning for Imaging (KLA Project), IIT Madras


⬅ Projects

🔗 GitHub Repo  |  Project Report

Abstract

Image restoration plays a vital role in domains like medical imaging, surveillance, and industrial inspection, where recovering clean images from noisy or blurred inputs is essential. We propose a novel U-Net-based restoration network enhanced with Spatial and Channel Attention (SCA) and non-local blocks to capture both local and global dependencies. This design effectively removes noise and blur while preserving subtle yet critical defect features. By dynamically emphasizing important regions through attention mechanisms, the network ensures accurate and detail-preserving restoration.

Methodology

The proposed U-Net-based image restoration network integrates Spatial and Channel Attention (SCA) and non-local blocks to capture both local and global dependencies within images. The non-local block enhances contextual understanding from distant regions, preserving subtle and fine defect details. A residual connection improves gradient flow, enabling stable training and robust feature learning.

Architecture of the proposed network for image restoration
Architecture of the proposed network for image restoration
Spatial and Channel Attention Module
Spatial and Channel Attention Module
Non-Local Block Module
Non-Local Block Module

Training was performed on the MVTec Anomaly Detection (AD) dataset, where clean images were artificially degraded using noise and blur to form input–target pairs. The model was implemented in PyTorch with approximately 868K parameters and trained for 250 epochs on an NVIDIA T4 GPU using the Adam optimizer (lr = 0.001).

A composite loss function was used:

  • Charbonnier Loss – ensures pixel-level accuracy
  • SSIM Loss – maintains perceptual image quality
  • Edge Loss – preserves fine edge structures

L = Lchar + 0.1·Ledge + 0.3·Lssim


Observations

Average PSNR Values for Each Category
Average PSNR Values for Each Category
Average SSIM Values for Each Category
Average SSIM Values for Each Category

Model performance was evaluated using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM).

  • Average PSNR: 30.55 dB
  • Average SSIM: 0.845
Architecture of the proposed network for image restoration
Sample Results

High PSNR and SSIM scores demonstrate that the model effectively restores image quality while preserving critical defect regions. Object types such as capsule, pill, and screw achieved the best restoration fidelity, confirming the network’s adaptability across textures and materials.


Conclusion

The Attention-Enhanced U-Net achieves superior image restoration performance by leveraging attention mechanisms and non-local context modeling. It effectively removes noise and blur while maintaining structural integrity and fine defect details.

This architecture presents a robust solution for defect-preserving image restoration in industrial and medical imaging applications.