NTIRE 2025 Challenge on Low Light Image Enhancement: Methods and Results

TL;DR

FusionNet and Transformer-based models achieved top PSNR of 26.35 in NTIRE 2025 low-light enhancement, demonstrating multi-model fusion effectiveness.

cs.CV 🔴 Advanced 2025-10-15 42 views
Xiaoning Liu Zongwei Wu Florin-Alexandru Vasluianu Hailong Yan Bin Ren Yulun Zhang Shuhang Gu Le Zhang Ce Zhu Radu Timofte Kangbiao Shi Yixu Feng Tao Hu Yu Cao Peng Wu Yijin Liang Yanning Zhang Qingsen Yan Han Zhou Wei Dong Yan Min Mohab Kishawy Jun Chen Pengpeng Yu Anjin Park Seung-Soo Lee Young-Joon Park Zixiao Hu Junyv Liu Huilin Zhang Jun Zhang Fei Wan Bingxin Xu Hongzhe Liu Cheng Xu Weiguo Pan Songyin Dai Xunpeng Yi Qinglong Yan Yibing Zhang Jiayi Ma Changhui Hu Kerui Hu Donghang Jing Tiesheng Chen Zhi Jin Hongjun Wu Biao Huang Haitao Ling Jiahao Wu Dandan Zhan G Gyaneshwar Rao Vijayalaxmi Ashok Aralikatti Nikhil Akalwadi Ramesh Ashok Tabib Uma Mudenagudi Ruirui Lin Guoxi Huang Nantheera Anantrasirichai Qirui Yang Alexandru Brateanu Ciprian Orhei Cosmin Ancuti Daniel Feijoo Juan C. Benito Álvaro García Marcos V. Conde Yang Qin Raul Balmez Anas M. Ali Bilel Benjdira Wadii Boulila Tianyi Mao Huan Zheng Yanyan Wei Shengeng Tang Dan Guo Zhao Zhang Sabari Nathan K Uma A Sasithradevi B Sathya Bama S. Mohamed Mansoor Roomi Ao Li Xiangtao Zhang Zhe Liu Yijie Tang Jialong Tang Zhicheng Fu Gong Chen Joe Nasti John Nicholson Zeyu Xiao Zhuoyuan Li Ashutosh Kulkarni Prashant W. Patil Santosh Kumar Vipparthi Subrahmanyam Murala Duan Liu Weile Li Hangyuan Lu Rixian Liu Tengfeng Wang Jinxing Liang Chenxin Yu
low-light enhancement deep learning Transformer multi-model fusion image restoration

Key Findings

Methodology

This review covers innovative approaches from NTIRE 2025, including fusion strategies like FusionNet, SG-LLIE, and Restormer. These models combine multi-scale feature extraction, Transformer mechanisms, frequency domain information, and multi-loss optimization. Many employ encoder-decoder architectures with long-range dependencies, structure-guided Transformers, and multi-task learning. Training involves large datasets, multi-stage procedures, data augmentation, and self-ensembling, significantly improving noise suppression, color fidelity, and detail preservation in challenging low-light scenarios.

Key Results

  • The top-performing models achieved PSNR of 26.35, SSIM of 0.858, LPIPS of 0.128, and NIQE of 10.95, outperforming previous methods. Fusion strategies, multi-scale features, and structure-guided Transformers contributed to these results, validating the effectiveness of multi-path information integration.
  • Different teams used various loss functions, such as Charbonnier, perceptual, multi-scale SSIM, and color losses, combined with data augmentation and ensemble techniques. These strategies enhanced robustness and generalization, especially in night scenes, backlighting, and non-uniform illumination.
  • Ablation studies confirmed that structure-guided Transformer modules and frequency domain features are key to performance gains, especially under extreme darkness and complex lighting conditions.

Significance

This work advances low-light image enhancement, addressing longstanding issues like noise amplification, color distortion, and detail loss. It provides robust solutions for night photography, autonomous driving, and surveillance, with models capable of high-quality real-time processing. The integration of multi-model fusion and Transformer mechanisms sets a new benchmark, fostering industrial and academic progress in low-light vision applications.

Technical Contribution

The core contribution involves a multi-model, multi-scale fusion framework combining Transformer, frequency information, and multi-loss training. Structural guidance and frequency domain features enhance detail and global context understanding. The ensemble and multi-stage training strategies improve robustness and generalization, offering a comprehensive solution for complex low-light scenarios.

Novelty

This is the first systematic integration of multi-model fusion, structure-guided Transformer, and frequency domain features in low-light enhancement. The approach surpasses existing single-model methods, establishing a new paradigm that effectively handles extreme darkness and complex illumination, with significant improvements over prior work.

Limitations

  • Training requires extensive data and computational resources, limiting deployment on edge devices. Performance drops in extremely noisy or ultra-high-resolution scenes, indicating a need for further robustness improvements.
  • Model inference speed is slower due to multi-model fusion, restricting real-time applications. Optimization for efficiency and hardware acceleration remains necessary.
  • Current models lack adaptive scene-awareness, which could further improve performance across diverse environments. Future work should explore lightweight architectures and scene-adaptive modules.

Future Work

Future directions include designing lightweight, real-time capable models, integrating scene-aware adaptive mechanisms, and exploring multi-modal inputs like depth or infrared. Developing more efficient training and inference pipelines will facilitate deployment in practical scenarios such as autonomous vehicles and surveillance systems. Continued research on robustness and generalization across diverse lighting conditions will be essential.

AI Executive Summary

Low-light image enhancement remains a critical challenge in computer vision, vital for applications like night photography, autonomous driving, and security surveillance. Traditional techniques, such as histogram equalization and Retinex algorithms, often struggle with noise amplification and color fidelity. Deep learning approaches, especially convolutional neural networks and Transformers, have revolutionized this field, enabling models to learn complex mappings from dark to well-lit images.

NTIRE 2025 showcased a broad spectrum of innovative solutions, with top teams adopting multi-model fusion, multi-scale feature extraction, and structure-guided Transformer architectures. These models leverage large datasets, multi-stage training, and ensemble strategies to achieve state-of-the-art performance, with the best models reaching PSNR of 26.35 and SSIM of 0.858. Such results demonstrate significant progress over previous benchmarks, highlighting the effectiveness of combining global and local information, frequency domain features, and multi-loss optimization.

The impact of these advancements extends beyond academic interest, promising practical benefits in night scene photography, surveillance, and autonomous systems. Enhanced models can operate in real-time, providing clearer images under challenging lighting conditions, thus improving safety and user experience. However, challenges remain, including high computational costs, slow inference speeds, and limited robustness in extreme scenarios. Future research will focus on model efficiency, scene adaptability, and multi-modal data integration, aiming to make low-light enhancement more accessible and deployable across industries. Overall, this progress marks a pivotal step toward truly intelligent, robust night-vision systems.

Deep Analysis

Background

The evolution of low-light image enhancement has transitioned from classical algorithms like histogram equalization and Retinex to deep learning models such as CNNs and Transformers. Early methods improved brightness but often amplified noise and distorted colors. CNN-based models like U-Net, ResNet, and multi-scale architectures significantly advanced the field, enabling better detail preservation and noise suppression. Recent breakthroughs include Transformer-based models like Restormer and structure-guided networks like ESDNet, which excel in modeling long-range dependencies and multi-scale features. Despite these advances, challenges persist in handling extreme darkness, non-uniform illumination, and computational efficiency, especially for high-resolution images. The NTIRE 2025 challenge builds on this foundation, encouraging innovative fusion of these techniques to push performance further.

Core Problem

The core challenge in low-light enhancement is achieving simultaneous brightness increase, noise reduction, and detail preservation under complex lighting conditions. Existing models often struggle with noise amplification, color distortion, and loss of fine details, especially in extreme darkness or non-uniform illumination. Moreover, balancing computational efficiency with high-quality output remains difficult, limiting real-time deployment. Addressing these issues requires novel architectures capable of multi-scale feature fusion, robust noise suppression, and adaptive scene understanding. The problem is compounded by the diversity of real-world low-light scenarios, demanding models that are both highly accurate and computationally feasible.

Innovation

Key innovations include: 1) Multi-model fusion strategies like FusionNet, combining local and global features for robustness; 2) Structure-guided Transformer modules (SG-LLIE) that incorporate structural priors and long-range dependencies; 3) Frequency domain feature integration to enhance noise suppression and color fidelity; 4) Multi-loss optimization combining Charbonnier, perceptual, and multi-scale SSIM losses for balanced training. These innovations collectively enable models to outperform previous state-of-the-art methods, especially in challenging scenarios, by leveraging complementary strengths of different architectures and training paradigms.

Methodology

  • �� Data: Utilized NTIRE 2025 dataset with diverse low-light scenes, including indoor, outdoor, night, and backlit images. • Architecture: Employed multi-model fusion (FusionNet, SG-LLIE, Restormer), each with encoder-decoder structures, multi-scale feature extraction, and Transformer modules. • Feature Fusion: Integrated long-range dependencies via structure-guided Transformers, combined frequency domain features, and employed multi-scale residual blocks. • Losses: Used Charbonnier for pixel accuracy, perceptual loss (VGG-based) for perceptual quality, multi-scale SSIM for structural fidelity, and color loss for color accuracy. • Training: Multi-stage, with data augmentation, self-ensembling, and transfer learning, trained on large datasets with Adam optimizer, cyclic cosine annealing, and early stopping. • Inference: Employed model ensembling, multi-scale testing, and image cropping for high-resolution images to balance accuracy and efficiency.

Experiments

Experiments involved 219 training, 46 validation, and 30 test scenes, evaluated via PSNR, SSIM, LPIPS, NIQE. Ablation studies confirmed the importance of multi-model fusion, structure-guided modules, and frequency features. Hyperparameters like learning rate, batch size, and training epochs were optimized through grid search. Results showed that fusion models outperform single architectures by 2-3dB in PSNR, with significant improvements in visual quality, especially in night and backlit scenes. Cross-scenario tests validated robustness, and ablation highlighted the contribution of each component.

Results

The best models achieved PSNR of 26.35, SSIM of 0.858, LPIPS of 0.128, NIQE of 10.95, outperforming baseline methods by substantial margins. Fusion strategies and multi-scale features were critical, with structure-guided Transformers providing global context. Ablation confirmed that frequency domain features and multi-loss training significantly enhanced noise suppression and detail preservation. The models demonstrated strong generalization across diverse low-light scenarios, setting new benchmarks for the field.

Applications

These models are applicable in night photography, surveillance, autonomous driving, and augmented reality, where real-time, high-quality low-light enhancement is crucial. They require high-performance hardware for deployment but promise substantial improvements in visibility and safety. Future integration with scene understanding and adaptive processing will broaden their industrial impact, enabling smarter, more resilient vision systems.

Limitations & Outlook

High computational cost and slow inference limit real-time deployment on edge devices. Performance in extremely noisy or ultra-high-resolution images needs further improvement. The models' reliance on large annotated datasets poses challenges for resource-constrained environments. Future work should focus on lightweight architectures, adaptive scene-aware modules, and multi-modal data fusion to address these limitations.

Plain Language Accessible to non-experts

想象你在一个黑暗的房间里找东西,光线很暗,东西都看不清楚。传统的方法就像用手电筒照亮,但光线不够,容易看到模糊和杂色。现在,科学家们设计了一种智能“放大镜”,它能在不增加噪声的情况下,让暗处的细节变得清晰。这个“放大镜”结合了不同的“眼睛”——比如一些能看远距离的“眼睛”和能看细节的“眼睛”,还会用特殊的“颜色魔法”让颜色还原得更自然。通过不断学习和调整,它变得越来越聪明,能在各种黑暗场景中帮你看得更清楚。这就像你用多个不同的放大镜和灯光组合,最后得到一幅亮丽、清晰的夜景照片。科学家们用这种方法,让夜晚的世界变得和白天一样明亮、细节丰富,未来还能用在自动驾驶、监控等很多地方,让我们的生活更安全、更方便。

ELI14 Explained like you're 14

想象你在晚上玩游戏,屏幕很暗,角色看不清楚。普通的亮度调节只会让画面变得更亮,但也会把噪点放大,画面变得模糊。科学家们发明了一种特别聪明的“夜视镜”,它能在不增加噪点的情况下,把暗处变得明亮又清晰。它就像用很多不同的“眼睛”一起工作:有的专门看远,有的专门看细节,还有的用特殊的颜色魔法帮你还原真实色彩。它们合作学习,不断变得更聪明,最后能在各种黑暗环境中帮你看得一清二楚。这就像你用多个不同的放大镜和灯光组合,最后拍出一张亮丽、清晰的夜景照片。未来,这种技术可以用在夜间驾驶、夜景监控,让我们的生活更安全、更方便。是不是很酷?

Abstract

This paper presents a comprehensive review of the NTIRE 2025 Low-Light Image Enhancement (LLIE) Challenge, highlighting the proposed solutions and final outcomes. The objective of the challenge is to identify effective networks capable of producing brighter, clearer, and visually compelling images under diverse and challenging conditions. A remarkable total of 762 participants registered for the competition, with 28 teams ultimately submitting valid entries. This paper thoroughly evaluates the state-of-the-art advancements in LLIE, showcasing the significant progress.

cs.CV