Learning Diverse Features with Part-Level Resolution for Person Re-Identification

TL;DR

PLR-OSNet combines global and part-level features with a single ID loss, achieving 88.9% mAP and 95.6% Rank-1 on Market1501 with only 3.4M parameters.

cs.CV 🔴 Advanced 2020-01-21 39 views
Ben Xie Xiaofu Wu Suofei Zhang Shiliang Zhao Ming Li
person re-identification deep learning feature diversity lightweight model multi-scale features

Key Findings

Methodology

Building on OSNet, the proposed PLR-OSNet features a dual-branch architecture: a global branch employing max pooling for holistic features, and a local branch dividing feature maps into uniform parts for part-level features, concatenated into a single vector. A single ID prediction loss guides the entire feature learning, reinforced by attention modules and combined with triplet and center losses. This design ensures feature diversity while maintaining model efficiency. The global branch captures overall appearance, while the local branch emphasizes discriminative parts, enabling robust person re-ID with only 3.4 million parameters.

Key Results

  • On Market1501, DukeMTMC-reID, and CUHK03, PLR-OSNet achieved state-of-the-art mAP scores of 88.9%, 91.6%, and 80.5%, respectively, with Rank-1 accuracies of 95.6%, 96.1%, and 84.6%. In DukeMTMC-reID, it outperformed previous methods by over 1.5% in mAP and 2% in Rank-1, with a lightweight model. Ablation studies confirmed that the global feature enhances performance, and the single ID loss outperforms multiple ID losses, demonstrating the effectiveness of the design choices.
  • The model's efficiency is validated by its small size (3.4M parameters) and high accuracy, making it suitable for real-world deployment. The combination of global and part-level features, along with attention mechanisms, contributes to its robustness across challenging scenarios, including pose variations and occlusions.

Significance

This work advances person re-identification by integrating feature diversity into a lightweight architecture, addressing the limitations of previous heavy models. It offers a practical solution for real-time applications like surveillance and access control, where computational resources are limited. The approach simplifies training by using a single ID loss, yet achieves superior accuracy, setting a new standard for efficient, high-performance re-ID systems. Its success demonstrates that careful feature design can break the trade-off between model size and accuracy, influencing future research directions.

Technical Contribution

The paper introduces a novel dual-branch network combining global max pooling and uniform part division, with a single ID prediction loss to promote feature diversity. Attention modules are incorporated to refine feature extraction. The model's lightweight design (3.4M parameters) does not compromise accuracy, outperforming many larger models. The integration of Part-Level feature resolution with a simplified loss function is a key innovation, enabling effective learning of discriminative features with minimal complexity.

Novelty

This is the first work to embed Part-Level feature resolution within a lightweight dual-branch architecture guided by a single ID loss, contrasting with prior multi-branch methods that rely on multiple losses. The approach effectively balances feature diversity and model simplicity, leading to superior performance with fewer parameters. The use of max pooling in the global branch combined with uniform part division in the local branch is a novel strategy for enhancing discriminability.

Limitations

  • Despite its efficiency, the model may still struggle under extreme pose variations or heavy occlusions, where local parts are misaligned or missing.
  • The uniform partition strategy may not adapt well to scale or pose changes, limiting robustness in highly dynamic environments.
  • The reliance on attention modules, while beneficial, could increase computational overhead in some deployment scenarios, and further optimization is needed for ultra-low-power devices.

Future Work

Future research will explore adaptive part division strategies that respond to pose and scale variations, as well as multi-scale feature fusion techniques. Incorporating self-supervised learning could reduce reliance on labeled data, enhancing generalization. Extending the framework to video-based re-ID and cross-modal scenarios will broaden its applicability, aiming for more robust and scalable person re-identification systems.

AI Executive Summary

Person re-identification (Re-ID) has become a critical component in surveillance, security, and human-computer interaction, yet remains challenging due to variations in pose, lighting, and occlusion. Traditional approaches relied heavily on global features, which often failed to capture fine-grained details necessary for accurate matching. Part-based methods introduced local features but suffered from complex architectures and limited generalization. Recent advances like OSNet demonstrated multi-scale feature learning, but often at the cost of increased model size and complexity.

This paper introduces PLR-OSNet, a lightweight yet powerful network that combines global and part-level features through a dual-branch architecture. The global branch employs max pooling to capture overall appearance, while the local branch divides feature maps into uniform parts, extracting discriminative local features. A single ID prediction loss guides the entire network, simplifying training and promoting feature diversity. Attention modules further refine feature extraction, enhancing robustness.

Extensive experiments on datasets such as Market1501, DukeMTMC-reID, and CUHK03 show that PLR-OSNet achieves state-of-the-art results, with mAP scores reaching 88.9%, 91.6%, and 80.5%, and Rank-1 accuracies of 95.6%, 96.1%, and 84.6%, respectively. Remarkably, the model parameters are only 3.4 million, making it highly efficient for real-world deployment. Ablation studies confirm the effectiveness of global features, single ID loss, and attention modules.

This work significantly advances the field by demonstrating that feature diversity can be achieved in a compact model, addressing the trade-off between accuracy and efficiency. Its practical implications include deployment in edge devices for surveillance and access control, with potential extensions to multi-scale and self-supervised learning. Despite some limitations under extreme conditions, the approach paves the way for more robust, scalable, and real-time person re-identification systems.

Deep Dive

Abstract

Learning diverse features is key to the success of person re-identification. Various part-based methods have been extensively proposed for learning local representations, which, however, are still inferior to the best-performing methods for person re-identification. This paper proposes to construct a strong lightweight network architecture, termed PLR-OSNet, based on the idea of Part-Level feature Resolution over the Omni-Scale Network (OSNet) for achieving feature diversity. The proposed PLR-OSNet has two branches, one branch for global feature representation and the other branch for local feature representation. The local branch employs a uniform partition strategy for part-level feature resolution but produces only a single identity-prediction loss, which is in sharp contrast to the existing part-based methods. Empirical evidence demonstrates that the proposed PLR-OSNet achieves state-of-the-art performance on popular person Re-ID datasets, including Market1501, DukeMTMC-reID and CUHK03, despite its small model size.

cs.CV cs.LG