OneSearch: A Preliminary Exploration of the Unified End-to-End Generative Framework for E-commerce Search

TL;DR

OneSearch: First industrial end-to-end generative framework for e-commerce search, boosting CTR by 1.67% and reducing operational costs by 75.40%.

cs.IR 🔴 Advanced 2025-09-03 9 views
Ben Chen Xian Guo Siyuan Wang Zihan Liang Yue Lv Yufei Ma Xinlong Xiao Bowen Xue Xuxin Zhang Ying Yang Huangyu Dai Xing Xu Tong Zhao Mingcan Peng Xiaoyang Zheng Chao Wang Qihang Zhao Zhixin Zhai Yang Zhao Bochao Liu Jingshan Lv Xiao Liang Yuqing Ding Jing Chen Chenyi Lei Wenwu Ou Han Li Kun Gai
E-commerce Search Generative Retrieval Hierarchical Semantic Encoding Reward System User Behavior Modeling

Key Findings

Methodology

OneSearch framework employs Keyword-enhanced Hierarchical Quantization Encoding (KHQE), Multi-view User Behavior Sequence Injection, and Preference-Aware Reward System (PARS) for end-to-end generative e-commerce search. KHQE preserves hierarchical semantics and unique attributes, ensuring strong query-item relevance. The multi-view strategy constructs behavior-driven user IDs, integrating short-term and long-term sequences to model user preferences comprehensively. PARS captures fine-grained user preferences through multi-stage supervised fine-tuning and adaptive reward-weighted ranking.

Key Results

  • OneSearch demonstrated superior performance in high-quality recall and ranking on large-scale industry datasets. Rigorous online A/B tests confirmed its ability to enhance relevance at the same exposure position, achieving statistically significant improvements: +1.67% item CTR, +2.40% buyer, and +3.22% order volume.
  • Furthermore, OneSearch reduces operational expenditure by 75.40% and improves Model FLOPs Utilization from 3.26% to 27.32%.
  • Successfully deployed across multiple search scenarios in Kuaishou, serving millions of users and generating tens of millions of PVs daily.

Significance

The significance of OneSearch lies in breaking the performance ceiling of traditional multi-stage cascading architectures by unifying the search process through an end-to-end generative framework. It addresses fragmented computation and objective collision issues, showcasing the potential of generative retrieval in e-commerce search, paving the way for smarter search systems.

Technical Contribution

OneSearch introduces Keyword-enhanced Hierarchical Quantization Encoding and Multi-view User Behavior Modeling to address information loss and inaccurate user intent capture in traditional methods. Its Preference-Aware Reward System enhances personalized ranking capabilities through multi-stage fine-tuning and reward-weighted optimization, significantly improving model efficiency and effectiveness.

Novelty

OneSearch is the first industrial-deployed end-to-end generative framework, innovatively applying generative retrieval to e-commerce search. Unlike traditional methods, it eliminates multi-stage filtering constraints, significantly enhancing search relevance and efficiency.

Limitations

  • OneSearch still faces performance limitations in handling cold-start queries and long-tail sessions, as user intent and item information are harder to capture in these scenarios.
  • The system may be misled by lengthy, noisy item information, affecting the accuracy of representation models.

Future Work

Future research directions include optimizing OneSearch's performance in cold-start and long-tail scenarios, further enhancing the model's ability to capture user intent. Additionally, exploring the application of generative retrieval in more e-commerce scenarios to expand its applicability and impact.

AI Executive Summary

Traditional e-commerce search systems employ multi-stage cascading architectures, balancing computational efficiency and business conversion but limited by fragmented computation and optimization objective collisions. To address these issues, researchers propose OneSearch, the first industrial-deployed end-to-end generative framework. This framework achieves fine-grained user preference capture through Keyword-enhanced Hierarchical Quantization Encoding, Multi-view User Behavior Sequence Injection, and Preference-Aware Reward System.

OneSearch demonstrated superior performance in high-quality recall and ranking on large-scale industry datasets. Rigorous online A/B tests confirmed its ability to enhance relevance at the same exposure position, achieving statistically significant improvements: +1.67% item CTR, +2.40% buyer, and +3.22% order volume. Furthermore, OneSearch reduces operational expenditure by 75.40% and improves Model FLOPs Utilization from 3.26% to 27.32%.

Successfully deployed across multiple search scenarios in Kuaishou, serving millions of users and generating tens of millions of PVs daily. OneSearch's success showcases the potential of generative retrieval in e-commerce search, paving the way for smarter search systems. Despite this, OneSearch still faces performance limitations in handling cold-start queries and long-tail sessions, with future research aiming to optimize performance in these scenarios.

Deep Analysis

Background

The evolution of e-commerce search systems has progressed from simple keyword-based matching to complex multi-stage cascading architectures. Traditional methods like EBR, DCN, etc., have made significant advances in recall and ranking stages but still face issues of fragmented computation and objective collision. Recently, Generative Retrieval (GR) has emerged as a promising paradigm, treating large-scale retrieval as sequence generation tasks, showing potential superior to traditional methods.

Core Problem

Traditional e-commerce search systems employ multi-stage cascading architectures, balancing computational efficiency and business conversion but limited by fragmented computation and optimization objective collisions. Additionally, these systems perform poorly in handling cold-start queries and long-tail sessions, struggling to accurately capture user intent.

Innovation

OneSearch addresses traditional issues through three core innovations: 1) Keyword-enhanced Hierarchical Quantization Encoding (KHQE) module preserves hierarchical semantics and unique attributes, ensuring strong query-item relevance; 2) Multi-view User Behavior Sequence Injection strategy constructs behavior-driven user IDs, integrating short-term and long-term sequences to model user preferences comprehensively; 3) Preference-Aware Reward System (PARS) captures fine-grained user preferences through multi-stage supervised fine-tuning and adaptive reward-weighted ranking.

Methodology

  • �� Keyword-enhanced Hierarchical Quantization Encoding (KHQE): Highlights core attributes of items through keyword-enhanced semantic collaborative encoding. Uses RQ-Kmeans for hierarchical feature encoding and OPQ for unique feature quantization of each item. • Multi-view User Behavior Sequence Injection strategy: Introduces weighted decay click behavior sequence into user ID to construct a distinctive user representation, explicitly incorporating short behavior sequences in prompts to learn recent user preferences and implicitly including long behavior sequences to model the user profile. • Preference-Aware Reward System (PARS): Designs a multi-stage supervised fine-tuning process for semantic alignment and personalization, followed by an adaptive reward system leveraging hierarchical user behavior signals and list-wise preference optimization.

Experiments

Experiments were conducted on large-scale industry datasets, using baselines including traditional multi-stage cascading architectures. Key metrics included item CTR, buyer volume, and order volume. Experiments also involved ablation studies to assess the contribution of each component. OneSearch demonstrated excellent performance in offline evaluations, with online A/B tests further validating its effectiveness in practical applications.

Results

OneSearch demonstrated superior performance in offline evaluations, with online A/B tests showing significant improvements at the same exposure position: +1.67% item CTR, +2.40% buyer, and +3.22% order volume. Furthermore, OneSearch reduces operational expenditure by 75.40% and improves Model FLOPs Utilization from 3.26% to 27.32%. These results indicate OneSearch's superior performance in high-quality recall and ranking.

Applications

OneSearch has been successfully deployed across multiple search scenarios in Kuaishou, serving millions of users and generating tens of millions of PVs daily. Its application in e-commerce search demonstrates the potential of generative retrieval, paving the way for the development of smarter search systems.

Limitations & Outlook

OneSearch still faces performance limitations in handling cold-start queries and long-tail sessions, as user intent and item information are harder to capture in these scenarios. Additionally, the system may be misled by lengthy, noisy item information, affecting the accuracy of representation models. Future research will focus on optimizing performance in these scenarios.

Plain Language Accessible to non-experts

Imagine you're in a massive library searching for a book. Traditional search methods are like first finding a pile of possible books and then gradually narrowing down to the one you want. This method, while effective, requires a lot of time and effort. OneSearch, however, is like a smart librarian who not only knows the content of each book but can also find the most suitable book based on your description. This method is not only faster but also more accurate because it understands your needs and provides the most relevant results right away.

ELI14 Explained like you're 14

Imagine you're playing a super complex treasure hunt game. Traditional methods are like you have to first find a bunch of possible clues and then slowly filter out the right ones to finally find the treasure. But OneSearch is like a super smart assistant who can take you directly to the treasure based on your description. It's like having a friend who can read your mind and always gives you the best advice when you need it! Isn't that cool?

Glossary

Generative Retrieval

An emerging retrieval paradigm that treats large-scale retrieval as sequence generation tasks, superior to traditional ANN-based methods.

OneSearch uses generative retrieval to unify the search process.

Hierarchical Quantization Encoding

Highlights core attributes of items through keyword-enhanced semantic collaborative encoding, ensuring strong query-item relevance.

KHQE module is one of the core innovations of OneSearch.

Preference-Aware Reward System

Captures fine-grained user preferences through multi-stage supervised fine-tuning and adaptive reward-weighted ranking.

PARS enhances OneSearch's personalized ranking capabilities.

Multi-view User Behavior Sequence Injection

Constructs behavior-driven user IDs by introducing weighted decay click behavior sequences.

This strategy is used to comprehensively model user preferences.

Kuaishou

A leading short video and live streaming platform in China, where OneSearch has been successfully deployed in multiple search scenarios.

OneSearch's successful deployment in Kuaishou demonstrates its potential in e-commerce search.

Open Questions Unanswered questions from this research

  • 1 How to optimize OneSearch's performance in cold-start and long-tail scenarios? Current methods struggle to accurately capture user intent in these scenarios.
  • 2 How to further enhance OneSearch's ability to handle lengthy, noisy item information?

Applications

Immediate Applications

E-commerce Platform Search Optimization

OneSearch can be used to optimize search functions on e-commerce platforms, improving user search experience and conversion rates.

Personalized Recommendation Systems

By modeling multi-view user behavior, OneSearch can enhance the accuracy of personalized recommendation systems.

Long-term Vision

Intelligent Search Systems

OneSearch's success demonstrates the potential of generative retrieval in intelligent search systems, with future applications in more fields.

Abstract

Traditional e-commerce search systems employ multi-stage cascading architectures (MCA) that progressively filter items through recall, pre-ranking, and ranking stages. While effective at balancing computational efficiency with business conversion, these systems suffer from fragmented computation and optimization objective collisions across stages, which ultimately limit their performance ceiling. To address these, we propose \textbf{OneSearch}, the first industrial-deployed end-to-end generative framework for e-commerce search. This framework introduces three key innovations: (1) a Keyword-enhanced Hierarchical Quantization Encoding (KHQE) module, to preserve both hierarchical semantics and distinctive item attributes while maintaining strong query-item relevance constraints; (2) a multi-view user behavior sequence injection strategy that constructs behavior-driven user IDs and incorporates both explicit short-term and implicit long-term sequences to model user preferences comprehensively; and (3) a Preference-Aware Reward System (PARS) featuring multi-stage supervised fine-tuning and adaptive reward-weighted ranking to capture fine-grained user preferences. Extensive offline evaluations on large-scale industry datasets demonstrate OneSearch's superior performance for high-quality recall and ranking. The rigorous online A/B tests confirm its ability to enhance relevance in the same exposure position, achieving statistically significant improvements: +1.67% item CTR, +2.40% buyer, and +3.22% order volume. Furthermore, OneSearch reduces operational expenditure by 75.40% and improves Model FLOPs Utilization from 3.26% to 27.32%. The system has been successfully deployed across multiple search scenarios in Kuaishou, serving millions of users, generating tens of millions of PVs daily.

cs.IR