Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books
Proposes a deep neural framework combining unsupervised sentence embeddings and video-text models for aligning books and movies, achieving over 70% accuracy.
Yukun Zhu, Ryan Kiros, Richard Zemel et al.