Ph.D Student at Columbia University
xudong.lin@columbia.edu
I am Xudong Lin (In Chinese, 蔺旭东), a fifth-year computer science Ph.D candidate in Columbia University. I am doing research in the DVMM lab, advised by Prof. Shih-Fu Chang. I also work closely with Prof. Heng Ji and Prof. Zheng Shou. My research interest lies in multimedia content understanding, representation learning, and video analysis.
During my undergraduate program, Mathematics and Physics, I spent four wonderful years at Tsinghua University, and began my research under the supervision of Prof. Jiwen Lu, and Prof. Jie Zhou.
I was also fortunate to work with Prof. B.S. Manjunath at UCSB, Dr. Lin Ma and Dr. Wei Liu at Tencent AI Lab. I am also happy to spend two wonderful summers with Prof. Lorenzo Torresani, Prof. Devi Parikh, Prof. Gedas Bertasius, Dr. Fabio Petroni, Dr. Marcus Rohrbach, and Dr. Jue Wang at Facebook AI Research.
Attending CVPR 2023 in-person. Check out our tutorial on Knowledge-Driven Vision-Language Encoding !
On the job market. Send me an email if you are interested!
Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval
Xudong Lin, Simran Tiwari, Shiyuan Huang, Manling Li, Mike Zheng Shou, Heng Ji, Shih-Fu Chang
Accepted by IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023
Arxiv
Project Page
Learning To Recognize Procedural Activities with Distant Supervision
Xudong Lin, Fabio Petroni, Gedas Bertasius, Marcus Rohrbach, Shih-Fu Chang, Lorenzo Torresani
Accepted by IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
Arxiv
Project Page
CLIP-Event: Connecting Text and Images with Event Structures
Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
Accepted by IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022
Arxiv
MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding
Revanth Gangi Reddy, Xilin Rui, Manling Li, Xudong Lin, Haoyang Wen, Jaemin Cho, Lifu Huang, Mohit Bansal, Avirup Sil, Shih-Fu Chang, Alexander Schwing, Heng Ji
Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) 2022
Arxiv
Joint Multimedia Event Extraction from Video and Article
Brian Chen*, Xudong Lin*, Christopher Thomas, Manling Li, Shoya Yoshida, Lovish Chum, Heng Ji, Shih-Fu Chang (* indicates equal contribution)
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP) Findings
Arxiv
VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs
Xudong Lin, Gedas Bertasius, Jue Wang, Shih-Fu Chang, Devi Parikh, Lorenzo Torresani
Accepted by IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Arxiv
Co-Grounding Networks with Semantic Attention for Referring Expression Comprehension in Videos
Sijie Song, Xudong Lin, Jiaying Liu, Zongming Guo, Shih-Fu Chang
Accepted by IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Arxiv
Flow-Distilled IP Two-Stream Networks for Compressed Video Action Recognition
Shiyuan Huang, Xudong Lin, Svebor Karaman, Shih-Fu Chang
Work in progress
Arxiv
Context-Gated Convolution
Xudong Lin, Lin Ma, Wei Liu, Shih-Fu Chang
Accepted by European Conference on Computer Vision (ECCV), 2020
Arxiv
Towards Train-Test Consistency for Semi-supervised Temporal Action Localization
Xudong Lin, Zheng Shou, Shih-Fu Chang
Work in progress
Arxiv
Dmc-net: Generating discriminative motion cues for fast compressed video action recognition
Zheng Shou, Xudong Lin, Yannis Kalantidis, Laura Sevilla-Lara, Marcus Rohrbach, Shih-Fu Chang, Zhicheng Yan
Accepted by IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019
Paper
Unsupervised Rank-Preserving Hashing for Large-Scale Image Retrieval
Svebor Karaman, Xudong Lin, Xuefeng Hu, Shih-Fu Chang
Accepted by International Conference on Multimedia Retrieval (ICMR) 2019
Preprint
Deep Variantional Metric Learning
Xudong Lin, Y. Duan, Q. Dong, J. Lu, J. Zhou
Accepted by European Conference on Computer Vision (ECCV) 2018
Paper
Deep Adversarial Metric Learning
Y. Duan, W. Zheng, Xudong Lin, J. Lu, J. Zhou
Accepted by IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018
Paper
GraphBit: Mining Bitwise Interaction via Deep Reinforcement Learning
Y. Duan, Z. Wang, J. Lu , Xudong Lin, J. Zhou
Accepted by IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018
Paper
Reviewer: CVPR 2020, ACM MM 2020, NeurIPS 2020, WACV 2021, ACCV 2020, IJCAI 2020
Reviewer: Neurocomputing
Reviewer: IEEE Access
Reviewer: IEEE Transactions on Circuits and Systems for Video Technology
“More is different.”