Yu Lu

PhD Student

University of Technology Sydney (UTS)
Email: aniki.yulu [AT] gmail dot com

Yu Lu (路雨) is a PhD candidate at ReLER Lab, Australian Artificial Intelligence Institute (AAII), University of Technology Sydney (UTS). His academic advisors are Prof. Yi Yang. and Dr. Linchao Zhu. He received his M.Eng. degrees from Beijing University of Posts and Telecommunications. His current research interests encompass the development of multi-modal large language models and exploring video generation techniques.


Experiences

Research Visiting: CCAI, Zhejiang University, Jun. 2023 - Sep. 2023
Advisior: Pro. Yi Yang

Research Intern: MMU Kwai Tech, September 2021 - March 2022
Advisior: Dr. Debing Zhang

Research Intern: AI Tencent, April 2021 - June 2021
Advisior: Dr. Yuchen Yuan

Research Intern: IDL Baidu Research, July 2019 - July 2020
Advisior: Prof. Guodong Guo


Publications

FlowZero: Zero-Shot Text-to-Video Synthesis with LLM-Driven Dynamic Scene Syntax
Yu Lu, Linchao Zhu, Hehe Fan, Yi Yang
Arxiv
[Paper] [Project] [Code]

Zero-shot Video Grounding with Pseudo Query Lookup and Verification
Yu Lu, Ruijie Quan, Linchao Zhu, Yi Yang
IEEE Transactions on Image Processing (TIP) , 2024
[Paper] [code]

Show Me a Video: A Large-Scale Narrated Video Dataset for Coherent Story Illustration
Yu Lu, Feiyue Ni, Haofan Wang, Xiaofeng Guo, Linchao Zhu, Zongxin Yang, Ruihua Song, Lele Cheng, Yi Yang
IEEE Transactions on MultiMedia (TMM) , 2023
[Paper] [Project]

ECLIP: Efficient Contrastive Language-Image Pretraining via Ensemble Confidence Learning and Masked Language Modeling
Jue Wang, Haofan Wang, Weijia Wu, Jincan Deng, Yu Lu, Xiaofeng Guo, Debing Zhang
ICML 2022 Pre-training Workshop
[Paper] [Code]

CRIS: CLIP-Driven Referring Image Segmentation
Zhaoqing Wang*, Yu Lu*, Qiang Li, Xunqiang Tao, Yandong Guo, MingMing Gong, Tongliang Liu (* means equal contribution)
CVPR 2022
[Paper] [Code]

GINet: Graph Interaction Network for Scene Parsing
Tianyi Wu*, Yu Lu*, Yu Zhu, Chang Zhang, Ming Wu, Zhanyu Ma, Guodong Guo (* means equal contribution)
ECCV 2020
[Paper] [Code]


Professional Activities

Journal Review:
TPAMI, TIP, KBS

Conference Review:
CVPR, ICCV, ECCV, ACL

News


14 Jun 2022
Our paper "EfficientCLIP: Efficient Cross-Modal Pre-training by Ensemble Confident Learning and Language Modeling" is accepted by ICML Pre-training Workshop.

4 March 2022
Our paper "CRIS: CLIP-Driven Referring Image Segmentation " is accepted by CVPR2022.

11 July 2020
Our paper "GINet: Graph Interaction Network for Scene Parsing " is accepted by ECCV2020.

4 July 2023
Our paper "Show Me a Video: A Large-Scale Narrated Video Dataset for Coherent Story Illustration " is accepted by TMM2023.

25 Jan 2024
Our paper "Zero-shot Video Grounding with Pseudo Query Lookup and Verification" is accepted by TIP2024.