Li Zhang

I am a tenure-track Professor at the School of Data Science, Fudan University. Previously, I was a Research Scientist at Samsung AI Center Cambridge, and a Postdoctoral Researcher at the Department of Engineering Science, University of Oxford, under the supervision of professor Philip H.S. Torr and professor Andrew Zisserman. Prior to joining Oxford, I read my PhD in computer science under the supervision of professor Tao Xiang at Queen Mary University of London.

My general research interests cover the broad area of machine learning and artificial intelligence, with special emphasis on building intelligent systems for autonomous driving and generalist embodied agent.

To Prospective Students

If you are highly creative, have top grades/coding skill and interested in joining my group please do not hesitate to send me your CV and transcripts of grades.
Make sure you are super enthusiastic about AI research.

News

Five papers (2 Spotlights and 3 Posters) to appear in NeurIPS 2024.

I will be serving as an Area Chair for CVPR 2025.

Three papers to appear in ECCV 2024.

Our work SETR is accepted by IJCV.

One paper to appear in IROS 2024 as oral presentation.

Two papers are accepted by IEEE RAL.

I will be serving as an Area Chair for NeurIPS 2024.

Our work SOFT is accepted by IJCV.

Three papers to appear in ICLR 2024.

Appointed as Associate Editor (AE) for Pattern Recognition.

Two papers (1 Oral and 1 Poster) to appear in AAAI 2024.

Two papers (1 Oral and 1 Poster) to appear in ICCV 2023.

I will be serving as an Area Chair for CVPR 2024.

One paper to appear in IROS 2023.

One paper is accepted by Machine Vision and Applications.

I will be serving as an Area Chair for NeurIPS 2023.

Two papers (1 Highlight and 1 Poster) to appear in CVPR 2023.

Two papers to appear in ICLR 2023.

Call for papers! We are orgnising a CVPR 2023 workshop on End-to-End Autonomous Driving: Perception, Prediction, Planning and Simulation.

One paper (Oral) to appear in AAAI 2023.

I will be serving as an Area Chair for CVPR 2023.

I will be talking at CCAI 2022 and PRCV 2022.

One paper (Spotlight) to appear in NeurIPS 2022.

Our work DGMN is accepted by IEEE TPAMI.

Four papers to appear in ECCV 2022.

Our DeepInteraction is ranked 1st at the nuScenes 3D detection leaderboard.

Our work SiamMask is accepted by IEEE TPAMI.

One paper to appear in CVPR 2022.

Our work SETR is ranked second at the most influential CVPR papers.

Two papers (1 Spotlight and 1 Poster) to appear in NeurIPS 2021.

Preprint

• DeepInteraction++: Multi-Modality Interaction for Autonomous Driving,
  Zeyu Yang, Nan Song, Wei Li, Xiatian Zhu, Li Zhang, Philip HS Torr,
  arXiv preprint, 2024
• Diffusion²: Dynamic 3D Content Generation via Score Composition of Orthogonal Diffusion Models,
  Zeyu Yang, Zijie Pan, Chun Gu, Li Zhang,
  arXiv preprint, 2024 [code]
• Data Interpreter: An LLM Agent for Data Science,
  Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, et al.
  arXiv preprint, 2024 [code]
• Translating Images to Road Network: A Sequence-to-Sequence Perspective,
  Jiachen Lu, Renyuan Peng, Xinyue Cai, Hang Xu, Feng Wen, Wei Zhang, Li Zhang,
  arXiv preprint, 2024 [code]
• S-NeRF++: Autonomous Driving Simulation via Neural Reconstruction and Generation,
  Yurui Chen, Junge Zhang, Ziyang Xie, Wenye Li, Feihu Zhang, Jiachen Lu, Li Zhang,
  arXiv preprint, 2024 [paper] [code]
• SeaFormer++: Squeeze-enhanced Axial Transformer for Mobile Visual Recognition,
  Qiang Wan, Zilong Huang, Jiachen Lu, Gang Yu, Li Zhang,
  arXiv preprint, 2024 [paper]
• Brain3D: Generating 3D Objects from fMRI,
  Yuankun Yang, Li Zhang, Ziyang Xie, Zhiyuan Yuan, Jianfeng Feng, Xiatian Zhu, Yu-Gang Jiang,
  arXiv preprint, 2024 [paper]
• Urban Scene Diffusion through Semantic Occupancy Map,
  Junge Zhang, Qihang Zhang, Li Zhang, Ramana Rao Kompella, Gaowen Liu, Bolei Zhou,
  arXiv preprint, 2024 [project page] [paper]
• From Summary to Action: Enhancing Large Language Models for Complex Tasks with Open World APIs,
  Yulong Liu, Yunlong Yuan, Chunwei Wang, Jianhua Han, Yongqiang Ma, Li Zhang, Nanning Zheng, Hang Xu,
  arXiv preprint, 2024 [paper]
• Fast Dynamic 3D Object Generation from a Single-view Video,
  Zijie Pan, Zeyu Yang, Xiatian Zhu, Li Zhang,
  arXiv preprint, 2024 [project page] [code]
• Harnessing Diffusion Models for Visual Perception with Meta Prompts,
  Qiang Wan, Zilong Huang, Bingyi Kang, Jiashi Feng, Li Zhang,
  arXiv preprint, 2023 [code]
• Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Rendering,
  Yurui Chen, Chun Gu, Junzhe Jiang, Xiatian Zhu, Li Zhang,
  arXiv preprint, 2023 [project page] [code]
• Preconditioned Score-based Generative Models,
  Hengyuan Ma, Li Zhang, Xiatian Zhu, Jianfeng Feng,
  arXiv preprint, 2023 [paper] [code]



Publications



• Tetrahedron Splatting for 3D Generation,
  Chun Gu, Zeyu Yang, Zijie Pan, Xiatian Zhu, Li Zhang,
  NeurIPS 2024 (Spotlight) [code]
• Motion Forecasting in Continuous Driving,
  Nan Song, Bozhou Zhang, Xiatian Zhu, Li Zhang,
  NeurIPS 2024 (Spotlight)
• DeMo: Decoupling Motion Forecasting into Directional Intentions and Dynamic States,
  Bozhou Zhang, Nan Song, Li Zhang,
  NeurIPS 2024
• DG-SLAM: Robust Dynamic Gaussian Splatting SLAM with Hybrid Pose Optimization,
  Yueming Xu, Haochen Jiang, Zhongyang Xiao, Jianfeng Feng, Li Zhang,
  NeurIPS 2024
• SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLM,
  Ming Nie, Dan Ding, Chunwei Wang, Yuanfan Guo, Jianhua Han, Hang Xu, Li Zhang,
  NeurIPS 2024
• Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving,
  Ming Nie, Renyuan Peng, Chunwei Wang, Xinyue Cai, Jianhua Han, Hang Xu, Li Zhang,
  ECCV 2024 [code]
• WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generation,
  Jiachen Lu, Ze Huang, Jiahui Zhang, Zeyu Yang, Li Zhang,
  ECCV 2024 [code]
• Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing,
  Jian Gao, Chun Gu, Youtian Lin, Hao Zhu, Xun Cao, Li Zhang, Yao Yao,
  ECCV 2024 [project page] [code]
• Vision Transformers: From Semantic Segmentation to Dense Prediction,
  Li Zhang, Jiachen Lu, Sixiao Zheng, Xinxuan Zhao, Xiatian Zhu, Yanwei Fu, Tao Xiang, Jianfeng Feng, Philip H.S. Torr,
  IJCV 2024 [paper] [code]
• OpenOcc: Open Vocabulary 3D Scene Reconstruction via Occupancy Representation,
  Haochen Jiang, Yueming Xu, Yihan Zeng, Hang Xu, Wei Zhang, Jianfeng Feng, Li Zhang,
  IROS 2024 (Oral) [paper]
• RoDyn-SLAM: Robust Dynamic Dense RGB-D SLAM with Neural Radiance Fields,
  Haochen Jiang, Yueming Xu, Kejie Li, Jianfeng Feng, Li Zhang,
  IEEE Robotics and Automation Letters (RA-L), 2024
• A Hybrid Approach for Cross-modality Pose Estimation Between Image and Point Cloud,
  Ze Huang, Li Sun, Qibin He, Zhongyang Xiao, Xinhui Bai, Hongyuan Yuan, Song-Zhi Su, Li Zhang,
  IEEE Robotics and Automation Letters (RA-L), 2024
• Softmax-free Linear Transformers,
  Jiachen Lu, Junge Zhang, Xiatian Zhu, Jianfeng Feng, Tao Xiang, Li Zhang,
  IJCV 2024 [paper] [code]
• Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting,
  Zeyu Yang, Hongye Yang, Zijie Pan, Li Zhang,
  ICLR 2024 [project page] [code]
• Enhancing High-Resolution 3D Generation through Pixel-wise Gradient Clipping,
  Zijie Pan, Jiachen Lu, Xiatian Zhu, Li Zhang,
  ICLR 2024 [project page] [code]
• Consistent4D: Consistent 360 Dynamic Object Generation from Monocular Video,
  Yanqin Jiang, Li Zhang, Jin Gao, Weiming Hu, Yao Yao,
  ICLR 2024 [project page] [code]
• S-Agents: Self-organizing Agents in Open-ended Environments,
  Jiaqi Chen, Yuxian Jiang, Jiachen Lu, Li Zhang,
  ICLR workshop on Large Language Model (LLM) Agents, 2024 [paper] [code]
• NeRF-LiDAR: Generating Realistic LiDAR Point Clouds with Neural Radiance Fields,
  Junge Zhang, Feihu Zhang, Shaochen Kuang, Li Zhang,
  AAAI 2024 (Oral) [code]
• LaneGraph2Seq: Lane Topology Extraction with Language Model via Vertex-Edge Encoding and Connectivity Enhancement,
  Renyuan Peng, Xinyue Cai, Hang Xu, Jiachen Lu, Feng Wen, Wei Zhang, Li Zhang,
  AAAI 2024 [code]
• Translating Images to Road Network: A Non-Autoregressive Sequence-to-Sequence Approach,
  Jiachen Lu, Renyuan Peng, Xinyue Cai, Hang Xu, Hongyang Li, Feng Wen, Wei Zhang, Li Zhang,
  ICCV 2023 (Oral) [code]
• PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection,
  Ming Nie, Yujing Xue, Chunwei Wang, Chaoqiang Ye, Hang Xu, Xinge Zhu, Qingqiu Huang, Michael Bi Mi, Xinchao Wang, Li Zhang,
  ICCV 2023 [code]
• Persistent Object Identification Leveraging Non-Visual Markers,
  Michael PJ Camilleri, Li Zhang, Rasneer S Bains, Andrew Zisserman, Christopher KI Williams,
  Machine Vision and Applications 2023
• SUIT: Learning Significance-guided Information for 3D Temporal Detection,
  Zheyuan Zhou, Jiachen Lu, Yihan Zeng, Hang Xu, Li Zhang,
  IROS 2023 (Oral)
• Generative Semantic Segmentation,
  Jiaqi Chen, Jiachen Lu, Xiatian Zhu, Li Zhang,
  CVPR 2023 [code]
• FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Tasks,
  Xiao Han, Xiatian Zhu, Licheng Yu, Li Zhang, Yi-Zhe Song, Tao Xiang,
  CVPR 2023 (Highlight) [code]
• S-NeRF: Neural Radiance Fields for Street Views,
  Ziyang Xie, Junge Zhang, Wenye Li, Feihu Zhang, Li Zhang,
  ICLR 2023 [project page] [code]
• SeaFormer: Squeeze-enhanced Axial Transformer for Mobile Semantic Segmentation,
  Qiang Wan, Jiachen Lu, Zilong Huang, Gang Yu, Li Zhang,
  ICLR 2023 [paper] [code]
• PolarFormer: Multi-camera 3D Object Detection with Polar Transformers,
  Yanqin Jiang, Li Zhang, Zhenwei Miao, Xiatian Zhu, Jin Gao, Weiming Hu, Yu-Gang Jiang,
  AAAI 2023 (Oral) [paper] [code]
• Dynamic Graph Message Passing Network for Visual Recognition,
  Li Zhang, Mohan Chen, Anurag Arnab, Xiangyang Xue, Philip H.S. Torr
  IEEE TPAMI 2023 [paper] [code]
• SiamMask: A Framework for Fast Online Object Tracking and Segmentation,
  Weiming Hu, Qiang Wang, Li Zhang, Luca Bertinetto, Philip H.S. Torr
  TPAMI 2023 [code]
• ImpDet: Exploring Implicit Fields for 3D Object Detection,
  Xuelin Qian, Li Wang, Yi Zhu, Li Zhang, Yanwei Fu, Xiangyang Xue,
  WACV 2023 [paper]
• Rethinking Local and Global Feature Representation for Dense Prediction,
  Mohan Chen, Li Zhang, Rui Feng, Xiangyang Xue, Jianfeng Feng,
  Pattern Recognition 2023
• DeepInteraction: 3D Object Detection via Modality Interaction,
  Zeyu Yang, Jiaqi Chen, Zhenwei Miao, Wei Li, Xiatian Zhu, Li Zhang,
  NeurIPS 2022 (Spotlight) [code]
• When, Where and How does it fail? A Spatial-temporal Visual Analytics Approach for Interpretable Object Detection in Autonomous Driving,
  Junhong Wang, Yun Li, Zhaoyu Zhou, Chengshun Wang, Yijie Hou, Li Zhang, Xiangyang Xue, Michael Kamp, Xiaolong (Luke) Zhang, Siming Chen
  IEEE TVCG 2022
• Learning Ego 3D Representation as Ray Tracing,
  Jiachen Lu, Zheyuan Zhou, Xiatian Zhu, Hang Xu, Li Zhang,
  ECCV 2022 [code] [demo]
• Accelerating Score-based Generative Models with Preconditioned Diffusion Sampling,
  Hengyuan Ma, Li Zhang, Xiatian Zhu, Jianfeng Feng,
  ECCV 2022 [code]
• FashionViL: Fashion-Focused Vision-and-Language Representation Learning,
  Xiao Han, Licheng Yu, Xiatian Zhu, Li Zhang, Yi-Zhe Song, and Tao Xiang,
  ECCV 2022 [code]
• RCLane: Relay Chain Prediction for Lane Detection,
  Shenghua Xu, Xinyue Cai, Bin Zhao, Li Zhang, Hang Xu, Yanwei Fu, Xiangyang Xue,
  ECCV 2022
• ONCE-3DLanes: Building Monocular 3D Lane Detection,
  Fan Yan, Ming Nie, Xinyue Cai, Jianhua Han, Hang Xu, Zhen Yang, Chaoqiang Ye, Yanwei Fu, Michael Bi Mi, Li Zhang
  CVPR 2022 [project page]
• SGM3D: Stereo Guided Monocular 3D Object Detection,
  Zheyuan Zhou, Liang Du, Xiaoqing Ye, Zhikang Zou, Xiao Tan, Errui Ding, Li Zhang, Xiangyang Xue, Jianfeng Feng,
  IEEE Robotics and Automation Letters (RAL) 2022, [paper]
• SOFT: Softmax-free Transformer with Linear Complexity,
  Jiachen Lu, Jinghan Yao, Junge Zhang, Xiatian Zhu, Hang Xu, Weiguo Gao, Chunjing Xu, Tao Xiang, Li Zhang,
  NeurIPS 2021 (Spotlight) [code]
• Progressive Coordinate Transforms for Monocular 3D Object Detection,
  Li Wang, Li Zhang, Yi Zhu, Zhi Zhang, Tong He, Mu Li, Xiangyang Xue,
  NeurIPS 2021 [code]
• The Devil is in the Task: Exploiting Reciprocal Appearance-Localization Features for Monocular 3D Object Detection,
  Zhikang Zou, Xiaoqing Ye, Liang Du, Xianhui Cheng, Xiao Tan, Li Zhang, Jianfeng Feng, Xiangyang Xue, Errui Ding,
  ICCV 2021
• Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformer,
  Zhihe Lu, Sen He, Xiatian Zhu, Li Zhang, Yi-Zhe Song, Tao Xiang,
  ICCV 2021 [code]
• Boundary-sensitive Pretraining for Temporal Localization in Videos,
  Mengmeng Xu, Victor Escorcia, Brais Martínez, Juan-Manuel Perez-Rua, Xiatian Zhu, Li Zhang, Bernard Ghanem, Tao Xiang,
  ICCV 2021
• Text-Based Person Search with Limited Data,
  Xiao Han, Sen He, Li Zhang, Tao Xiang,
  BMVC 2021
• Few-shot Action Recognition with Prototype-centered Attentive Learning,
  Xiatian Zhu, Antoine Toisoul, Juan-Manuel Prez-Ra, Li Zhang, Brais Martinez, Tao Xiang,
  BMVC 2021
• Rethinking Local and Global Feature Representation for Semantic Segmentation,
  Mohan Chen, Xinxuan Zhao, Bingfei Fu, Li Zhang, Xiangyang Xue,
  BMVC 2021
• Dual Prior Learning for Blind and Blended Image Restoration,
  Xin Jin, Li Zhang, Chaowei Shan, Xin Li, Zhibo Chen,
  IEEE TIP 2021
• Towards Efficient Scene Understanding via Squeeze Reasoning,
  Xiangtai Li, Xia Li, Ansheng You, Li Zhang, Guangliang Cheng, Kuiyuan Yang, Yunhai Tong, Zhouchen Lin,
  IEEE TIP 2021 [code]
• Global Aggregation then Local Distribution for Scene Parsing,
  Xiangtai Li, Li Zhang, Guangliang Cheng, Kuiyuan Yang, Yunhai Tong, Xiatian Zhu, Tao Xiang,
  IEEE TIP 2021 [code]
• How to trust unlabeled data? Instance Credibility Inference for Few-Shot Learning,
  Yikai Wang, Li Zhang, Yuan Yao, Yanwei Fu
  TPAMI 2021 [paper] [code]
• Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers,
  Sixiao Zheng, Jiachen Lu, Hengshuang Zhao, Xiatian Zhu, Zekun Luo, Yabiao Wang, Yanwei Fu, Jianfeng Feng, Tao Xiang, Philip HS Torr, Li Zhang
  CVPR 2021 [paper] [code]
• Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detection,
  Li Wang, Liang Du, Xiaoqing Ye, Yanwei Fu, Guodong Guo, Xiangyang Xue, Jianfeng Feng, Li Zhang
  CVPR 2021 [paper] [code]
• Learning Dynamic Alignment via Meta-filter for Few-shot Learning,
  Chengming Xu, Yanwei Fu, Chen Liu, Chengjie Wang, Jilin Li, Feiyue Huang, Li Zhang, Xiangyang Xue,
  CVPR 2021 [code]
• Delving into Data: Effectively Substitute Training for Black-box Attack,
  Wenxuan Wang, Bangjie Yin, Taiping Yao, Li Zhang, Yanwei Fu, Shouhong Ding, Jilin Li, Feiyue Huang, Xiangyang Xue
  CVPR 2021
• Learning a Few-shot Embedding Model with Contrastive Learning,
  Chen Liu, Yanwei Fu, Chengming Xu, Siqian Yang, Jilin Li, Chengjie Wang, Li Zhang
  AAAI 2021 [code]
• Long-Term Cloth-Changing Person Re-identification,
  Xuelin Qian, Wenxuan Wang, Li Zhang, Fangrui Zhu, Yanwei Fu, Tao Xiang, Yu-Gang Jiang, Xiangyang Xue
  ACCV 2020 (Oral) [paper] [project page]
• Dynamic Depth Fusion and Transformation for Monocular 3D Object Detection,
  Erli Ouyang*, Li Zhang*, Mohan Chen, Anurag Arnab, Yanwei Fu
  ACCV 2020 [paper]
• Depth Guided Adaptive Meta-Fusion Network for Few-shot Video Recognition,
  Yuqian Fu*, Li Zhang*, Junke Wang, Yanwei Fu, Yu-Gang Jiang
  ACM MM 2020 (Oral) [paper]
• Few-shot Action Recognition with Permutation-invariant Attention,
  Hongguang Zhang, Li Zhang, Xiaojuan Qi, Hongdong Li, Philip H.S. Torr, Piotr Koniusz
  ECCV 2020 (Spotlight) [paper]
• XingGAN for Person Image Generation,
  Hao Tang, Song Bai, Li Zhang, Philip H.S. Torr, Nicu Sebe
  ECCV 2020 [paper] [code]
• Improving Semantic Segmentation via Decoupled Body and Edge Supervision,
  Xiangtai Li, Xia Li, Li Zhang, Guangliang Cheng, Jianping Shi, Zhouchen Lin, Shaohua Tan, Yunhai Tong
  ECCV 2020 [paper] [code]
• Dynamic Graph Message Passing Network,
  Li Zhang, Dan Xu, Anurag Arnab, Philip H.S. Torr
  CVPR 2020 (Oral) [paper] [code]
• Strip Pooling: Rethinking Spatial Pooling for Scene Parsing,
  Qibin Hou, Li Zhang, Ming-Ming Cheng, Jiashi Feng
  CVPR 2020 [paper] [code]
• Instance Credibility Inference for Few-Shot Learning,
  Yikai Wang, Chengming Xu, Chen Liu, Li Zhang, Yanwei Fu
  CVPR 2020 [paper] [code]
• Style Normalization and Restitution for Generalizable Person Re-identification,
  Xin Jin, Cuiling Lan, Wenjun Zeng, Zhibo Chen, Li Zhang
  CVPR 2020 [paper]
• Dual Graph Convolutional Network for Semantic Segmentation,
  Li Zhang, Xiangtai Li, Anurag Arnab, Kuiyuan Yang, Yunhai Tong, Philip H.S. Torr
  BMVC 2019 [paper] [code]
• Global Aggregation then Local Distribution in Fully Convolutional Networks,
  Xiangtai Li, Li Zhang, Ansheng You, Maoke Yang, Kuiyuan Yang, Yunhai Tong
  BMVC 2019 [paper] [code]
• Fast Online Object Tracking and Segmentation: A Unifying Approach,
  Qiang Wang*, Li Zhang*, Luca Bertinetto*, Weiming Hu, Philip H.S. Torr
  CVPR 2019 [paper] [code]
• Learning to Compare: Relation Network for Few-Shot Learning,
  Flood Sung, Yongxin Yang, Li Zhang, Tao Xiang, Philip H.S. Torr, Timothy M. Hospedales
  CVPR 2018 [paper] [FSL code] [ZSL code]
• Learning a Deep Embedding Model for Zero-Shot Learning,
  Li Zhang, Tao Xiang, Shaogang Gong
  CVPR 2017 [paper] [code]
• Learning a Discriminative Null Space for Person Re-identification,
  Li Zhang, Tao Xiang, Shaogang Gong
  CVPR 2016 [paper] [code]