jay.png

I am a Ph.D. student at Show Lab, National University of Singapore, advised by Prof. Mike Zheng Shou and Prof. Wynne Hsu. Previously, I received my B.Eng. in Computer Science from Shen Yuan Honors College of Beihang University.

My research centers on video understanding and generation.

email: jay.zhangjie.wu [at] gmail.com

google scholar · github · linkedin · twitter

news

Feb 2024 Tutorial Diffusion-based Video Generative Models to appear at CVPR 2024.
Oct 2023 Code and model weights of Show-1 are released!
May 2023 Organized LOVEU-TGVE (Text-Guided Video Editing) competition at CVPR 2023.
Apr 2023 Searching for papers on video diffusion models? Check out our GitHub repo Awesome-Video-Diffusion .

publications

(*) denotes equal contribution
  1. evolvedirector.png
    EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models
    Rui Zhao, Hangjie Yuan, Yujie Wei, Shiwei Zhang, Yuchao Gu, Lingmin Ran, Xiang Wang, Zhangjie Wu, Junhao Zhang, Yingya Zhang, and Mike Zheng Shou
    NeurIPS 2024
    Paper Code
  2. motiondirector.gif
    MotionDirector: Motion Customization of Text-to-Video Diffusion Models
    Rui Zhao, Yuchao Gu, Jay Zhangjie Wu, David Junhao Zhang, Jiawei Liu, Weijia Wu, Jussi Keppo, and Mike Zheng Shou
    ECCV 2024 (Oral) · GitHub Repo stars
    Paper Code Project Page
  3. freeatm.png
    Free-ATM: Exploring Unsupervised Learning on Diffusion-Generated Images with Free Attention Masks
    David Junhao Zhang, Mutian Xu, Jay Zhangjie Wu, Wenqing Zhang, Xiaoguang Han, Song Bai, and Mike Zheng Shou
    ECCV 2024
    Paper
  4. videoswap.gif
    VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence
    Yuchao Gu, Yipin Zhou, Bichen Wu, Licheng Yu, Jia-Wei Liu, Rui Zhao, Jay Zhangjie Wu, David Junhao Zhang, Mike Zheng Shou, and Kevin Tang
    CVPR 2024 · GitHub Repo stars
    Paper Code Project Page
  5. dynvideoe.gif
    DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing
    Jia-Wei Liu, Yan-Pei Cao, Jay Zhangjie Wu, Weijia Mao, Yuchao Gu, Rui Zhao, Jussi Keppo, Ying Shan, and Mike Zheng Shou
    CVPR 2024
    Paper Project Page
  6. show1.gif
    Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation
    David Junhao Zhang*, Jay Zhangjie Wu*, Jia-Wei Liu*, Rui Zhao, Lingmin Ran, Yuchao Gu, Difei Gao, and Mike Zheng Shou
    IJCV 2024 · GitHub Repo stars
    Paper Code Project Page
  7. mixofshow.gif
    Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models
    Yuchao Gu, Xintao Wang, Jay Zhangjie Wu, Yujun Shi, Yunpeng Chen, Zihan Fan, Wuyou Xiao, Rui Zhao, Shuning Chang, Weijia Wu, Yixiao Ge, Ying Shan, and Mike Zheng Shou
    NeurIPS 2024 · GitHub Repo stars
    Paper Code Project Page
  8. tuneavideo.gif
    Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
    Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Stan Weixian Lei, Yuchao Gu, Yufei Shi, Wynne Hsu, Ying Shan, Xiaohu Qie, and Mike Zheng Shou
    ICCV 2023 · Most Influential ICCV’23 Papers #5 · GitHub Repo stars
    Paper Code Project Page Demo Two Minute Papers
  9. leocod.png
    Label-Efficient Online Continual Object Detection in Streaming Video
    Jay Zhangjie Wu, David Junhao Zhang, Wynne Hsu, Mengmi Zhang, and Mike Zheng Shou
    ICCV 2023
    Paper Code
  10. clvqa.png
    Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task
    Stan Weixian Lei*, Difei Gao*, Jay Zhangjie Wu, Yuxuan Wang, Wei Liu, Mengmi Zhang, and Mike Zheng Shou
    AAAI 2023 (Oral)
    Paper Code
  11. egfr.png
    Mining whole-lung information by artificial intelligence for predicting EGFR genotype and targeted therapy response in lung cancer: a multicohort study
    Shuo Wang*, He Yu*, Yuncui Gan*, Zhangjie Wu, and et al.
    The Lancet Digital Health 2022 (Impact Factor: 23.8)
    Paper PDF
  12. opixray.png
    Occluded Prohibited Items Detection: An X-ray Security Inspection Benchmark and De-occlusion Attention Module
    Yanlu Wei*, Renshuai Tao*, Zhangjie Wu, Yuqing Ma, Libo Zhang, and Xianglong Liu
    ACM MM 2020 (Oral)
    Paper Code