Brian Chen

Graduating in 2022, looking for a research related job opportunity.


I am a fifth-year Ph.D. student at Dept. Of Computer Science, Columbia University, in DVMM lab advised by Prof. Shih-Fu Chang.

My research interests focus on Computer Vision, Multimodal Learning, and Self-supervised Learning. Particularly, I am interested in learning representations from videos.

During my Ph.D. period, I worked on the DARPA AIDA project, which mainly focused on incorporating cross-domain knowledge (images, videos, text, and audio) for knowledge graph construction.

I am closely working with IBM Research and MIT CSAIL on the Sight and Sound Project (since 2020 - ), aiming at learning representations from video and audio.

Prior to joining Columbia Univ., I finished my Bachelor and Master degrees at the Dept. of Computer Science and Information Eng., National Taiwan University, in 2015 and 2017 respectively, advised by Prof. Shou-De Lin.


Jun 1, 2021 Started Research Intern at Salesforce Research
Under the guidance of Ramprasaath Selvaraju, Juan Carlos Niebles, and Nikhil Naik.
Jun 1, 2020 Started Research Intern at IBM Research
Under the guidance of Samuel Thomas, Brian Kingsbury, and Hilde Kuehne.
Aug 1, 2019 Started Research Intern at NTU
Under the guidance of Hanwang Zhang

Selected Publications

  1. EMNLP
    Joint Multimedia Event Extraction from Video and Article
    Brian Chen, Xudong Lin, Christopher Thomas, Manling Li, Shoya Yoshida, Lovish Chum, Heng Ji, and Shih-Fu Chang
    In Empirical Methods in Natural Language Processing findings (EMNLP) 2021
  2. ICCV
    Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos
    Brian Chen, Andrew Rouditchenko, Kevin Duarte, Hilde Kuehne, Samuel Thomas, and others
    In International Conference on Computer Vision (ICCV) 2021
  3. AAAI
    General Partial Label Learning via Dual Bipartite Graph Autoencoder
    Brian Chen, Bo Wu, Alireza Zareian, Hanwang Zhang, and Shih-Fu Chang
    In AAAI Conference on Artificial Intelligence (AAAI) 2020