Brian Chen

I am a fifth-year Ph.D. student at Dept. Of Computer Science, Columbia University, in DVMM lab advised by Prof. Shih-Fu Chang.

My research interests focus on Computer Vision, Multimodal Learning, and Self-supervised Learning. Particularly, I am interested in learning representations from videos.

During my Ph.D. period, I worked on the DARPA AIDA project, which mainly focused on incorporating cross-domain knowledge (images, videos, text, and audio) for knowledge graph construction.

I am closely working with IBM Research and MIT CSAIL on the Sight and Sound Project (since 2020 - ), aiming at learning representations from video and audio.

Prior to joining Columbia Univ., I finished my Bachelor and Master degrees at the Dept. of Computer Science and Information Eng., National Taiwan University, in 2015 and 2017 respectively, advised by Prof. Shou-De Lin.

News

Jun 1, 2021	Started Research Intern at Salesforce Research Under the guidance of Ramprasaath Selvaraju, Juan Carlos Niebles, and Nikhil Naik.
Jun 1, 2020	Started Research Intern at IBM Research Under the guidance of Samuel Thomas, Brian Kingsbury, and Hilde Kuehne.
Aug 1, 2019	Started Research Intern at NTU Under the guidance of Hanwang Zhang

Selected Publications

EMNLP

Joint Multimedia Event Extraction from Video and Article

Brian Chen, Xudong Lin, Christopher Thomas, Manling Li, Shoya Yoshida, Lovish Chum, Heng Ji, and Shih-Fu Chang

In Empirical Methods in Natural Language Processing findings (EMNLP) 2021
ICCV

Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos

Brian Chen, Andrew Rouditchenko, Kevin Duarte, Hilde Kuehne, Samuel Thomas, and others

In International Conference on Computer Vision (ICCV) 2021
AAAI

General Partial Label Learning via Dual Bipartite Graph Autoencoder

Brian Chen, Bo Wu, Alireza Zareian, Hanwang Zhang, and Shih-Fu Chang

In AAAI Conference on Artificial Intelligence (AAAI) 2020