About
Linjie Li is a Researcher at the computer vision science group in Microsoft Cloud & AI.
Before joining Microsoft, Linjie obtained her Master’s degree in computer science from Purdue University in 2018. Her current research interests include Vision-and-Language Pre-training, Self-supervised Learning and Adversarial Training.
Selected Publications
UNITER: UNiversal Image-TExt Representation Learning
Joint image-text embedding is the bedrock for most Visionand-Language (V+L) tasks, where multimodality inputs are simultaneously processed for joint visual and textual understanding. In this paper, we introduce UNITER, a UNiversal Image-TExt Representation, learned through large-scale pre-training over four image-text…
Large-Scale Adversarial Training for Vision-and-Language Representation Learning
We present VILLA, the first known effort on large-scale adversarial training for vision-and-language (V+L) representation learning. VILLA consists of two training stages: (i) task-agnostic adversarial pre-training; followed by (ii) task-specific adversarial finetuning. Instead of adding adversarial perturbations on image pixels…
Less is More: CLIPBERT for Video-and-Language Learning via Sparse Sampling
The canonical approach to video-and-language learning (e.g., video question answering) dictates a neural model to learn from offline-extracted dense video features from vision models and text features from language models. These feature extractors are trained independently and usually on tasks…