Shiyang Li



shiyangli AT ucsb DOT edu

About Me

Hello, I am a third year Ph.D. student at the Department of Computer Science, University of California, Santa Barbara, fortunately advised by Prof. Xifeng Yan. Prior to that, I obtained my B.Eng. degree in Computer Science and Technology with honors from Harbin Institute of Technology (HIT), Harbin, China.

I have broad research interests :). I am currently working on natural language processing. Before that, I ever worked on time series forecasting and computer vision.


  • TabFact: A Large-scale Dataset for Table-based Fact Verification
    Wenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang, Hong Wang, Shiyang Li, Xiyou Zhou and William Yang Wang
    [paper] [website] [code and data]
    International Conference on Learning Representations, 2020

  • Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
    Shiyang Li, Xiaoyong Jin, Yao Xuan, Xiyou Zhou, Wenhu Chen, Yu-Xiang Wang and Xifeng Yan [paper]
    Advances in Neural Information Processing Systems (NeurIPS), 2019

  • HierCon: Hierarchical Organization of Technical Documents based on Concepts
    Keqian Li, Shiyang Li, Semih Yavuz, Hanwen Zha, Yu Su, and Xifeng Yan
    IEEE International Conference on Data Mining (ICDM), 2019 (Regular, acceptance rate: 9.08%) [paper]
    Selected as one of the best papers of ICDM 2019 and invited for potential publication at the KAIS Journal

  • Towards Understanding Acceleration Tradeoff between Momentum and Asynchrony in Distributed Nonconvex Stochastic Optimization
    Tianyi Liu, Shiyang Li, Jianping Shi, Enlu Zhou and Tuo Zhao [paper]
    Advances in Neural Information Processing Systems (NeurIPS), 2018

Preprints and Workshops

  • Teaching Pretrained Models with Commonsense Reasoning: A Preliminary KB-Based Approach
    Shiyang Li, Jianshu Chen and Dian Yu [paper]
    NeurIPS 2019 Workshop on Knowledge Representation & Reasoning Meets Machine Learning (KR2ML)

  • Multi-step Deep Autoregressive Forecasting with Latent States
    Xiaoyong Jin, Shiyang Li, Yunkai Zhang and Xifeng Yan [paper]
    ICML 2019 Workshop on Time Series

Work Experience

  • SenseTime
    Nov. 2017 - Aug. 2018, Beijing, China
    Research Intern, Segmentation Group
    Mentor: Dr. Guangliang Cheng and Dr. Jianping Shi

Academic Service

  • Reviewer: ICML 2020, NeurIPS 2020, ICLR 2021

Honors and Awards

  • Best paper candidate, IEEE ICDM  2019
  • NeurIPS Travel Award   2018, 2019
  • Outstanding Scholar Fellowship, Department of CS at UCSB   2018
  • Academic Excellence Fellowship, Department of CS at UCSB   2018