Shiyang Li

About Me

Hello, I am a second year Ph.D. student at the Department of Computer Science, University of California, Santa Barbara, fortunately advised by Prof. Xifeng Yan.

I obtained my B.Eng. degree with honors from the Department of Computer Science and Technology, Honors School of Harbin Institute of Technology (HIT), Harbin, China.

I am interested in time series modeling and natural language understanding.

Publications

• Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
  Shiyang Li, Xiaoyong Jin, Yao Xuan, Xiyou Zhou, Wenhu Chen, Yu-Xiang Wang and Xifeng Yan [paper]
  Advances in Neural Information Processing Systems (NeurIPS), 2019

• HierCon: Hierarchical Organization of Technical Documents based on Concepts
  Keqian Li, Shiyang Li, Semih Yavuz, Hanwen Zha, Yu Su, and Xifeng Yan
  IEEE International Conference on Data Mining (ICDM), 2019 (Regular, acceptance rate: 9.08%) [paper]

• Towards Understanding Acceleration Tradeoff between Momentum and Asynchrony in Distributed Nonconvex Stochastic Optimization
  Tianyi Liu, Shiyang Li, Jianping Shi, Enlu Zhou and Tuo Zhao [paper]
  Advances in Neural Information Processing Systems (NeurIPS), 2018

Preprints and Workshops

• Teaching Pretrained Models with Commonsense Reasoning: A Preliminary KB-Based Approach
  Shiyang Li, Jianshu Chen and Dian Yu [paper]
  NeurIPS 2019 Workshop on Knowledge Representation & Reasoning Meets Machine Learning (KR2ML)

• TabFact: A Large-scale Dataset for Table-based Fact Verification
  Wenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang, Hong Wang, Shiyang Li, Xiyou Zhou and William Yang Wang
  [paper] [website] [code and data]

• Multi-step Deep Autoregressive Forecasting with Latent States
  Xiaoyong Jin, Shiyang Li, Yunkai Zhang and Xifeng Yan [paper]
  ICML 2019 Workshop on Time Series

Work Experience

• Tencent AI Lab
  Jun. 2019 - Sep. 2019, Bellevue, WA, U.S.A.
  Research Intern, NLP Group
  Mentor: Dr. Jianshu Chen

• SenseTime
  Nov. 2017 - Aug. 2018, Beijing, China
  Research Intern, Segmentation Group
  Mentor: Dr. Guangliang Cheng and Dr. Jianping Shi

Honors and Awards

• NeurIPS Travel Award   2018
• Outstanding Scholar Fellowship, Department of CS at UCSB   2018
• Academic Excellence Fellowship, Department of CS at UCSB   2018