ZHANG Shanghang

Name:ZHANG Shanghang

Title:Tenure Track Assistant Professor

Office:Science Building 2 Room 2728, Peking University

Phone:+86 18932862953

Research interests:Machine learning, Computer vision, Brain-inspired learning

Homepage:https://www.shanghangzhang.com/

E-mail:shanghang AT pku DOT edu DOT cn

Address:Science Building 2 Room 2728, Peking University, No. 5 Yiheyuan Road, Haidian District, Beijing

Personal Introduction

Dr. Shanghang Zhang is a Tenure Track Assistant Professor at the School of Computer Science, Peking University. She has been the postdoc research fellow at Berkeley AI Research Lab (BAIR), EECS, UC Berkeley. Her research focuses on OOD Generalization that enables the machine learning systems to generalize to new domains, categories, and modalities using limited labels, with applications to autonomous driving and robotics, as reflected in her over 40 papers on top-tier journals and conference proceedings (Google Scholar Citations: 3100, H-index: 23, I10-index: 35). She has also been the author and editor of the book “Deep Reinforcement Learning: Fundamentals, Research and Applications” published by Springer Nature. This book is selected to Annual High-Impact Publications in Computer Science by Chinese researchers and its Electronic Edition has been downloaded 120,000 times worldwide. Her recent work “Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting” has received the AAAI 2021 Best Paper Award.  It ranks the 1st place of Trending Research on PaperWithCode and its Github receives 2,600+ Stars. Shanghang has been selected to “2018 Rising Stars in EECS, USA”. She has also been awarded the Adobe Academic Collaboration Fund, Qualcomm Innovation Fellowship (QInF) Finalist Award, and Chiang Chen Overseas Graduate Fellowship. Her research outcomes have been successfully productized into real-world machine learning solutions and filed 5 patents. Dr. Zhang has been the chief organizer of several workshops on ICML/NeurIPS, and the special issue on ICMR. Dr. Zhang received her Ph.D. from Carnegie Mellon University in 2018, and her Master from Peking University.

Selected Publications

  1. Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., & Zhang, W. (2021, February). Informer: Beyond efficient transformer for long sequence time-series forecasting. In Proceedings of AAAI. AAAI Outstanding Paper Award.

  2. Zhang, S., Wu, G., Costeira, J. P., & Moura, J. M. (2017). Understanding traffic density from large-scale web camera data. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 5898-5907).

  3. Zhang, S., Wu, G., Costeira, J. P., & Moura, J. M. (2017). Fcn-rlstm: Deep spatio-temporal neural networks for vehicle counting in city cameras. In Proceedings of the IEEE international conference on computer vision (ICCV) (pp. 3667-3676).

  4. Zhang, S., Shen, X., Lin, Z., Měch, R., Costeira, J. P., & Moura, J. M. (2018). Learning to understand image blur. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 6586-6595).

  5. Zhao, H., Zhang, S., Wu, G., Moura, J. M., Costeira, J. P., & Gordon, G. J. (2018). Adversarial multiple source domain adaptation. Advances in neural information processing systems (NeurIPS), 31.

  6. J. Ni, S. Zhang, H, Xie, “Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learning”, Advances in Neural Information Processing Systems (NeurIPS), 2019.

  7. X. Ma, X. Kong, S. Zhang, E. Hovy, “MaCow: Masked Convolutional Generative Flow”, Advances in Neural Information Processing Systems (NeurIPS), 2019.

  8. Zhao, S.#, Wang, G.#, Zhang, S.#, Gu, Y., Li, Y., Song, Z., ... & Keutzer, K. (2020, April). Multi-source distilling domain adaptation. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) (Vol. 34, No. 07, pp. 12975-12983).

  9. Zhao, S., Yue, X., Zhang, S., Li, B., Zhao, H., Wu, B., ... & Keutzer, K. (2020). A review of single-source deep unsupervised visual domain adaptation. IEEE Transactions on Neural Networks and Learning Systems (TNNLS, IF 14.255).

  10. Dong, H., Dong, H., Ding, Z., Zhang, S., & Chang. (2020). Deep Reinforcement Learning. Springer Singapore.

  11. X. Sun, Y. Xu, P. Cao, Y. Kong*, L. Hu, S. Zhang*, Y.Wang, “TCGM: An Information-Theoretic Framework for Semi-Supervised Multi-Modality Learning”,European Conference on Computer Vision (ECCV) 2020, Oral presentation.

  12. K. Mei, C. Zhu, J. Zou, S. Zhang, “Instance Adaptive Self-Training for Unsupervised Domain Adaptation”, 16th European Conference on Computer Vision (ECCV), 2020.

  13. Li, B.#, Wang, Y.#, Zhang, S.#, Li, D., Keutzer, K., Darrell, T., & Zhao, H. (2021). Learning invariant representations and risks for semi-supervised domain adaptation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1104-1113).

  14. S. Zhou, S. Zhang, et al. “Caching in Dynamic Environments: a Near-optimal Online Learning Approach”, IEEE Transactions on Multimedia (TMM, IF 8.182), 2021.

  15. H. Zhou, J. Li, J. Peng, S. Zhang, S. Zhang, “Triplet Attention: Rethinking the similarity in Transformers”, ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2021.

  16. X Ma, X Kong, S Zhang, E Hovy, “Decoupling Global and Local Representations via Invertible Generative Flows”, Accepted by International Conference on Learning Representations (ICLR), 2021.

  17. T. Li, X. Chen, S. Zhang*, Z. Dong*, K. Keutzer, “Cross-Domain Sentiment Classification With Contrastive Learning and Mutual Information Maximization”, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2021.

  18. C. Zhang#, M. Zhang#, S. Zhang#, et al. "Delving deep into the generalization of vision transformers under distribution shifts.", Conference on Computer Vision and Pattern Recognition (CVPR), 2022.

  19. M. Liu, Q. Zhou, H. Zhao, L. Du, Y. Du, J. Li, K. Keutzer, S. Zhang*. Prototypical Supervised Contrastive Learning for LiDAR Point Cloud Panoptic Segmentation, International Conference on Robotics and Automation (ICRA), 2022.

  20. S. Zhou, H. Zhao, S. Zhang*, et al. “Online Continual Adaptation with Active Self-Training”, Artificial Intelligence and Statistics Conference (AISTATS), 2022.

  21. S. Zhou, S. Zhang*, et al. “Active Gradual Domain Adaptation: Dataset and Approach”, IEEE Transactions on Multimedia (TMM, IF 8.182), 2022.

  22. J. Yu, J. Liu, X.Wei, H. Zhou, Y. Nakata, D. Gudovskiy, T. Okuno, J. Li, K. Keutzer, S. Zhang*, MTTrans: Cross-Domain Object Detection with Mean Teacher Transformer, 17th European Conference on Computer Vision (ECCV) 2022.

  23. X. Li, J. Liu, S.Wang, C. Lyu, M. Lu, Y. Chen, A. Yao, Y. Guo, S. Zhang*, Efficient Meta-Tuning for Content-aware Neural Video Delivery, 17th European Conference on Computer Vision (ECCV) 2022.

  24. Chu, X., Jin, Y., Zhu, W., Wang, Y., Wang, X., Zhang, S. and Mei, H., 2022, June. DNA: Domain Generalization with Diversified Neural Averaging. In International Conference on Machine Learning (pp. 4010-4034) (ICML). PMLR.

  25. Y Zou, S Zhang, Y Li, R Li, Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting Mitigation, Neural Information Processing Systems (NeurIPS) 2022.

  26. H Zhou, S Xiao, S Zhang, J Peng, S Zhang, J Li, Jump Self-attention: Capturing High-order Statistics in Transformers, Neural Information Processing Systems (NeurIPS) 2022.

Education

Carnegie Mellon University

Ph.D.

Department of Electrical and Computer Engineering

Advisor: Prof. José M. F. Moura,   Prof. João P. Costeira

08/2013 – 06/2018

Peking University

Master of  Science

Department of EECS  

Advisor: Prof. Wen Gao, Prof. Xiaodong   Xie

09/2010 – 06/2013

Southeast   University  

Bachelor of Science

Electrical &   Computer Engineering

09/2006 – 06/2010

Research interest: Machine Learning, Computer Vision

My research focuses on machine learning generalization in the open world, including theory, algorithm, and system development, with applications to important IoT problems such as smart traffic and intelligent manufacture. Especially, by investigating the brain cognition mechanism, I develop generalized and efficient machine learning system that can adapt to new domains and modalities with limited labels.

Research experiences

CS, Peking University, Beijing, China.

Tenure Track Assistant Professor

01/2022–Present

EECS, UC Berkeley, CA, US.

Postdoctoral Research Fellow

01/2020–01/2022

Petuum Inc., Sunnyvale, CA, US.

Research Manager

08/2018–01/2020

Carnegie Mellon University, Pittsburgh, PA,   US.

Research Assistant

08/2013–06/2018

Adobe Inc. San Jose, CA, US.

Research Intern

06/2017–09/2017

Awards

  • AAAI Best Paper Award, 2021 (CCF A, one of the most prestigious International Conferences on AI)

  • 2018 Rising Stars in EECS, US

  • NIPS travel award; CVPR Doctoral Consortium Travel Award, 2018

  • Qualcomm Innovation Fellowship (QInF), Finalist Award, 2015

  • CMU Research Fellowship

  • Chiang Chen Overseas Graduate Fellowship, $100,000, 2013 (10 winners nationwide)

  • Youth Academic Scholarship; Outstanding Student Award of Peking University (Twice)

  • Second prize in the International Contest on Mathematical Modeling, 2009

  • National Scholarship, 2009

Academic Service

  • Senior Program Committee, AAAI Conference on Artificial Intelligence (AAAI), 2022 & 2023.

  • Organizing Chair, Advances in Neural Information Processing Systems (NeurIPS) 2022, 1st Human in the Loop Learning Workshop.

  • Chief Organizer, International Conference on Machine Learning (ICML) 2021, Self-Supervised Learning for Reasoning and Perception.

  • Chief Organizer, International Conference on Machine Learning (ICML) 2021, 3rd Human in the Loop Learning Workshop.

  • Guest Editor, Special Issue on Novel Technologies in Multimedia Big Data, Electronics (ISSN 2079-9292).

  • Chief Organizer, Conference on Neural Information Processing Systems (NeurIPS) 2020, Self-Supervised Learning-Theory and Practice Workshop.

  • Chief Organizer, International Conference on Machine Learning (ICML) 2020, 2nd Human in the Loop Learning Workshop.

  • Chief Organizer, International Conference on Machine Learning (ICML) 2019, 1st Human in the Loop Learning Workshop.

  • Chief Organizer, ACM International Conference on Multimedia Retrieval (ICMR) 2019, "MMAC: Multi-Modal Affective Computing of Large-Scale Multimedia Data" Special Session.

  • Member, IEEE, IEEE Women in Engineering, IEEE Computer Society, IEEE Signal Processing Society.

  • Member, Association for Computing Machinery (ACM), ACM-SIGMM, ACM-SIGAI.

  • Reviewer, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), IEEE Transactions on Neural Networks and Learning Systems (TNNLS), International Journal of Computer Vision (IJCV), IEEE Signal Processing Magazine (SPM), Transactions on Image Processing (TIP), IEEE Transactions on Multimedia (TMM), IEEE Signal Processing Letters (SPL), The ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM).

  • Reviewer/Program Committee, NeurIPS; ICLR; CVPR; ICCV; ECML; AAAI; IJCAI.

Invited Talks

  • Keynote talk, The 2nd Anti-UAV Workshop & Challenge, ICCV 2021.

  • Invited talk, “The 4th Workshop and Prize Challenge: Bridging the Gap between Computational Photography  and Visual Recognition (UG2+)”, CVPR 2021.

  • Invited talk, Society for Neuroscience (SfN) Global Connectome, SfN social event: Neuroscience Meets AI.

  • Invited talk, ODSC West 2020, one of the largest applied data science conferences in the world with more than 5000 attendees.

  • Invited talk, ODSC West 2019, one of the largest applied data science conferences in the world with more than 5000 attendees.

  • Invited talk, Berkeley AI Research Lab (BAIR), 13/08/2019.

  • Invited talk, Shenzhen Pengcheng Cyberspace Laboratory, 29/12/2018.

  • Invited talk, Institute of Computing Technology, Chinese Academy of Sciences, 12/12/2018.

  • Invited talk, Forum on Frontiers of Computing, Peking University, 19/10/2018.

  • Invited talk, Nvidia Research, 28/03/2018.

  • Invited talk, Microsoft Research, 03/04/2018.

  • Invited talk, Berkeley AI Research (BAIR), 19/07/2018.

  • Selected to CVPR 2018 Doctoral Consortium with Travel Awards.

  • Invited talk, Vision and Learning Seminar (VALSE), 28/03/2018.

  • Invited to Facebook's 3rd Annual Women in Research Lean In Event.

 Teaching

04802019 Computer   Vision: Theory, Model, and Approach, Lecturer, Peking University

Fall, 2022

594BB Tensor computation for machine learning and data analysis: Guest Lecture, University of California, Santa Barbara (UCSB), Santa Barbara, CA

Fall, 2020

Nonlinear Optimization: Teaching Assistant, Carnegie Mellon  University, Pittsburgh,   PA

Spring, 2016

Multimedia Processing: Teaching Assistant, Peking   University, Beijing, China

Spring, 2012

Students Mentoring: 15 Ph.D. students, 5 Master students, 5 Undergraduate students

09/2015-03/2021