北航经管学院“经济统计论坛”系列讲座
（2026年第9期，总第46期）
讲座题目：On Mixture of Experts and Local Model Averaging
讲座时间：2026.10.27（周二）10:00-11:00
讲座地点：新主楼A618
讲座嘉宾：杨宇红，清华大学丘成桐数学科学中心教授
讲座嘉宾 简介
Dr. Yuhong Yang is Professor at Yau Mathematical Sciences Center. He received his Ph.D. in statistics from Yale University in 1996. His research interests include model selection, model averaging, forecasting,multi-armed bandit problems, causal inference, high-dimensional data analysis, and machine learning. He has published in journals in several fields including Annals of Statistics, JASA, IEEE Transactions on Information Theory, IEEE Signal Processing Magazine, Journal of Econometrics, Journal of Machine Learning Research, and International Journal of Forecasting. He is a recipient of the US NSF CAREER Award and a fellow of the Institute of Mathematical Statistics also the American Statistical Association. He has been included in the list of top 2% of the world's most cited scientists by Stanford University.
讲座概要
Mixture of experts (MOE) plays an essential role in LLMs. It is closely related to localized model averaging. In this talk, we will examine benefits of combining models in a way that allows the weights to depend on the input (i.e., localized model averaging), establish oracle inequalities for certain simplified MOE models, and discuss natures of several key features in MOE such as shared experts and top-k in routing.
This talk is based on joint work with Ziwen Gao, Baihua He, Siyuan He, Jie Hu and Bokai Yang.
