报告题目 (Title):Non-convergence Analysis of Randomized Direct Search(随机直接搜索的非收敛性分析)
报告人 (Speaker):张在坤 副教授(香港理工大学,知名专家)
报告时间 (Time):2023年11月28日 (周二) 19:00
报告地点 (Place):腾讯会议(742226720)
邀请人(Inviter):徐姿 教授
报告摘要:Direct search is a popular method in derivative-free optimization. Randomized direct search has attracted increasing attention in recent years due to both its practical success and theoretical appeal. It is proved to converge under certain conditions at the same global rate as its deterministic counterpart, but the cost per iteration is much lower, leading to significant advantages in practice. However, a fundamental question has been lacking a systematic theoretical investigation: when will randomized direct search fail to converge? We answer this question by establishing the non-convergence theory of randomized direct search. We prove that randomized direct search fails to converge if the searching set is probabilistic ascent. Our theory does not only deepen our understanding of the behavior of the algorithm, but also clarifies the limit of reducing the cost per iteration by randomization, and hence provides guidance for practical implementations of randomized direct search.