The Development of an Open-Domain Neural Dialogue System
ABSTRACT In this talk, I will give an overview of some research projects at Microsoft Research aiming at building an open-domain neural dialogue system. We group dialogue bots based on users' goals into three categories: task completion bots, information access bots, and social bots. We explore different neural network models and deep reinforcement learning technologies to build response generation engines for all the bots. We will review our experimental settings, recent results tested on simulator users and real users, share the lessons we learned and discuss future work.
BIO Jianfeng Gao is a Partner Research Manager in Deep Learning Technology Center (DLTC) at Microsoft Research, Redmond. He works on deep learning for text and image processing (see his JICAI2016 Tutorial) and leads the development of AI systems for dialogue, machine reading comprehension (MRC), question answering (QA), and enterprise applications.
At Microsoft, he participated in: developing a series of deep semantic similarity models (DSSM, also a.k.a. Sent2Vec), which have been used for many text and image processing tasks, including web search [Huang et al. 2013, Shen et al. 2014], recommendation [Gao et al. 2014a], machine translation [Gao et al. 2014b], and QA [Yih et al. 2015]; releasing a new MRC dataset, called MS MARCO; and developing a series of reasoning networks for MRC, aka ReasoNet and ReasoNet with shared memory; and developing a neural network models for social bots trained on Twitter data [project site] and task-completion bots [Lipton et al. 2016; Bhuwan et al. 2016] trained via reinforcement learning using a user simulator.
From 2006 to 2014, he was Principal Researcher at Natural Language Processing Group at Microsoft Research, Redmond, where he worked on Web search, query understanding and reformulation, ads prediction, and statistical machine translation. From 2005 to 2006, he was a research lead in Natural Interactive Services Division at Microsoft where he worked on Project X, an effort of developing natural user interface for Windows. From 1999 to 2005, he was Research Lead in Natural Language Computing Group at Microsoft Research Asia, where together with his colleagues, developed the first Chinese speech recognition system released with Microsoft Office, the Chinese/Japanese Input Method Editors (IME) which were the leading products in the market, and the natural language platform for Windows Vista.