Jump to navigation

  • Academics
  • Research
  • Partnership
  • News
  • Events
  • LTI Intranet
  • Contact Us
  • Careers
  • Apply
  • Academics
  • Research
  • Partnership
  • People

Search form

Events Listing for: 03/27/2020

 Download .ics
Friday, March 27, 2020 - 2:30pm to 4:00pm
LTI Colloquium: From 'F' to 'A' on the N.Y. Regents Science Exams: A Look Inside the Aristo System
Peter Clark, Senior Research Manager
AI2
2315 Doherty Hall

ABSTRACT:

Performing well on standardized exams has been a longstanding challenge for AI. Even in 2016, the best AI system achieved less than 60% on an 8th Grade science exam challenge. Recently, AI2's Aristo system achieved surprising success on the Grade 8 New York Regents Science Exams, scoring over 90% on the exam's non-diagram, multiple choice (NDMC) questions. How was it able to do this? How much reasoning is going on inside? And what mistakes does it still make? In this talk, I will overview Aristo and the impact of its various components, in particular its new language model (LM) solvers. I will present several analyses of what is going on inside Aristo, in particular probing how much the LM solvers go beyond simple pattern matching, and what kinds of errors still occur. Finally I will speculate on the larger quest towards knowledgeable machines that can reason, explain, and interact, and what additional capabilities are needed to reach this broader goal.

 

BIO:

Peter Clark is a Senior Research Manager and founding member of AI2, and has led Project Aristo since its inception in 2014. His research focuses upon natural language processing, machine inference, and commonsense reasoning, and the interplay between these three areas.

Details:

John Friday jfriday@cs.cmu.edu

LTI Colloquium


April 2020

S M T W T F S
 
 
 
1
 
2
 
3
 
4
 
5
 
6
 
7
 
8
 
9
 
10
 
11
 
12
 
13
 
14
 
15
 
16
 
17
 
18
 
19
 
20
 
21
 
22
 
23
 
24
 
25
 
26
 
27
 
28
 
29
 
30
 
 
 

Display Events by Category:

All Events
Thesis Oral
Special Event
Thesis Proposal
Thesis Defense
LTI Colloquium
Upcoming Guest Lectures
LTI PhD Thesis Proposal
LTI PhD Theseis Defense
LTI Summer Seminar Talk

Contact Us

Language Technologies Institute
5000 Forbes Avenue
Pittsburgh, PA
15213-3891

412-268-6591
ltiwebmaster@cs.cmu.edu

Connect

   
Carnegie Mellon University School of Computer Science

Login | Logout