knowledge acquisition for knowledge-based systems workshop

653 Pages·2016·32.1 MB·English

Proceedings of the
KNOWLEDGE ACQUISITION FOR
KNOWLEDGE-BASED SYSTEMS
WORKSHOP
Ban(fConference Centre
Banff, Alberta, Canada
Noven1ber 2-7, 1986
Sponsored by the
American Association for
Artificial Intelligence
Workshop Co-chairs:
John H. Boose, Boeing Computer Services
Brian R. Gaines, University ofCalgary
i
J_
Proceedings of the
KNOWLEDGE ACQUISITION FOR
KNOWLEDGE-BASED SYSTEMS WORKSHOP
Banff Conference Centre, Banff, Alberta, Canada
November 2-7,1986
Sponsored by the American Association for Artificial Intelligence
These proceedings are prov1ded b)' Boeing Computer Services in a limited
distribution for workshop participants. Please do not reproduce any portion of this
work without written permission from the authors.
KNOWLEDGE ACQUISITION FOR KNOWLEDGE-BASED SYSTEMS WORKSHOP
Sponsored hy the American Association for Artificial Intelligence
Banff, Canada, 'Jovember2-7, 1986
CONTENTS
Program ............. . iv
List of Participants and Authors ix
Technical Papers (listed alphabetically by author)
"The KREME Knowledge Editing Environn11·nt,"
Glenn Abrett, Mark H. Burstein, BBN Laboratories 1-0
"Ontological Analysis: An Ongoing Expertment,"
James H. Alexander, Michael J. Freiling (speaker), Sher:· l J. Shulman, Steven Rehfuss
and Steven L. Messick, Tektronix Laboratories . . .............. . 2-0
"Knowledge Elicitation Using Discourse Analysis,"
NicholasJ. Belkin, Rutgers l.J,tiversity; H. M. Brooks, The City University, London;
P. J. Daniels, Ministry of Defense, U.K. . . . . . . . . . . . . . . ....................... . 3-0
"On the Structure of Expository Text· Preliminari... • Building an Expert System
from Manuals,"
Genevieve Berry-Rogghe, Templf' I ntversity, Randy ;\1. Kaplan .................... . 4-0
"Expertise Transfer and C•uuplPx Prohlemg G !';ing AQ l:J]'; AS as a Knowledge
Acquisition Workbench for Rxpert Sy ... t~rtl'• "
John H. Boose, Jeffrey M Hradshaw r -:p• akerJ, RM•int tifH:·ial Intelligence Center ... 5-0
"Induction of Horn Clauses: Methud,. and !hP Plausible Generalisation Algorithm,"
Wray Buntine, New South Wales Institute of Technology and Macquarie University ...... . 6-0
"Generic Tasks in Know ledge-Based Reasoning: The 'Right' Level of Abstraction for
Knowledge Acquisition,"
Tom Bylander, B. Chandrasekaran, Ohio State University .... 7-0
"Acquisition ofUncertain Rules in a Probabilistic Logic,"
John G. Cleary, University ofCalgary . . . . . . . . .......................... . 8-0
"Cognitive Biases and Corrective Technigues; Proposals for Improving Elicitation
Procedures for Knowledge-Based Systems,"
David A. Clea ·. ts, CSDA Forest Service ..... 9-0
"The Application of Psychological Scaling Techmques to Knowledge Elicitation for
Expert Systems,"
Nancy M. Cooke,James E. McDonald, New Mexico State University 10-0
"A Foundational Approach to Autonomous Knowledge Acquisition ir·
Knowledge-Based Systems,"
James P. Delgrande, Simon Fraser lJ niversity 11-0
"KRITON: A Knowledge Acquisi1•on Tool ior Expert Systems,"
Joachim Diederich, Ingo Ruhrnann, Mark May, German Research Institute for
Mathematics and Data Proce-.smg . . . . . . . . . . . . . . 12-0
"MOLE: A Tenacious Knowledge Acqutsitwn Tool,"
Larry Eshelman, Damien Ehret, John VfcDermott, and Ming Tan,
Carnegie-Mellon Uni.,;ersity 13-0
/
I
"An Overview of Knowledge Acquisition and Transfer,"
Brian Gaines, University ofCalgary . . 14-0
"Knowledge Based Knowledge Acquisition for a Statistical Consulting System,"
William A. Gale, AT+T Bell Laboratories . . . . . . . . . . . . . . . . . . . . . . . . . . 15-0
"A Conceptual Framework for Knowledge Elicitation,"
Chaya Garg-Janardan and Gavriel Salvendy, Purdue University 16-0
"Design for Acquisition: Principles of Knowledge System Design to Facilitate
Knowledge Acquisition,"
Thomas Gruber, Paul Cohen, University of Massachusetts ..... 17-0
"Structured Analysis of Knowledge,"
Simon A. Hayward, STC Technology Limited; B. J. Wielinga and J.A. Breuker
University of Amsterdam . . . . . . . ......................... . 18-0
"Specification of Expertise: Knowledge Acquisition for Expert Systems,"
Paul E. Johnson, School ofManagemPnt; Sharon Gruber, 3M Company .... 19-0
"Knowledge Acquisition for Fault Isolation Expert Systems,"
Kenneth De Jong, George Mason University, and The Navy Center for Applied
Research in AI . . . . . . . . . . . . . . . . . . . . . . . . . . . . ..................... . 20-0
"An Intelligent Mixed-Initiative Workbench for Knowledge Acquisition,"
Gary S. Kahn, Edwin H. Breaux, Robert L. Joseph, and Peter DeKlerk,
Carnegie Group Inc. . . . . . . . . . . . . . . . . . . ................................ . . 21-0
"Heuristics for Expertise Transft>r-The Automatic Management of Complex Knowledge
Acquisition Dialogs,"
Catherine M. Kitto, ,John H. Boose, Boeing Arttficiallntelligence Center ............... . 22-0
"KNACK-Report Driven Knowledge Acqmsition,"
Georg Klinker, Joel Bl·ntolila, Serge Genf>tet, Mirhael Grimes, and John McDermott,
Carnegie .Mellon l'niversity ..................................... . 23-0
"Generalization in a Noisy Fnvironment: 'rhe Need to Integrate Symbolic and Numeric
Techniques in Learnit .•.
Yves Kodratoffand Michel Manago, Laboratoire de Recherche en Informatique,
U niv. Paris-Sud and CNRS; Jim Blythe and Clive Small man, GEC Research,
Thierry Andro, Cognitech . . . . . ............................... . 24-0
"YAKYAK: Yet Another Kit !or Your Acquisition of Knowledge,"
James Kornell, General Research Corp. . ....................... . 25-0
"The Knowledge Acquisition Grid: A Method for Training Knowledge Engineers,"
Marianne LaFrance, Boston College . . . .............................. . 26-0
"On Competence and Performance Notions in Expert System Design· A Critique of Rapid
Prototyping"
Otto E. Laske, Arthur D. Little, Inc. . ...... . 27-0
"Mode ling Human Expertise in Knowledge Engineering: Some Preliminary Observations,"
David C. Littman, Yale University . . . . . . . . . . ................................... . 28-0
"Taking Backtracking with a Grain of SALT,"
Sandra Marcus, Boeing Artificial Intelligenc.e Center . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29-0
11
"Measurement ofDeclarat.ivP and Procedural Knowledge in the Development of a
Knowledge-Based Media Planning System "
Andrew A. Mitchell, University ofToronto . . . . . . . . . . . . . . . . . . . . . . . . . . 30-0
"INFORM: An Architecture for Expert-Directed Knowledge Acquisition,"
Eric A. Moo re, Schl umberger I Appl icon, Alice. M. Agogino,
UniviversityofCalifornia, Berhley . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31-0
"Acquiring Domain Models,"
Katharina Morik, Technische Universitat Rerlin 32-0
"Using A Domain Model to Drive an Interactive Knowledge Editing Tool,"
Mark A. Musen, Lawrence M. Fagan, David M Combs, Edward H. Shortliffe,
Stanford University School ofMedicinP . . . . . . . . . . . . . . . . ........... . 33-0
"Explanation-Based Learning for Know ledgt> based Systems,"
Michael J. Pazzani, The Aerospace Corp. and the
UCLA Artificial Intelligence Laboratory 34-0
"Analysis of the Performance of a Genef., Algorithm-Based System for Message
Classification in Noisy Environments,"
Elaine J. Pettit, Merit Technology, Inc.; Michael Pet.tit, University of Texas at Dallas 35-0
"Simplifying Decision Trees,"
J. R. Quinlan, New South Wales Institute ofTechn• . lngy 36-0
"Multiple Problem Spaces in the Knowledge Design Process,"
Alain Rappaport, Neuron Data and the Robotics Institue, Carnegie-Mellon University . . . . 37-0
"Ontology and Inventory: A Foundation for a Knowledge Acquisition Methodology,"
Steven Regoczei, Trent University; Edwin P. 0. Plantinga, University of Toronto . . . . . . . . . 38-0
"Techniques for Knowledge Acquisition and Transfer,"
Mildred L. G. Shaw and Rrian R Gaines, UnivPrsity ofCalgary . ······· ... 39-0
"Knowledge Base Debugging l;sing Apprf'.•ticeship Learning Techmques,"
David C. Wilkens, Stanford University . . . . . . . . . . . . . . . . . 40-0
"Case Generation fo1 Rule Synthesis,"
Edward Wisniewski, Brown University; Howard Winston, Reid Smith, \1ichael Kleyn,
Schlumberger Doll Research . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41-0
"MappingCognit1 ve Demands and Activities in Complex Problems Solving Worlds,"
David D. Woods, Westinghouse Research and Development Center; Erik Hollnagel,
Computer Resources International, Copenhagen . . . . . . . . . . . . . . . . . . . . . . . . 42-0
'"
PROGRAM
KNOWLEDGE ACQUISITION I<'OR KNOWLEDGE-BASED SYSTEMS WORKSHOP
Sponsored by the American A:5sociation for Artificial Intelligence
Banff. Canada, "l ovember 2-7, 1986
eo-chairmen:
John H. Boose, Boeing Artificial Intelligence Center
Brian R. Gaines. l niversity ofCalgary
Program Committee
Jeffrey Bradshaw, Boeing Computer Services
William Clancey, Stanford C ni vet·si ty
Cathy Kitto, Ro~ing Compu!Pr Services
Janusz Kowahk. Hoeing .,ompttterServices
John McDermott, Carnegie-Mellon University
Ryszard Michalski, Cniversity of Illinois, Urbana
Art Nagai, Boeing Computer Services
Mildred Shaw, University ofCalgary
DAILY SCHEDULE
Workshop sessions will be held in the residence building. There will be coffee andjuice breaks each
morning and afternoon, and lunch will be served from 12:00 -1:00. Lunches and continental
breakfasts will be served in the residence building; hot breakfasts and dinnf>r!'; will be available in a
separate Centre building.
SCHI<:UULE OF EVENTS
Sunday, November 2
2:00-9:00: Registra tio11
7:00: Reception
Monday, November 3
Plenary Sessions
Plenary speakers will describt: the state ofthe art from their point of view, and give a short synopsis
of each paper being presented in their topic area.
8:30-9:30: "An Overview of Knowledge Acquisition and Transfer,"
Brian Gaines, University ofCalgary
9:30-10:30: "Cognition and Expertise,"
William Clancey, Stanford University
10:30-11:00: Break
11:00-12:00: "Interactive lnterviewmg Tools I,"
John McDermott, C'arnegie-:\llp\lon University
12:00-1:00: Lunch
1:00-2:00: "Interactive InterviE•\\ ing Tools Il,"
John Boose, Boeing Artificial Intelligence Center
2:00 3:00: "Approaches to the Analysis of Knowledge Structures,"
Gavriel Salvendy, Purdue Cniversity
3:00 · 3:30: Break
3:30-4:30: "Learning,"
Ryszard Michalslu, t.:niversily of Illinois at Urbana
.... /) &f-/5'
Dinner 6·~ /L~
IV
Tuesday, November 4
(Note: presenters should allow at lt>a!'lt 10 minutes for questions during their presentation time.)
Room A
Cognition and Expertise
8·30-9:00· "Modeling Human Expertise in Knowledge Engineering: Some Preliminary
Observations,"
DavidC. Littman, Yale University
9:00 9:30 "Cognitive Biases and Corrective Techniques; Proposals for Improving Elicitation
ProcPdures for Knowledge-Based Systems,"
David A Cleaves, USDA Forest Service
9:30 10:00 "Mapping Cognitive Demands and Activities in Complex Problems Solving Worlds,"
David D Woods, Westinghouse Research and Development Center; Erik Hollnagel,
Computer Resources Inlt!rnational, Copenhagen
10:00-10:30 HrNJ.k
10:30-11:00: "Explanation-Based Learrung for Knowledge-based Systems,"
Michael J. Pazzani, The Aerospace Corp. and the UCLA Artificial Intelligence
Laboratory
11:00-11:30: "Ontology and In,entory: A Foundation for a Knowledge Acquisition Methodology,"
Steven Regoczei, Trent University; Edwin P. 0. Plantinga, University of Toronto
11:30-12:00: "Acquiring Domain Models,"
Katharina Morik, Ter:hnisr.:hP U niversitat Berlin
12:00-1:00: Lunch
Approaches to the Analysis of Knowledge Structures
1:00-1:30: "Knowledge Elidtatwr. L ;,. i?; Discourse Analysis,"
Nicholas J. Belk ir. R ..• ;.;. • . ~~niversity; H. M. Brooks, The City University, London;
P. J. Daniels, \fini,l ....; "Dtft-trse, U.K.
1:30-2:00: "Specification of E l(.p~rt, . ~ Knowledge Acquisition for Expert Systems,"
Paul E. .Johnson. School of \1anagement; Sharon Gruber, 3M Company
2:00-2:30: "The Applicatton ut Psychological Scaling Techniques to Knowledge Elicitation for
Expert Systems,"
Nancy M. Cooke, James E. McDonald, New Mexico State University
2:30-3:00: Break
3:00-3:30: "A Conceptual Framework for Knowledge Elicitation,"
Chaya Garg-Janardan and Gavriel Salvendy, Purdue University
3:30-4:00. "Structured Analysis of Knowledge,"
Simon A Hayward, STC Technology Limited; B. J. Wielinga and J A Breuker,
University of Amsterdam
4 00 4:30 "Measurement of De<'laratJ .;e and Procedural Knowledge in the Development of a
Knowledge-Based Media Planning System,"
Andrew A. Mitchell, l"niversity ofToronto
4:30-5:00: "On the Structure of Expository Text Preliminaries to Building an Expert System
from Manuals,"
Genevieve Berry-Rogghe, Temple University; Randy M. Kaplan
RoomB
Interactive Interviewing Tools I
8:30-9:00: "The KREME Knowledge Editing Environment,"
Glenn Abrett Mark H. Burstein, BBN Laboratories
9:00-9:30: "MOLE: A Tenacious Knowledge Acquisition Tool,"
Larry Eshelman, Damien Ehret, John McDermott, and Ming Tan, Carnegie-Mellon
University
9:30-10:00: "Knowledge Based Knowledge Acquisition for a Statistical Consulting System,"
William A. Gale, AT+T Bell Laboratories
10:00-10:30: Break
10:30-11:00: "An Intelligent Mixed-ln1tiative Workbench for Knowledge Acquisition,"
Gary S. Kahn, Edwin H Breaux, Rol:v·rt. L. Joseph, and Peter DeKlerk, Carnegie
Gr<,up Inc
11:00-11.30: "KNACK- Report-Driven Knowledge Acquisition,"
Georg Klinhr, Joel Bentolila, Serge Genetet, Michael Grimes, and John McDermott,
Carnegie-Mellon University
11:30 -12:00· "YA KY AK. Yet Another Kit for Your Acquisition of Knowledge,"
James Kornell, General Research Corp.
12:00-1:00: Lunch
1:00-1:30: "Taking Backtracking with a Grait. ofSALT,"
Sandra Marcus, Boeing Artificial Intelligence Cent.er
1:30-2:00: "Using A Domain Model to Drivt> <tr• Interactive Kuo''" 1.-dg•· hl•t ing Tool,"
Mark A. Musen, Lawrence M Fagan, David M. Combs, l•:dwarri H "hortliffe,
Stanford University School ofMerlir ne
2:00-2:30: "Multiple Problem Spaces in the Knowledge Design Process,"
Alain Rappaport, Neuron Data and t 'te Robotics Inst it ue, Carncg1e Mellon
Unhersity
2:30-3:00: Br""•k
3:00-3:30: "Techni<tues for Knowledge Acquisition and Transfer,"
Mildred Shaw and Brian Gainesx sz, University ofCalgary
Learning I
3:30 4:00: "Knowledge Base Debugging Using Apprenticeship Learning Techniques,"
David C. Wilkens, Stanford University
4:00. 4:30: "Case Generation for Rule Synthesis,"
Edward Wisniewski, Brown University; Ho ward Winston, Re id Smith, Michael
Kleyn, Schlumberger-Doll Research
J. f tt( r;-
Dinner 0 0 ¥V-
Wednesday, November 5
Room A
Learningll
8:30-9:00: "Simplifying Decision Trees "
J. R. Quinlan, New South Wales Institute ofTechnology
9:00-9:30: "Induction of Horn Clauses M~t hods and the Plausible Generalisation Algorithm,"
Wray Buntine, New South Wales Institute of Technology and Macquarie University
9:30-10:00: "Acquisition of U nCf~rtam Rules in a Probabilistic Logic,"
John G. Cleary, Uni .-rsity ofCalgary
10:00-10:30: Break
vi
10:30-11:00: "A Foundational Approach to Autonomous Knowledge Acquisition in Knowledge
Based Systems,"
James P Delgrande, Simon Fraser University
11:00-11:30: "Generalization in a Noisy Environment: The Need to Integrate Symbolic and
Numeric Techniques in Learning,"
Yves Kodratoffand Michel Manago, Laboratoire de Recherche en lnformatique, Univ.
Paris-Sud and CNRS JimBlythe and Clive Smallman, GEC Research; Thierry
Andro, Cognitech
11:30 · 12:00: "Analysis of the Performance of a Genetic Algorithm-Based System for Message
Classification in Noisy Environments,"
Elaine J. Pettit, Merit Technology, Inc.; Michael Pettit, University of Texas at Dallas
RoomB
Interactive Interviewing Tnols 11
8:30-9:00 "KRITON· A Knowledge A('quisih \fl Tool for Expert Systems,"
Joachim Diederich, lngo Ruhmann Mark May, German Research ' ·stitute for
Mathematics and Data ProcessinP
9:00-9:30: INFORM: An Architectur< for Ex:pen-Directed Knowledge Acquisition,"
Eric A. Moon", Schlumberger1 Applicon; Alice M. Agogino, Univiversity of California,
Berkeley
9:30-10:00: "Design for Acquisition: Principles of Knowledge System Design to Facilitate
Knowledge Acquisition,"
Thoma:-r:,·ulw!' Pau1 r.,:. versity of Massachusetts
rIll
10:00-10:30: Break
10:30-11:00: "Expertise 1'ransff'r and l. :: :J:plex Problems: Using AQUINAS as a Knowledge
Acquisition Workbench for Expert Systems,"
John H Bt•· .1. Jeffre_; \1. Bradshaw (speaker), Hoeing Artificial Intelligence Cente1
11:00-11:30: "Heuristics r,,, E"'perti~e Transfer: The Automatic Management of Complex
Knowledg ... Actlui!-;itinn Dialogs,"
CatherinP M Kitto, John H Boose, Hoeing Artificial Intelligence Center
11:30-12:00: "KnowledgP Al'quisition for Fault Isolation Expert Systems,"
Kenneth DeJong, George Mason University, and The Navy Center for Applied
Research i~. AI
Lunch, afternoon, evening-Local Atn•osphere Enjoyment and Bear Patrol
Thursday, November 6
Morning Panel Discussions
8:00-10:00· Panel I-"Knowledge Acquisition Methodology and Training"
8:00-8:30 "Generic Tasks in Know kdge Based Reasoning: The 'Right' Level of Abstraction for
Knowledge Acquisition,"
Tom Bylander, B Chand1a::;ekaran, Ohio State University
8:30-9:00: "Ontological Analysis· An Ongoing Experiment,"
James H. Alexander, \11, !1ael J. Freiling (speaker), Sheryl J. Shulman, Steven
Rehfuss and Steven L. Messick, Tektronix Laboratories
9:00-9:30: "The Knowledge Acquisitwn Grid: A Method for Training Knowledge Engineers,"
Marianne LaFra ce. Boston College
9:30-10:00: Discussior
10:00-10:30: Break
vii
10:30-12:00: Panel 11 · .. Reasoning with Uncertainty: Implications for Knowledge
Acquisition"
Moderator: Ryszard Michalsk1, with Bnan Gaines andJ R Quinlan
12:00-1:00: Lunch
Afternoon Working Groups
Attendees will participate in one of several small working groups that will attempt to define
the state-of-the-art and future research directions in their topic area
Cognition and Expertise, William Clancey, e1 q 1
Interactive Interviewing Tools I, John McDermott, et al.
Interactive Interviewing Tools 11, John Boose, et al.
Approaches to the Analysis of Knowledge Structures, Gavriel Salvendy, et al
Learning, Ryszard Michalski, et al.
Knowledge Acquisiton Methodology and Training, B. Chandrasekaran, et al
Reasoning with Uncertainty and Knowledge Acquisiton, Brian Gaines, J. R. Qumlan, et al.
Friday, November 7
Working Group Presentations
A spokesperson will present results from each working group
8:00-8:20: Cognition and Expertise
8:20-8:40: IntPractive Interviewing Tools I
8:40-9:00: Int• .-vi~>wingTools 11
9:00-9:20: Approaches to the Analysis of Knowledge Structures
9:20-9:40: Learning
9:40-10:00: Knowledge Acquisiton Methodology and Training
10:00-10:30: Break
10:30-11:00 Reasoning with Uncertainty and Knowledge Acquisiiton
Summary
11:00 -12:00: Workshop Summary, Brian Gaines
12:00-1:00: Lunch
Vi ll