Pattern Recognition Theory and Applications: Proceedings of the NATO Advanced Study Institute held at St. Anne’s College, Oxford, March 29–April 10, 1981

559 Pages·1982·17.773 MB·English

by  Pierre A. Devijver (auth.), Josef Kittler, King Sun Fu, Louis-François Pau (eds.)

Pattern Recognition Theory and Applications
NATO ADVANCED STUDY INSTITUTES SERIES
Proceedings of the Advanced Study Institute Programme, which aims
at the dissemination ofa dvanced knowledge and
the formation of contacts among scientists from different countries
The series is published by an international board of publishers in conjunction
with NATO Scientific Affairs Division
A Life Sciences Plenum Publishing Corporation
B Physics London and New York
C Mathematical and D. Reidel Publishing Company
Physical Sciences Dordrecht, Boston and London
D Behavioural and Sijthoff & Noordhoff International
Social Sciences Publishers
E Applied Sciences Alphen aan den Rijn and Germantown
U.S.A.
Series C - Mathematical and Physical Sciences
Volume 81 - Pattern Recognition Theory and Applications
Pattern Recognition
Theory and Applications
Proceedings oft he NATO Advanced Study Institute
held at St. Anne's College, Oxford, March 29-April10, 1981
edited by
J. KITTLER
Science and Engineering Research Council,
Rutherford and Appleton Laboratories, Chilton, Didcot, England
K. S. FU
Purdue University, West Lafayette, Indiana, U.S.A.
and
L. F. PAU
Ecole Nationale Superieure des Telecommunications, Paris, France
D. Reidel Publishing Company
Dordrecht: Holland / Boston: U.S.A. / London: England
Published in cooperation with NATO Scientific Affairs Division
Library of Congress Cataloging in Publication Data
NATO Advanced Study Institute (1981 . Oxford, Oxfordshire)
Pattern recognition theory and applications.
(NATO advanced study institutes series. Series C, Mathematical and
physical sciences; v. 81)
"Published in cooperation with NATO Scientific Affairs Division".
Includes index.
1. Pattern perception-Congresses. 2. Biomedical engineering
Congresses. 3. Automatic speech recognition-Congresses. I. Kittler, J.,
1946- II. Fu, K. S. (King Sun), 1930- III. Pau, L.-F.
(Louis-Fran~ois), 1948- IV. North Atlantic Treaty Organization.
Division of Scientific Affairs. V. Title. VI. Series.
Q327.N2 1981 001.53'4 81-23452
ISBN-13: 978-94-009-7774-7 e-ISBN-13: 978-94-009-7772-3
DOl: 10.1007/978-94-009-7772-3
Published by D. Reidel Publishing Company
P.O. Box 17,3300 AA Dordrecht, Holland
Sold and distributed in the U.S.A. and Canada
by Kluwer Boston Inc.,
190 Old Derby Street, Hingham, MA 02043, U.S.A.
In al1 other countries, sold and distributed
by_Kluwer Academic Publishers Group,
P. O. Box 322, 3300 AH Dordrccht, Hol1and
D. Reidel Publishing Company is a member of the Kluwer Group
Al1 Rights Reserved
Copyright ©1982 by D. Reidel Publishing Company, Dordrecht, Hol1and
Softcover reprint of the hardcover 1s t edition 1982
No part of the material protected by this copyright notice may be reproduced or utilized
in any form or by any means, electronic or mechanical, including photocopying,
recording or by any informational storage and retrieval system,
without written permission from the copyright owner
TABLE OF CONTENTS
PREFACE ix
SECTION 1 PATTERN RECOGNITION METHODOLOGY
P.A. Devijver: Advances in Nonparametric Techniques
of Statistical Pattern Classification 3
D.J. Hand: Statistical Pattern Recognition of Binary
Variables 19
A. Miyake: On the Haar Condition in Algorithms for
the Optimal Solution of Linear Inequalities 35
Th. Van der Pyl: Pattern Class Representation Related
to the Karhunen-Loeve Expansion 43
M. Terrenoire and D. Tounissoux: Sample Size
Sensitive Entropy 53
J.P. Rasson, A. Hardy, L. Szaryand P. Schindler:
An Optimal Clustering Method Based~on the Rasson's
Criterion and Resulting from a New Approach 63
G.T. Toussaint: Computational Geometric Problems in
Pattern Recognition 73
L. Norton-Wayne: A Coding Approach to Pattern
Recognition 93
S.K. Pal: Fuzzy Set Theoretic Approach: A Tool for
Speech and Image Recognition 103
M.G. Thomason: Syntactic Methods in Pattern Recognition 119
K.S. Fu: Hybrid Approaches to Pattern Recognition 139
A.K.C. Wong and L. Goldfarb: Pattern Recognition of
Relational Structures 157
M. Nadler: Hybrid Pattern Recognition: A Synthesis
of the Numerical and Qualitative Approaches 177
L.F. Pau: Fusion of Multisensor Data in Pattern
Recognition 189
vi TABLE OF CONTENTS
SECTION 2 IMAGE UNDERSTANDING AND INTERPRETATION
M. Brady: Artificial Intelligence Approaches to
Image Understanding 205
L.E. Druffel: Summary of the DARPA Image Understanding
Research Program 265
R. Bajcsy: Three-Dimensional Object Representation 283
H. Bunke: Automatic Interpretation of Lines and Text
in Circuit Diagrams 297
J.P. Harris, J. Kittler, B. Llewellyn and G. Preston:
A Modular System for Interpreting Binary Pixel
Representations of Line-Structured Data 311
B. Neumann and H. -H. Nagel: Recognition of Time
Varying Patterns in Image Sequences 353
SECTION 3 MEDICAL APPLICATIONS
E. Granum: Application of Statistical and Syntactical
Methods of Analysis and Classification to Chromosome
Data 373
C. Lundstee~ T. Gerdes and K. Philip: Attributes for
Pattern Recognition Selected by Stepwise Data
Compression Supervised by Visual Classification 399
J.T. Tou: Application of Pattern Recognition to
Knowledge System Design and Diagnostic Inference 413
E.S. Gelsema: Applications of Interactive Pattern
Recognition 431
R. Bonamini, R. De Mori, A. Lettera, R. Roggero and
E. Sandretto: An Electrocardiographic Signal
Understanding System 443
C.A. McNary and D.J. Skorton: Segmentation-Based
Boundary Extraction for Endocardial Definition in
Cross-Sectional Echocardiography 465
R. Bajcsy, P. Karp and A. Stein: Computerised
Anatomy Atlas of the Human Brain 477
TABLE OF CONTENTS vii
SECTION 4 SPEECH PROCESSING AND OTHER APPLICATIONS
L. Saitta: Decision TIleoretic and Structural Pattern
Recognition Methods in Speech Processing 489
Y.H. Pao: Pattern Recognition and Machine Intelligence
Techniques for Electric Power System Security
Assessment 507
C. Y. Suen and W. Y. Chan: A r.lu1ti-~1icrocomputer Based
Reading Machine for the Blind 521
D.C. Lai and S.K. Kwon: Decision-Set Concept with
Application to the Recognition of Hand-Printed
Numeric Characters 531
K. O'Mara: On the Development of a Model for
Determining the Frequency of Occurrence of English
Language Words 549
SECTION 5 PANEL DISCUSSION
G.T. Toussaint, E. Backer, P. Devijver, K. Fukunaga and
J. Kittler: Summary of Panel Discussion on Decision
Theoretic Methods 569
AUTHOR INDEX 573
SUBJECT INDEX 575
PREFACE
This book is the outcome of the successful NATO Advanced
Study Institute on Pattern Recognition Theory and Applications,
held at St. Anne's College, Oxford, in April 1981., The aim of
the meeting was to review the recent advances in the theory of
pattern recognition and to assess its current and future practical
potential. The theme of the Institute - the decision making
aspects of pattern recognition with the emphasis on the novel
hybrid approaches - and its scope - a high level tutorial coverage
of pattern recognition methodologies counterpointed with contrib
uted papers on advanced theoretical topics and applications - are
faithfully reflected by the volume.
The material is divided into five sections:
1. Methodology
2. Image Understanding and Interpretation
3. Medical Applications
4. Speech Processing and Other Applications
5. Panel Discussions.
The first section covers a broad spectrum of pattern
recognition methodologies, including geometric, statistical, fuzzy
set, syntactic, graph-theoretic and hybrid approaches. Its cove,r
age of hybrid methods places the volume in a unique position
among existing books on pattern recognition.
The second section provides an extensive treatment of the
topical problem of image understanding from both the artificial
intelligence and pattern recognition points of view. The two
application sections demonstrate the usefulness of the novel
methodologies in traditional pattern 'recognition application areas.
They address the problems of hardware/software implementation and
of algorithm robustness, flexibility and general reliability. The
final section reports on a panel discussion held during the
Institute.
In essence the book provides an up-to-date account of the
state of the art in pattern recognition and sets out new directions
for future theoretical developments. As such it will serve not
only as a useful reference book for the pattern recognition system
designer but also as a guide and stimulus to pattern recognition
researchers interested in the advancement of the subject.
Oxford
October 1981 Josef Kittler
ix
J. Kittler, K. S. Fu, and L. F. Pau (eds.), Pattern Recognition Theory and Applications, ix.
Copyright © 1982 by D. Reidel Publishing Company.
SECTION 1
PATTERN RECOGNITION METHODOLOGY
ADVANCES IN NONPARAMETRIC TECHNIQUES OF STATISTICAL PATTERN
CLASSIFICATION
Pierre A. DEVIJVER
Philips Research Laboratory
Brussels BELGIUM
1. INTRODUCTION
This paper is concerned with nonparametric statistical
pattern recognition and focuses on some theoretical advances that
have taken place since the previous NATO Advanced Study Institute
on Pattern Recognition Theory and Applications held in Bandol,
France, in 1975, [1 ]. In an article of this size, it is not
feasible to cover the field exhaustively. Therefore, the aim of
our selective discussion of topics is merely to give a limited
perspective on how statistical theories of pattern classification
have evolved during the last six years.
The following topics are considered
Feature selection.
Finite-sample problems
Sample size and measurement complexity.
Finite-sample problems in sequential classification.
Finite-sample density estimation.
Finite-sample distance measure for searching nearest
neighbors.
Discriminant analysis.
Nearest neighbor rules
Convergence conditions and error bounds.
Error-acceptance relationships.
Editing, multiediting, and condensing.
2. ADVANCES IN FEATURE SELECTION
The feature selection problem is concerned with the question
of searching the best d-feature subset of D measurements. All
feature selection algorithms published up to 1976 were variations
3
J. Kittler, K. S. Fu, and L. F. Pau (eds.), Pattern Recognition Theory and Applications, 3-18.
Copyright © 1982 by D. Reidel Publishing Company.