Table Of ContentCROSS-LANGUAGE
INFORMATION RETRIEVAL
THE KLUWER INTERNATIONAL SERIES ON
INFORMATION RETRIEVAL
Series Editor
W. Bruce Croft
University ofMassachusetts
Amherst, MA 01003
AlsointheSeries:
MULTIMEDIA INFORMATIONRETRIEVAL: Content-Based
Information Retrieval from LargeTextand Audio Databases
byPeterSchauble
ISBN: 0-7923-9899-8
INFORMATION RETRIEVAL SYSTEMS
byGeraldKowalski
ISBN: 0-7923-9926-9
CROSS-LANGUAGE
INFORMATION RETRIEVAL
edited by
Gregory Grefenstette
Xerox Research Centre Europe
Grenoble, France
~.
"
SPRINGER SCIENCE+BUSINESS MEDIA, LLC
ISBN 978-1-4613-7591-3 ISBN 978-1-4615-5661-9 (eBook)
DOI 10.1007/978-1-4615-5661-9
Library of Congress Cataloging-in-Publication Data
A C.I.P. Catalogue record for this book is available
from the Library of Congress.
The publisher offers discounts on this book when ordered in bulk quantities. For
more information contact: Sales Department, Kluwer Academic Publishers,
101 Philip Drive, Assinippi Park, Norwell, MA 02061
Copyright © 1998 by Springer Science+Business Media New York
Originally published by Kluwer Academic Publishers in 1998
Softcover reprint of the hardcover 1s t edition 1998
AH rights reserved. No part of this publication may be reproduced, stored in a
retrieval system or transmitted in any form or by any means, mechanical, photo
copying, recording, or otherwise, withoutthe prior written permission of the
publisher, Springer Science+Business Media, LLC.
Printed on acid-free paper.
CONTENTS
PREFACE
IX
1 THE PROBLEM OF CROSS-LANGUAGE
INFORMATION RETRIEVAL
Gregory Grefenstette 1
1 Introduction 1
2 The Three Problems ofCLlR 3
3 Finding Translations 4
4 Pruning Translation Alternatives 7
5 Weighting Translation Alternatives 8
6 Conclusion 9
2 ON THE EFFECTIVE USE OF LARGE
PARALLEL CORPORA IN CROSS
LANGUAGE TEXT RETRIEVAL
Mark W. Davis 11
1 Introduction 11
2 Recuerdo: A Spanish Retrieval Engine 13
3 Collins Bilingual English-Spanish Dictionary 14
4 The UN Parallel Corpus 14
5 The Disambiguation Engine 15
6 Monolingual and Cross-Language Retrieval Results 17
7 The Role ofDisambiguation 18
8 Further Improving Disambiguation Performance 21
9 Conclusions 21
VI CRoss-LANGUAGE INFORMATION RETRIEVAL
3 STATISTICAL METHODS FOR CROSS-
LANGUAGE INFORMATION RETRIEVAL
Lisa Ballesteros and W. Bruce Croft 23
1 Introduction 23
2 Previous Work 24
3 Dictionary Translation Using Expansion 26
4 Experiments 27
5 Conclusions and Future Work 39
4 DISTRIBUTED CROSS-LINGUAL
INFORMATION RETRIEVAL
Christian Fluhr, Dominique Schmit, Philippe Ortet,
Faza Elkateb) Karine Gurtner, Khaled Radwan 41
1 The EMIR project approach 42
2 The distributed multilingual client-server architecture 46
3 Experimentation on a library catalog 49
4 Conclusion 50
5 AUTOMATIC CROSS-LANGUAGE
INFORMATION RETRIEVAL USING
LATENT SEMANTIC INDEXING
Michael L. Littman, Susan T. Dumais, Thomas K.
Landauer 51
1 Introduction 51
2 Overview ofLatent Semantic Indexing (LSI) 52
3 Cross-Language Retrieval Using LSI 54
4 Conclusion 62
6 MAPPING VOCABULARIES USING
LATENT SEMANTICS
David A. Evans, Steve K. Handerson, Ira A. Monarch,
Javier Pereiro, Laurent Delon, William R. Hersh 63
1 The Problem: ManagingSemanticsin Medical Vocabularies 64
2 The Basis ofa Solution: Latent Semantic Indexing 65
3 The Hypothesis: LSI Applied to Terms 68
4 Experiments: LSI Mappings ofMedical 'Term Space' 73
Contents Vll
5 Conclusion: DevelopingGeneral, Robust Methods for Med
ical Semantics 79
7 CROSS-LANGUAGE INFORMATION
RETRIEVAL: A SYSTEM FOR
COMPARABLE CORPUS QUERYING
Eugenio Picchi and Carol Peters 81
1 Introduction 81
2 Corpus Linguistics and Bilingual Reference Corpora 82
3 Procedures for Comparable Corpus Processing 84
4 First Results 88
5 Application to Cross Language Information Retrieval 90
8 A LANGUAGE CONVERSION FRONT-END
FOR CROSS-LANGUAGE INFORMATION
RETRIEVAL
YAMABANA Kiyoshi MURAI(J Kazunori DOl
J J
Shinichi KAMElShin-ichiro 93
J
1 Introduction 93
2 Problems in Translation Equivalent Selection 94
3 Description of the Method 96
4 Implementation 101
5 Experimental Results 102
6 Discussion 103
7 Conclusion 104
9 THE SYSTRAN NLP BROWSER:
AN APPLICATION OF MACHINE
TRANSLATION TECHNOLOGY IN
CROSS-LANGUAGE INFORMATION
RETRIEVAL
Denis A. Gachot Elke Lange and Jin Yang 105
J
1 Introduction 105
2 SYSTRAN NLP Browser 107
3 Discussion 115
4 Conclusion 117
VIll CRoss-LANGUAGE INFORMATION RETRIEVAL
10 A WEIGHTED BOOLEAN MODEL FOR
CROSS-LANGUAGE TEXT RETRIEVAL
David Hull 119
1 Introduction 119
2 Boolean vs. Vector Space Retrieval 120
3 Background: Extended Boolean Models 123
4 A New Weighted Boolean Model 125
5 Background: Cross-Language Text Retrieval 127
6 Testing the Weighted Boolean Model 130
7 Commentary 135
11 BUILDING A LARGE MULTILINGUAL
TEST COLLECTION FROM COMPARABLE
NEWS DOCUMENTS
Paraic Sheridan, Jean Paul Ballerini, Peter Schauble 137
1 Introduction 137
2 Evaluation using Seed Documents 140
3 The ETH MultilingualTest Collection 142
4 Summary and Conclusions 149
12 EVALUATING CROSS-LANGUAGE TEXT
FILTERING EFFECTIVENESS
Douglas W. Oard, Bonnie J. Dorr 151
1 Introduction 151
2 Adaptive MultilingualText Filtering 152
3 Ideal Experiment Design 154
4 Use ofAvailable Corpora 156
5 Results 158
6 Conclusions 160
REFERENCES 1~
INDEX 177
PREFACE
Most of the papers in this volume were first presented at the Workshop on
Cross-Linguistic Information Retrieval that was held August 22, 1996 dur
ing the SIGIR'96 Conference. Alan Smeaton of Dublin University and Paraic
Sheridan of the ETH, Zurich, were the two other members of the Scientific
Committee for this workshop. SIGIR is the Association for Computing Ma
chinery (ACM) Special Interest Group on Information Retrieval, and they
have held conferences yearly since 1977. Three additional papers have been
added: Chapter 4 Distributed Cross-Lingual Information retrieval describes
the EMIR retrieval system, one ofthe first general cross-language systems to
be implemented and evaluated; Chapter 6 Mapping Vocabularies Using Latent
Semantic Indexing, which originally appeared as a technical report in the Lab
oratory for Computational Linguistics at Carnegie Mellon University in 1991,
is included here because it was one ofthe earliest, though hard-to-find, publi
cations showing the application ofLatent SemanticIndexing to the problem of
cross-language retrieval; and Chapter 10 A Weighted Boolean Model for Cross
Language Text Retrievaldescribes a recent approach to solving the translation
term weighting problem, specific to Cross-Language Information Retrieval.
Gregory Grefenstette
CONTRIBUTORS
Lisa Ballesteros David Hull
W, Bruce Croft Gregory Grefenstette
Centerfor Intelligent Xerox ResearchCentreEurope
InformationRetrieval GrenobleLaboratory
ComputerScienceDepartment
UniversityofMassachusetts Thomas K. Landauer
DepartmentofPsychology
Mark W. Davis andInstituteofCognitiveScience
ComputingResearchLab UniversityofColorado,Boulder
New Mexico StateUniversity
Michael L. Littman
Bonnie J. Dorr ComputerScienceDepartment
DepartmentofComputerScience BrownUniversity
UniversityofMaryland
Douglas W. Oard
Susan T. Dumais CollegeofLibrary
InformationSciencesResearchGroup andInformationServices
Bellcore, Morristown, NJ UniversityofMaryland
David A. Evans Carol Peters
Steve K. Handerson Istitutodi ElaborazionedellaInformazione
Ira Monarch CNR, Pisa, Italy
Javier Pereiro
Laurent Delon Eugenio Picchi
William R. Hersh Istitutodi LinguisticaComputazionale
Laboratoryfor ComputationalLinguistics CNR, Pisa, Italy
Carnegie Mellon University
Paraic Sheridan
Denis A. Gachot Jean Paul Ballerini
Elke Lange Peter Schauble
Jin Yang Swiss FederalInstituteofTechnology(ETH)
SYSTRAN Software,Inc, Zurich,Switzerland
La Jolla, CA
YAMABANA Kiyoshi
Christian Fluhl' MURAKI Kazunori
Dominique Schmit DOl Shinichi
Philippe Ortet KAMEl Shinichiro
Falza Elkateb Information Technology Research Laborato
Karine GUl'tner ries
Khaled Radwan NEC Corporation,Kawasaki, Japan
DISTjSMTI, CEA-Saclay
GifsurYvette, France
