Inference and Asymptotics

369 Pages·1994·8.673 MB·English

by  O. E. Barndorff-Nielsen, D. R. Cox (auth.)

MONOGRAPHS ON
STATISTICS AND APPLIED PROBABILITY
General Editors
D.R. Cox, D.V. Hinkley, N. Reid, D.B. Rubin
and B. W. Silverman
Stochastic Population Models in Ecology and Epidemiology
M.S. Bartlett (1960)
2 Queues D.R. Cox and W.L. Smith (1961)
3 Monte Carlo Methods J.M. Hammersley and D.C. Handscomb (1964)
4 The Statistical Analysis of Series of Events D.R. Cox and
P.A.W. Lewis (1966)
5 Population Genetics W.J. Ewens (1969)
6 Probability, Statistics and Time M.S. Bartlett (1975)
7 Statistical Inference S.D. Silvey (1975)
8 The Analysis of Contingency Tables B.S. Everitt (1977)
9 Multivariate Analysis in Behavioural Research A.E. Maxwell (1977)
10 Stochastic Abundance Models S. Engen (1978)
11 Some Basic Theory for Statistical Inference E.J.G. Pitman (1978)
12 Point Processes D.R. Cox and V. Isham (1980)
13 Identification of Outliers D.M. Hawkins (1980)
14 Optimal Design S.D. Silvey (1980)
15 Finite Mixture Distributions B.S. Everitt and D.J. Hand (1981)
16 Classification A.D. Gordon (1981)
17 Distribution-free Statistical Methods J.S. Maritz (1981)
18 Residuals and Influence in Regression R.D. Cook
and S. Weisberg (1982)
19 Applications of Queueing Theory G.F. Newell (1982)
20 Risk Theory, 3rd edition R.E. Beard, T. Pentikiiinen and
E. Pesonen (1984)
21 Analysis of Survival Data D.R. Cox and D. Oakes (1984)
22 An Introduction to Latent Variable Models B.S. Everitt (1984)
23 Bandit Problems D.A. Berry and B. Fristedt (1985)
24 Stochastic Modelling and Control M.H.A. Davis and R. Vinter (1985)
25 The Statistical Analysis of Compositional Data J. Aitchison (1986)
26 Density Estimation for Statistical and Data Analysis
B. W. Silverman (1986)
27 Regression Analysis with Application G.B. Wetherill (1986)
28 Sequential Methods in Statistics, 3rd edition G.B. Wetherill (1986)
29 Tensor Methods in Statistics P. McCullagh (1987)
30 Transformation and Weighting in Regression R.J. Ca"oll and
D. Ruppert (1988)
31 Asymptotic Techniques for use in Statistics O.E. BarndorjJ-Nielsen
and D.R. Cox (1989)
32 Analysis of Binary Data, 2nd edition D.R. Cox and E.J. Snell (1989)
33 Analysis of Infectious Disease Data N.G. Becker (1989)
34 Design and Analysis of Cross-Over Trials B. Jones and
M.G. Kenward (1989)
35 Empirical Bayes Method, 2nd edition J.S. Maritz and T. Lwin (1989)
36 Symmetric Multivariate and Related Distributions K.-T. Fang.
S. Kotz and K. Ng (1989)
37 Generalized Linear Models, 2nd edition P. McCullagh and
J.A. Neider (1989)
38 Cyclic Designs J.A. John (1987)
39 Analog Estimation Methods in Econometrics C.F. Manski (1988)
40 Subset Selection in Regression A.J. Miller (1990)
41 Analysis of Repeated Measures M. Crowder and D.J. Hand (1990)
42 Statistical Reasoning with Imprecise Probabilities P. Walley (1990)
43 Generalized Additive Models T.J. Hastie and R.J. Tibshirani (1990)
44 Inspection Errors for Attributes in Quality Control
N.L. Johnson. S. Kotz and X. Wu (1991)
45 The Analysis of Contingency Tables, 2nd edition B.S. Everitt (1992)
46 The Analysis of Quantal Response Data B.J.T. Morgan (1992)
47 Longitudinal Data with Serial Correlation: A State-space Approach
R.H. Jones (1993)
48 Differential Geometry and Statistics M.K. Murray
and J.W. Rice (1993)
49 Markov Models and Optimization M.H.A. Davis
50 Networks and Chaos-Statistical and Probabilistic Aspects
O.E. Barndorff-Nielsen. J.L. Jensen and W.S. Kendall (1993)
51 Number Theoretic Methods in Statistics K.-T. Fang
and Y. Wang (1993)
52 Inference and Asymptotics O.E. Barndorff-Nielsen and D.R. Cox (1994)
53 Practical Risk Theory for Actuaries C.D. Daykin. T. Pentikiiinen
and M. Pesonen (1993)
54 Statistical Concepts and Applications in Medicine J. Aitchison and I.J.
Lauder (1994)
55 Predictive Inference S. Geisser (1993)
56 Model Free Curve Estimation M. Tarter and M. Lock (1994)
57 An Introduction to the Bootstrap B. Efron and R. Tibshirani (1993)
58 Nonparametric Regression and Generalized Linear Models P.J. Green
and B.W. Silverman (1994)
(Full details concerning this series are available from the Publishers.)
Inference and
Asymptotics
O.E. BARNDORFF·NIELSEN
Department of Theoretical Statistics
University of Aarhus
Denmark
and
D.R.COX
Nuffield College
Oxford. UK
SPRINGER·SCIENCE+BUSINESS MEDIA. B.V.
First edition 1994
© 1994 O.E. Bamdorff-Nielsen and D.R. Cox
Originally published by Chapman & Hall in 1994
Softcover reprint of the hardcover 1s t edition 1994
Typeset in 10/12pt Times by Thomson Press (India) Ltd, New Delhi
ISBN 978-0-412-49440-6 ISBN 978-1-4899-3210-5 (eBook)
DOI 10.1007/978-1-4899-3210-5
Apart rrom any fair dealing ror the purposes of research or private study, or
criticism or review, as permitted under the UK Copyright Designs and Patents
Act, 1988, this publication may not be reproduced, stored, or transmitted, in
any form or by any means, without the prior permission in writing of the
publishers, or in the case of reprographic reproduction only in accordance
with the terms or the licences issued by the Copyright Licensing Agency in
the UK, or in accordance with the terms oflicences issued by the appropriate
Reproduction Rights Organization outside the UK. Enquiries concerning
reproduction outside the terms stated here should be sent to the publishers
at the London address printed on this page.
The publisher makes no representation, express or implied, with regard to
the accuracy oCthe information contained in this book and cannot accept any
legal responsibility or liability for any errors or omissions that may be made.
A catalogue record for this book is available from the British Library
Library of Congress Cataloging-in-PubJication data available
8
Printed on permanent acid-rree text paper, manufactured in accordance with
ANSI/NISO Z39.48-1992 and ANSI/NISO Z39.48-1984(Pmnanence ofPaper~
Contents
Preface ix
1 Preliminaries 1
1.1 Introduction 1
1.2 Normal theory linear model 3
1.3 Exponential models 4
1.4 Transformation models 8
1.5 Invariance 10
Further results and exercises 11
Bibliographic notes 13
1 Some general concepts 14
2.1 Introduction 14
2.2 Likelihood 14
2.3 Sufficiency 28
2.4 Conditioning and some general concepts 32
2.5 Ancillarity 36
2.~ Examination of model adequacy 45
2.7 Parameter orthogonality 49
2.8 Review of transformation models 52
2.9 Review of prime exponential models 61
2.10 Review of curved exponential models 65
Further results and exercises 72
Bibliographic notes 78
3 Fint-order theory 80
3.1 Introduction 80
3.2 Main statistics: no nuisance parameters 80
3.3 Distribution theory: no nuisance parameters 85
3.4 Profile likelihood 89
3.5 Further statistics: nuisance parameter case 91
CONTENTS
~
3.6 Effects of parameter orthogonality 98
3.7 Distribution theory: nuisance parameter case 100
3.8 Non-standard cases 106
Further results and exercises III
Bibliographic notes 117
4 Higber-order theory: preliminaries and motivations 119
4.1 Introduction 119
4.2 Choice between different statistics: qualitative
considerations 119
4.3 The reasons for modifying simple likelihood-based
methods 123
4.4 Higher-order theory: the key questions 131
Further results and exercises 139
Bibliographic notes 141
5 Some tools of higber-order theory 143
5.1 Introduction 143
5.2 Log-likelihood derivatives and mixed log model
derivatives 145
5.3 Expansion of likelihood quantities:
expected/observed case 148
5.4 Expansion of likelihood quantities: observed case 155
5.5 Translation between observed and expected
expressions 157
5.6 Yokes and invariant calculations 161
5.7 Appendix: Differentiation of matrix quantities 168
Further results and exercises 169
Bibliographic notes 170
6 Higber-order theory: likelihood combinants 172
6.1 Introduction 172
6.2 The p·-formula 173
6.3 The score and the profile score 179
6.4 The maximum likelihood estimator revisited 184
6.5 The likelihood ratio 188
6.6 The directed likelihood 201
6.7 Approximate interval probabilities 211
Further results and exercises 217
Bibliographic notes 222
CONTENTS vii
7 Higher-order theory: some further results and tools 225
7.1 Introduction 225
7.2 Approximate sufficiency and ancillarity 225
7.3 lacobians of conditionality structures 236
7.4 Derivation of pt and p* for curved exponential
models 238
7.5 The effect of sampling rules 240
7.6 Independence of second order 251
Further results and exercises 255
Bibliographic notes 259
8 Various notions of pseudo-likelihood and higher-order
theory 261
8.1 Introduction 261
8.2 Modified profile likelihood 263
8.3 Stable adjustments of profile likelihood 269
8.4 Stable adjustments of directed likelihood 274
8.5 Large number of nuisance parameters 282
8.6 Further definitions of pseudo-likelihood 289
Further results and exercises 294
Bibliographic notes 296
9 Further aspects 298
9.1 Pivots 298
9.2 Estimating equations and quasi-likelihood 301
9.3 Stochastic processes and time series 306
9.4 Prediction 314
9.5 Asymptotic randomization theory 320
Further results and exercises 327
Bibliographic notes 330
References 332
Author index 351
Subject index 354
Preface
Our book Asymptotic Techniquesfor Use in Statistics was originally
planned as an account of asymptotic statistical theory, but by the
time we had completed the mathematical preliminaries it seemed
best to publish these separately. The present book, although largely
self-contained, takes up the original theme and gives a systematic
account of some recent developments in asymptotic parametric
inference from a likelihood-based perspective.
Chapters 1-4 are relatively elementary and provide first a review
of key concepts such as likelihood, sufficiency, conditionality,
ancillarity, exponential families and transformation models. Then
first-order asymptotic theory is set out, followed by a discussion of
the need for higher-order theory. This is then developed in some
generality in Chapters 5-8. A final chapter deals briefly with some
more specialized issues.
The discussion emphasizes concepts and techniques rather than
precise mathematical verifications with full attention to regularity
conditions and, especially in the less technical chapters, draws quite
heavily on illustrative examples. Each chapter ends with outline
further results and exercises and with bibliographic notes.
Many parts of the field discussed in this book are undergoing
rapid further development, and in those parts the book therefore in
some respects has more the flavour of a progress report than an
exposition of a largely completed theory.
We have attempted to follow a connected line of developments
but inevitably some parts are mQre specialized than other. The
following are some of the sections that might be largely omitted at
a first reading: the later part of section 2.8, sections 3.8, 5.3-5.7,6.3,
6.4, 7.3-7.6 and Chapter 9.
We are grateful to Dawn Peters and Neil Shephard for comments
on some of the chapters.
x PREFACE
Our collaboration has been supported throughout by a grant from
the European Communities for which we wish to express our strong
appreciation.
Susanne Slotsdal and Oddbj0rg Wethelund, Aarhus University,
did outstanding work typing a difficult manuscript.
O.E. Barndorft'-Nielsen
n.R. Cox