Evaluation of Agri-Environmental Policies SELECTED METHODOLOGICAL ISSUES AND CASE STUDIES Evaluation I. Framework for agri-environmental policy evaluation of Agri-Environmental Chapter 1. Design and implementation of agri-environmental policies: Are guidelines feasible? Chapter 2. Evaluating policies for delivering agri-environmental public goods Policies II. Specific evaluation issues and country experiences Chapter 3. Evidence-based agri-environmental policies: The Swedish experience SELECTED METHODOLOGICAL ISSUES Chapter 4. Additionality in US agri-environmental programmes for working land: A preliminary look at new data AND CASE STUDIES III. Lessons learnt from evaluations performed E v Chapter 5. Follow-up study of the impacts of agri-environmental measures in Finland a CCCICCfCiVCCWnaV.hhhhhhhh r .aGM maaaaaaaatNeppppppppreaeerttttttttrsreeeeeeeeewskhrrrrrrrrc’ e ee67891111mptd.1230...-r e,.Ea...bEEA CtAcCvSEavv hpatpaacasooiolcollonpeucsuudelanlidatiaaioc socdot ett-yisialiaomfnopo oftengneiogeolv c ulitoinaoaertttfiig ilfsicc uvo ocra ea afiamrn- gnltot enisrhceoesnid -eostnstveh o sn eiAncoor dovoavgofdi anftigrmEsr iilmoCo- runpfEinnAov-aelsnmieirnPtar vionftene oioagrnvsncnorlrimt e tre nissamao ecemuilpn nnhnacm epmiettEcnianernmengelotalgsagy enasm sl lst utacFfhFa eurnrhueoeilalde es ospswanis tnuodipdangrdltrle iy eiFcinast rlyiD t: aos qAIinnprnuedanadacle te leiiteratx xsyfPl f,l tyae atoBr ncy eaetamtxdeslsgp i esneoilnuiegvfct msa aiitPslng u ar aratogihg-tgeieerornin a-nStvem- oiinbnrmuova Itinstrehaome linNdynem anmKtteioaoonrldn tesa eaRcll lhpiinveoegmlr ic ae ipesps or ona ch luation of Agri-Environmental Policies SELECT eAAeeAeAeAeAeAeAnnnnnnnnGGGGGGGGvvvvvvvviiRiRiRiRiRiRiRRrrrrrrrroooIoIoIoIIooIIICCCCCCCCnnnnnnnnUUmUmUmUmmUmUUmmeeeeeeeLeLLLLLLLnnnnnnnnTTTTTTTTttttttttUUUUUUUU aaaaaaaaRRRRRRRRggggggggEEEEErrErErErrrriiiiii i i cccccccc EEuEuEuuEuEuEuullllllllNNNNNNNttttttttuuuuuuVVuVuVVVVrrrrrrrrIIIIIIIRRRReReReReeeee OOOOOOOeeeeeeennnnnnnNNNNNNNvvvvvvviMiMiMiMiMiMiMrrrrrrroooooooEEEEEEEnnnnnnnNNNNNNNmmmmmmmTTTTTTTeeeeeeenn n n n n n AAAAAttttttt G G G GGaaaaaaagggggRRgRgRRrrrrrrrIIIIIiCiCiCiiCiCicccccccuuUuUuUuuUuUlllllllLLLLLtttttttTTTuuTuTuuuurrrrUrUrUrUUeeeeeeeRRRRR eeeeeeEEEEEnnnnnn vvvvvv iiiiiiEEEEErrrrrrooNoNoNoNoNnnnnnnVVVVVmmmmmmIIIIIRReReeReReennnnnnOOOOOtttttt N N NNNaaeaaggnMMMggMMvrrrrEEEiEEiiiirccccNNNNNouuuunllTTTllTTttttm uuuuAA AAerrrrnGGGGeeeet RRRR eeeannInIIIgCCCCvvvriiiUUUUrrricoooLLLLunnnTTTTlmmmtUUUUueeeRRRRrnnnetEEttEE a eaa gnggEEEEvrrrNNNNiiiircccVVVVouuuIIIInlllRRRRtttmuOOuuOOerrrnNNNNeeet MMMM eeennnEEEEvvvNNNNiiirrrTTTTooo n n nAAAmmmGGGeeennnRRRtttIII CCCaaagggUUUrrrLLLiiicccTTTuuuUUUllltttRRRuuuEEErrr e ee EEEeenNnNNvvVVViirrIIIoRRoRnnOOOmmNNNeennMMMtt EEEaaNNNggrrTTTiic c AAuu E D M ET H O POOhTVhitlEEsetiipsCCat s:DDww/e/ ow d(Pc2rxuwki0t.b ed1.ios l2oits eh)iph,.ci ousiEdnr bvpg-glaiiu./ls li1bubh0aleri.ctad1iaor 7yotn8i.on o7on r/tf gh1 aAe,0s g a.:O1rni7E-d8EC 7dnD/vo9 i ri7nLo8oinb9tm r2hae6erny4s,t1 iatw7al ht9Pei3co 3thloi2c g-cieeaosntnh: teSarecslt e aucllst e OfdoE rMC mDeot hbreoo doinokflsoo,rg mpiceaartilio oIdsnsi.cuaelss aanndd Cstaasties tSictauld dieast,a bases. DOLOGICAL ISSUES AND CASE STUDIES AeA e A eA e ennnnnGGGGvvvvviRiRiRiRirrrrrooIIooIoICCCCnnnnnUUmmUUmmmeeeeeLLLLnnnnnTTTTtttttUUUU aaaaaRRRRgggggEEEErrrrriiii i ccccc AEEuEuEuuullGlllNNNNtttttuuRVuVuuVVrrrrrIIIIIRRRRCeeeee OOOOUeeeeennnnnNNLNNvvvvvTMiMiMiMiirrrrrUoooooEEEERnnnnnNNNNmmmmmETTTTeeeee n n n n neEAAAAtttttnN GG G GvaaaaaiVggRgRggRRrrrIrrroIIIIRCiCiCiCiincccccOmuUuUuUuUulleNlllLLLLtttttnTTTMuTuuuutrrUrUrrUU EaeeeeeRRRRg N eeeeerEEEEnnnTnni c vvvvv AuAiiiiiEEEErrrrrlGGoNoNoNoNotnnunnnRRVVVVmmrmmmIIIIIIeCRReReRCeee nnnnneOOUOOUtttttn L N N LNNvaaaaaTTiggMMgggMMrUUrrrrroEEEEiiiiRinRcccccNNNNmuuuuEuEllTeTllTlT tttttn e uEuuuuEAAAAtnrrrrr NNGGvGGaeeeeeiVgVr RRRReeeeroIInnnnIIRIIRinCCCCcvvvvOmOuiiiiUUUUrrrrelNNooooLtLLLnnnunnMTTTMTtmmrmm UUUUaEeEeeeegRRRR nnNnnNerttEtEtEEnTiT cv a aaa A u iAggAggErEEElGrrrrGoGtNNNNiiiiunRccccRRVVVVrmuuuuIIIIIeIICllellCRRRRC ttttneUuuOuuOUOOUtnrrrrL LvNNLNNaeeeeTiTTgr MMMMUeeeeUroUnnnniEREEnERcRvvvvmNNNNuEiiiiErrErrel TTTToooo t n e En nu n nEtEAAAAnmmrmm NNNavGGGGeeeeeigV VrnnVnnRRRRerIotttItInRiIIRIIR ncCCCvCaaaaOmuOiOggggrUUUUleNrrrroNtNLLnLLiiiiunMccccMTTtTMTrmuuuu UUUUEaeEllellEg ttttRRNnRReNNuuuurtnEETEErrrrTi Tcva e e e e iA uA gr A AEEEEeeeleGroGGtGnnnNnNNNinucRRvvvvRRmVVVVruiiiirIrrrIeIIeICIlIICooCRRooRRCt neUnnunUntOOUOOUnmmrmm LLavLNNLNNeeeeeTTgiT TrnnnnMMMMeUUrUotUtttni R ncEREEEvRaaRaamuiNNENgNgEggrEElerrrr o TtTTT nE iiiiu n cc E cc tEENAAArAmuuuu e ISBN 978-92-64-17932-5 -:HSTCQE=V\^XWZ: 51 2012 11 1 P Evaluation of Agri-Environmental Policies SELECTED METHODOLOGICAL ISSUES AND CASE STUDIES This work is published on the responsibility of the Secretary-General of the OECD. The opinions expressed and arguments employed herein do not necessarily reflect the official views of the Organisation or of the governments of its member countries. This document and any map included herein are without prejudice to the status of or sovereignty over any territory, to the delimitation of international frontiers and boundaries and to the name of any territory, city or area. Please cite this publication as: OECD (2012), Evaluation of Agri-Environmental Policies: Selected Methodological Issues and Case Studies OECD Publishing. http://dx.doi.org/10.1787/9789264179332-en ISBN 978-92-64-17932-5 (print)(cid:3) ISBN 978-92-64-17933-2 (PDF)(cid:3) (cid:3) (cid:3) The statistical data for Israel are supplied by and under the responsibility of the relevant Israeli authorities. The use of such data by the OECD is without prejudice to the status of the Golan Heights, East Jerusalem and Israeli settlements in the West Bank under the terms of international law. Corrigenda to OECD publications may be found on line at: www.oecd.org/publishing/corrigenda. © OECD 2012 You can copy, download or print OECD content for your own use, and you can include excerpts from OECD publications, databases and multimedia products in your own documents, presentations, blogs, websites and teaching materials, provided that suitable acknowledgement of OECD as source and copyright owner is given. All requests for public or commercial use and translation rights should be submitted to [email protected]. Requests for permission to photocopy portions of this material for public or commercial use shall be addressed directly to the Copyright Clearance Center (CCC) at [email protected] or the Centre français d’exploitation du droit de copie (CFC) [email protected]. 3 FOREWORD – Foreword Governments are increasingly aware of the importance of monitoring and evaluating agri- environmental policies. By establishing evidence-based policymaking, management and accountability, they can improve the design and implementation of their policies. The thirteen chapters in this volume were presented at the OECD Workshop on “Evaluation of Agri- Environmental Policies” held in Braunschweig, Germany on 20-22 June 2011. They cover a broad range of conceptual and practical issues related to evaluating policy measures for stimulating improvements in the environmental performance of agriculture. The focus is on policy instruments that target farming practices with the objective of enhancing agriculture’s provision of public goods or raising environmental performance standards above the mandatory level specified by legislation Acknowledgements Dimitris Diakosavvas organised the Workshop and supervised the preparation of the Proceedings. The Secretariat would like to thank Alison Burrell for her excellent work as editor of this volume. The OECD Secretariat is indebted to the German authorities for hosting a successful Workshop and to all those who provided and presented chapters, acted as discussants and panellists, and contributed to the general discussions. Françoise Bénicourt, Michèle Patterson and Theresa Poincet provided assistance in preparing the final publication. EVALUATION OF AGRI-ENVIRONMENTAL POLICIES: SELECTED METHODOLOGICAL ISSUES AND CASE STUDIES © OECD 2012 5 TABLE OF CONTENTS – Table of contents Abbreviations ........................................................................................................................................... 7 Introduction byAlison Burrell...................................................................................................................................... 9 I. Framework for agri-environmental policy evaluation Chapter 1. Design and implementation of agri-environmental policies: Are guidelines feasible? byClunie Keenleyside, Ben Allen, Kaley Hart and David Baldock ........................................... 23 Chapter 2. Evaluating policies for delivering agri-environmental public goods by Alison Burrell ......................................................................................................................... 49 II. Specific evaluation issues and country experiences Chapter 3. Evidence-based agri-environmental policies: The Swedish experience by Sören Höjgård and Ewa Rabinowicz ..................................................................................... 71 Chapter 4. Additionality in US agri-environmental programmes for working land: A preliminary look at new data by Roger Claassen ....................................................................................................................... 91 III. Lessons learnt from evaluations performed Chapter 5. Follow-up study of the impacts of agri-environmental measures in Finland by Jyrki Aakkula, Mikko Kuussaari, Katri Rankinen, Petri Ekholm, Janne Heliölä, Terho Hyvönen, Laura Kitti and Tapio Salo ............................................................................. 111 Chapter 6. Evaluation of agri-environmental measures in Flanders, Belgium by Michael Van Zeebroeck and Dirk Van Gijseghem .............................................................. 129 Chapter 7. Evaluation of cross compliance in England by Agri-Environment Analysis Theme Group, Farming and Food Group, DEFRA ................. 141 Chapter 8. A policy evaluation of Environmentally Friendly Direct Payment Programme in Korea by Chang-Gil Kim and James Banfill ....................................................................................... 153 IV. New methodologies and evaluation approaches Chapter 9. Evaluating agri-environmental schemes using a spatially explicit agent-based modelling approach by Marleen Schouten, Nico Polman, Eugène Westerhof and Paul Opdam ............................... 171 Chapter 10. Econometric methods for estimating the additional effects of agri-environmental schemes on farmers' practices by Sylvan Chabé-Ferret and Julie Subervie .............................................................................. 185 Chapter 11. Application of the Agri-Environmental Footprint Index to assess agri-environmental policies in Greece by Stamatios Christopoulos and George Vlahos ....................................................................... 199 EVALUATION OF AGRI-ENVIRONMENTAL POLICIES: SELECTED METHODOLOGICAL ISSUES AND CASE STUDIES © OECD 2012 6 – TABLE OF CONTENTS V. Market-based solutions to agri-environmental policy Chapter 12. Cost effectiveness of CAP greening measures: An ex ante evaluation in Italy by Andrea Povellato and Davide Longhitano ........................................................................... 217 Chapter 13. Socio-political conditions for successful water quality trading in the South Nation River Watershed, Canada by Dennis O'Grady .................................................................................................................... 235 EVALUATION OF AGRI-ENVIRONMENTAL POLICIES: SELECTED METHODOLOGICAL ISSUES AND CASE STUDIES © OECD 2012 7 ABBREVIATIONS – Abbreviations ADAS Previously the government-run Agricultural Development and Advisory Service in England and Wales, now a privatised company known as ADAS AE Agri-environmental AEM Agri-environmental measure AES Agri-environmental scheme AFI Agri-environmental Footprint Index ARMS Agricultural Resources Management Survey CAFO Confined animal feeding operation CAP Common Agricultural Policy CBA Cost-benefit analysis CEA Cost-effectiveness analysis CHP Combined heat and power CMEF Common Monitoring and Evaluation Framework Defra Department for Environment, Food and Rural Affairs (England and Wales) EF (farming) Environmentally friendly (farming) EFDPP Environmentally Friendly Direct Payment Programme (Korea) FADN Farm Accountancy Data Network FAS Farm Advisory Service GAEC Good agricultural and economic condition GIS Geographical information system GWh Gigawatt hour Ktoe Kiloton of oil equivalent LU Livestock unit MC(D)A Multi-criterion (decision) analysis MS Member State (of the European Union) MWh Megawatt hour NHP National handicap payments NUTS Nomenclature of Territorial Units for Statistics NVZ Nitrate Vulnerable Zone EVALUATION OF AGRI-ENVIRONMENTAL POLICIES: SELECTED METHODOLOGICAL ISSUES AND CASE STUDIES © OECD 2012 8 – ABBREVIATIONS QAS Quality assurance scheme RDP Rural Development Programme RPA Rural Payments Agency (England and Wales) SMR Statutory management requirement (with an EU Directive as its legal basis) SPS Single Payment Scheme (direct decoupled payment scheme under the EU’s CAP) UAA Utilised Agricultural Area USDA US Department of Agriculture EVALUATION OF AGRI-ENVIRONMENTAL POLICIES: SELECTED METHODOLOGICAL ISSUES AND CASE STUDIES © OECD 2012