跟踪能源技术研究的公共投资路线图（英）-IEAVIP专享VIP免费

下载本文档

阅读 254
格式 pdf
大小 5.65 MB
约124页
2023-04-18
收藏
点赞(0)
海报
举报

Tracking Public

Investment in Energy

Technology Research –

A Roadmap

The IEA examines the

full spectrum

of energy issues

including oil, gas and

coal supply and

demand, renewable

energy technologies,

electricity markets,

energy efficiency,

access to energy,

demand side

management and

much more. Through

its work, the IEA

advocates policies that

will enhance the

reliability, affordability

and sustainability of

energy in its

31 member countries,

11 association countries

and beyond.

This publication and any

map included herein are

without prejudice to the

status of or sovereignty over

any territory, to the

delimitation of international

frontiers and boundaries and

to the name of any territory,

city or area.

Source: IEA.

International Energy Agency

Website: www.iea.org

IEA member

countries:

Australia

Austria

Belgium

Canada

Czech Republic

Denmark

Estonia

Finland

France

Germany

Greece

Hungary

Ireland

Italy

Japan

Korea

Lithuania

Luxembourg

Mexico

Netherlands

New Zealand

Norway

Poland

Portugal

Slovak Republic

Spain

Sweden

Switzerland

Republic of Türkiye

United Kingdom

United States

The European

Commission also

participates in the

work of the IEA

IEA association

countries:

Argentina

Brazil

China

Egypt

India

Indonesia

Morocco

Singapore

South Africa

Thailand

Ukraine

INTERNATIONAL ENERGY

AGENCY

Tracking Public Investment in Energy Technology Research: A Roadmap Abstract

PAGE | 3

I EA. CC BY 4.0.

Abstract

A wide range of countries make efforts to track their entire national public energy

research, development and demonstration (RD&D) activity on an ongoing basis,

also sharing the collected data with the IEA through a standardised template.

However, the approaches adopted to collect data vary significantly across

countries. This roadmap describes the variety of country approaches, also

identifying the most important common components: the institutional

arrangements; the methods for collecting, classifying and validating the data; the

data management and technology processes; and, finally, the dissemination. It is

intended not only as a guide for countries near the beginning of their journeys

towards the collection of energy RD&D, but also for countries with more advanced

systems looking to strengthen specific areas. The roadmap is the product of

interviews held with representatives of 20 governments between November 2021

and March 2022, and it is indebted to their generosity in sharing their experiences

with tracking national energy RD&D spending. Case studies based on the

interviews are used to highlight noteworthy methods, while complete national

systems descriptions are included in the annex. It is hoped that this publication

will serve as a reference and inspiration for experts in this important area of

tracking clean energy transitions and that new experiences can be added in the

future.

/124

下载本文档

文本预览下载提示常见问题

TrackingPublicInvestmentinEnergyTechnologyResearch–ARoadmapTheIEAexaminesthefullspectrumofenergyissuesincludingoil,gasandcoalsupplyanddemand,renewableenergytechnologies,electricitymarkets,energyefficiency,accesstoenergy,demandsidemanagementandmuchmore.Throughitswork,theIEAadvocatespoliciesthatwillenhancethereliability,affordabilityandsustainabilityofenergyinits31membercountries,11associationcountriesandbeyond.Thispublicationandanymapincludedhereinarewithoutprejudicetothestatusoforsovereigntyoveranyterritory,tothedelimitationofinternationalfrontiersandboundariesandtothenameofanyterritory,cityorarea.Source:IEA.InternationalEnergyAgencyWebsite:www.iea.orgIEAmembercountries:AustraliaAustriaBelgiumCanadaCzechRepublicDenmarkEstoniaFinlandFranceGermanyGreeceHungaryIrelandItalyJapanKoreaLithuaniaLuxembourgMexicoNetherlandsNewZealandNorwayPolandPortugalSlovakRepublicSpainSwedenSwitzerlandRepublicofTürkiyeUnitedKingdomUnitedStatesTheEuropeanCommissionalsoparticipatesintheworkoftheIEAIEAassociationcountries:ArgentinaBrazilChinaEgyptIndiaIndonesiaMoroccoSingaporeSouthAfricaThailandUkraineINTERNATIONALENERGYAGENCYTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAbstractPAGE3IEA.CCBY4.0.AbstractAwiderangeofcountriesmakeeffortstotracktheirentirenationalpublicenergyresearch,developmentanddemonstration(RD&D)activityonanongoingbasis,alsosharingthecollecteddatawiththeIEAthroughastandardisedtemplate.However,theapproachesadoptedtocollectdatavarysignificantlyacrosscountries.Thisroadmapdescribesthevarietyofcountryapproaches,alsoidentifyingthemostimportantcommoncomponents:theinstitutionalarrangements;themethodsforcollecting,classifyingandvalidatingthedata;thedatamanagementandtechnologyprocesses;and,finally,thedissemination.ItisintendednotonlyasaguideforcountriesnearthebeginningoftheirjourneystowardsthecollectionofenergyRD&D,butalsoforcountrieswithmoreadvancedsystemslookingtostrengthenspecificareas.Theroadmapistheproductofinterviewsheldwithrepresentativesof20governmentsbetweenNovember2021andMarch2022,anditisindebtedtotheirgenerosityinsharingtheirexperienceswithtrackingnationalenergyRD&Dspending.Casestudiesbasedontheinterviewsareusedtohighlightnoteworthymethods,whilecompletenationalsystemsdescriptionsareincludedintheannex.Itishopedthatthispublicationwillserveasareferenceandinspirationforexpertsinthisimportantareaoftrackingcleanenergytransitionsandthatnewexperiencescanbeaddedinthefuture.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAcknowledgementsPAGE4IEA.CCBY4.0.AcknowledgementsThisreportwasco-ordinatedbySuzyLeprince(EnergyDataCentre),withguidancefromRobertaQuadrelliandSimonBennett(DirectorateofSustainability,TechnologyandOutlooks),basedonthevaluableinputprovidedbyAitorSoler(independentconsultant).ThereportisindebtedtothesupportandguidancefromNickJohnstone(ChiefStatistician).Thereportwouldnothavebeenpossiblewithouttheinputandfeedbackofcolleaguesfromacrossnationaladministrations:AndreasIndinger(AustrianEnergyAgency)andSabineMitter(MinistryforClimateAction,Environment,Energy,Mobility,InnovationandTechnology–Austria),GustavoNaciffdeAndrade,CamiladeAraujoFerraz(EnergyResearchOffice–Brazil)andBarbaraBressanRocha(CentreforStrategicStudiesandManagement–Brazil),ClaudeGauvinandJiyoungYu(NaturalResourcesCanada),ShimonMüller(MinistryofIndustryandTrade–CzechRepublic),IrjeMöldre(MinistryofEconomicAffairsandCommunications–Estonia),FabianWerner(FederalMinistryforEconomicAffairsandClimateAction–Germany),BettinaLemström(MinistryofEconomicAffairsandEmployment–Finland)andEnniSanasvuori(StatisticsFinland),RachidaLaghouatiandChristopheMeilhac(MinistryforEnergyTransition–France),GáborCsirikusz(NationalResearch,DevelopmentandInnovationOffice–Hungary),LucyCorcoran,SolèneGoyandIreneWard(SustainableEnergyAuthorityofIreland),ShintaroFujimoriandKyoheiInaba(MinistryofEconomy,TradeandIndustry–Japan),DaumantasKerežis(MinistryofEnergyoftheRepublicofLithuania)andTadasNorvydas(LithuanianEnergyAgency),JesperJuffermansandStefKnibbeler(NetherlandsEnterpriseAgency),EspenBernhardKjærgård(MinistryofPetroleumandEnergy–Norway),MaciejKiełmiński(MinistryofEducationandScience–Poland),RuiBorges,MariadaGraçaTorresandPauloPartidário(DirectorateGeneralforEnergyandGeology–Portugal),MiguelSantosAndrés(MinistryfortheEcologicalTransitionandtheDemographicChallenge–Spain)andMartaMarch(MinistryofScienceandInnovation–Spain),MichaelMoser(SwissFederalOfficeofEnergy),RezaKaraviehandNicoMillar(DepartmentforBusiness,EnergyandIndustrialStrategy–UnitedKingdom).TheEuropeanCommissionalsoprovidedvaluableinputthankstoDanielePoponi,DrilonaShtjefniandIngridaMurauskaite-Bull.ValuablereviewofthepreliminarydrafthasalsobeenprovidedbytheOECD,includingFernandoGalindoRueda(SeniorEconomist,HeadofScienceandTechnologyIndicators;OECDDirectorateforScience,TechnologyandInnovation).TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAcknowledgementsPAGE5IEA.CCBY4.0.ThanksalsototheIEACommunicationandDigitalOfficefortheirhelpinproducingthereport,particularlytoAstridDumond,TalineShahinian,IsabelleNonain-SemelinandThereseWalsh.AdamMajoeeditedthemanuscript.CommentsandquestionsarewelcomeandshouldbeaddressedtoRDD@iea.org.ThepreparationofthisreportwasmadepossiblethroughtheCleanEnergyTransitionsinEmergingEconomiesprogramme,whichreceivedfundingfromtheEuropeanCommission’sHorizon2020researchandinnovationprogrammeundergrantagreementno.952363.ThepreparationofthisreportwasmadepossiblethroughtheCleanEnergyTransitionsinEmergingEconomiesprogramme,whichreceivedfundingfromtheEuropeanCommission’sHorizon2020researchandinnovationprogrammeundergrantagreementno.952363.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapPAGE6IEA.CCBY4.0.TableofcontentsTrackingpublicenergyresearchdevelopmentanddemonstration...................................7WhatdoesitmeantocollectpublicRD&Dspendingdata?.............................................11Purpose...................................................................................................................................161-Defineclearobjectives........................................................................................16Institutionalarrangements....................................................................................................202–Setuptheframework.........................................................................................203–Mappartnersanddatasources..........................................................................234–Createthenetwork.............................................................................................25Collection,classificationandvalidation..............................................................................295–Assessdataavailability......................................................................................296–Designthecollectionandclassification..............................................................32Developthevalidationprocess............................................................................................37Datamanagementandtechnology.......................................................................................418–Selectandcreatetheinformationtechnologytools.............................................41Datadissemination.................................................................................................................459–Sharethedata....................................................................................................4510–Communicatethefindings................................................................................47Continuousimprovement......................................................................................................4811–Establishalearningandadaptationculture......................................................48Conclusion..............................................................................................................................50Annex.......................................................................................................................................51Austria....................................................................................................................51Brazil........................................................................................................................56Canada....................................................................................................................63CzechRepublic........................................................................................................70Estonia.....................................................................................................................74France......................................................................................................................78Hungary...................................................................................................................82Ireland......................................................................................................................86Lithuania..................................................................................................................90Netherlands..............................................................................................................95Norway.....................................................................................................................98Poland....................................................................................................................102Portugal..................................................................................................................106Spain......................................................................................................................110Switzerland............................................................................................................114UnitedKingdom......................................................................................................120Abbreviationsandacronyms..................................................................................122TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapTrackingpublicenergyresearchdevelopmentanddemonstrationPAGE7IEA.CCBY4.0.TrackingpublicenergyresearchdevelopmentanddemonstrationReducingglobalCO2emissionstonetzeroby2050isconsistentwitheffortstolimitthelong‐termincreaseinaverageglobaltemperaturesto1.5C.Thiscallsfornothinglessthanacompletetransformationofhowweproduce,transportandconsumeenergy.Withoutamajoraccelerationincleanenergyinnovation,reachingnetzeroemissionsby2050willnotbeachievable.Estimationsshowthattechnologiesthatareavailableonthemarkettodaycouldprovidenearlyalloftheemissionsreductionsrequiredby2030toputtheworldontrackfornetzeroemissionsby2050.However,reachingthistargetwillrequirethewidespreaduseafter2030oftechnologiesthatarestillattheresearch,developmentanddemonstration(RD&D)stagetoday.Thisneedisevenbiggerinsectorssuchasheavyindustryandlong‐distancetransport.Majorinnovationeffortsarevitalsothatthetechnologiesnecessaryfornet‐zeroemissionscanreachmarketsassoonaspossible.Additionally,energytechnologyinnovationisakeytoolforoil-andgas-importingcountriestryingtoimprovetheirenergysecurity.Newtechnologiescanreducedependencyonfossilfuelimports:firstly,bydecreasingenergydemandwithimprovementsinenergyefficiency,andsecondly,byreplacingfossilfuelswithotherenergycarriersproducedlocally.Leadershipinnewenergytechnologiescanalsocreatelong-termvaluefortoday’senergyexportersastheytransitiontonewsourcesofincome.Furthermore,thedevelopersofsuccessfulnewtechnologieswillbeattheheartoffutureinnovationecosystemsandeconomicprosperityastheenergytransitionaccelerates.Ensuringthatthepushforcleanenergyinnovationissufficienttoreachnetzeroby2050requirescomprehensivetracking.Trackingcleanenergyinnovationprogressencompassesseveralcriticalelementsofeffectiveenergyinnovationpolicy:identifyinggapsandopportunities,evaluatingtheeffectivenessofprogrammesandpolicies,andunderstandingthemarketreadinessofkeytechnologies,nationallyandglobally.OneofthepolicytoolsavailableaspartofnationalenergyresearchpoliciesandsupportprogrammesisdirectpublicexpendituresonRD&D,andtheonlywaytoaccuratelytrackthemistohaverobustandreliablestatistics.Thesedataprovidethequantitativebasistodesign,evaluateandadjustthosepolicies.Theyalsogeneratevaluableinsightsforgovernmentministriesanddepartmentsthatarenotdirectlyresponsibleforenergyresearchspending–includingthoseconcernedwithenergystrategy,TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapTrackingpublicenergyresearchdevelopmentanddemonstrationPAGE8IEA.CCBY4.0.industryandeducation–aswellasmanyregionalandprovincialinstitutions,privateindustryandothersintheresearchandinnovationecosystem.Inthiscontext,theIEAactsasanenergypolicyadvisertopromotereliable,affordableandcleanenergyglobally.Assuch,oneofitsprioritiesistocollectdataonRD&Dspendinginthefieldofenergy.Uniquely,theIEAhasbeencollectingdataongovernmentfundingofenergytechnologyRD&Dactivitiesacrosscountriessince1974fromitsmembers,withinthebroadersetofenergystatisticsrequirements.ThesedataprovideinvaluableinformationtopolicymakersacrosstheglobetohelptheirdecisionsonenergyRD&Dinvestmentsaswellastheirformulationofotherpoliciesaffectinginnovation,includingmarketpullpolicies.TheprivatesectorcanalsobenefitfromadeeperunderstandingofgovernmentactivitiesinenergyRD&D.TheIEAcollectsannualenergyRD&Ddatausingastandardisedquestionnairethatclassifiesenergytechnologiesintofourlevelsofdetailwithinsevenhigh-levelcategories:energyefficiency,fossilfuels,renewableenergy,nuclear,hydrogenandfuelcells,otherpowerandstoragetechnologies,andcross-cutting.Basedonthisdatacollection,theIEAreleasesitsdatasetofpublicinvestmentinenergyRD&Donline.Forexample,thelatestdatashowthattheglobalinvestmentofIEAmembersin2021wasalmostUSD23billion.Since2021,thedatasetalsoincludesdatasharedbyBrazil,thefirstnon-membercountryoftheIEAtocontributetothedatabase.TotalpublicenergyRD&DbudgetsinIEAmembercountries,1974-2021IEA.CCBY4.0.TheIEAdatasetismadepossiblethroughthesignificanteffortsofgovernmentstocompileenergyRD&Ddata.WhileeachgovernmenthashistoricallydesigneditsmostappropriateapproachtocollectingandsharingnationalenergyRD&Ddata,theIEAhasseenthevalueinexchangingknowledgeacrosscountryexperts.Toaccuratelytrackallflowsoffunds,anumberofcommonstepsmustbefollowedregardlessofthenationalcontext.TheyincludeidentifyingthefundersandTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapTrackingpublicenergyresearchdevelopmentanddemonstrationPAGE9IEA.CCBY4.0.spendersandclassifyingprojectsbytopicandresearchstage.Additionally,accessingandmaintainingtherightchannelstodisseminatethedataareimportant.Whileeachcountry’sdatafollowthestructureandscopesetoutintheIEAGuidetoReportingRD&DBudget/ExpenditureStatistics(hereafter,theEnergyRD&DManual),towhichtheyhavecontributed,theprecisedatacollectionapproachesvary.Thereisnosingleapproachthatperfectlyfitstheneedsofallthecountries,andgovernmentshavedesignedprocessesfortheirinstitutionalcontextsandrefinedthemovertime.Thiscreatesextensivepotentialforcountriestoshareeffectivepracticesandlearnfromeachother’sexperiences.However,thedifferentapproacheshaveneverbeendocumentedorshareduntilnow.Assuch,thisroadmaphasbeenproducedtohelpcountriesdesignorredesignarobustdatacollection,validation,anddisseminationprocessbasedontheexperienceofIEAmemberandassociationcountries.TheexampleoftheEuropeanUnionhasbeentakentoshowcasetheimportanceofenergyinnovationanditstracking.In2008,theEuropeanUnionlaunchedtheStrategicEnergyTechnologyPlantosupportresearchandinnovationandestablishedtheStrategicEnergyTechnologyPlanInformationSystem(SETIS)totrackandmonitoritsimplementation.EuropeanUnioncasestudy:StrategicEnergyTechnologyPlanTheStrategicEnergyTechnology(SET)PlanisaninitiativeoftheEuropeanCommissiontosupporttheresearchandinnovationactionsintheEuropeanUnion.Itisnotafundingprogramme,butitaimstohelpco-ordinatenationalresearchandinnovationactivitiesfordevelopinglow-carbonenergyamongtheEUmemberstatesandfourassociatedcountries(Iceland,Norway,SwitzerlandandtheRepublicofTürkiye)andtoalignnationalresearchandinnovationprogrammeswithitsagenda.Itsmainobjectiveistomaximisetheimpactofresearchandinnovationbyco-ordinatingnationalefforts.Todothis,theprogrammeestablishesagovernancemodel,settingprioritiesandkeyactionsandpromotingdifferentworkinggroups.TheSETPlanwasfirstlaunchedin2008.Since2008,energyinnovationhasmovedclosertothecentreoftheEuropeanUnion’svisionforits21stcenturyeconomy.Infact,thetransitiontowardsclimateneutralityby2050givesenergyacentralrole,andtoreachclimateneutrality,theEuropeanUnionwillneedtodecarboniseatleastsixtimesfasterthananythingrealisedgloballysofar.Toaccomplishthischallengingtask,theEuropeanUnionconsidersinnovation,includingR&D,akeyenablerofnewsynergiesintheenergyTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapTrackingpublicenergyresearchdevelopmentanddemonstrationPAGE10IEA.CCBY4.0.system.Relyingoncleanandinnovativeprocessesandtools,thepathtowardssystemintegrationwillalsotriggernewinvestments,jobsandgrowthandstrengthenEUindustrialleadershipatagloballevel.In2016,theEuropeanCommissionpresentedaresearch,innovationandcompetitivenessstrategytosupportenergyinnovationwithnewpolicystrategies.Thesestrategiesoutlineavisionforenergytechnologyandhavethreegoals:Energyefficiencyfirst.Makingenergydemandandsupplymoreefficientbymeansofcost-effectiveinitiativesthatrespondtoend-useenergysavingsdemandandmoreefficientconversion,transmissionanddistributionofenergy.Europe:agloballeaderinrenewables.TheEuropeanUnionhasafirmcommitmenttobecomingagloballeaderinrenewableenergy.Afairdealforconsumers.TheEuropeanUnioniscommittedtodiversifyingEurope’ssourcesofenergyandensuringenergysecuritythroughsolidarityandco-operationamongEUcountries.TotrackandmonitortheimplementationoftheSETPlan,theEuropeanUnioncreatedtheSETPlanInformationSystem.Itistheopenaccessinformation,knowledgemanagementanddisseminationsystemfortheEuropeanstrategicenergytechnologyplan.TheSETPlanInformationSystemprovidesinformationonthestateoflow-carbontechnologies.Italsoassessestheimpactofenergytechnologypolicies,reviewsthecostsandbenefitsofvarioustechnologicaloptionsandestimatesimplementationcosts.ApartfromtheannualSETPlanimplementationprogressreport,theSETPlanInformationSystemincludesadashboardwithenergyRD&Ddata.ThedashboardpresentsaquickoverviewforeachEUmemberstateoftwokeyindicators:thelevelofinvestmentinresearchandinnovation,bothprivate(expenditurebybusinessesandindustry)andpublic(memberstates’nationalprogrammesandinstruments),andtrendsinpatentsfortheIntegratedSETPlanActions.ThisinformationisusefulforEuropeanindustrialinitiatives,privatecompanies,tradeassociations,theEuropeanEnergyResearchAlliance,internationalorganisationsandfinancialinstitutions.Sources:EuropeanCommission,EnergyResearchandInnovationStrategy;EuropeanCommission,EnergyResearchandInnovation;EuropeanCommission,EnergyEfficiencyFirst;EuropeanCommission,SETIS-SETPlanInformationSystem.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapWhatdoesitmeantocollectRDDdata?PAGE11IEA.CCBY4.0.WhatdoesitmeantocollectpublicRD&Dspendingdata?Governmentshaveaparticularlycentralandwide-rangingroleindeterminingthesuccessofenergyinnovationthatgoesfarbeyondtheprovisionoffundsforRD&D.Theysetoverallnationalobjectivesandprioritiesandplayavitalroleindeterminingmarketexpectations,ensuring,forexample,thatgovernmentfundinghasapositiveimpactontechnologicalinnovationintheprivatesectorwithoutanycrowdingouteffect.Theyalsohaveuniqueresponsibilitiesforensuringtheflowofknowledge,investinginenablinginfrastructureandfacilitatingmajordemonstrationprojects.Manypolicytoolsareattheirdisposal,includingbutnotlimitedtotaxcredits,loanguaranteesanddirectfunding.Toactivatealltheseleverseffectivelyandtoensurethatgovernmentscanmakeinformeddecisions,itisvitaltoproducereliableandaccuratestatistics,focusinginthisreportonpublicenergyRD&Dbudgetstatistics.Collecting,validatinganddisseminatingthesedataisacomplexprocess.Toundertakethesetasks,theresponsiblegovernmentdepartmentsareoftentaskedwithallocatingappropriatelevelsofresourcesandpromotingcollaborationamonginstitutions.Inmanycases,thesecollaborationsareformalised,forexampleindata-sharingagreements.Tonavigatethelanguageusedinthisfield,itisimportanttohaveacommonunderstandingofsomekeyterminology.Formoredetailedinformationondefinitions,seetheOECD’sFrascatiManual,whichdescribestheinternationallyrecognisedmethodologyforcollectingandusingR&Dstatistics,andtheEnergyRD&DManual,specifictotheprocessdescribedinthishandbook.GlossaryPublic:Thisreferstogovernmentfunds,eitheratthecentral/federalorprovincial/statelevel.State-ownedenterprisesarealsoincluded.EnergyRD&D:EnergyRD&Dcoversresearch,developmentanddemonstrationrelatedtotheproduction,storage,transportation,distributionandrationaluseofallformsofenergy.RD&DcoversbasicresearchwhenitisclearlyorientedtowardsTrackingpublicinvestmentinenergytechnologyresearch–AroadmapWhatdoesitmeantocollectRDDdata?PAGE12IEA.CCBY4.0.thedevelopmentofenergy-relatedtechnologies,appliedresearch,experimentaldevelopmentanddemonstration.ThisdefinitionofenergyRD&DisquotedfromtheEnergyRD&DManual,whichwaselaboratedin2011throughaconsultationamongexpertsandtheIEA.TheFrascatiManualdefinesgeneralR&Dasfollows:“Researchandexperimentaldevelopment(R&D)comprisecreativeandsystematicworkundertakeninordertoincreasethestockofknowledge–includingknowledgeofhumankind,cultureandsociety–andtodevisenewapplicationsofavailableknowledge.”EnergyRD&Ddata:ThisreferstobothpublicenergytechnologyRD&Dbudgetsandexpenditures,reportedfromtheperformer’sperspectiveasexpendituresorfromthefunder’sperspectiveasbudgets.Funder:FundersofenergyRD&DareinstitutionsthatprovidefundstoperformerstoundertakeRD&Dintheenergysector.Performer:PerformersofenergyRD&DareinstitutionsthatundertakeRD&D.Theycanbeabusinessenterprise,governmentinstitution,highereducationinstitutionorprivatenon-profitinstitution.Co-ordinatingteam:Theco-ordinatingteamisthegroupofpeoplethatco-ordinatesthenationalefforttocollectandclassifytheenergyRD&DdataandpossiblycompletetheIEAquestionnaire.Process(ofdatacollection,classification,validationand/ordissemination):Inthisreport,theword“process”isusedtodescribethemethodologiesfollowedbycountriestocollect,classify,validateand/ordisseminateenergyRD&Ddata.Cycle(ofdatacollection,classification,validationand/ordissemination):Inthisreport,theword“cycle”isusedtodescribetheannualexecutionofthemethodology(process)tocollect,classify,validateand/ordisseminateenergyRD&Ddata.Networkofinstitutions:ThisistheconnectedgroupofinstitutionsthatinteractintheefforttoproduceenergyRD&Dstatistics.(Data)Contacts:ThesearethepeerswhoworkinthenetworkofinstitutionsandinteracttocarryouttheenergyRD&Ddatacycle.TheRD&Ddatacollectionprocesscanbeunderstoodintermsofitssixphasesand11steps.Asareal-worldexample,LithuaniahasbuiltanenergyRD&DprocessfromscratchinparallelwithitsaccessionprocesstotheIEA.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapWhatdoesitmeantocollectRDDdata?PAGE13IEA.CCBY4.0.RoadmaptocollectingenergyRD&DdataIEA.CCBY4.0..Notes:SOE=state-ownedenterprise;IT=informationtechnology.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapWhatdoesitmeantocollectRDDdata?PAGE14IEA.CCBY4.0.Lithuaniacasestudy:CreatinganenergyRD&DcollectionprocessLithuaniastartedtocollectenergyRD&Ddatain2020.Before2020,alltheenergyRD&DdataavailablewerethegeneralRD&Ddataproducedbythenationalstatisticsoffice.However,theseweremuchsimplerstatistics,withoutabreakdownbytechnology.Thissignificanteffortwasundertakenbyacombinationofthreemaindrivers:•AnimportantpushfromtheLithuaniangovernmenttohavesoliddatatomakeinformedpolicydecisionsonenergyresearch.Thiswasthemaindriverforlaunchingtheinitiativetoestablishthedatacollectionsystem.•WithintheprocesstobecomeamemberoftheIEA,energydatasubmissionsareanaccesscriterionforallcountries.LithuaniasetaclearobjectiveofsubmittingenergyRD&DdatatotheIEAin2020.•EUrequirementsfordatacollection.Additionally,therewasalreadyanimmediateandrelevantusecaseforthesestatisticsbytheMinistryofEnergy.LithuaniaispartoftheNordic-Balticco-operationformatwithajointenergyresearchfundingprogramme.Intheframeworkofthisprogramme,thestudyreport“Baltic-NordicRoadmapforCo-operationonCleanEnergyTechnologies”hasbeenfinanced,withanaimtoidentify,prioritiseandsuggestenergy-relatedtechnologiesforshorter-termandlonger-terminvestmenttoachievetheclimateandenergyobjectivesofthecountry.TheenergyRD&Ddatacollectionisagoodindicatortotrackcompliancewiththisroadmap.Oncethemotivationwasclearlyidentified,Lithuaniacreatedateamoffourpeoplededicatedtothisproject,andafteroneyear,theysubmittedenergyRD&DdatatotheIEAforthefirsttimewithgoodcoverageanddataquality.TheteamisacombinationofpeoplefromtheMinistryofEnergyoftheRepublicofLithuaniaandtheLithuanianEnergyAgency.TheLithuanianEnergyAgencyisresponsibleforthecollection,processingandsubmissionoftheenergyRD&DdatatotheIEA,withoversightfromtheMinistryofEnergyoftheRepublicofLithuaniaThefirsttaskofthisteamwastoscreenthenationalenergyRD&Decosystem.Theteamidentified19organisationsinvolvedinenergyRD&DinLithuania.Theinstitutionsincludedfourministries,twopublicagencies,onescienceandtechnologyresearchcentre,fourstate-ownedenterprises,theresearchcouncilofLithuania,theLithuanianenergyinstitute,oneorganisationofresearchandtechnologyandfiveuniversities.Theteamcontactedalltheseinstitutionstoaskforavailableinformationandagreeonacontacttoreceiveatemplate,providethedata,andsolveanydoubtsandinconsistencies.Wherepossible,thetargetcontactwasthepersonwiththetechnologicalknowledgetoclassifydifferentprojectsandcompletethequestionnaire.Additionally,theco-ordinatingteamassessedtheavailabilityofpublicdatabases,butevenwheresomewereinplace,theydecidedTrackingpublicinvestmentinenergytechnologyresearch–AroadmapWhatdoesitmeantocollectRDDdata?PAGE15IEA.CCBY4.0.tolaunchaseparatedatacollectionprocessasthesedatabaseswerearrangeddifferentlyfromtheIEAquestionnaire.Fromthisexercise,theydiscoveredthatitwaseasytoidentifythehigh-levelenergyRD&Dlandscape,butitwasmorechallengingtoensuredataavailabilityinalltheseinstitutions.Fornow,theprocessisentirelyvoluntary,butLithuaniaisworkingontheintroductionofalegalbackgroundtodefinethespecificresponsibilitiesofeachoftheinstitutionsandformalisethedatacollection.Oncetheinstitutionalarrangementwasset,Lithuaniaranatestdatacycleinthefourthquarterof2020andthenrepeatedthecycleinthefirsthalfof2021toalignwiththeIEA’sreporting.DatawerecollectedthroughvoluntaryquestionnairessentbyemaildirectlytothedifferentinstitutionsinvolvedinenergyRD&DusingtheIEAtemplate.ThequestionnairewassentwithalinktotheEnergyRD&DManual.ThereportinginstitutionswereresponsibleforcompilingalltheprojectfundstheyreceivedfrompublicinstitutionstofinanceenergyRD&D.Mostoftheinstitutionscouldreporttheiractualspendingfortheyearofstudyandnotbudgetorfundallocations.Theclassificationofprojectswasachallengeinmanycases,buttheMinistryofEnergyandLithuanianEnergyAgencycollaboratedwiththeinstitutionstoresolveanyissues.Anadditionalproblemwasthedifferencesindataavailabilityamongdifferentorganisationsasthereisnostandardisedmethodologytocollectdataacrossinstitutions.Forthisreason,outofthe19questionnairessent,10responseswerereceivedin2020and15in2022.ItisimportanttohighlightthatmostofthenationalenergyRD&Dfundswerecoveredbecausethemainspendersreportedgood-qualitydata.Oncealltheanswerswerereceived,theteamaggregatedallthedatainaquestionnaireandsubmittedittotheIEA.Regardingthetechnologytosupporttheprocess,LithuaniadidnotdeployadataplatformtomanagethedatacollectionandreliedonExcelspreadsheetssharedacrossinstitutionsbyemail.Thesmallnumberofinstitutionsmadeitfeasibletomanagethistaskbyemail.Finally,thereisnospecificnationalRD&Dpublicationinplace.Fornow,theIEAreportisusedtodisseminatethedata,whicharewidelyusedinternallytoinformpolicydecisions.Lithuaniaiscurrentlyassessingtheinternalinterestinpreparingapublicationoncetheentireprocessiswellestablishedandactivelyengagingwiththeinstitutionstoreceivemorequestionnaireswithdata.Sources:LithuanianEnergyAgency;MinistryofEnergyoftheRepublicofLithuania.Trackingpublicinvestmentinenergytechnologyresearch:AroadmapPurposePAGE16IEA.CCBY4.0.PurposeEnergyRD&Disastrategicfieldformanycountries.Infact,successfulnationalstrategiesinRD&Dhaveachievedthemobilisationofenoughresourcestomakethosecountriestheleadersinsomesustainableenergytechnologies,creatingnationalwelfareandqualifiedjobs.Forthisreason,governmentsacrosstheworldareimportantactorsforpushinginnovationandsupportingprojectswithpublicfunds.Toallocatepublicfundstospecificprojectsandtechnologies,publicinstitutionsdesignandimplementeffectiveRD&Dfundingprogrammes.Apartfromthealreadychallengingdefinitionofthesefinanceschemes,eachcountrymighthavespecificpolicyobjectivesthatneedtobetrackedandassessedtoensurethattheoutputsmeettheneedsofalltherelevantstakeholders.Inthisregard,energyRD&Ddataareakeyelementforsettingaquantitativebasisforinforminggovernments’decisionsonenergyRD&D.EnergyRD&DdataprovideinvaluableinformationtopolicymakerstohelptheirdecisionsonenergyRD&Dinvestmentsaswellastheirformulationofotherpoliciesaffectinginnovation,includingmarketpullpolicies.Additionally,thesedatacanbebeneficialforprivatecompaniestodefinetheirownstrategies.1-DefineclearobjectivesDefiningthespecificsofthedesiredoutputfromthebeginningofthedesignorredesignoftheRD&Ddataprocessisaprerequisiteforawell-constructedsystem.Iftheseobjectivesarenotclearlydefined,thefinalprocessmaynotbeappropriateforthedatausers,andthiscanleadtoinefficientparallelenergyRD&Ddataprocesses.BeforestartinganyprojectonenergyRD&Ddata,itisveryimportanttoidentifyanddefinethespecificnationalneedsfortheenergyRD&Ddatacollectionprocess,includingthechangesrelatingtotheevolvingtechnologyandstakeholderlandscapesaswellasthemaindatausers.Thiscanbeachievedwithabroadconsultationofusersandinterestedparties.Todothis,themaindatausersmayconsiderpresentingandexplaininganyinitiativestodesignorredesigntheenergyRD&Dprocesstoeverystakeholderinthenetworkandestablishingandactivelymaintainingopencommunicationwiththem.TherearedifferentTrackingpublicinvestmentinenergytechnologyresearch:AroadmapPurposePAGE17IEA.CCBY4.0.methodologiesforcollectingtherequirementsandprioritisingthem,buttheassessmentoftheseinputsfromthestakeholderscanpositivelyinfluencethedifferentcomponentsofthedatacollectionsystem.Itisimportanttokeepinmindthatmaintaininggooddataqualitycanbeveryresource-intensive,soidentifyingthedatauseranddataownerforrequesteddatacanbringsubstantialcostsavingstoaproject.Therequirementsinthisphaseoftheprocessarethesamewhethergovernmentsaredesigninganewcollectionprocessorupdatinganexistingprocesstoadapttonewpolicypriorities.Articulatingclearobjectivesiskeytoensuringthattheworkfulfilsitsintendedpurposeandthattherighttoolsareinplacetoevaluateitsprogressandresults.Infact,governmentscouldconsiderdraftingthismotivationonaregulatoryframeworktoformaliseit.Inmostcases,theseobjectivesarethemaindriverforlaunchingaproject.However,itiskeytodelveintothesedriversandidentifytheexactpolicydecisionstobeinformedbytheenergyRD&Ddata.Then,itispossibletodesignaprocessandsystemtocompilehigh-qualitystatisticstoinformthosedecisions.Someofthedecisionsmightbe:toassessthefundsneededtodevelopacertaintechnologytotrackthetrendsinspendingbyenergytechnologytoassesstheperformanceoftechnologypoliciestoidentifygapsinfundingtomeetnationalenergyandclimateobjectives.Thespecificsoftherequirementscanbeidentifiedbyinteractingwiththemaindatausers,whoareprobablythemainpromotersofthedesignorredesignoftheprocess,inmanycasestheministriesinchargeofenergyandinnovationpolicies.Inadditiontothemotivations,itmightbeinterestingtolistthedatarequirementsandstartdesigningtheformatoftheoutput.Insomecases,areportwithkeyhighlightsmightbeenough,whereasinothercases,theministriesmayneedadatabasewithproject-levelinformationtobeautonomousintheiranalysis.Additionally,itisalsoimportanttoassesstheinterestofpotentialdatausersoutsidetheministriesanddesignthedatadisseminationwiththoseexternalusersalsoinmind.Someoftheseexternaldatausersmayincludeperformersandinternationalorganisations.ManycountrieshavealreadyinplacesomequantitativebasistoassessanddesignenergyRD&Dfundingprogrammes.However,thealignmentofthesedatawiththereportingofenergyRD&DstatisticstotheIEAmayvarybycountry.AlthoughcountriesarecommittedthroughtheIEAenergyRD&Ddatacycletocollaborateintheinternationalefforttocreateaglobaldataset,theprocessofreportingtotheIEAis,insomecases,imperfectlyalignedwiththeprocessofthecompilationofdatatoassesstheRD&Dfundingprogrammesthatareinplace.Forthisreason,itisimportanttodisseminatetheworkdonetocompiletheIEATrackingpublicinvestmentinenergytechnologyresearch:AroadmapPurposePAGE18IEA.CCBY4.0.statisticsbecausetheremightbesynergiesbetweensuchprocessesandtheIEAdatacycle.Inothercases,theremightbeadditionalinterestsnotcoveredbytheIEAquestionnaire.Thesecouldbe,forexample,additionaldemographicindicators,suchasthenumberofRD&Dpersonnel,theregionaldistributionoffundingoraspecifictechnologyinterestthatismoredetailedthantheIEAquestionnaire(e.g.aparticularbatterytechnology)oroutsideofthescope(e.g.criticalmineralsanddigitalisation)orthereadinessleveloraverageefficiencyofspecifictechnologies(e.g.solarPVcells).Inthesecases,thereisalsoapotentialincreaseinefficiencywhenthecountrybuildstheseinterestsontopoftheIEAsurvey,ratherthancreatingseparateprocessesinparallel,bringingareductionintheburdenonrespondents.Brazilisanexampleofacountrythathasdraftedclearobjectivesintheframeworkofabroaderprojectthathasledtoawell-definedenergyRD&Ddatacollectionprocess.Brazilcasestudy:EnergyBigPushprojectIn2018,BrazillaunchedanambitiousprojecttoimproveitsprocessforcollectingandcompilingenergyRD&Ddata.ThemainobjectivesinboostingthiseffortweretoguidepublicpolicyandfillgapstoefficientlycompileinvestmentinenergyRD&Dstatistics.InMay2018,duringpreparationsforthethirdMissionInnovationMinisterial,BrazilfocusedonenhancingdatacollectiononpublicandpubliclyorientedinvestmentinenergyRD&Dandidentifiedalackofdatainthisfield.Forthisreason,thecountryacknowledgedtheobjectivetodeveloparobust,integrated,comprehensiveandstructureddatabasewithalltheinformationrequiredtoproducestatisticsthatcouldguidepublicpolicy.Inparallel,theUnitedNationsEconomicCommissionforLatinAmericaandtheCaribbean(ECLAC)launcheditsBigPushforSustainabilityin2016.Thiswasanapproachtosupportcountriesinbuildingmoresustainabledevelopmentstyles.Toaccomplishthistransitiontowardssustainability,RD&Dincleanenergyisvital.Forthisreason,theCenterforStrategicStudiesandManagement(CGEE)joinedforceswithECLAC’sBigPushforSustainabilityinBrazil.Inthiscontext,in2019,ECLAC,theCGEEandtheBrazilianEnergyResearchOffice(EPE)createdtheEnergyBigPushBrazilproject.SynergieswerethenTrackingpublicinvestmentinenergytechnologyresearch:AroadmapPurposePAGE19IEA.CCBY4.0.identified,andtheIEAalsojoinedtheprojectwithinthescopeofitsCleanEnergyTransitionsProgramme.Theprojectwasstructuredaroundfouraxesofactivity,eachwithaspecificobjective:•Axis1–Developmentofaprocessforcollecting,structuringandmanagingdataonpublicandprivateinvestmentsinenergyRD&D.•Axis2–Surveyoftechnical,economic,socialandenvironmentalperformanceindicatorsassociatedwithlow-carbonenergysolutions.•Axis3–Identificationofstrategicguidelinesandkeypolicyinstrumentstoaccelerateinvestmentsinenergyinnovation.•Axis4–Innovativeandeffectivecommunicationstrategyofprojectresults,targetedatdecisionmakers.Theresultsofactionstakenaroundaxis1hadthemethodologicalsupportoftheIEAfromthebeginning,asinternationalcomparabilitywasoneoftheobjectivesofthisproject.Theresultsofthefirstthreeaxeswerepublishedin2020ontheECLACwebsiteandwerealsodisseminatedataneventorganisedbytheIEAwithECLAC,theEPEandtheCGEE.In2020,whenthefirstphaseoftheprojectended,theMinistryofMinesandEnergyinstructedtheEPEtobuildaplatformonitswebsitetomaketheresultsobtainedsofaravailabletoadiverseaudienceandenabletheirannualupdate.Thus,withthetechnicalandfinancialsupportoftheUnitedKingdom’sProsperityFundandtheBrazilianEnergyProgramme,andundertheco-ordinationoftheEPE,executionfromtheCGEEandtechnicalsupportfromAdamSmithInternational,thedigitalplatformInova-ewasdevelopedandlaunchedin2021.By2021,projectdatahavealreadybeenusedtoassistinpublicenergypolicydecisionmaking.ExamplesofthisaretworecentresolutionslaunchedbytheBrazilianNationalCouncilforEnergyPolicythatprioritisesstrategicareasforRD&Dinvestments.Sources:BrazilianEnergyResearchOffice;BrazilianCentreforStrategicStudiesandManagement.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapInstitutionalarrangementsPAGE20IEA.CCBY4.0.InstitutionalarrangementsTheprocessofinnovationineverycountryinvolvesasignificantnumberofactors:governments,researchers,privateinvestors,entrepreneurs,corporationsandcivilsociety.Theyallplayanimportantroleingeneratingideasfornewtechnologies,performingresearchatallstagesfrombasicresearchtodemonstrationprojects,andfinancingprojects.Theyallsharethecommongoalofbringingnewtechnologiestothemarket.CapturingandunderstandingthiscomplexnetworkofinstitutionsisachallengeinthedesignorredesignofaprocesstoproduceenergyRD&Dstatistics.Inmanycases,theinstitutionsinvolvedintheprocessaredevotedtodoingcreativeworkandtheyarefocusedonincreasingthestockofknowledge.Theyusuallyworkundertightdeadlinesonchallengingprojectswithconsiderablefinancialpressure.Forthisreason,itiskeytodesigntheprocesscarefully,limitingthetransferofinformationtotheessentialandminimisingtheadministrativeburdenonrespondents.Toovercomethesechallenges,governmentsmayconsiderdedicatingeffortatthebeginningofaprojecttoensuringtheteamsandindividualsparticipatinginthedatacollectionareappropriatelyinvolved,resourcedandinformedtocreateconnectionsandsocialisetheprocessspecificitiesacrossthenetwork.Identifyingtherightsetofskillsforthemembersintheworkinggroupsandestablishingbidirectionalcommunicationsbetweendifferentinstitutionsisessentialatthispoint.Thisinvestmentmayhavesecondarypositiveimpacts,andtheenergyRD&Ddataprocesscanpromoteorcreatenewcollaborationstreamsbetweendifferentinstitutionsanddepartments.Insomecases,aspecificlegalframeworkcanboostthecreationofthenetwork.TheDutchClimateActintheNetherlandsisanexample,butsucharegulationisnotalwaysnecessarytohaveastrongnetworkofinstitutions.2–SetuptheframeworkOneofthekeyelementsofthedesignorredesignoftheenergyRD&Ddatacollectionandreportingprocessistheteamthatco-ordinatestheannualcycles(theco-ordinatingteam).Theco-ordinatingteaminteractswithcontactsinotherinstitutions,makingsurethatthedatatheymanagearecorrectandcomplywithinternationaldefinitions.Bringingtherightsetofskillsintothisteamcontributestothecompilationofhigh-qualityenergyRD&Dstatistics.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapInstitutionalarrangementsPAGE21IEA.CCBY4.0.Inmostcountries,theunitinchargeoftheco-ordinationofdatacollectionandreportingusuallybelongstotheprimaryministryforenergytopics(theMinistryofEnergyorsimilar).Forinstance,thisistheMinistryofEconomy,TradeandIndustryinJapanandtheMinistryofPetroleumandEnergyinNorway.Nonetheless,dependingonthecapacityoftheministrytodedicateresourcestothistypeofproject,insomecases,abigpartoftheworkisdonebythenationalenergyagency.Thisagencyisoftenaninstitutionthatdependsontheprimaryministryforenergytopicsandhasthedutyofprovidingtechnicaladviceonenergyissues.Evenifthecollectionandreportingareco-ordinatedbytheministryresponsibleforenergytopics,theprocessrequiresawarenessoftherelateddatacollectionactivitiesandpotentialcollaborationwithotherministries,suchasthatresponsibleforscienceandinnovationorthenationalstatisticsoffice,whichoftencompilesgeneralRD&Dstatisticsacrossdomains,forexampleintheirsubmissionofdataonGovernmentBudgetAllocationsforR&DtotheOECD.TheseRD&Dstatisticsgenerallyconsiderenergyasahigh-levelsocio-economicobjective,mighthaveadifferentdefinitionandboundariesforthedata(e.g.excludingdemonstrationthatdoesnotqualifyasR&D)andmaynotprovideanydisaggregationbytechnology.Itis,therefore,generallydifficulttoaligntheenergyRD&Ddataprocesswithcross-sectoralR&Dstatisticalwork,althoughsomecountrieshaveworkedtodefineanintegratedapproach.Whenthisalignmenthappens,theremightbebenefitsofappointingateamintheministryresponsibleforscienceandinnovationinsteadoftheministryresponsibleforenergytoco-ordinatethecompilationoftheenergyRD&Dstatistics.Forinstance,inHungary,theco-ordinatingteaminchargeofcompilingthestatisticsandsubmittingthequestionnairetotheIEAdirectlyistheNationalResearch,DevelopmentandInnovationOffice.Thestaffofthisministrymightneedtrainingonenergytechnologies,buttheywilllikelybewellawareofthebroadernationalRD&DlandscapeandfamiliarwithRD&Dstatistics.Infact,inthecaseofSpain,eventhoughthequestionnaireissubmittedtotheIEAbytheMinistryfortheEcologicalTransitionandtheDemographicChallenge,whichactsasacentralfocalpointfortheIEA,theenergyRD&DquestionnaireiscompletedbytheMinistryofScienceandInnovation.Everyyear,theco-ordinatingteaminteractswithdatacontactsfromotherinstitutions,soitisimportanttoraisethisneedfromthebeginningoftheprojectandincludethetimedimensionintheanalysis.Astheeffortfromeachinstitutionmayvaryconsiderablybutpredictablyalongtheannualcycle,theinstitutionscanplanandallocatetheresourcesrequiredandavoidissuesfromplacingaburdenonoverloadedpeople.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapInstitutionalarrangementsPAGE22IEA.CCBY4.0.Thenumberoffull-timeequivalents(FTEs)neededineachoftheinstitutionsandtheco-ordinationteamvariesgreatlyfromcountrytocountry.Itisextremelydependentonthetypeofdatacollection,theavailabilityofdata,thematurityoftheprocessandthenumberofinstitutionstoco-ordinate.Ingeneral,governmentsmayconsidersizingtheteamfortheannualcycleandallocatemoreresourcesforspecificperiodswhenthereisaredesignoftheenergyRD&Ddataprocess,suchasincreasingthescopeandcoverageoftheexistingprocessorcreatinganewcollectionprocessfromscratch.Additionalresourcesmightbeneededtocarryoutdatarevisionactivitiesforpastyearsaswell.Oncetheco-ordinatingteamissetup,thegovernmentmayconsidertrainingonbothenergytechnologiesandstatisticalmethodsfortheteammembers.Evenifthegooddistributionoftasksaccordingtotheskillsoftheteammemberscanguaranteethesuccessofthedatacycles,thisisoftenasectorwithahighstaffturnover.Forthisreason,itisespeciallyimportanttomakesurethatknowledgeissharedacrosstheteamandthattrainingmaterialsareavailabletodealwiththisturnoverwithoutdisruptingthecycle.Additionally,thereisacontinuousriskoftherestructuringofministriesduetochangesinthepoliticallandscape.Thisrestructuringcanleadtothedatacollectionprocessnotbeingallocatedtoanyministryoritbeingmovedtoacompletelydifferentsectionordepartment.Forthisreason,toavoidabreakinthedatacollectionitisessentialtoinvolvehighermanagementtoshowthevalueofthedatacollectionandensureitsprioritisationanddocumenttheprocessproperlysothatitcanbetransferredtoanotherteammoreeasily.Austriaisanexampleofacountrythathasexternalisedtheco-ordinatingteamusingacompetitivemechanism.Austriacasestudy:ExternalisingthedatacollectionTheresponsibilitytocollectandreportenergyRD&DdatainAustrialieswiththeAustrianFederalMinistryforClimateAction,Environment,Energy,Mobility,InnovationandTechnology.However,insteadofdedicatinginternalresourcestothecollectionandreportingprocess,theministryhasexternalisedthisactivity.Thecontractspecifiestheoutputsandqualityrequiredandprovidestheawardeewiththeresourcestoundertakethetasksneededtocollectthedata,withtherequirementtominimisetheburdenonrespondents.Currently,theAustrianEnergyAgencyiscarryingoutworktocollect,processandvalidatetheenergyRD&Dstatistics.TheAustrianEnergyAgencyisanenergyresearchandpolicyorganisationthroughwhichagroupofinstitutionsco-operate,suchasthefederalandprovincialadministrationsandimportantcorporationsfromTrackingpublicinvestmentinenergytechnologyresearch–AroadmapInstitutionalarrangementsPAGE23IEA.CCBY4.0.avarietyofeconomicsectors.Theboardofdirectorscomprisesthefederalministerdealingwithenvironmentalaffairs,thefederalministerchargedwithenergyaffairsandthechairmanoftheprovincialgovernors.TheAustrianEnergyAgencyhasbeendoingthisactivityforthelast18years.Eachcycle,theAustrianEnergyAgencydedicatesaround0.3-0.4FTEstothisprocess.Themaineffortisdedicatedtovalidation,analysisanddatadisseminationandpreparinga100-pagereportfortheministryandpresentingitatdifferentforums.Thedatacollectionisdonedifferentlyforeachinstitutionandincludesstructuredsurveys,unstructuredExcelfilesandextractionsfromprivateandpublicdatabases.Thisheterogeneitymakesitdifficulttodevelopaconventionallegalframeworktoformalisetherelationshipsbetweendifferentinstitutions.However,thegeneralinterestinappearinginthenationalstatistics,andthefactthatthecyclehasbeenrepeatedformanyyears,hasresultedinarobustprocesswithhighcoverage.Additionally,thereisanimportanteffortbytheAustrianEnergyAgencytoperformacontinuousscreeningoftheinstitutionallandscapetoquicklyidentifynewactorsintheenergyRD&Darena.Source:AustrianEnergyAgency.3–MappartnersanddatasourcesDrawingthefulllandscapeofthenationalenergyRD&DinstitutionsanddatasetsisnecessarytomakesurethatthecompiledenergyRD&Dstatisticsarecomplete.Additionally,theresultsoftheanalysisprovidekeyinformationfordesigningthecollection,classificationandvalidationprocess.Oncetheteamforco-ordinatingtheenergyRD&Ddatacollectionandreportingiscreated,theirfirsttaskisusuallytoscreentheentireenergyRD&Decosystem.Theco-ordinatingteammayconsidertrackingtheenergyRD&Dmoneyflowstomakesurethatalltheinstitutionsareidentifiedandconsidered.Inmostcases,itiseasiertouseatop-downapproachbecausethenumberofinstitutionsinvolvedinenergyRD&DfundingismuchsmallerthanthenumberofperformersdoingRD&D.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapInstitutionalarrangementsPAGE24IEA.CCBY4.0.TypicalinstitutionallandscapeofanenergyRD&DfundingecosystemIEA.CCBY4.0.Ingeneral,thefunctionsalongtheflowofthepublicfundsforenergyRD&Daresplitamongdifferentinstitutions.Aninstitutiondealingwithnationalfinancepreparestheannualbudgetforallpublicinstitutions.ApartofthisbudgetisallocatedtosupportenergyRD&Dusuallythroughtwoinstitutions:onethatisresponsibleforenergytopicsandanotheronethatisresponsibleforscienceandeducation,forexampletheMinistryforEnergyTransitionandtheMinistryforHigherEducationandResearchinFrance.Inaddition,therecanalsobeinstitutionsthataremorespecialisedthanministriesthatsolelyfocusonresearch,suchastheResearchCouncilofNorwayortheNationalCentresforResearchandDevelopmentandScienceinPoland,orsolelyfocusonenergy,suchastheLithuanianandAustrianenergyagencies.Inaddition,thereareindependentpublicbodiesthatfundthenationalenergyRD&Ddirectlyfromconsumersandnotthroughtheannualnationalbudget,andtheseare,therefore,notcapturedbytheministryoffinance.TheOfficeofGasandElectricityMarketsintheUnitedKingdomisanexample.Inparallel,manycountrieshavesubnationalauthorities(state,provincialandterritorial–municipalauthoritiesalsoparticipatebuttheyareoutofthescopeoftheIEAdefinitions)fundingenergyRD&D.ThespecificweightoftheseinstitutionsinthenationalenergyRD&Dvariesbetweencountries.Forexample,inCanada,theshareofprovincialandterritorialexpenditureswasalmost30%ofthetotalinthe2019-2020period.Includingalltheseinstitutionsintheprocesscanincreasethecomplexityoftheprocess.However,everyeffortshouldbemadetoincreasethecoverageanddataqualityofthestatistics,especiallywhenthebudgetsaresignificant.Thereisacompromisebetweenresourcesandcoveragetobeaddressedbycountries.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapInstitutionalarrangementsPAGE25IEA.CCBY4.0.ThenationalandsubnationalauthoritiesarethefundersofenergyRD&D.Theylaunchprogrammesandinnovationplanstochannelthefundstotheperformers.Inaddition,itmayhappenthatsomepublicbodiesthatarefocusedonnon-energytopicsfundsomeenergyRD&D,suchastheResearchInstituteforExploitationoftheSeainFranceortheFederalMinistryofFoodandAgricultureinGermany.Forthisreason,itisalsoimportanttobringtheseinstitutionsintothenetwork.Inmostcases,thenumberofperformersislargerthanthefunders,soagreaterefforttoidentifyperforminginstitutionsisrequired.Theseinstitutionsincludescienceandtechnologyresearchcentres,state-ownedenterprises,organisationsofresearchandtechnology,universitiesanduniversitiesofappliedsciences,amongothers.4–CreatethenetworkAspartoftheprocess,everycycle,theco-ordinatingteamcommunicateswithdifferentdatacontactsfromalltheinstitutionsinvolved.Appointingthesecontactsfromeachinstitution,creatingregularcommunicationstreamsandassigningsufficientresourcestothedepartmentsofthesedatacontactstoundertakethetasksinvolvedintheprocessarecriticalforproducinghigh-qualityenergyRD&Dstatistics.Aftertheeffortproducedbytheco-ordinatingteamtoidentifyalltheinstitutionsinvolvedinthenationalenergyRD&Dlandscape,thenetworkofinstitutionsismobilisedtoperformtheannualdatacollectioncycle.Theco-ordinatingteammightconsiderappointingstablecontactsinalltheinstitutions,bothfundersandperformers.Thesecontactsareusuallyresponsiblefortheco-ordinationwithintheinstitutionstoensurethatthedataareavailableonanagreeddate.Additionally,theyaregenerallythecontactpointstoanswerquestionsaboutthedataandsolveorclarifyinconsistencies.Evenifthedatacollectionprocesswasdesignedtominimiseinteractionsbetweenmembersofthenetwork,identifyingworking-levelcontactsinalltheinstitutionscanbringsubstantialefficiencieswhenaproblemorinconsistencyisidentified.Theformalisationofthenetworkandtheappointmentofcontactsareusuallyagreeduponinworkinggroupsorcommitteesforseniorofficersanddirectors.Theinvolvementandcommitmentoftheseseniorofficialsarerelevantforensuringdatacontinuity.Theco-ordinatingteammightconsiderincludingtheannualrevisionoftheenergyRD&Ddatacollectionandvalidationprocessintheagendaoftheseworkinggroupsandcommittees.Additionally,anothertooltostrengthenthelinksbetweenthepeopleparticipatinginthenetworkistoconcludetheannualTrackingpublicinvestmentinenergytechnologyresearch–AroadmapInstitutionalarrangementsPAGE26IEA.CCBY4.0.cyclewithmeetingsoremailswiththeworking-levelcontactstoshowcaseresultsandaddressthechallengesandproblemsthatwereidentifiedduringthepreviouscycle.Creatingalegalframeworkthatdefinestherolesandresponsibilitiesofeachpartnermightbebeneficial,especiallyfornewprocesses,butitisnotalwaysnecessaryforthesuccessoftheprocess.Thislegalframeworkcanactivatetheprocessinalltheinstitutionseffectivelyandprovidethemwithaverypowerfulargumenttoaskforadditionalresourcestoparticipateinthecompilationofthestatistics.Formorematuredatacollectionprocesses,thecommitmentoftheexistingnetworkmightbeenoughtomovetheprocessforward.Additionally,whenplanningtheannualactivitiesoftheministriesanddepartments,governmentsshouldconsiderincludingthereportingofenergyRD&Ddataintheassignmentlettersfortherelevantinstitutionssothattheresourcestodothistaskareaccountedforintheirbudgets.Canadaisanexampleofacountrywithahighnumberofinstitutions,bothfederalandprovincial,thatrequiresintenseworktocreateandmaintainthenetworktosuccessfullyconducttheannualenergyRD&Ddatacycle.Canadacasestudy:AcollaborativeframeworktoproduceenergyRD&DstatisticsinafederalcountryCanadahasafederalsystemofgovernancewithonefederal,tenprovincialandthreeterritorialgovernments.NaturalResourcesCanada(NRCan)isthefederalgovernmentdepartmentresponsibleforreportingenergyRD&DdatatotheIEAandrepresentingCanadaattheinternationalleveltomeetthecountry’sglobalcommitmentsrelatedtothesustainabledevelopmentofnaturalresources.NRCanhasthemandatetodeveloppoliciesandprogrammesthatenhancethecontributionofthenaturalresourcessectortotheeconomyandtoconductinnovativescienceinfacilitiesacrossCanadatogenerateideasandtransfertechnologies.Thisfederal-provincialgovernancestructurehasabiginfluenceontheinstitutionalarrangementoftheCanadiansystemtoproduceenergyRD&Dstatistics,assomeoftheenergy-relatedjurisdictionalresponsibilitiesaredividedbetweenfederalandprovincialinstitutionsandothersaresharedbetweenthem.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapInstitutionalarrangementsPAGE27IEA.CCBY4.0.ShareofresponsibilitiesbetweenfederalandprovincialinstitutionsinCanadaFederalresponsibilitiesSharedProvincialresponsibilitiesInternationalenergyInterprovincialenergyTradeandinvestmentNuclearenergyanduraniumEnergyresourcesonfederalCrownland,offshoreandnorthof60ºlatitudeRegulationsandstandardsrelatingtoenergyefficiencyEnvironmentalregulationofnewenergyprojects(includingindigenousconsultation)ScientificresearchanddevelopmentOffshorepetroleuminAtlanticAccordareasInfrastructuresecurityandresiliencyEnergyefficiencyRegulationofnaturalresourcedevelopmentonprovinciallandsLand-useandprojectplanningRoyaltydesignandcollectionIntra-provincialenergyresourceinfrastructure,distributionandstorageElectricitygenerationOneofthereasonsforNRCantoco-ordinatethisdatacollectioneffortacrossinstitutionsisthatitisafocalpointforfederalenergyRD&DandalsooneofthemainenergyRD&DfundersinCanada.Nonetheless,thereareaconsiderablenumberofotherfederaldepartmentsandprovincialandterritorialgovernmentswhofundenergyRD&Dacrossthecountry.Intotal,thereareapproximately30federaldepartmentsandagencies(e.g.EnvironmentandClimateChangeCanada,Innovation,ScienceandEconomicDevelopmentCanadaandNRCanitself)plus13provincialandterritorialgovernmentsfundingenergyRD&Dprojects.Inthiscontext,NRCaninteractswithallthesefederal,provincialandterritorialinstitutionstocollectandcompiletheenergyRD&DdataandsubmitthemtotheIEA.Intheprocessofcompilingstatistics,theygeneratetwodifferentsetsofdata.FederaldataincludeenergyRD&Dprojectsfundedbyfederaldepartmentsandagencies.NRCanco-ordinatesthedatacollectionandcompilationeffortsofaround30departmentsandagencies.Generally,eachfederalparticipantcollectsandconsolidatesatthedepartmentaloragencylevel.Consolidationeffortsvarydependingonhoweachdepartmentoragencyisstructured(e.g.oneconsolidateddatasetversusthreeindividualdatasetsforonedepartment).Priortoconsolidatingallthefederaldata,NRCantakesseveralstepstoreview,validateandverifytheindividualdatasubmissions.ProvincialdataincludeenergyRD&Dprojectsfundedbyprovincialandterritorialgovernments.EachprovincialgovernmenthasasimilarstructuretothefederalTrackingpublicinvestmentinenergytechnologyresearch–AroadmapInstitutionalarrangementsPAGE28IEA.CCBY4.0.government,withdifferentministriesmanagingthefundingprogrammes.Thereisoneministrywithasimilarco-ordinatingroleasNRCanatthefederallevelineveryprovincialandterritorialgovernment.Theseco-ordinatorscollectandconsolidatethedatafromalltheministriesintheprovinceorterritory.TheyarethecontactpointsforNRCantocollecttheentireprovincialorterritorialdataset.Insummary,maintainingfederal,provincialandterritorialofficialandworking-levelcontactsisimportanttoensureaccurateandconsistentdatasetsareproducedannually.EnergyRD&DdatacollectionflowsbetweeninstitutionsinCanadaIEA.CCBY4.0.Regardlessofthecomplexityanddiversityofthefederal,provincialandterritorialparticipants,thereisnoobligationforthedifferentinstitutionstocollectandsharetheinformationwithNRCan.However,thecommitmentasacountrytocollaboratewiththeIEAandthegoodrelationshipsbetweendepartmentsandinstitutionsmaketheprocessveryrobust.Toformalisethisprocess,officiallettersfromthedirectorgeneralofNRCanaresentannuallytotheindividualfederaldepartmentsandagenciesandtoallprovincesandterritories.Apartfromthisformalisationoftheprocess,NRCanmakesasubstantialefforteveryyeartoengagewithalltheparticipatinginstitutions.Forexample,NRCanpreparesguidancedocumentsandconductsinformationsessionsforthesurveyparticipantstohelpensureaccurateandconsistentdataarecollected.Inaddition,NRCanalsosharesthedataresultsintheformofapresentationwithalltheparticipants.Inallcasesandregardlessoftheinstitution,thetasksfortheenergyRD&Ddatacollectionaredoneusinginternalresources,coveredbythebudgetsofeachinstitution.Thereisnorole100%dedicatedtothesetasks,and,consideringthenumberofinstitutionsinvolved,itisdifficulttoestimatetheFTEperyearneededtocarryoutthedatacollection,processinganddissemination.Source:NaturalResourcesCanada.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE29IEA.CCBY4.0.Collection,classificationandvalidationOncethenetworkiscreated,itistimetodesignthemethodologiestocollect,classifyandvalidatetheenergyRD&Dstatistics.Eachcountrymayuseadifferentmethodology,dependingontherealityoftheirnationalenergyRD&Dlandscape.Todesignandimplementtherightprocedures,itisimportanttoassessthedataavailabilityandanalysethesizeandrolesofthenetwork.Thedesignoftheprocesspresentstwomaintrade-offs:betweendataqualityandtheresourcestocompilethestatisticsbetweenthecompletenessofthedataandthetimelagbetweentheendoftheyearandthepublicationofthedata.5–AssessdataavailabilityReportingdatatootherinstitutionsisoftenachallengingtask.UsingalreadyavailabledatatocompileenergyRD&Dstatisticscanreducetheburdenondataproviders.Thisway,theresourcesinthenetworkcanperformmorecomplexdatachecksandincreasethequalityofthedataset.Beforedesigningandimplementingnewreportingprocesseswithotherinstitutions,theco-ordinatingteammayconsiderundertakingathoroughassessmentoftheenergyRD&Ddataalreadyavailable.Thisincludesbothonlinedatabases,accessibletothegeneralpublic,andprivatedatabasesinternaltotheinstitutions,whichcaneasilyextractthedata.Insomecases,therearepubliclyavailableaccountingdataforthepublicfundssupportingenergyRD&D.Leveragingalltheavailableinformationminimisestheburdenondataproviders,easingimplementationandstrengtheningtheengagementofthenetwork.Inaddition,itcanreducethedependencyondataproviders,reducingthetimeneededtoundertaketheprocessandproblemsderivedfromstaffrotation.Insomecases,theinformationavailableisalreadysufficienttomeetalltheobjectivesdefinedinthefirstphase.Inthesecases,theco-ordinatingteamcanperformthedataextractionandclassificationindependentlyandlimitinteractionswithotherinstitutionsinthenetworktoresolvedoubtsandissues.However,forTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE30IEA.CCBY4.0.mostcountries,thisisnotthecase.Atthispoint,governmentsmayconsiderextendingthescopeoftheexistingcollectionprocessestomeettheobjectives,forinstance,addingspecificenergy-relatedtagstotheprojectreporting.Thismaybeagoodwaytoreducetheburdenonreportinginstitutions.Anotherimportantfactortoconsideristhetimelag.Differentinstitutionshavetheirdataavailableatdifferenttimesoftheyear.Forsomeinstitutions,thismightbealmostrealtimewhenthereisalreadyareportingsysteminplaceandtheperformersregisterandclassifytheprojectsinasystemassoonastheyreceivethefunds.Forexample,theNetherlandsEnterpriseAgencyreceivesandprocessesdatacontinuouslythroughouttheyearascompaniesapplyforsubsidies.Forotherinstitutions,theco-ordinatingteammaywait3-6monthsuntiltheaccountingofthereportinginstitutionisconsolidated.PortugalisanexampleofacountrythathasmodifiedanexistingsurveytocollectenergyRD&Ddata.Thisisnotableasthedatacollectionisnotlimitedtopublicinstitutionsbutalsocoverstheprivatesector.Portugalcasestudy:LeveraginganexistingsurveytocollectpublicandprivateenergyRD&DdataPortugalhascollectedRD&DdatafrombothpublicandprivateorganisationsthroughtheSurveyoftheNationalScientificandTechnologicalPotential(IPCTN)sincethe1960s.Thesurveywasbiannualuntil2008,afterwhichitbecameannual.EveryMarch,theInstitutionsDirectory,whichincludestheinstitutionsthatreceivearequesttoanswertheIPCTNonanannualbasis,isupdated.Portugalusesinformationfromthepreviousinquiriesandconsultsvariousinstitutionalsources,suchas:•Websitesofuniversities,colleges,polytechnicinstitutes,higherschoolsandresearchcentres.•TheTaxIncentiveSystemforBusinessR&D.•TheFoundationforScienceandTechnology,afunderofRD&Dprojects.•AlistofcompanieswithRD&DandinnovationprojectsfinancedunderPortugal2020,whichincludesgeneralandregionaloperationalprogrammes.•CompaniesparticipatinginprojectswithintheEuropeanUnion(FrameworkProgrammesforR&DandH2020).TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE31IEA.CCBY4.0.•CompanieswithinvestmentinRD&DorindeclareddevelopmentinthevariousitemsofSimplifiedBusinessInformation.•Companieswithprimaryorsecondaryeconomicactivitiesclassifiedindivision72ofthePortugueseClassificationofEconomicIndustries(CAE)-Rev.3(scientificresearchanddevelopmentactivities).•CompanieslocatedintechnologyparksorRD&Dincubatortechnologycentresandotherinstitutionsthatinterfacewithcompanies,amongothers.Afterthis,theplatformforthesurvey(IPCTN)isopened,andcompaniesandpublicinstitutionsarerequiredtoprovidetheirRD&Ddata.Thisplatformincludesadigitalversionofthequestionnaires.Therearetwodifferentquestionnaires,oneforprivatecompaniesandoneforpublicinstitutions.Thesurveyiscompletedbybothfundingagenciesandperformers.In2019,globally,12049potentialRD&Dexecutingentitiesweresurveyed,ofwhich10518answered,representingaresponserateof87%.Amongtherespondents,4707wereentitiesthatcarriedoutRD&D.Summaryof2019respondentsbytypeoforganisationOrganisationSurveyedAnsweredResponserateActiveinRD&DCompany10540911286.0%3761Stateentity81672188.0%310Highereducationunit62362099.5%599Privatenon-profitinstitutions7016593.0%37TheenergyRD&Ddataaresortedbasedontheresponsestoquestion5(energy)ofthesurvey.Inthisquestion,thenomenclatureofsocio-economicobjectivesisbasedontheNomenclaturefortheAnalysisandComparisonofScientificProgrammesandBudgets(NABS2007).Startingfromthe2019survey,theIPCTNquestionnaireformdisaggregatedtheenergyobjectiveinordertocomplywiththeone-digitleveloftheIEAquestionnaire.TheplatformisopenuntilDecember.Then,thecollecteddataareprocessedthroughtheplatform.OncethePortugueseDirectorateGeneralforEnergyandGeologyreceivestherequestfromtheIEAtoanswerthequestionnaire,theconsolidatedenergyRD&DdataforthegovernmentandtheprivatesectorarecollectedfromtheDirectorateforEducationandScienceStatistics.Source:PortugueseDirectorateGeneralforEnergyandGeology.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE32IEA.CCBY4.0.6–DesignthecollectionandclassificationSelectingtherightmethodologytocollectandclassifyenergyRD&Ddataaccordingtointernationalstandardsisatthecoreofcompilingcompleteandhigh-qualitystatistics.Therearethreepotentialmethods,dependingontheresourcesinplaceandtheavailabilityofthedatasourcesidentifiedinthepreviousstep:dataextractionfromapublicdatabase,anunstructuredsurveyandastructuredsurvey.Insomecases,thedataarenotreadilyavailable,oritisnotstraightforwardtoextendtheprocessesinplacetocapturethedesiredscope.Whenthisisthecase,itmaybenecessarytodesignandimplementtheentiredatacollectionprocessfromscratch.ItmightbeinterestingtorepeattheassessmentdescribedabovebutconsideralltheRD&Ddatacollectionprocesses.Thismightbebeneficialfortheperformers,asintegratingthenewreportingrequestswithotherRD&Ddatacollectioncyclescanbringsynergiestotheprocessoverall.Inaddition,thenetworkofinstitutionsmightbereluctanttoeffectivelyengageiftheyfeelthattheyarebeingaskedforsimilarinformationbydifferentinstitutionsatdifferenttimes.Itmight,however,makeitdifficulttoadaptandimprovetheprocessasitwouldbedependentonadatarequestthatwouldnothavethesameconsiderations.Inanycase,theinitialrawdataavailablearecommonforallthecountriesandusuallyconsistofalistofenergyRD&Dprojects.Generally,theattributesavailableinthislistarethetitle,anabstract,thenameoftheresearchersandthefundsallocated.Thesefundsmightbeannualisedinthecaseofmulti-yearprojects.ClassifyingtheprojectsaccordingtotheIEAclassificationoranyothertechnology-basedclassificationcanbechallenging.Someprojectsmightincludemultipletechnologies,anditisnotalwayspossibletosplitthefundingattributedtotheprojectaccordingtotheactualfundsgoingtoeachpartoftheproject,especiallyforbasicenergyresearchandgeneral-purposetechnologies.Thepersonclassifyingtheprojectshouldtryattributingthefundstothemostdetaileddegreeofclassificationtothebestoftheirability.Ingeneralterms,researchershaveabetterknowledgeoftheprojectsubject,buttheco-ordinatingteamismorefamiliarwiththeclassificationandtheIEAmanualandhasagreaterinterestinensuringtheprojectiscorrectlyclassified.Dependingonwhogetstheresponsibilityofclassifyingtheprojectsandaggregatingthedata,therearethreemainoptionstoundertaketheenergyRD&Ddatacollection:dataextractionfromapublicdatabase,anunstructuredsurveyandastructuredsurvey.TheselectionofoneofthesemethodologieswilldependTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE33IEA.CCBY4.0.ontheavailabilityofdataandtheinstitutioninchargeofclassifyingtheindividualprojects.Thedecisionofwhoclassifytheprojectsisoftenachallengewhendesigningtheprocess.Todecidewhoisinchargeofclassifyingeachspecificproject,governmentsmayconsiderassessinganddefiningtheskillsrequiredtobepartofthenetworkandcollaboratetocompiletheenergyRD&Dstatistics.Infact,therecanbeacompromiseonthissetofidealskillsbetweenmasteringtheIEAclassificationandstatisticalprocessesandhavingathoroughknowledgeofthespecificresearchprojects.Forthisreason,methodologiestoclassifyprojectsvaryfromacentralunitinaministryclassifyingtherawdataprojectbyprojectorusingscripts,toresearchersclassifyingtheirownprojects.Infact,itmayhappenthatalongtheprocess,differentstrategiesareusedinasinglecountry.InIreland,forexample,theclassificationtothetwo-digitlevelisdonebynationalresearchfunders,andtheco-ordinatingteamclassifiestheprojecttoamoredetaileddegreetolowertheburdenonthenationalresearchfunders.InPoland,theclassificationisdoneatanintermediarystagebythesurveyedinstitutions.Inallcases,itiscriticaltoassociatethedatacollectedwithmetadatatoprovideinformationaboutthedata’sstructure,natureandcontext.DataextractionfromapublicdatabaseWhenthereisadatasetavailablepublicly,itmightbeefficientfortheco-ordinatingteamtoindependentlyextracttherawdataattheprojectlevelandclassifytheprojectsonebyone.Dependingonthesizeoftheinstitutionandthenumberofprojects,thisprocesscanbeautomatedbyusingascriptthatlooksforkeywordsinthetitleandtheabstract.ThisisdoneinBrazil,forexample.Othercountries,suchastheCzechRepublic(describedinthenextcasestudy)andHungary,usekeywordstofilterenergyprojectsfromthelistofgeneralRD&Dprojects.Ifthesizeofthesampleisfewerthan100projects,thebenefitoftheautomaticclassificationmightnotjustifytheinvestmentinthedesignandmaintenanceofthealgorithms.Thisoptionprovidesgreatindependencefortheco-ordinatingteamandminimisestheburdenonthecontactsfromthereportinginstitutions.Thecontactswilladdressdoubtsandprovideadditionalinformationtounderstandanyinconsistenciesandbreaksinthetimeseries.Inmostcycles,theywillnotneedtoprovideanyinformationtotheco-ordinatingteam.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE34IEA.CCBY4.0.CzechRepubliccasestudy:Usingapublicdatabasetocompilestatisticsbackto1996ThedatacollectionintheCzechRepublicisdonebytheDepartmentofStrategyandInternationalCooperationinEnergyintheMinistryofIndustryandTradeoftheGovernmentoftheCzechRepublic.InthenationalRD&Dlandscape,therearefourmainactors:theMinistryofEducation,YouthandSports;theMinistryofIndustryandTrade;theCzechScienceFoundationandtheTechnologyAgencyoftheCzechRepublic.However,projectsaresupportedmainlybyfundsmanagedbytheTechnologyAgencyoftheCzechRepublicthroughspecificprogrammes.ThisagencymaintainsthepublicdatabaseSTARFOS,withinformationonalltheRD&Dprojectsreceivingpublicfunds.Anyperformerreceivingpublicfundsisrequiredtoinputinformationintothispublicdatabase.In2018,theCzechRepublicrevisedtheenergyRD&Ddatabackto1996.Duringthisprocess,theymappedtheenergyRD&Dlandscape,developedamethodologyandcreatedapowerfulnetworkwiththeTechnologyAgencyandtheResearch,DevelopmentandInnovationCouncil.TheCzechRepubliccarriesoutanannualprocesstocollectenergyRD&DdataandreportittotheIEA.ThisannualcycleisalignedwiththeIEA’sdatacollectioncycle.Assoonasthedataareavailable,theMinistryofIndustryandTradestartsthefollowingprocess.First,theydownloadalistofprojectsfromtheSTARFOSdatabase,around300projectsperyear,usingkeywordstofilterenergyprojects.Inthisprocess,theTechnologyAgencyoftheCzechRepublic,whichhasdirectaccesstobackgrounddataintheSTARFOSdatabase,collaborateswiththeministrytoprovidethesplitbetweentheeligiblecostandtheamountofpublicsupport.Inadditiontothesetwofigures,theavailableinformationinthedatabaseusedintheprocessisbasicinformationabouttheinstitutionperformingtheresearch,projectsolutiontime,programmeunderwhichtheprojectisfunded,publictendernumber,R&Dcategoriesfield,etc.TheTechnologyAgencyisthemainfundingbodyandtheownerofthemostrelevantfundingprogrammes.However,someothersourcesoffundingarenotincludedinthedata,whichcoverapproximately80%ofthenationalpublicfunding.Asanextstep,theprojectsareclassifiedaccordingtotheIEAcategories.Initially,theprojectsaredividedintotwobigcategoriesaccordingtothenationalclassification:nuclearenergyandnon-nuclearenergy.Theco-ordinatingteamattheministryclassifieseachprojectbyreadingtheirtitlesandabstracts.Inthisprocess,theministryalsoreceivestheassistanceoftheTechnologyAgencytohelpclassifycertainprojects.TheCzechRepublicreportsthepublicsupportfigurestotheIEAasthegovernmentRD&Dbudget,andthedifferencebetweentheeligiblecostandthepublicsupportaspartoftheprivatesectorRD&Dbudget.OncethedataareTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE35IEA.CCBY4.0.compiled,theyarevalidatedbycomparingthedataoftheyearofstudywiththoseofthepreviousyearintermsoforderofmagnitude.Additionally,theministryperformspredictionsbasedonliveprojectsthatarealsousedtoverifythecompletenessandaccuracyofthedata.Oncethedataarevalidated,theIEAquestionnaireiscompletedandsubmitted.TheMinistryofIndustryandTradeiscurrentlyassessingthepossibilityofaskingtheresearcherstoclassifytheirprojectsaccordingtotheIEAclassificationandincludethisfieldinthepublicdatabase.ThiswouldmodifyconsiderablytheprocessofaskingforpublicfundsforresearchasitwouldrequirechangingthestructureoftheSTARFOSdatabase.Transformationprojectsareproposed,assessedandperformedinfive-yearnationalplans.ThenextprogrammeintheCzechRepublicisData2between2023and2028.Source:CzechMinistryofIndustryandTrade.UnstructuredsurveyWhenthedatasetexistsbutisnotpubliclyavailable,andtheclassificationofprojectsisintendedtobecentralisedbytheco-ordinatingteam,governmentsmayconsidercollectingdatausinganunstructuredsurvey.Thisstrategyimposesaminimumburdenonthedatacontactsasitconcentratestheclassificationeffortwithintheco-ordinatingteam.Thisway,thedatacontactsneednotbefamiliarwiththeIEAclassification,andtheywilllimittheirworktoextractingtheinformationfromtheirsystemsandsharingitbyemailwiththeco-ordinatingteam.ThisisthecaseintheNetherlands,wheretheco-ordinatingteamclassifiestheprojectsonebyonewhenassessingtheapplicationforpublicfunding.ThisapproachisalsointerestingforlargepublicdatabaseswithinformationongeneralRD&Dprojects(notexclusivelyforenergyRD&D)whereitmightbedifficultfortheco-ordinatingteamtoextractonlytheenergyRD&Dprojects.Forinstance,inEstonia,theenergydepartmentintheMinistryofEconomicAffairsandCommunicationsrequestsfromtheResearchInformationCentreanextractionofthedatafromtheirdatabase,filteringallenergy-relatedprojects.Afterwards,theco-ordinatingteamclassifiestheprojectsaccordingtotheIEAclassification.However,theremightnotbeaspecifictagforenergyintheexistingdatabase,whichmightrequirefilteringenergyandnon-energyprojectsmanually.Inthiscase,itmightbemoreefficientfortheco-ordinatingteamtodothefilteringthemselvesastheyhaveabetterknowledgeofthecriteriaused.Inmostcases,theunstructuredsurveywillbeanExcelfilewithoneprojectineachrowandwiththefollowinginformation:title,abstract,performinginstitution(sometimesthenameoftheprojectmanager)andfundsfortheyearofstudy,aswellasanyadditionalrequiredinformationdefinedduringstep1.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE36IEA.CCBY4.0.StructuredsurveyWhentheco-ordinatingteamislimitedtoco-ordinationandreportingtotheIEAorwhenthestatisticalandenergyknowledgeisconcentratedinthereportinginstitutions,governmentmayconsiderpreparingastructuredsurveytocollectthedata.Inmostcases,theeasiestwaytocollecttheenergyRD&DdataistodirectlyusetheIEAquestionnaire.Thisway,theidentificationandclassificationofenergyprojectsaredonebythedatacontactsinthenetworkofinstitutions.InNorway,forexample,theResearchandTechnologyUnitoftheClimate,IndustryandTechnologyDepartmentintheMinistryofPetroleumandEnergysendstheIEAquestionnairetosevenfundinginstitutionsandstate-ownedenterprises,whofillintheenergyRD&Ddata.Then,theco-ordinatingteamcombinesalltheinformationintheformtheysubmittotheIEA.ThemainriskofthisstrategyisensuringthatallthereportinginstitutionshavetherightknowledgeandskillstocomputethestatisticsandfillintheIEAquestionnaire,andthatahomogeneouscriterionisappliedinthisclassification.Thestrategyreducestheeffortrequiredtocollectthedata,especiallywhentherearefeworganisationstosurvey,anditalmosteliminatestheclassificationworkfortheco-ordinatingteam.However,itincreasestherequirementsforrobustdatavalidation.TrackingenergyRD&DintheprivatesectorThebusinesssectorisamajorcontributortoenergyinnovation.For2021,theIEAtrackedalmostUSD120billionincorporateenergyR&Dspending,threetimesmorethanforgovernments.TherearegoodreasonsforestimatingprivatesectorcontributionstoenergyR&D,includinghavingamorecomprehensivepictureofR&Dspendinganddifferentiatingbetweenitsroles.Publicandprivatespendingisgenerallynotdirectlysubstitutable,withtheprivatesectorfocusingmoreonincrementalimprovementsandproductdevelopment.However,inmostcountries,informationonprivateenergyinnovationismuchlessreadilyavailableandlessreliablethanthatforthepublicsector.Inaddition,thereiscurrentlynoguidetohowtomeasureenergyRD&DinthebusinesssectorthatisequivalenttotheIEAGuidetoReportingEnergyRD&DBudget/ExpenditureStatistics.TohelpgovernmentsunderstandthevariousoptionstheIEAreportTrackingCleanEnergyInnovationintheBusinessSector:AnOverview,summarisestheexistingapproachesusedbygovernmentsandotheranalystsinthisarea.Itprovidesexamplesfromaroundtheworldofdatasources–includingfinancialfilings,venturecapitaldeals,patents,scientificpublications,marketedTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE37IEA.CCBY4.0.productsandfirm-levelperceptions–andpresentstheadvantages,disadvantagesandtrade-offsofeach.Amongtheoptions,surveyscanbeoneofthemostreliableandcomprehensivemeansofgatheringdataonprivateR&Dspending,andtheycanalsoincludequestionsonothervaluableenergyinnovationindicators.Encouragingly,acommoninternationalvocabularyandsetofpracticesexistformeasuringR&DconsistentlyandcomparablyinthebusinesssectorthroughtheOECDFrascatiManual,alsousedbyUNESCOasitsstandardformeasuringR&D.MostcountriesalreadyhaveinplacesurveysaboutR&Dactivitiesinthebusinesssector,usuallyfollowingtheFrascatiManualguidelines.Thetimeneededtodevelopenergysurveyscanbereducedby“piggybacking”onthestatisticalarchitectureandlegalframeworkofestablishedbusinesssectorR&Dsurveys.Forexample,Austria,CanadaandItalyhavecreateddedicatedsectionsonenergy,integratedintomandatorybroaderR&Dsurveys.Theyaskfordisaggregateddataondifferenttechnologies,sometimesaccordingtointernationalenergytechnologyclassifications,suchasthoseoftheIEA.Otherindicators,suchasfinancialstatements,cancomplementsurveysbyprovidingnear-real-timedataonR&Dexpenditure.DevelopthevalidationprocessValidatingthecollecteddataisessentialforanystatisticalprocess.Therearedifferentmethodologiestovalidatethedata,frombasicconsistencycheckstoadvancedalgorithmsthatvalidatetheclassificationofprojects.Themethodologiesusedwilldependmainlyonthedecisionstakeninthepreviousstepandthesecondarysourcesofdataavailable.Oncethedataarereceiveditisimportanttoensurethattheyarecompleteandaccurate.Theprocesstovalidatethedatawillgreatlydependonthestrategydefinedforthecollectionandclassification.Inanycase,itisimportanttoverifythesplitofenergyRD&Dfundsbytechnologyarea.Additionally,thechecksalsodependonthesecondarysourcesofdataavailable.Hungary,forexample,usestwosecondarydatabasestocompleteandvalidatethedata,theHungarianCentralStatisticalOfficeandEurostatdatabases.Whentherawdataattheprojectlevelareavailable,apossiblemethodologytochecktheclassificationofprojectsistorunscriptsthatclassifythemaccordingtokeywords.Thismethodologywillnotgiveperfectresults,butitmayhighlightsomeprojectsthatneedverification,especiallywhenthefundsforthatprojectarehigh.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE38IEA.CCBY4.0.Insomecases,itmightbenecessarytocontacttheperformertoensurethattheprojectiscorrectlyclassified.However,insomecases,theproject-leveldatamightnotbeavailable.Insuchcases,theonlywaytoverifytheclassificationistolookforbreaksinthetimeseriescomparedwithpreviousyears,asisdoneinFrance,forexample.Insomecases,thesebreaksmaybeareflectionofthetrueunderlyingdataduetoanewprogrammetoacceleratethedevelopmentofaspecifictechnologyoracutinenergyRD&Dfundsduetoaneconomiccrisis.Inanycase,theco-ordinatingteammayconsiderverifyingthesejumpswiththereportinginstitutions.Tocheckthecompletenessofthedata,itisimportanttogobacktostep3andmakesurethatthedatawerecollectedfromalltheinstitutionsidentifiedwhenmappingtheenergyRD&Dlandscape.Additionally,assessingthetrendinthetotalnationalRD&Dbudgetmayshowthatsomedataaremissingorthattheremightbesomedouble-countingerrors.Forthistotalbudget,theremightbesecondarysourcestocomparethedatawith.Anothergoodpracticetoidentifydataerrorsistocollectdatafrombothfundersandperformers.Ifthetwodatasetsareavailable,thesumofallthebudgetsofthefundersshouldbesimilartothesumofthemoneyreceivedbytheperformers.Ofcourse,therewillalwaysbeastatisticaldifference,butthismayhighlightbiggapsinthecoverageanddoublecounting.ThiscanbeespeciallyrelevantforEuropeancountriestryingtodistinguishbetweenEUfunds(thatshouldnotbeincludedinthenationalaggregates)andnationalfunds.Inallthesecases,itisimportanttoengagewithcontactsinthereportinginstitutionsorthoseinstitutionsthatmaintainthepublicdatabaseswherethedataarecollectedfrom.Theseinstitutionsmayneedtobearinmindthatsomeresourceswillbeneededtocollaborateinthevalidationprocess.ThenextcasestudysummarisestheentireSwissprocesstocollect,classifyandvalidateenergyRD&Ddata.Switzerlandisanexampleofacountrythathasautomatedmanytasksalongtheprocessandutilisesbothdatafrompublicsourcesandastructuredsurvey.Switzerlandcasestudy:Automatingdatacollection,classificationandvalidationTheSwissprocesstocollect,classify,validateandpublishthedataisdividedintofivestepsdoneinanannualcycle:•step1:analysisoflandscapeTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE39IEA.CCBY4.0.•step2:federalandEUdatamanagement•step3:regionalandinstitutionaldatamanagement•step4:co-ordinationandoverheadcosts•step5:publication.ThefirststepconsistsofacontinuousprocessofoverviewandidentificationofkeyactorsintheenergyRD&Dlandscape.Theoutputofthisprocessistoconnectwithacontactpersonineachoftheinstitutionsandtomakesurethatalltherelevantprogrammesareconsideredintheprocess.Thesecontactsarekeytotherobustnessoftheprocessastheywillassistintheclassificationofprojectsandprovideadditionaldata.Thesecondstepisthebiggestone,anditiscarriedoutbetweenMarchandMay,whenprojectinformationisavailablefrompublicdatabaseswithfederalorEUfunding.Thedataavailabilityismanuallychecked,andoncethisisdone,theSwissFederalOfficeofEnergydownloadsthedatafromthethreepublicprojectdatabases:SwissNationalScienceFoundation,AramisandCORDIS.Therearearound3000newprojectstobefilteredeveryyear,10%beingenergyrelevant.Thisisdoneautomatically,usingRcode.Thesedatabasesincludeeithertherealpaymentsortheapprovedtotalcontributionsfromthepublicfundingbodiestotheresearchorganisations.Oncethedataaredownloaded,theyarefilteredbasedonspecificcriteria,suchaskeywordsinthetitleandprojectdescription,theprogrammeandthefundingarea.Thisresultsinthecompilationofalistofenergyprojects.ThisisalsodoneusingRcode.Afterthefilteringprocess,thereisamanualverificationtoreducefalsepositivesandfalsenegatives.Then,eachoftheprojectsisclassifieddowntothemostdetailedleveloftheIEAandtheSwissclassifications.Thisisthemosttime-consumingpartoftheprocess.Twopeopleundertakeasemi-automaticprocesstoclassifythetypeofresearchprojectandthenamanualclassificationofthetopic.Finally,theavailabilityofannualpaymentdataisassessed,andthebudgetarystageisselectedbasedonthefollowingprioritycriteria,withcurrencyconversionwhenneeded:1.effectiveannualpayment2.annualpaymentsaccordingtothebudget3.estimatedannualamountsfromthetotalbudget.Onceallthedataareselectedandarranged,theyaretransformedintoanExcelformattoperformafinalmanualconsistencycheck.Thethirdstepiscollectionthroughsurveysofnon-federalandnon-EUfunding.Thisisdonebycollectingtheinformationdirectlyfromthecontacts,betweenJuneTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapCollection,classificationandvalidationPAGE40IEA.CCBY4.0.andAugust,usingsurveys.UsingRscripts,threefilesarecreatedwithalistofprojectsperresearchorganisation:1.Projectsaccordingtostep2(withfederalorEUfundingfortheyearofinterest).2.Projectsaccordingtostep3ofthepreviousyearthatarestillongoing(withownorcantonalfundsinthepreviousyear).Theyareaskedtocompletetheinformationonspendingfortheyearofstudy.3.Alistwithemptyrowstoindicatenewprojectsorprojectsmissedlastyear.Thesequestionnairesaresentbyemailtoallthecontactpersonswithadeadlinetosendthembackafterafewweeks.Assoonasthesefilesarereceivedback,theyarecheckedmanually,lookingatduplicates,thescopeandclassificationaccordingtoSwissandIEAguidelinesandtheprojecttype,etc.Includingfederalfunding,therearearound600newprojectseveryyeartobeclassified.Finally,theconsolidatedlistofprojectsisloadedintothesystemandtransformedintoanExcelcomma-separatedvalueformat.Atotalofmorethan2000projectsandactivitiesareincludedintheannualstatistics.Thefourthstepisthecollectionoftheco-ordinationandoverheadcosts.Thiscanbedoneinparallelwithstep3assoonasthefederalinstitutions,universitiesanduniversitiesofappliedsciencereportthesecoststotheFederalStatisticalOffice.Forotherfundingagencies,suchastheSwissNationalScienceFoundation,thesedataareextractedfromtheirpublicannualreports.Then,co-ordinationandoverheadcostsareproportionallyallocatedtotheprojectsfundedbyeachagency.In2019,CHF427millionwasaccountedforinthestatistics,ofwhich53%correspondedtoprojectsinthedatabasesinstep2,21%toquestionnairesinstep3and26%toestimatesofoverheadcostsinstep4.Thefifthstepispublicationanddatadissemination.InNovember,thefirstdraftversionofthedataisprepared.Publicationisfurtherexplainedinthedatadisseminationsection.TopreparethesubmissionfortheIEA,theEUcontributionsareexcluded.Source:SwissFederalOfficeofEnergy.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapDatamanagementandtechnologyPAGE41IEA.CCBY4.0.DatamanagementandtechnologyApartfromtheorganisationalsideoftheenergyRD&Ddatacollectionactivity,thereisanimportanttechnicalside.EnergyRD&Dstatisticsaresupportedbytechnologicalpieces,suchasdatabases,integratednationalsystemsanddataplatforms.EventhoughmostcountriesrelyonExcelspreadsheetsfortheprocessdescribedinthisdocument,andtheinformationisexchangedbyemail,therearealreadygoodexamplesofmorecomplexdatamanagementtoolsintheinternationalenergyRD&Ddata,suchastheSTARFOSdatabaseintheCzechRepublic,theResearchInformationCenterinEstoniaortheiPCTnplatforminPortugal.Inaddition,itispossiblethatindividualinstitutionsthatrespondtothesurveysfortheco-ordinatingteamsrelyoninternaldatabasestocompiletheirenergyRD&Ddata.8–SelectandcreatetheinformationtechnologytoolsAllprocessesaresustainedbytechnologicalpiecesofhardwareandsoftware.SelectingtherightsystemsisachallengebecauseenergyRD&Ddataareusuallytoosmallafieldtojustifythecomplexityandeconomicsoflarge-scaleinformationtechnology(IT)projects.Forthisreason,itcanbehelpfultoclustertheenergyRD&DprocesswithothersimilarprocesseswhenselectingtherightITtools,suchasplatformsfordigitalquestionnaires,databasestostoreproject-leveldataandadvancedanalyticstoautomatetasks.Inthelastdecades,datamanagementcapabilitieshaveevolvedatanunprecedentedspeed.Technologicalchangeshappeneveryfewyears,bringingnewpiecesofhardware,softwareandtechnologicalservicesconstantlyintothemarketandenablingnewdatamanagementstrategies.Inadditiontothisenvironmentofcontinuoustransformation,theprojectstobuildandupdatethesesystemsareusuallylong,complexandresource-intensiveanddifficulttointegrateintotheITsystemsofgovernments.Theyusuallyrequirespecificprofessionalskillstobesuccessful.Thesecharacteristicsmightmakeitdifficultforpublicinstitutionstoactivelylaunchlarge-scaleITtransformationprojects.Nonetheless,governmentswillrequiremoreandmoredata,andthenumberofdatacollection,validationanddisseminationprocessessupportedbymoderntoolswillincreaseexponentially,bringingautomationandcreatingmoreefficientprocesses.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapDatamanagementandtechnologyPAGE42IEA.CCBY4.0.ItisimportanttoacknowledgethatitmightbedifficultfortheenergyRD&DdataprocessdescribedinthisdocumenttojustifyanITtransformationproject.Forthisreason,governmentsmayneedtoconsidertheirentiredatamanagementrequirementswhendefiningtheirdatastrategiesandlaunchinganddeployingnewsoftwareandhardware.Themainroleoftheco-ordinatingteaminthisregardistoactivelydisseminatetheworkdonewiththeenergyRD&Ddata.Thisway,otherministrieswillbeawareoftheenergyRD&Dprocess,anditwillbeconsideredwhendefiningdatamanagementstrategies.Additionally,theentirenetworkcanbeproactiveandcontinuouslyevaluatepossibilitiestoadaptexistingplatformstoincorporatetheenergyRD&Ddatacollection,validationanddisseminationprocesses.Anadditionalcommonrequirementofallthesetechnologiesiscybersecurity.Smallteamsmaydevelopdepartmentaltoolsconnectedwithdatasourcesthatdonotcomplywithcybersecuritystandards.Thesetoolsmayseemtobeeffectiveandfasttoimplement,buttheymayleavethedooropentocyberattacks.ThemaintechnologiesthatcanbeusedfortheenergyRD&Ddataprocessaredigitalquestionnaires,projectdatabasesandscriptsforprojectclassification.DigitalquestionnairesDigitalquestionnairesaredigitalformsofthesurveysusedtocollectdatafromrespondentsthatcanbecompletedandsubmittedonline.Theseneedtobeintegratedintoplatformsthatcanmanageuserstoensurethatthequestionnairesarecompletedonlybyvalidrespondentsandconnectedtodatabasesthatstoretheanswers.Theseplatformscanbeparticularlyusefulwhenthenumberofquestionnairesprocessedannuallyishigh.Iftheprocessincludestheprivatesector,andthereforethousandsofactorsaresurveyed,digitalquestionnairesmightbecomeessential.ThisisthecaseforPortugal,whichusesadataplatformtocollectandprocessmorethan12000questionnaireseveryyear.Anotherdriverindeployingadigitalquestionnaireisthecapabilitytoautomaticallyprocessandvalidatetheanswers.Theseplatformscanincorporateallthechecksrequiredtoensurethatthedataarecorrectandhighlightalltheinconsistenciesinstantlytothedatasubmitterforthemtocorrect.Thisway,theprocessbecomesfaster,andtheexchangeofcommunicationsneededtovalidatethedataisreduced.ProjectdatabasesSomecountrieshaveprojectdatabasestostoreinformationonallnationalRD&D.Insomecases,thesedatabasesarelimitedtoprojectsreceivingpublicfunds,butsomecountrieslikeEstoniaaretryingtocreateresearchandinnovationdatahubs,includinginformationonprivateresearch,activeresearchersandinstitutionsTrackingpublicinvestmentinenergytechnologyresearch–AroadmapDatamanagementandtechnologyPAGE43IEA.CCBY4.0.inthedatabase.Thesedatabasesusuallyhaveinformationincludingtheprojecttitle,abstract,performinginstitution,researcherandtopicaccordingtonationalandinternationalclassificationcriteria.Infact,themainbenefitoftheseplatformsforthecompilationofenergyRD&Dstatisticsisthattheburdentoclassifyaspecificprojectisputontheresearcher,whohasthecompleteinformationandtechnicalknowledgetoclassifytheprojectcorrectly.ScriptsforprojectclassificationWhenprojectdatabasesexist,itisunlikelythattheprojectsareclassifiedaccordingtotheIEAclassification.Inthesecases,thefirststepistomapthenationalclassificationtotheIEAclassificationatthemostdisaggregatedlevelpossible.However,theremightnotbeuniquerelationsbetweenclassifications,anditmightbedifficulttodoacompletemappingtothelevelofdetailrequestedintheIEAquestionnaire.Inthesecases,governmentscouldconsiderdevelopingscriptsthatgothroughthelistofprojectsandclassifythemaccordingtopre-definedkeywordsorresearchers.Thesescriptsareusedbymanycountries,suchasBrazilandSwitzerland.Inthecomingyears,itmightbepossibletousetextanalyticstoimprovetheeffectivenessofthescriptstoclassifyprojects,butabiglistofprojectswouldbeneededtotrainthealgorithm.EstoniaisanexampleofacountrythathascreatedapublicdatabasetomanagealldataonnationalRD&D.TheinstitutionmanagingthedatabasecollectstheenergyRD&Ddatausinganunstructuredsurvey,whicharethensenttotheco-ordinatingteamattheEstonianMinistryofEconomicAffairs.Estoniacasestudy:TheResearchInformationSystemTheEnergyDepartmentoftheEstonianMinistryofEconomicAffairsandCommunicationsistheinstitutioninchargeofcompilingtheenergyRD&DstatisticsandsubmittingthemtotheIEA.Thisministryisinchargeofdesigningandimplementingnationaldevelopmentplans.ItdoesnotcarryoutanydatacollectionactivitiesforenergyRD&Dbecausethedataarealreadypubliclyavailableandcanbeconsolidatedfromtheexistingdatabase.TheResearchInformationSystemwasestablishedbytheEstonianMinistryofEducationandResearchandismaintainedandoperatedbytheEstonianResearchCouncil.Researchersarerequiredtofillinthedatawhenreceivingpublicfundsfortheirresearch.Thesystemgathersinformationonresearchanddevelopmentinstitutions,researchers,researchprojectsandvariousresults.ItisTrackingpublicinvestmentinenergytechnologyresearch–AroadmapDatamanagementandtechnologyPAGE44IEA.CCBY4.0.alsoaninformationchannelforsubmittingandprocessinggrantapplicationsandforsubmittingandvalidatingprojectreports.Inaddition,theResearchInformationSystemistryingtobroadenitsscopeandisintendedtobecomeameetingpointandcentralsourceofinformationfortheRD&DlandscapeinEstonia.Itis,thus,workingtoincludemoreinformationaboutprivatelyfundedRD&Dprojects.Additionally,therearesomesmallprojectswithpublicfundsgiventoconsultancieswhennoresearchcentresareavailablethatarecurrentlynotincludedinthedatabasebutcouldbeinthefuture.Source:EstonianMinistryofEconomicAffairsandCommunications.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapDatadisseminationPAGE45IEA.CCBY4.0.DatadisseminationOncethedataareprocessed,itisimportanttodisseminatethemeffectively.Asdescribedinthepurposesection,itisgoodpracticetohaveavisionofwhatthefinaloutputoftheprocesswillbefromtheverybeginningoftheproject,asthisvisionwillguidethedesignoftheentirecollectionandvalidationprocess.Datadisseminationisprobablythemostimportantstepoftheroadmap,astherelevanceofthecompileddatasetwilldependentirelyonthedocumentsandtablesthatarepublished,eitherforinternalusersorthepublicingeneral.Toensurethattheobjectivesdefinedatthebeginningoftheprocessaremet,itmaybeappropriateforallthepublicationstofocusonidentifieddatausers.Asageneralrule,datashouldbeeasilyaccessible,includingalltherelevantdocumentationandmetadatatounderstandit,anddatausersshouldbeabletoextractinformationfromthedataeasilyinordertoinformpolicydecisions.Additionally,disseminatingthedataiskeytoprovidingvisibilityofalltheeffortsmadebythenetwork.Sharingthedataresultswiththerespondinginstitutions,asisbeingdoneinCanadabyNRCan,willstrengthentheengagementoftheentirenetworkandcancreateaforumtointroducenewdatacycles,explainchangesfrompreviousyearsandanswerquestions.9–SharethedataSharingthecompiledenergyRD&Dstatisticsisthefinalgoaloftheprocess.Selectingtherightcommunicationstrategyandformatforthedataisacriticalstep.Atthisstage,itisimportanttogobacktotheobjectivesidentifiedinthefirststepandtomakesurethatallofthemhavebeenfulfilled.Datauserscanbedividedintointernalusers(insidetheministriesandgoverningbodies)andexternalusers(thegeneralpublic,academiaandtheprivatesector,etc.).Theneedsandmotivationsofthesetwotypesofusersareverydifferent,andthedisseminationchannelsandstrategiesshould,therefore,bedefinedwiththesedifferentneedsinmind.InternalusersusetheenergyRD&Ddatatoassesspolicies,informdecisionsanddesignenergyRD&Dfundingprogrammes.Theyareusuallyoneofthemainsponsorsofaprojecttosetupthecollectionandvalidationsystemsdescribedinthisdocument,andtheyhaveclearrequirementsregardingdatadissemination.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapDatadisseminationPAGE46IEA.CCBY4.0.Thesedatausersaregenerallyinterestedinhigher-levelaggregateddatabutcanalsouseproject-leveldatainpolicyevaluation.Inmanycases,becausetheyarepartofgovernmentalinstitutions,theyusesimilarITsystemstotheonesusedbytheco-ordinatingteam,enablingthedevelopmentofadhocdashboardsintegratedwithinternaldatabases.Thesedashboardscanallowinternaldatauserstofilterthedata,creategraphswithtimeseriesanddiveintothedata.Nonetheless,thesedevelopmentsmightbetoocomplex,andinsomecases,sharingtheannualIEAquestionnaireinternallymightbeenoughtoprovidealltheinformationneeded.Externalusersincludeacademicresearchers,journalists,someoftheorganisationsthatcollaboratedinthedatacollectionprocessandprivatecompanies.Theinformationrequiredbytheseusersmightbeatanylevelofdetail,soitismoredifficulttoensurethatalltheirneedsareconsideredandmet.Manycountriesusuallygiveaccesstotheirmicro-dataonthebasisofprojectproposalsforscientificpurposes,butanothergoodoptionistoapplyanopenaccessdatastrategy.Openaccessdatameansthatgovernmentaldatawillbeavailabletoanyonewiththepossibilityofredistributioninanyformwithoutanycopyrightrestriction.Governmentsincreasinglyhaveincentivestomakeasmuchdataavailableaspossiblewhileminimisingtheprocessingnecessarytomanageconfidentialityconcerns.Switzerlandisanexampleofthisopendatastrategy.Toaccomplishthisdisseminationstrategy,governmentsmightconsiderusingthestatisticalresourcesalreadyavailableinmostcountriestoenableanyonetofilteranddownloadanydatarequired.Theseresourcesaregenerallymanagedbythenationalstatisticsoffice.Certaincountries,suchasIrelandandBrazil,havechosentodisseminatetheirdatathroughdatabases,attheprojectlevelforIrelandandatthetopiclevelforBrazil.Additionally,acommonneedamongalltheusersistohaveavailableadetaileddatadictionaryandsetofdocumentsexplainingthemethodology,includingallmetadataavailable.Thedatadictionaryisadocumentcentralisingalltheinformationaboutthedata,suchastheirdefinitions,relationshipstootherdata,originandformat.Themethodologydocumentexplainsalltheprocessesforcollecting,classifying,validatinganddisseminatingthedata.Infact,itcouldhaveaverysimilarstructuretothishandbookbutwithcountry-specificinformation.Finally,themetadataisadocumentthatprovidesinformationaboutthecoverage,budgetarystagesorinformationaboutjumpsinthetimeseriesorsimilaranomaliesthatcouldbeinterpretedaserrorsbyothers.Thisinformationcanalsobeincludedinthedatadictionary.Thesedocumentswillallowuserstoaccuratelyextractinformationfromthedata.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapDatadisseminationPAGE47IEA.CCBY4.0.10–CommunicatethefindingsIftheco-ordinatingteamisagroupofexpertsonenergyRD&Ddata,theycannotonlysharethecompiledstatisticsbutalsoaddananalysisofthetrendsinenergyRD&D.Governmentsmayconsiderwritingareportandarrangingapresentationorwebinartoexplainthekeyoutcomesoftheannualcycle.Inadditiontothedata,theco-ordinatingteamcanalsoperformdataanalysisandpublishthefindings.Theseanalysescanbeshowninannualreportspublishedonline.ThisisthecaseincountriessuchasAustria,theCzechRepublic,FranceandGermanywho,attheendofthecycle,writereportsshowingthekeytrendsdeducedfromthedataandexplainingthemostrelevantfactsonenergyRD&D.Thestructureofthesereportsisoftensimilarregardlessofthecountry.Theyshowthekeyfiguresfortheyearofstudy,highlightingthemainincreasesanddecreasesinenergyRD&Dbudgetsforspecifictechnologies.Thedataareusuallyclassifiedatthetwo-digitlevel,andinsomecountries,theyalsoincludethetimeseriesandtheregionaldistributionofresearchfunds.DashboardssuchastheonedevelopedbytheUnitedKingdomarealsoagoodwaytodisseminatethedata.Therearesomegoodpracticestoincreasethevalueofthesedocuments.Forinstance,itcanbeinterestingtocollaboratewithinternaluserstoincludesomeoftheconclusionsoftheirpolicyanalyses.Thisprovidesanadditionallayerofanalysistothedata,showingthepurposebehindtheefforttocollectthedata.Ifthisinformationisavailable,itcanbepositivetopresentittothenetworkthatparticipatedinthecollectionandclassificationprocesses,asitwillprovethattheeffortcarriedoutbythenetworkhasagreatimpact.Anotherinterestingwaytocompletethedisseminationisbyaddinginternationalcomparisons.ThisisapotentialwaytopublicisetheworkdonebyallthecountriescollaboratingwiththeIEAinthecompilationofcomparableglobalenergyRD&Dstatistics.Inaddition,itprovidesaninternationalbenchmarktoassesswhichcountriesaremakinggreatereffortsinenergyRD&Dorhowrelevantglobalinvestmentsareinbringingspecifictechnologiestothemarket.Trackingpublicinvestmentinenergytechnologyresearch–AroadmapContinuousimprovementPAGE48IEA.CCBY4.0.ContinuousimprovementAttheendofeverycycle,theentireprocessmightbereviewed.Toeffectivelyreviewtheprocess,theco-ordinatingteammightusethefivephasesdescribedinthisroadmaptoensurethecompletenessoftherevision:purposeandobjectives;institutionalarrangement;collection,classificationandvalidation;datamanagementandtechnology;anddatadissemination.11–EstablishalearningandadaptationcultureThefirstitemthattheco-ordinatingteamcouldreviewisthepurposeandobjectives.Insomecases,newpolicyprioritiesmighthaveappearedalongthecycle.Whenthisisthecase,itisimportanttoensurethatthecurrentprocessintegratesthesenewpolicyprioritiesandthatthecompiledstatisticshaveenoughinformationtotracktheprogress.Additionally,theparticipationofthecountryininternationalforumsmightinspirenewmotivationsthatwouldneedtobeincorporatedintotheprocess.Forthisreason,itisimportanttoresearchcontinuouslythebroaderenergyandinnovationlandscape,nationallyandinternationally.Regardingtheinstitutionalarrangement,theco-ordinatingteammightregularlyscreentheenergyRD&Dlandscapetoidentifyandaddnewcontactstothenetwork.Inmanycases,someinstitutionsinthenetworkwillfacestaffrotationsortransformationsintheirinternalprocessesandduties.Itisimportantthattheco-ordinatingteamassiststheminthisprocess,providingtrainingwhenneededtoensuredatacontinuity.Fordatacollection,classificationandvalidation,itisimportanttoidentifyandsolvebottlenecks.Theco-ordinatingteamshouldbecriticalofthemethodologyandcontinuouslyassessitsefficiencyandimplementchangestoautomatisepartsoftheprocess.Theendofthecycleisalsoagoodmomenttoensurethatthenetworkiseffectivelyengagedandtoidentifyandimproveinstitutionalrelationships.Thedevelopmentsindatamanagementandtechnologyincludetwopotentialdifferentissuestoscreen.Ontheonehand,theco-ordinatingteammightassesswhetherthereareanynewtechnologicaldevelopmentsinthemarketthatcouldimprovethecurrentprocess.Ontheotherhand,asmentionedinthesectionondatamanagementandtechnology,itiskeytobeawareoftheinternalITprojectslaunchedbytheinstitutionsoftheco-ordinatingteamorthenetwork.Thisway,Trackingpublicinvestmentinenergytechnologyresearch–AroadmapContinuousimprovementPAGE49IEA.CCBY4.0.theco-ordinatingteamandthedatacontactscanassessthepossibilityofincorporatingsomeoftheneedsoftheenergyRD&Ddatacollectionintotheseprojects.Finally,regardingdatadissemination,theco-ordinationteamassesswhethertheoutputs,suchaspublicationsandpresentations,aresufficientlycirculatedandreachtherightusers.Itisalsoimportanttotakeintoaccountuserfeedbacktoimproveanalysisandreports,includingintermsofrelevancytothecurrentenergytechnologypriorities.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapConclusionPAGE50IEA.CCBY4.0.ConclusionAsdescribedinthisdocument,thedifferentmethodologiesfollowedbycountriestocompileenergyRD&Dstatisticsaregroupedintosixphasesand11steps.Thesesixphasesare:purposeandobjectives;institutionalarrangement;collection,classificationandvalidation;datamanagementandtechnology;datadissemination;andcontinuousimprovement.ThesephasescanbefollowedinsequenceforcountriesnearthebeginningoftheirjourneystowardsenergyRD&Ddatacollectionbutalsoindependentlyforcountriesthatareredesigningspecificareasoftheprocess.Whilethephasesdescribedinthisreportfollowanorder,theycanbeconsideredinparalleldependingonthecontextofeachcountry.SimplifiedroadmaptocollectingenergyRD&DdataIEA.CCBY4.0.Asmentionedearlier,theIEAdescribesherepossibleoptionsforcountriestofollowduringthedesignoftheirenergyRD&Ddatacollectionsystems.Eachcountry’ssituationisdifferent,andgovernmentsshouldseethisreportasatoolboxtoadapttotheirindividualsituations.Thisroadmapisaninitialstepthataimstobethebasisforfurtherexchangesbetweencountries,andtheIEAishappytoprovidefurthersupporttoanycountrythatwantstoimproveorsetupitsdatacollectionsystem.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE51IEA.CCBY4.0.AnnexAustriaInstitutionalarrangementReportinginstitutionAustrianEnergyAgency,contractedbytheMinistryforClimateAction,Environment,Energy,Mobility,InnovationandTechnologyRoleofreportinginstitutionDeveloping,supportingandimplementingmeasuresthataimatasustainableenergysupplyanduseFundingresponsibilitiesofthereportinginstitutionNotafundinginstitutionWaytoformaliserelationshipbetweeninstitutionsContractbetweentheministryandtheagencyNolegalframeworkwiththesurveyedinstitutionsCollection,classificationandvalidationprocessTypeofdatacollectionStructuredsurveyUnstructuredsurveyPublicdatabasePrivatedatabaseTypeofsurveyDifferentfromtheIEAsurveyProjectlevelSurveyfrequencyAnnualDataextractionProjectdata(contracts)fromfundinginstitutionsDataextractionfrequencyAnnualClassificationIEAclassificationdonebytheco-ordinatingteamFourstagesofRD&D:basicresearch,experimentalresearch,technicaldevelopmentandfirst-of-its-kinddemonstrationDatavalidationCross-checkwithprojecttitleorotherprojectinformationfortopicsTimeseriesassessmentDatamanagementandtechnologyDataplatformInternalExceldatabasewithallprojectsAdvanceddataanalyticsNoTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE52IEA.CCBY4.0.DatadisseminationMaindatausersMinistriesandfederalauthoritiesDisseminationchannelAnnualreportinJuneAnnualpublicpresentationinJuneDedicatedwebsiteSpecificqueriesMainpublicationEnergyRD&D2021-PublicExpendituresinAustria.SurveyfortheIEAPurposeEnergyRD&DdatahavebeencollectedinAustriasince1974toinformtheIEA,ministriesandfederalauthorities.Themainobjectiveofthesestatisticsistobethequantitativebasisforthedesign,trackingandevaluationoftheRD&Dfundingprogrammes.Theyarealsousedasaquantitativebasistoassessthealignmentbetweenpublicpolicies(forinstance,tosupportelectromobilityorgrid-scalestorage)andtheresearchprojectscarriedout.InstitutionalarrangementTheresponsibilitytocollectandreportenergyRD&DdatainAustrialieswiththeAustrianFederalMinistryforClimateAction,Environment,Energy,Mobility,InnovationandTechnology.However,insteadofdedicatinginternalresourcestothecollectionandreportingprocess,theministryhasexternalisedthisactivity.Thecontractspecifiestheoutputsandqualityrequiredandprovidestheawardeewiththeresourcestoundertakethetasksneededtocollectthedata,withtherequirementtominimisetheburdenonrespondents.Currently,theAustrianEnergyAgencyiscarryingoutworktocollect,processandvalidatetheenergyRD&Dstatistics.TheAustrianEnergyAgencyisanenergyresearchandpolicyorganisationthroughwhichagroupofinstitutionsco-operate,suchasthefederalandprovincialadministrationsandimportantcorporationsfromavarietyofeconomicsectors.Theboardofdirectorscomprisesthefederalministerdealingwithenvironmentalaffairs,thefederalministerchargedwithenergyaffairsandthechairmanoftheprovincialgovernors.TheAustrianEnergyAgencyhasbeendoingthisactivityforthelast18years.Eachannualcycle,theAustrianEnergyAgencydedicatesaround0.3-0.4FTEstothisprocess.Themaineffortisdedicatedtodatavalidation,analysisanddisseminationastheyarerequestedtopreparea100-pagereportfortheministryandpresentitatdifferentforums.Thedatacollectionisdonedifferentlyforeachinstitutionandincludesstructuredsurveys,unstructuredExcelfiles,extractionsfromprivatedatabasesandaccessTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE53IEA.CCBY4.0.topublicdatabases.Thisheterogeneitymakesitdifficulttodevelopaconventionallegalframeworktoformalisetherelationshipbetweendifferentinstitutions.However,thegeneralinterestinappearinginthenationalstatistics,andthefactthatthecyclehasbeenrepeatedformanyyears,hasresultedinarobustprocesswithhighcoverage.Additionally,thereisanimportanteffortbytheAustrianEnergyAgencytoperformacontinuousscreeningoftheinstitutionallandscapetoquicklyidentifynewactorsintheenergyRD&Darena.State-ownedenterprisesarenotincludedinthepublicdata,buttheyareincludedinthedataoftheprivatesector.FundinginstitutionsandmajorprogrammesThemainsourcesoffundingforenergyRD&DarethefederalministriesandtheClimateandEnergyFund.Thesefundsaremainlytransferredtotheresearchinstitutionsthroughthenationalfundingagencies.In2021,almostthree-quartersofthisexpenditurewasprovidedbygovernmentalauthorities(federalandregionalfundingorganisations).Theremainingpartcamefrom(publiclyfunded)researchinstitutionsanduniversitiesprovidedwithequitycapital.TotalenergyRD&DexpenditurebyinstitutioninAustria,2021IEA.CCBY4.0.Austria’snationalfundingagenciesassignasignificantshareoffinancialresourcesprovidedbyfederalbudgetstoenergyRD&D.In2021,EUR163millionwascontractedviatheseinstitutions.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE54IEA.CCBY4.0.EnergyRD&DfundinginstitutionsandtheirfundsinAustriain2021Fundinginstitution2021fundsAustrianResearchPromotionAgencyContractedEUR142million,mostlyfromministriesandClimateandEnergyFundbudgetsbutalsoincludingEUR18millionfrombottom-upprogrammesforcompaniesKommunalkreditPublicConsultingAdministeredEUR19millionforfirst-of-their-kinddemonstrationprojectsAustrianScienceFundFinancedEUR0.8millioninenergy-relatedbasicresearchAustriaWirtschaftsserviceProvidedEUR1.6millionoutoftheirseedfinancingprogrammesSource:IEAResearchCooperation(2022),EnergyRD&DSurvey2021-PublicSectorExpendituresinAustria.SurveyfortheIEA.Collection,classificationandvalidationprocessThedatacollectionprocessisveryheterogeneousinAustria.ThemainprincipleoftheAustrianEnergyAgencyistoreducetheburdenonreportingbodiestoaminimum.Therefore,abigpartoftheclassificationandvalidationtasksareundertakenbytheagencyitself.TheycollecttherawdataattheprojectlevelusinganoptionalExcelspreadsheetformat,butnotalltherespondentsprovidethedatawiththesamestructure.Additionally,insomecases,thereportinginstitutionsmakethedataavailabletotheAustrianEnergyAgencydirectlyfromtheirsystems:inapublicdatabaseinthecaseoftheAustrianScienceFundandfromaprivatedatabaseinthecaseoftheAustrianResearchPromotionAgency.Whenthedataareavailable,theyaredirectlycollectedandprocessedbytheAustrianEnergyAgencywithoutanyinteractionwiththereportinginstitutionunlessthereisaproblemorananomaly.ProjectsareusuallyclassifiedaccordingtotheIEAclassificationbytheresearchinstitutions.TheyalsoclassifyeachprojectintooneofthefourfollowingRD&Dstages:basicresearch,experimentalresearch,technicaldevelopmentandfirst-of-its-kinddemonstration.Toavoiddoublecountingonprojectsfundedbydifferentinstitutions,eachrespondentreportstheamountfundedbythemself,notthetotalfundingoftheproject,consideringthecontractssignedintheyearofstudy.TheprojectsarealsoclassifiedaccordingtoothercriteriathatfalloutsidethescopeoftheIEAsurvey,suchasgenderbalance.Forexample,projectsareclassifiedaccordingtothegenderoftheprojectleaderorthenumberoffemaleexpertsworkinginaspecificfield.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE55IEA.CCBY4.0.Oncetheenergyagencyreceivesthedata,theydosomecross-checkingwiththeprojecttitleandadditionaldatatovalidatetheclassificationandstudythetimeseriestoassessbreaks.Iftheyidentifyaninconsistency,theysolveitbyreachingouttothecontactsofthereportinginstitutions.Insomecases,aprojectclassificationmayneedtobealteredduetoconfidentialityissues.Asaprinciple,itshouldnotbepossibletodeducefromthestatisticsanyspecificprojectorinstitutioninformation.Onceeverythingisprocessed,allthevalidatedprojectdataareloadedontoaninternaldatabase(around1000projectsperyear).Allthetables,graphsandinformationpublishedbytheagencyareextractedfromthisdatabase.DatamanagementandtechnologyThereisnospecificdataplatformtodealwithalltheexchangesofinformationbetweentheAustrianEnergyAgencyandtherespondents.TheseinteractionsaredifferentfromonereportinginstitutiontoanotherandincludethecirculationofformattedExcelspreadsheets,generalExcelspreadsheets,accesstopublicdatabasesandaccesstoprivatedatabases.AlltheinformationiscentralisedinanadvancedExceldatabasethatisusedtocarryoutthedatavalidation.Ingeneral,thereisalotofmanualworkinthisprocess.DatadisseminationThekeyusersofenergyRD&DdatainAustriaaretheministries,federalauthoritiesandprogrammedesigners.Theorganisationscarryingouttheprojectsarealsointerestedinthesedataastheycanobtaininformationaboutfundingprogrammesandassesswhetherthefundsinplaceareenoughtoadvancethedevelopmentofcertaintechnologiesattherequiredspeed.Themainoutputisa100-pagereportshowingareviewofenergyRD&DinAustria,availableonline.Additionally,theAustrianEnergyAgencypreparesworkshopstopresentthemainconclusionsofthereport.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE56IEA.CCBY4.0.BrazilInstitutionalarrangementReportinginstitutionsEnergyResearchOffice(EPE)CentreforStrategicStudiesandManagement(CGEE)RoleofreportinginstitutionsEPE:supportingtheBrazilianMinistryofMinesandEnergy’senergypolicieswithstudiesandresearchonenergyplanningCGEE:supportingdecision-makingprocessesinscience,technologyandinnovationFundingresponsibilitiesofthereportinginstitutionsNotmainfundersWaytoformaliserelationshipbetweeninstitutionsNospecificlegalframeworkforenergyRD&DdatacollectionCollaborativeframeworkwithpubliclyavailabledataCollection,classificationandvalidationprocessTypeofdatacollectionPublicdatabaseRawprojectdatasentbyinstitutionsDataextractionProjectdata(budgets)fromfundinginstitutionsFrequencyofdataextractionAnnualTypeofrawdataProjectsClassificationIEAclassificationdonebytheco-ordinatingteamDatavalidationKeywordsAnalysisbyenergyspecialistDatamanagementandtechnologyDataplatformCentralplatformhostedandmanagedbytheEPEAdvanceddataanalyticsClassificationbasedonRprogrammedesignedtoidentifykeywordswithcontinuousrefiningofthescriptsDatadisseminationMaindatausersPolicymakers,academics,investorsandcivilsocietyDisseminationchannelWebsiteMainpublicationInova-eplatformPurposeIn2018,BrazillaunchedanambitiousprojecttoimproveitsprocessesforcollectingandcompilingenergyRD&Ddata.Thereasonstoboostthiseffortwereaneedtoguidepublicpolicyandtofillgapsinthecompilationofthesestatistics.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE57IEA.CCBY4.0.InMay2018,duringthepreparationforthethirdMissionInnovationMinisterial,focusedonenhancingdatacollectionofpublicandpubliclyorientedinvestmentinenergyRD&D,Brazilidentifiedagapinhavingarobust,integrated,comprehensiveandstructureddatabasewithalltheinformationrequiredtoproducestatisticsthatcouldguidepublicpolicy.Inparallel,theUnitedNationsECLAClaunchedtheBigPushforSustainabilityin2016.Thiswasanapproachtosupportcountriesinbuildingmoresustainabledevelopmentstyles.Toaccomplishthistransitiontowardssustainability,RD&Dincleanenergyisvital.Forthisreason,theCGEEjoinedforceswithECLAC’sBigPushforSustainabilityinBrazil.Inthiscontext,in2019,ECLAC,theCGEEandtheEPEcreatedtheEnergyBigPushBrazilproject.Onceitwascreated,synergieswereidentified,andtheIEAalsojoinedtheprojectwithinthescopeofitsCleanEnergyTransitionsProgramme.Theprojectwasstructuredaroundfouraxesofactivity,eachwithaspecificobjective:Axis1–Developmentofaprocessforcollecting,structuringandmanagingdataonpublicandprivateinvestmentsinenergyRD&D.Axis2–Surveyoftechnical,economic,socialandenvironmentalperformanceindicatorsassociatedwithlow-carbonenergysolutions.Axis3–Identificationofstrategicguidelinesandkeypolicyinstrumentstoaccelerateinvestmentsinenergyinnovation.Axis4–Innovativeandeffectivecommunicationstrategyofprojectresults,targetedatdecisionmakers.Theworkonaxis1hadmethodologicalsupportfromtheIEAfromthebeginning.Theresultsofthefirstthreeaxeswerepublishedin2020ontheECLACwebsiteandwerealsodisseminatedataneventorganisedbytheIEAwithECLAC,theEPEandtheCGEE.In2020,whenthefirstphaseoftheprojectended,theMinistryofMinesandEnergyinstructedtheEPEtobuildaplatformonitswebsitetomaketheresultsobtainedsofaravailabletoadiverseaudienceandenabletheirannualupdate.Thus,withthetechnicalandfinancialsupportoftheUnitedKingdom’sProsperityFundandtheBrazilianEnergyProgramme,andundertheco-ordinationoftheEPE,executionfromtheCGEEandtechnicalsupportfromAdamSmithInternational,thedigitalplatformInova-ewasdevelopedandlaunchedin2021.InstitutionalarrangementTheEPEandCGEEoverseetheenergyRD&DdatacollectionandcompilationinBrazil.TheEPEisresponsibleforreportingthisinformationtotheIEA.Thereisnospecificlegalframeworkforthisdatacollectionyet.However,theLeideAcessoTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE58IEA.CCBY4.0.aInformaçãoouLeidaTransparência[LawonAccesstoInformationorTransparency]providesproceduresinthisregardtobefollowedbytheunion,states,federaldistrictsandmunicipalitiesinordertoguaranteeaccesstoinformationsuchasgovernmentexpenditures.Thisexcludesinformationforwhichsecrecyisessentialtothesecurityofsocietyandthestate.Insomecases,dataarecollectedfrompubliclyavailabledatasets.Inothercases,collectinginstitutionsrequesttheprojectdatafromthedatasources.Therearenoformalagreementswiththeseinstitutions,anddatasharingisbasedonacollaborativeandvoluntaryframework,formalisedbycontactsatthedirectorlevel.However,workinggroupshavebeenestablishedwiththedataprovidersandtheIEAtoenhancecollaborationandtotrackthatthedevelopmentoftheprojectisinlinewiththeroadmap.Havingthisworkinggroupfromthebeginningoftheprocessisessentialforensuringtheinvolvementandengagementoftheinstitutionsandtheworking-levelcontacts.ThishasallowedcollaborationtovalidatetheclassificationofprojectsaccordingtotheIEAclassificationundertakenbytheEPEeveryyear.Theresourcescarryingoutthistaskare2.5-3FTEs.However,duringthefirsttwoyears,whenalltheprocesseswereestablishedandadatarevisionbacktotheyear2013wascompleted,thenumberofpeopleinvolvedintheprojectamountedto5-6FTEs.FundinginstitutionsandmajorprogrammesDuringthefirsttwoyearsoftheproject,oncethedataneedswereidentified,asignificanteffortwasconductedtocreateanetworkofinstitutions.Sofar,eightinstitutionshavebeenusedasdatasourcesintheprocess.EnergyRD&DfundinginstitutionsandperformersinBrazilDatasourceFundingsourcePerformerFundingAuthorityforStudiesandProjectsNationalScienceandTechnologyDevelopmentFundFundingAuthorityforStudiesandProjectsScienceandtechnologyinstitutionPrivatecompanyNationalCouncilforScientificandTechnologicalDevelopmentNationalScienceandTechnologyDevelopmentFundOtherScienceandtechnologyinstitutionMinistryofScience,TechnologyandInnovationFederalBudgetNationalScienceandTechnologyDevelopmentFundNationalNuclearEnergyCommissionScienceandtechnologyinstitutionTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE59IEA.CCBY4.0.DatasourceFundingsourcePerformerBrazilianElectricityRegulatoryAgencyCompanyCompanyitselfScienceandtechnologyinstitutionAnothercompanyNationalAgencyforPetroleum,NaturalGasandBiofuelsCompanyCompanyitselfScienceandtechnologyinstitutionAnothercompanySiga-Brasil(forNationalNuclearEnergyCommissiondata)NationalBankforEconomicandSocialDevelopmentNationalBankforEconomicandSocialDevelopmentTwocompaniesScienceandtechnologyinstitutionSãoPauloStateResearchFoundationSãoPauloStateTaxRevenueScienceandtechnologyinstitutionSource:UnitedNationsECLAC(2020),OverviewofEnergyInnovationInvestmentsinBrazil:DataforanEnergyBigPush.Collection,classificationandvalidationprocessThedatacollectionsysteminBrazilisstillveryyoung,andwhileitbecamemorematurewiththeEnergyBigPushprocess,itisstillintheprocessofbeingfullyestablished.Asof2022,BrazilhasruntwocyclesandexpectstoestablishanannualcyclealignedwiththeIEARD&Ddatacollectiontimeline.Aspartofthisprocess,BrazilhascreatedacentraldatabasetocontainalltheinformationonRD&Dandestablishedanetworkofinstitutionsaswellasagovernancemodelforthecollection,classificationandverificationprocess.Inparallel,ithascompiledstatisticsbackto2013.Oneofthemainrequirementswhencreatingtheprocesswastocreateamoreautomatisedwayofcollectingandtreatingthedatawhilealsominimisingtheburdenonthedataproviders,aswellasbenefittingfromtheexperiencesofothercountries,internationalstandardsandcollaboration.Themethodologytosetupthisprocesswasafive-stepcycle:1.Identifyinformationneeds(basedontheguidingquestions).2.Gather,extract,transform,cleanandloadthedata.3.Exploreandanalysethedatainformation.4.Buildvisualisationsanddeliverinformation.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE60IEA.CCBY4.0.5.Considerfeedbackandlessonslearnt.Thedatasourcesareacombinationofpublicdatabasesanddatasetspreparedfromdatasourceswithrawprojectdata.Thesedifferentsourcesmighthavedifferentformats,sotheEPEandCGEEhavetoperformnormalisationandclassificationwork.Datacollectionisdoneeitherautomatically,whenthedataarepubliclyavailableandstructuredandcanbeaccessedthroughanautomaticquery,ormanually,byemail,whenthedataarepreparedinafilebythedatasource.Insomecases,thisfilewithrawprojectdatamayincludeprojectsunrelatedtoenergy.Thedatasourcesaremainlyfundingagencies,sothedataareprojectbudgetsandnotactualspending.Theessentialdatathatarecommunicatedarethedataorigin,theprojecttitle,theamountoffunding,andthedateandperiodofexecutionoftheproject.Althoughitischallenging,theCGEEandEPEaretryingtoimplementinparallelabottom-upapproachfordataverification.Thedataarethentransformedandcleanedtofitthedatastructureofthecentraldatabase.TheEPErunsascripttosearchforkeywordsinthetitleanddescriptionofeachprojectinordertocategoriseitaccordingtotheIEAclassification.Insomecases,theoriginaldatasetcontainsonlyenergyprojects,whereasinothercases,thereareprojectsfromvariousdifferentsectors(transport,construction,science,etc.)thatdonotrelatetoenergy.Theuseofkeywordsalsoallowsforfilteringoftheenergyprojectsfromnon-energyprojects.Thereisasetofkeywordsforeverytwo-digitIEAcategory.Theoutputofthescriptisanewcolumninthedatabasewiththetwo-digitcategoryforeachproject.Asthedevelopmentofthiscleaningprocessisstillatanearlystage,itcanleadtoambiguity,suchasclassifyingsomeprojectsintotwoormorecategories.Theuseofthealgorithmfornewdataupdatecycleswillallowtherefinementofthekeywordsusedandwillreducethistypeofambiguity.Thesamemethodologyisappliedtoalltheprojectsandthereisnoprioritisationbasedonthesizeoftheprojectorothercriteria.Afterwards,thisclassificationisvalidatedbyatechnicalenergyanalyst,whosefocusistodisambiguateprojectsthathavebeenallocatedmorethanonecategory.Additionally,theanalystchecksasampleoftherestoftheprojectstoseeifsomemightbemissing.Oncethedataarecleaned,treatedandvalidated,institutionsareaskedtocheckwhetherthevalidationiscorrect.Finally,allthedataareconsolidatedbeforepublicationtorunafinalvalidationofthehigh-levelresults.Thereareroughly16000projectsperyear,onaverage,ontheplatform.Oncetheprocessiscompletelyestablished,Brazilwillfocusonthefollowingimprovementstomaketheprocessmorerobustandefficient:increaseprocessautomationthroughextract,transform,loadTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE61IEA.CCBY4.0.improvethealgorithmstominimisethenumberofprojectsclassifiedinmorethanonecategoryaswellastheneedformanualvalidationimproveclassificationsandkeywordsstrengthenthegovernanceoftheprocessprioritiseothertypesofindicatorstopublishontheplatform.DatamanagementandtechnologyDataextractionfrompublicdatabasesisdoneautomaticallybyscripts.Someofthedatasourcessendfileswithdatasetsofrawdata.AlltheprojectsarefilteredandclassifiedtotheIEAclassificationtwo-digitlevelwithaBooleanalgorithmandkeywords.Then,thecleaneddataarepublishedontheInova-eplatform.TheInova-eplatformisoneofthelonger-termoutcomesoftheEnergyBigPushproject.ThedevelopmentoftheplatformwasfundedbytheProsperityFundoftheUnitedKingdomundertheBrazilEnergyProgramme.TheInova-eprojectaimedtocreateanopenplatformwithdataandanalysisonenergyRD&Dinvestment,withtheviewtoinformpolicymakingandthecountry’senergyinnovationstrategy.TheEPEistheinstitutionresponsibleformaintainingtheplatform,whichhoststhedatacollectedandanalysedthroughtheEBP.DatauseanddisseminationConsolidateddataaremadeavailabletothepublicthroughtheInova-eplatform.Itisusedbymultipleusers,frompolicymakerstoresearchcentresandthegeneralpublic.Infact,sincethecreationofthedatabase,projectdatahavealreadybeenusedtoassistinpublicpolicydecisionmakingintheenergyRD&Darea,suchasinthefollowingexamples:CNPEResolutionNo.2/2021,whichestablishesguidelinesonresearch,developmentandinnovationintheenergysectorinareassuchashydrogen,storage,digitaltransformationandbiofuels,amongothers.TheEPEprovidedtechnicalsupporttotheMinistryofMinesandEnergytopreparetheresolution,basedoninformationfromtheEBPandInova-e.ImprovementoftheNationalAgencyforPetroleum,NaturalGasandBiofuelsTechnicalRegulationNo.3/2015inordertostrategicallyguideitsinvestmentsinRD&Iin2021.PreparationbytheEPEofatechnicalnote,BasesfortheConsolidationoftheBrazilianHydrogenStrategy,asanaidtotheMinistryofMinesandEnergyforthepreparationofResolution6/2021.ThisnotealsousesinformationfromtheEBPandInova-easitpertainstohydrogen.TheEnergyEfficiencyAtlasBrazil2021(ajointpublicationwiththeIEA)useddatafromInova-etoreportthestatusofinvestmentinenergyefficiencyinBrazil.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE62IEA.CCBY4.0.RepresentationsofBrazilininternationalforums,suchasMissionInnovation,includingaworkshoporganisedbytheIEA,WorkingTogethertoEnhanceGlobalRD&DDataCollection,andthepreparationofapodcastreportingtheBrazilianexperienceinthisarea,duringthesixthMissionInnovationMinisterialinSeptember2021.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE63IEA.CCBY4.0.CanadaInstitutionalarrangementReportinginstitutionNaturalResourcesCanada(NRCan)RoleofreportinginstitutionDevelopingpoliciesandprogrammesthatenhancethecontributionofthenaturalresourcessectortotheeconomyConductinginnovativescienceinfacilitiesacrossCanadatogenerateideasandtransfertechnologiesFundingresponsibilitiesofthereportinginstitutionOneofthemajorspendersWaytoformaliserelationshipbetweeninstitutionsNolegalframeworkfortheenergyRD&DdatacollectionbutthecommitmentofseniorofficersCollection,classificationandvalidationprocessTypeofdatacollectionSurveyofinstitutions(federaldepartments/agencies,provincialandterritorialgovernments)TypeofsurveySamesurveyasIEAwithadifferentformatSurveyfrequencyAnnualClassificationIEAclassificationatthesurveystageDatavalidationCollaborationeffortwithfederal,provincialandterritorialsurveyparticipantstoensurecompletenessandavoiddoublecountingDatamanagementandtechnologyDataplatformExchangeofExcelfilesbyemailImplementationofadataplatformassessedanddismissedAdvanceddataanalyticsNoDatadisseminationMaindatausersPolicymakers(e.g.support/renew/launchprogrammesaspartofadecision-makingtool)DisseminationchannelWebsiteMainpublicationNaturalResourcesCanadaEnergyFactBookPurposeCanadacollectsenergyRD&DdataprimarilytosupporttheIEAinitsworkonenergyinnovation.Nationally,thedataareusedinvariousways,suchastosupportthedesignofnewprogrammesthatincludeenergyRD&Dfundingandtoevaluatetheperformanceofcurrentprogrammes,forexample.Inaddition,theTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE64IEA.CCBY4.0.dataareusedtoinformpolicymakersthroughinternalandexternalreportsproducedbyNRCanandothergovernmentorganisations.InstitutionalarrangementCanadahasafederalsystemofgovernancewithonefederal,tenprovincialandthreeterritorialgovernments.NRCanisthefederalgovernmentdepartmentresponsibleforreportingenergyRD&DdatatotheIEA.ItalsorepresentsCanadaattheinternationalleveltomeetthecountry’sglobalcommitmentsrelatedtothesustainabledevelopmentofnaturalresources.NRCanhasthemandatetodeveloppoliciesandprogrammesthatenhancethecontributionofthenaturalresourcessectortotheeconomyandtoconductinnovativescienceinfacilitiesacrossCanadatogenerateideasandtransfertechnologies.Thisfederal/provincialgovernancestructurehasabiginfluenceontheinstitutionalarrangementoftheCanadiansystemtoproduceenergyRD&Dstatisticsassomeoftheenergy-relatedjurisdictionalresponsibilitiesaredividedbetweenfederalandprovincialinstitutionsandothersareshared.ShareofresponsibilitiesbetweenfederalandprovincialinstitutionsinCanadaFederalresponsibilitiesSharedProvincialresponsibilitiesInternationalenergyInterprovincialenergyTradeandinvestmentNuclearenergyanduraniumEnergyresourcesonfederalCrownland,offshoreandnorthof60ºlatitudeRegulationsandstandardsrelatingtoenergyefficiencyEnvironmentalregulationofnewenergyprojects(includingindigenousconsultation)ScientificresearchanddevelopmentOffshorepetroleuminAtlanticAccordAreasInfrastructuresecurityandresiliencyEnergyefficiencyRegulationofnaturalresourcedevelopmentonprovinciallandsLand-useandprojectplanningRoyaltydesignandcollectionIntra-provincialenergyresourceinfrastructure,distributionandstorageElectricitygenerationSource:NaturalResourcesCanada(2021),Canada:EnergyRD&DDataCollectionProcessKnowledgeSharing.OneofthereasonsforNRCantoco-ordinatethisdatacollectioneffortacrossinstitutionsisthatitisalsooneofthemainenergyRD&DfundersinCanada.Nonetheless,thereareaconsiderablenumberofotherfederaldepartmentsandprovincialandterritorialgovernmentsthatfundenergyRD&Dacrossthecountry.Intotal,thereareapproximately30federaldepartmentsandagencies(suchasTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE65IEA.CCBY4.0.EnvironmentandClimateChangeCanada;Innovation,ScienceandEconomicDevelopmentCanadaandNRCanitself)plus13provincialandterritorialgovernmentsfundingenergyRD&Dprojects.Inthiscontext,NRCaninteractswithallthesefederal,provincialandterritorialinstitutionstocollectandcompiletheenergyRD&DdataandsubmitthemtotheIEA.Intheprocessofcompilingstatistics,theygeneratetwodifferentsetsofdata.FederaldataincludeenergyRD&Dprojectsfundedbyfederaldepartmentsandagencies.NRCanco-ordinatesthedatacollectionandcompilationeffortsofaround30departmentsandagencies.Generally,eachfederalparticipantcollectsandconsolidatesatthedepartmentaloragencylevel.Consolidationeffortsvarydependingonhoweachdepartmentoragencyisstructured(e.g.oneconsolidateddatasetversusthreeindividualdatasetsforonedepartment).Priortoconsolidatingallofthefederaldata,NRCantakesseveralstepstoreview,validateandverifytheindividualdatasubmissions.ProvincialdataincludeenergyRD&Dprojectsfundedbyprovincialandterritorialdepartments.Eachprovincialgovernmenthasasimilarstructuretothefederalgovernment,withdifferentministriesmanagingfundingprogrammes.Thereisonedepartmentwithasimilarco-ordinatingroleasNRCanatafederallevelineveryprovincialandterritorialgovernment.Theseco-ordinatorscollectandconsolidatethedatafromalltheministriesintheprovinceorterritory.TheyarethecontactpointsforNRCantocollecttheentireprovincialorterritorialdataset.Insummary,maintainingfederal,provincialandterritorialofficialandworking-levelcontactsisimportanttoensureaccurateandconsistentdatasetsareproducedannually.EnergyRD&DdatacollectionflowsbetweeninstitutionsinCanadaIEA.CCBY4.0.Regardlessofthecomplexityanddiversityofthefederal,provincialandterritorialparticipants,thereisnoobligationforthedifferentinstitutionstocollectandsharetheinformationwithNRCan.However,thecommitmentasacountrytocollaborateTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE66IEA.CCBY4.0.withtheIEAandthegoodrelationshipsbetweendepartmentsandinstitutionsmaketheprocessveryrobust.Toformalisethisprocess,anofficialletterfromthedirectorgeneralofNRCanissenttotheindividualfederaldepartmentsandagenciesandtoallprovincesandterritories.Apartfromthisformalisationoftheprocess,NRCanmakesasubstantialefforteveryyeartoengagewithalltheparticipatinginstitutions.Forexample,NRCanpreparesguidancedocumentsandconductsinformationsessionsforthesurveyparticipantstohelpensureaccurateandconsistentdataarecollected.Inaddition,NRCanalsosharesthedataresultsintheformofapresentationwithalltheparticipants.Inallcasesandregardlessoftheinstitution,thetasksfortheenergyRD&Ddatacollectionaredoneusinginternalresourcescoveredbythebudgetsofeachinstitution.Thereisnorole100%dedicatedtothesetasks,and,consideringthenumberofinstitutionsinvolved,itisdifficulttoestimatetheFTEperyearneededtocarryoutthedatacollection,processinganddissemination.FundinginstitutionsandmajorprogrammesTheCanadianenergyRD&Ddatacoversthefollowingfivemainfederalfunders.EnergyRD&DmajorfundingfederalinstitutionsandprogrammesinCanadaFundinginstitutionMajorprogrammesNaturalResourcesCanadaProgramofEnergyResearchandDevelopmentEnergyInnovationProgramImpactCanadaInitiative–CleanTechnologyChallengesCleanGrowthProgramGreenInfrastructure–SmartGrid,Buildings,ElectricVehiclesInfrastructure,CleanEnergyforRuralandRemoteCommunities)CanadianEmissionsReductionInnovationNetworkBreakthroughEnergySolutionsCanadaAtomicEnergyofCanadaLimitedRevitalisationoftheChalkRiverLaboratoriesFederalNuclearScienceandTechnologyWorkPlanSustainableDevelopmentTechnologyCanadaSustainableDevelopmentTechFundNationalResearchCouncilCanadaR&DprogrammesIndustrialResearchAssistanceProgramTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE67IEA.CCBY4.0.FundinginstitutionMajorprogrammesNaturalSciencesandEngineeringResearchCouncilofCanadaDiscoveryResearchResearchTrainingandTalentDevelopmentResearchPartnershipCollection,classificationandvalidationprocessAsdescribedintheprevioussection,NRCanistheco-ordinatorofthecollectioneffortsofCanada’senergyRD&Ddata,anditcompilesandvalidatesthedatabeforefillingandsubmittingtheIEAquestionnaire.ItdoesthisonanannualcycleusingtheIEAquestionnaireasasurveyforalltheinstitutions.EachsurveyedinstitutionisresponsibleforclassifyingeachprojectintotheIEAcategories.NRCancollectsthetemplatesfilledwithdataandvalidatesthem,contactingtheinstitutionswhennecessarytoresolveanydoubtsorinconsistencies.TimelineoftheCanadiandatacollectionprocessIEA.CCBY4.0.Source:NaturalResourcesCanada(2021)Canada:EnergyRD&DDataCollectionProcessKnowledgeSharing.Thedatacollectionisdoneintwoparallelsteps,oneforfederalinstitutionsandoneforprovincesandterritories.NRCanlaunchesthesurveyinOctoberforthefederalinstitutionsandinNovemberforprovincesandterritories.Thesurveyissentinanemailfromthedirectorgeneral’sofficetoanotherseniorofficerofasimilarlevelinthesurveyedinstitution.Working-levelcontactsarealsoincludedinthecommunication.Thiscommunicationconsistsofaformalletteraskingforassistancetosucceedonanewdatacycle.Inthisemail,theIEAsurveytemplate,withsomere-formatting,isattachedwithsomeadditionaldocumentationtohelpguidethesurveyparticipants:ataskletter,supplementalguidanceandafrequentlyaskedquestionsdocument.ThesupplementalguidanceisashortmanualthatisintendedtohelpparticipantsnavigatethroughthefullIEARD&DManual.NRCanalsocreatesthefrequentlyaskedquestionsdocumenttoprovideresponsestoquestionsthathavecomeupinpreviousyearsofconductingthedatacollectionefforts.ThequestionsareeitherTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE68IEA.CCBY4.0.broadincontentorapplyonlytosomeparticipants.Thefrequentlyaskedquestionsareupdatedeachyearasnewquestionsarise.Rightafterlaunchingthesurvey,NRCanarrangesseveralinformationsessions.Forfederalparticipants,therearetwosessions,oneforNRCanandoneforothergovernmentdepartments.Forprovincialandterritorialparticipants,therearetwosessions,oneinEnglishandoneinFrench.Inthesemeetings,NRCanexplainstheprocesstothepeoplewhowillpreparethedataandcompletethesurveyineachinstitution,highlightingthemaintopicsdiscussedduringthepreviouscycleandclearlydescribingwhattodoandwhen.NRCanfindsthesesessionsveryproductive.Infact,manyquestionsinthefrequentlyaskedquestionsdocumentcomefromthesemeetings,especiallyasrespondentscanaskspecificquestionsinone-to-oneconversationswithNRCan.Anotherkeyobjectiveoftheinformationsessionsistoco-ordinatethereportingandavoiddoublecountingamongthefederal,provincialandterritoriallevels.Eachparticipantisresponsibleforreportingtherelevantexpendituresfortheirinstitution.However,whentherearetransfersoffundsbetweeninstitutions,reportingfundscanbetricky.Inthecaseoffederalparticipants,theyfollowrulestoavoidorminimisedoublecounting:Donotincludefundsthattheinstitutiontransferredtootherinstitutions,asthosefundsaretobereportedbytherecipient.Includefundsreceivedbytheinstitutionfromotherinstitutions.Eachdepartmentandagencycandecidehowtocollectthedatatoadapttheprocesstotheparticularitiesoftheirdepartment.NRCanprovidesguidanceintermsofhowbesttocollectthedata,butthenitisuptotheinstitutionstofollowtheseguidelinesandadaptthemtotheirspecificneeds.AsNRCanhaslessvisibilityoftheinternalrealityandprocessesofdifferentprovinces,itstickstotheco-ordinatorrole.Inadditiontotheeffortstoco-ordinateandclarifythereportingatthebeginningofthecycle,NRCanalsocarriesoutavalidationprocess.Itisaniterativeprocesswitheachrespondentduringwhichtheyexchangeinformationtoclarifyeverydetailandensuredataaccuracy.Dependingonthestructureofaprogramme,capturingenergyRD&Dexpendituresmaybeachallengingtask.Forsomerespondents,energyprojectsarerelativelyeasytoreport,whileothershaveahardtimepickingoutenergyprojectsintheirvastarrayofsupportedsectors.Forthisreason,itisimportanttoworkcloselywitheachdepartmentandagencytovalidateandverifywhatiswithinthescopeoftheIEAdefinitionsandtoprovideassistanceregardingthescopeofdatacollection,typesofexpendituresandtechnologyandcategorydefinitions.Furthermore,thevalidationandverificationprocesscansometimesinvolveevaluatingprojectstoensureexpendituresarewithinthescopeoftheIEAdefinitions.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE69IEA.CCBY4.0.Themainvalidationchecksarethefollowing:comparingwiththepreviousyear’ssubmissiontoidentifytrendsandoutlierscomparingthepreviouslybudgetedexpendituresagainsttheactualexpendituresforthesameyearvalidatingbudgetedorestimatedamountsthroughbudgetorotherannouncements.Onceallthesurveysarecompletedandverifiedwiththerespondents,allthetemplatesarelinked,andtheresultsareconsolidated.Finally,NRCanrunschecksoftheaggregateddatatoensurecompleteness.Theentireprocessissubjecttocontinuousimprovementso,afterthesubmissioneveryyear,theprocessisevaluatedandadapted.Forinstance,theentiresurveypackage(anofficialletterandvariousguidancedocuments)isrevisedandupdatedeachyear,andvirtualmeetingsareheldwithsomerespondentstohelppreparefortheupcomingsurveycycle.Inconclusion,therearevariouscommunicationstakingplaceannuallytohelpbetterCanada’sreportingefforts.DatamanagementandtechnologyThereisnocentraldatabaseacrossfederal,provincialorterritorialgovernments.Forthisreason,theexchangeofinformationbetweendifferentinstitutionsisdonebyemailusinganExcelsurvey.DatadisseminationOneofthekeyactionsidentifiedtosucceedeveryyearinthisprocessissharingdataresultswithalltherespondentsafterconsolidatingthefederal,provincialandterritorialdata.Theresultsaresharedintheformofapresentation,includingthecountryrankingandtheresultsbytechnology.Sharingtheresultsprovidesanopportunitytostrengthenlinksbetweeninstitutions,remindrespondentsofthenextyear’ssurveycycleandaddressanyquestionsorconcernsthatrespondentsmayhave.Additionally,someinstitutionsusetheresultsfortheirownprioritisationandbenchmarkingwhendesigningenergyRD&Dprogrammesandotherpolicy-relatedexercises.TheinformationisalsousedinternallyinNRCanforabreakdownofthespending.Theyusethedatatomakeinformeddecisionswhendefiningandlaunchingnewprogrammesandtopreparereportsevaluatingtheperformanceofthespendingorinforminghigh-rankingofficers.Additionally,theconsolidatedfiguresarepublishedintheEnergyFactBook,whichNRCanpublisheseveryyearonitswebsite.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE70IEA.CCBY4.0.CzechRepublicInstitutionalarrangementReportinginstitutionDepartmentofStrategyandInternationalCooperationinEnergyoftheMinistryofIndustryandTradeRoleofreportinginstitutionResponsibleforthenationalindustrypolicies,energypolicies,tradepolicies,exportpromotionpolicies,integratedrawmaterialspoliciesandtheuseofmineralresourcesFundingresponsibilitiesNofundingresponsibilitiesWaytoformaliserelationshipbetweeninstitutionsLegislationofActNo.130/2002CollcoverstherequirementtosubmitinformationonresearchprojectsreceivingpublicfundingCollection,classificationandvalidationprocessTypeofdatacollectionPublicdatabaseDataextractionProjectdataFrequencyofdataextractionAnnualClassificationClassificationdonebytheco-ordinatingteamusingkeywordsDatavalidationContinuityofspendingHigh-levelfiguresDatamanagementandtechnologyDataplatformSTARFOSalreadyoffersacentraliseddatabaseforRD&Dprojects.AdvanceddataanalyticsNoDatadisseminationMaindatausersMinistriesandperformersDisseminationchannelWebsiteMainpublicationStatisticsonResearchandDevelopmentExpenditureintheFieldofEnergyforthePurposeofInternationalEnergyAgency(IEA)QuestionnaireProjectsarealsoavailableinSTARFOSPurposeTheCzechRepublic,asamemberoftheIEA,isrequiredtoreportselectedstatisticaldataintheformofquestionnaires,oneofthequestionnairesbeingTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE71IEA.CCBY4.0.focusedonenergyRD&D.Forthepurposeofthepreparationofstatisticaldataforthisquestionnaire,analysisonRD&Dexpenditureshasbeencarriedoutsince1996.InstitutionalarrangementEnergyRD&DdataarecollectedbytheDepartmentofStrategyandInternationalCooperationinEnergyoftheMinistryofIndustryandTradeoftheCzechRepublic.InthenationalRD&Dlandscape,therearefourmainactors:theMinistryofEducation,YouthandSports;theMinistryofIndustryandTrade;theCzechScienceFoundationandtheTechnologyAgencyoftheCzechRepublic.However,projectsaresupportedmainlybyfundsmanagedbytheTechnologyAgencyoftheCzechRepublicthroughspecificprogrammes.Thisagencymaintainsapublicdatabase,STARFOS,withinformationonalltheRD&Dprojectsreceivingpublicfunds.Anyperformerreceivingpublicfundsisrequiredtoinputsomeinformationintothispublicdatabase.Forthisreason,theMinistryofIndustryandTradeandtheTechnologyAgencyoftheCzechRepublicactivelycollaborateontheenergyRD&Ddatacollection,validationanddisseminationprocess.Sincetheinformationispubliclyavailable,thereisnospecificlegalbasisforthiscollection.However,ActNo.130/2002Collandothersecondarylegislationsformalisethedatacollectionrequirementsonresearchprojectswhenpublicfinanceisinvolved.In2018,whentheCzechRepubliccarriedoutaprojecttocompilethestatisticsbackto1996,thereweretwopeopleintheministryworkingontheproject.Fortheannualrevision,thenumberofFTEsintheministryisconsiderablysmaller.However,theefforttocreateandmaintainthepublicdatabasesSTARFOSandISVAVissupportedbyadditionalFTEsattheTechnologyAgencyoftheCzechRepublicandtheResearch,DevelopmentandInnovationCouncil.Collection,classificationandvalidationprocessIn2018,theCzechRepublicrevisedtheenergyRD&Ddatabackto1996.Duringthisprocess,theymappedtheenergyRD&Dlandscape,developedamethodologyandcreatedapowerfulnetworkwiththeTechnologyAgencyandtheResearch,DevelopmentandInnovationCouncil.TheCzechRepubliccarriesoutanannualprocesstocollectenergyRD&DdataandreportittotheIEA.ThisannualcycleisinfactalignedwiththeIEAdatacollectioncycle.Assoonasthedataareavailable,theMinistryofIndustryandTradestartsthefollowingprocess.First,theydownloadalistofprojectsfromthedatabaseSTARFOS,around300projectsperyear,usingkeywordstofilterenergyprojects.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE72IEA.CCBY4.0.KeywordsusedforfilteringEnergy,nuclear,nuclearenergy,non-nuclearenergy,electricity,grids,heating,reactor,combustion,cogeneration,co-combustion,heat,naturalgas,gas,gaseous,network,hydrogen,fuel,fuels,storage,distribution,transmission,electromobility,photovoltaics,bioenergy,biomass,biofuels,waste,smart,radioactiveInthisprocess,theTechnologyAgencyoftheCzechRepublic,whichhasdirectaccesstobackgrounddataintheSTARFOSdatabase,collaborateswiththeministrytoprovidethesplitbetweentheeligiblecostandtheamountofpublicsupport.Inadditiontothesetwofigures,theavailableinformationinthedatabaseusedintheprocessisbasicinformationabouttheinstitutionperformingtheresearch,theprojectsolutiontime,theprogrammeunderwhichtheprojectisfunded,thepublictendernumberandtheR&Dcategoryfield,etc.TheTechnologyAgencyisthemainfundingbodyandtheownerofthemostrelevantfundingprogrammes.However,someothersourcesoffundingarenotincludedinthedata,whichcoverapproximately80%ofthenationalpublicfunding.Asanextstep,theprojectsareclassifiedaccordingtotheIEAcategories.Initially,theprojectsaredividedintotwobigcategoriesaccordingtothenationalclassification:nuclearenergyandnon-nuclearenergy.Theco-ordinatingteamattheministryclassifiestheprojectsonebyone,readingtheirtitlesandabstracts.Inthisprocess,theministryalsoreceivesassistancefromtheTechnologyAgencytohelpclassifycertainprojects.TheCzechRepublicreportstotheIEAthepublicsupportfiguresasthegovernmentRD&DbudgetandthedifferencebetweentheeligiblecostandthepublicsupportastheprivatesectorRD&Dbudget.Oncethedataarecompiled,theyarevalidatedbycomparingthedataoftheyearofstudywiththepreviousyearintermsoforderofmagnitude.Additionally,theministryperformspredictionsbasedonliveprojectsthatarealsousedtoverifythecompletenessandaccuracyofthedata.Oncethedataarevalidated,theIEAquestionnaireiscompletedandsubmitted.TheMinistryofIndustryandTradeiscurrentlyassessingthepossibilityofaskingresearcherstoclassifytheirprojectsaccordingtotheIEAclassificationandincludethisfieldinthepublicdatabases.Thiswouldconsiderablymodifytheprocessofaskingforpublicfundsforresearch,asitwouldrequirechangingthestructureoftheSTARFOSdatabase.Thesetypesoftransformationprojectsareproposed,assessedandperformedinfive-yearnationalplans.ThenextprogrammeintheCzechRepublicisData2between2023and2028.Fornow,theCzechRepublicreportsdemonstrationprojectswithR&Dbudgets,andRD&Dbystate-ownedenterprisesarenotincluded.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE73IEA.CCBY4.0.DatamanagementandtechnologyInformationonmostoftheRD&DprojectsintheCzechRepublicispubliclyavailableintheSTARFOSandISVAVdatabases.Thisgeneratesanefficientdatacollectionmethodologyasthesetwodatabasescentralisetheinformationfrommanyperformers(researchcentresanduniversities,etc.).STARFOSisafull-textsearchengineforprojectsandresultsinthefieldofresearch,experimentaldevelopmentandinnovationsthathavebeensupportedbypublicfundsoftheCzechRepublic.ThedatasourceistheInformationSystemofR&DoperatedbytheOfficeoftheGovernmentoftheCzechRepublic.Thedataareupdatedeverynight.DatadisseminationThedataaredisseminatedattheendofthecycle.Theproject-leveldataarealreadyavailableinthedatabasesmentionedintheprevioussection.Additionally,theministrydisseminatesthedatareportedtotheIEAwithashortanalysisinadocumentonitswebsite.Eventhoughitispubliclyavailable,themainusersforthedataaregoverningbodies(mainlytheMinistryofEducation,YouthandSports,theMinistryoftheEnvironmentandtheMinistryofIndustryandTrade)andthestatisticsoffice.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE74IEA.CCBY4.0.EstoniaInstitutionalarrangementReportinginstitutionMinistryofEconomicAffairsandCommunicationsRoleofreportinginstitutionCreatingoverallconditionsforthegrowthofcompetitivenessoftheEstonianeconomyFundingresponsibilitiesMainfundinginstitutionWaytoformaliserelationshipbetweeninstitutionsNoneedasthedataarepubliclyavailableCollection,classificationandvalidationprocessTypeofdatacollectionPublicdatabaseDataextractionProjectdatafilteredbyenergy-relatedkeywordsFrequencyofdataextractionAnnualClassificationIEAclassificationdoneprojectbyprojectbytheco-ordinatingteamDatavalidationFewprojectssovalidationnotindispensableDatamanagementandtechnologyDataplatformCompleteETISdatabaseExcelspreadsheettoclassifytheprojectsAdvanceddataanalyticsNoDatadisseminationMaindatausersPolicymakersformoredetaileddatathantheIEAclassificationDisseminationchannelNospecificdatadisseminationforenergyRD&DdataMainpublicationNospecificpublicationforenergyRD&DdataPurposeEstonia,asamemberoftheIEA,isrequiredtosubmitarangeofenergy-relatedstatisticstotheagency,includingthequestionnaireonenergyRD&Ddata.InordertocreateseparatenationalstatisticsonenergyRD&D,furtherdiscussiononthecreationofarelatedparametersdatabaseanditsfinancinginthelongtermwouldbeneeded.InstitutionalarrangementTheEnergyDepartmentoftheMinistryofEconomicAffairsandCommunicationsistheinstitutioninchargeofcompilingtheenergyRD&DstatisticsandsubmittingTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE75IEA.CCBY4.0.themtotheIEA.Thisministryisinchargeofdesigningandimplementingnationaldevelopmentplans.TheydonotcarryoutdatacollectionactivitiesforenergyRD&Dbecausethedataarealreadypubliclyavailable,sotheyconsolidatethemfromtheexistingdatabase.TheResearchInformationSystem(ETIS)wasestablishedbytheEstonianMinistryofEducationandResearchandismaintainedandoperatedbytheEstonianResearchCouncil.Theresearchersarerequiredtofillinthedatawhengettingpublicfundsfortheirresearch.ETISgathersinformationonresearchanddevelopmentinstitutions,researchers,researchprojectsandvariousresults.ETISisalsoaninformationchannelforsubmittingandprocessinggrantapplicationsandforsubmittingandvalidatingprojectreports.Toworkwithamoredetailedsample,theMinistryofEconomicAffairsandCommunicationsasksannuallyforadataextractionincludingonlyenergyprojects.Thereisnolegalbackgroundmakingthiscommunicationcompulsory,otherthanthemissionofETIStodisseminatepublicinformationonresearchactivitiesinEstonia.ETISistryingtobroadenthescopeofthesystemandisintendedtobecomeameetingpointandcentralsourceofinformationfortheRD&DlandscapeinEstonia.Itis,thus,workingtoincludemoreinformationonprivatelyfundedRD&Dprojects.Additionally,therearesomesmallprojectswithpublicfundsgiventoconsultancieswhennoresearchcentresareavailablethatarecurrentlynotincludedinthedatabasebutshouldbeinthefuture.FundinginstitutionsandmajorprogrammesTheEstonianenergyRD&Ddatacoversthefollowingmainfundinginstitutionsandprogrammes.EnergyRD&DfundinginstitutionsandmajorprogrammesinEstoniaFundinginstitutionMajorprogrammesMinistryofEconomicAffairsandCommunicationsNationalDevelopmentPlanoftheEnergySectoruntil2030MinistryofEducationandResearchEstonianResearchCouncilRITA–SupportforsectoralR&DMobilitasPlussNUTIKAS–AppliedresearchinsmartspecialisationgrowthareasTeamMe+TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE76IEA.CCBY4.0.Collection,classificationandvalidationprocessOnceayear,whentheIEAsendstheenergyRD&Dquestionnaire,theResearchInformationCentreextractsdatafromETISfilteringalltheenergy-relatedprojectsandsendsthemtotheenergydepartmentintheMinistryofEconomicAffairsandCommunications.ETISisaverydetaileddatabase,andtheextractionincludeslargeamountsofinformationforeachproject,suchasthetitleandabstract,theclassificationsaccordingtotheCommonEuropeanResearchClassificationSchemeandtheFrascatiManual,andthefundinginstitutionandperformer.ResearchersdonotclassifytheirprojectsaccordingtotheIEAclassification,mainlybecausethedatabasehasabroaderscopethanenergy.OncetheExcelspreadsheetwiththeextractionisreceived,theministrygoesprojectbyproject,readingthetitlesandtheabstractstoclassifythem.Oncealltheprojectsareclassified,theyinputthedataintotheIEAquestionnaire.Thismethodologyismanageablebecausethereareonly50-100projectsayear(65in2020)thatfallinthescopeoftheIEAquestionnaire.Thisworkiscarriedoutannuallybyonepersonandtakeslessthanaweek.Thedatabaseincludesthemoneyprovidedtotheprojecteachyearandaforecastofthebudgetedmoneyforfutureyearsinmulti-yearprojects.Thisway,itispossibletovalidatetheextractionthefollowingyearbycomparingitwiththepreviousyear’sbudget.Inanycase,consideringthesmallsampleofprojectsinthescopeandthedetaileddescriptionofeachprojectinthedatabase,thedataqualityishighandtheResearchInformationCenterhardlyeverhastobeconsultedtodiscussorsolveanyissues.Currently,theministrycannotdifferentiateaccuratelybetweendemonstrationprojectsandR&D.Unlessclearlystatedinthetitleordescription,aprojectisnotclassifiedasademonstration.Regardingstate-ownedenterprises,twomainonesareidentifiedbecausetheyappearasthefinancinginstitutionsinthedatabase.TheseareEestiEnergiaandElering.TheoverallprocessisrobustandsimpleduetothesmallnumberofprojectscoveredperyearandthegoodworktooperateandmaintainthepublicdatabaseofalltheRD&Dactivityinthecountry.DatamanagementandtechnologyThesourceoftherawdataisanonlinepublicdatabase.Researchersneedtoinputtheinformationontheirprojectswhentheyreceivepublicfunds,andthisinformationisopentothepublic.TheprocessingisdoneonanExcelspreadsheetusingtheresultsofaquerytoETIStoextractonlytheenergy-relatedprojects.Thereisnoanalyticalmethodorscripttoclassifyprojects,andthisisdonemanually.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE77IEA.CCBY4.0.AsEstoniaisasmallcountrywithalimitednumberofresearchersintheenergyfield,anenergy-onlyspecificdatabasewouldnotberelevant.Thereare,however,areasforimprovementintheexistingsystemthatcouldmakeitmorerelevanttothecollectionofenergyRD&Ddata.DatadisseminationRegardingdatadissemination,EstonianinstitutionsdonotusetheIEAclassification,andtheyundertaketheprocessonlytofulfilinternationalcommitments.TheyusuallyneedtododetailedanalysesonspecificRD&Dtopicstoinformpolicymakers,andforthis,theyneedtogobacktothesourceandworkwithamorerefineddataextraction.SomeoftheseanalysescanbefoundonthewebsiteoftheMinistryofEconomicAffairsandCommunications.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE78IEA.CCBY4.0.FranceInstitutionalarrangementReportinginstitutionMinistryforEcologicalTransitionDepartmentofDataandStatisticalStudiesRoleofreportinginstitutionResponsibleforpreparingandimplementingthegovernment’spolicyinthefieldsofsustainabledevelopment,climate,energytransitionandbiodiversityFundingresponsibilitiesofthereportinginstitutionNofundingresponsibilitiesWaytoformaliserelationshipbetweeninstitutionsNospecificlegalframeworkGoodcollaborationbetweenpublicandsemi-publicinstitutionsandtheministryCollection,classificationandvalidationprocessTypeofdatacollectionStructuredsurveyTypeofsurveyIEAquestionnaireSurveyfrequencyAnnualClassificationIEAclassificationalreadyinthesurveyDatavalidationCheckforbreaksinthetimeseriesattheaggregatedandtechnologicallevelsDatamanagementandtechnologyDataplatformExchangeofExcelfilesbyemailAdvanceddataanalyticsNoDatadisseminationMaindatausersGovernment,publicDisseminationchannelWebsiteMainpublicationPublicSpendinginEnergyR&Din2020-SharpIncreaseinFundingforNewTechnologyPurposeFrancecollectsenergyRD&Dtoassessinnovationinthefieldofenergytechnology,inadditiontothesubmissiontotheIEA.ThedataareusedtoinformpolicymakersandthepublicthroughreportsproducedbytheMinistryofEcologicalTransition.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE79IEA.CCBY4.0.InstitutionalarrangementInFrance,theenergyRD&DdatacollectioniscarriedoutannuallybytheDepartmentofDataandStatisticalStudies(SDES)oftheMinistryofEcologicalTransition.Theministryisresponsibleforimplementingpoliciesinthefieldsofsustainabledevelopment,climate,energytransitionandbiodiversity,andtheSDESisresponsibleforthemonitoringofdataonhousing,construction,transport,energy,environmentandsustainabledevelopment.TheministryitselfdoesnotfundenergyRD&Dalthoughthiswasthecaseinthepast.TheSDEScollectsdatafromaround13institutions.ThereisnospecificlegalframeworkfortheenergyRD&Ddatacollection,butasallthesurveyedinstitutionsarepublicorsemi-public,thecollaborationbetweentheministryandtheinstitutionsisclose,whichmakesiteasiertocollectthedata.TheSDEShasgoodrelationshipswiththesurveyedinstitutions,whichtheyconsidercritical.Theinstitutionsanswerquicklyandgiveexplanationsonchangesorrevisionsintheirdatawithoutbeingqueried.Thereisacustomapproachtoeachinstitution.ThedatacollectionwaspreviouslymanagedbytheDirectorateGeneralforEnergyandClimatesotherewasalreadyanexistingsystemwhentheSDESinheritedtheprocess.FundinginstitutionsandmajorprogrammesFrancehasidentifiedasthemainfundinginstitutionsthefollowing13publicscientificandtechnicalinstitutions,industrialandcommercialinstitutions,publicinterestgroupsorpublicfundingprogrammes.EnergyRD&DfundinginstitutionsandmajorprogrammesinFranceFundinginstitutionAgencyforEcologicalTransitionNationalAgencyforRadioactiveWasteManagementNationalResearchAgencyPublicInvestmentBank(BPIFrance)FrenchGeologicalSurveyNationalCentreforScientificResearchScientificandTechnicalCentreforBuildingAlternativeEnergiesandAtomicEnergyCommissionFrenchInstituteofPetroleumandNewEnergiesTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE80IEA.CCBY4.0.FundinginstitutionRadioprotectionandNuclearSafetyInstituteFrenchResearchInstituteforExploitationoftheSeaNationalResearchInstituteforAgriculture,FoodandEnvironmentGustaveEiffelUniversity(formerlyFrenchInstituteofScienceandTechnologyforTransport,DevelopmentandNetworks)NationalInstituteofAgriculturalResearchCollection,classificationandvalidationprocessTheSDESstartstheprocesseachyearbysendinganemailinApriltotheinstitutionsidentifiedasactiveinpublicenergyRD&Dfunding.ThisemailincludestheIEAquestionnaireaswellastheEnergyRD&DManual.ThedeadlineforreplyingtotherequestistheendofJuneorbeginningofJuly.Itissometimesrequiredtosendreminders,butthereareusuallynoissueswithinstitutionssubmittingdata.Theprocessusuallytakesaroundamonthandahalfspreadoverseveralmonths.Anestimatedtotalof0.2FTEsisattributedtothisactivity.Revisionstothedataarequiterare,buttheydohappenonoccasion.Forexample,therewasarevisionoftheNationalCentreforScientificResearchdatainordertobetterreflectitsenergyRD&Dfunding.Itsubmittedarevisionstartingfromthebeginningofthe2010s,andtheministryestimatedtherevisionforthepreviousperiodstartingfrom2002.Thevalidationprocessoccursfirstwhenreceivingthedatafromaninstitution.TheSDEScomparesthedatawiththepreviousyear.Iftherearebreaksinthetimeseries,itaskstheinstitutionformoreinformation.Thereisalsosomecheckingdonetomakesureanitemhasnotbeenwronglyattributedtoonetechnology.Thiscanbetrackedbylookingatbreaksinthetimeseriesforspecifictechnologies.OnedifficultythatinstitutionssometimesencounterismeetingthelevelofdisaggregationrequiredbytheIEAquestionnaire,aswellasattributingthedatatotherightcategory.Sometechnologies,forexample,donotfitwellintotheIEAclassificationandhavetobeputinthe“unallocated”category.Thisisthecaseforcertaintechnologiesrelatedtoinformationandcommunicationtechnologyorenergyefficiency,forexample.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE81IEA.CCBY4.0.Thefinalcoverageatthenationallevelisestimatedtobequitecomplete.TheSDESisnotawareofanyotherrelevantinstitutionsthatshouldbeincluded.Forthe2021data,alloftheorganisationssurveyedcompletedthequestionnaire.TheNationalResearchInstituteforAgriculture,FoodandEnvironmentdidnotrespondfrom2014to2021(fordatafrom2013to2020).AstheinstituteisundertheMinistryofAgricultureandnottheMinistryforEcologicalTransition,theSDEShaslessleveragetoobtainananswer.So,itsdatawereestimatedsince2014(concerningdatafrom2013).However,thisonlyrepresentsabout0.3%ofthetotalfunding.Thedataattheregionallevelarecurrentlynotincluded.ThereisprobablyexistingfundingthatisnotcoveredbecauseregionsalsohavethemandatetofundR&D.Inordertolaunchanynewstatisticalsurvey,theywouldhavetogothroughtheNationalCouncilforStatisticalInformationtojustifyhowusefulthecollectionis.Thethreestate-ownedenterprises,RéseaudeTransportd’Électricité,ÉlectrictédeFranceandOrano,arecurrentlynotincludedbecauseofsecrecy.Theycannotpublishcompanydataifitisforlessthanthreecompaniesorifonecompanyamountstomorethan85%ofthetotal.Theadditionofstate-ownedenterprisedataisnotplannedintheshortterm.DatamanagementandtechnologyInFrance,theexchangeofinformationbetweendifferentinstitutionsisdonebyemailusingtheExcelsurvey.DatadisseminationTheSDESpublishesareport,LesDépensesPubliquesdeR&DenÉnergie,everyyeartopresenttheenergyRD&Ddata.TheMinistryofEcologicalTransitionusesthereportpublishedeachyearforpolicymaking.Itisalsousedbythemediatoreportonthesubject.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE82IEA.CCBY4.0.HungaryInstitutionalarrangementReportinginstitutionMinistryforTechnologyandIndustry(TIM)StateSecretariatforEnergyandClimatePolicyDepartmentforStrategicPlanningandProgrammingNationalResearch,DevelopmentandInnovationOffice(NRDIO)RoleofreportinginstitutionMinistryforTechnologyandIndustry:ManagesandimplementsdomesticenergypoliciesandprovidesdatatotheIEANRDIO:SupportsthescientificandinnovationecosystemandprovidesdatatotheMinistryforTechnologyandIndustryFundingresponsibilitiesofthereportinginstitutionNRDIOisamajorRD&DfunderWaytoformaliserelationshipbetweeninstitutionsNon-energyR&DdataaretypicallycollectedandprovidedtotheEuropeanUnionandinternationalorganisationsbytheHungarianEnergy&PublicUtilityRegulatoryAuthority,regulatedbyActNo.LXXXVIof2007onElectricEnergy.ThenationalreportonGHGEmissionsandClimateChangeissetinGovt.DecreeNo.278of2014(XI.14).Collection,classificationandvalidationprocessTypeofdatacollectionPublicandprivatedatabasesContactsDatacollecteddirectlyfromperformersClassificationInternalclassificationsDatavalidationDatavalidatedusingdatafromtheHungarianCentralStatisticalOfficeDatamanagementandtechnologyDataplatformNRDIOmanagesacentraldatabaseandaplatformtorequestRD&DfundingAdvanceddataanalyticsFilteringbyfieldsofscienceclassification(tier1-3)DatadisseminationMaindatausersPolicymakersDisseminationchannelsEvents,newslettersTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE83IEA.CCBY4.0.DatadisseminationMainpublicationsNationalEnergyStrategy2030NationalEnergyandClimatePlanNationalCleanDevelopmentStrategy2020-2050EnergyResearch,DevelopmentandInnovationinHungaryPurposeTheenergyRD&DstatisticsarecompiledinHungarymainlytoassistpolicymakersinadvisingthegovernment.TheNationalResearch,DevelopmentandInnovationOffice(NRDIO)performsadhocdataextractionstoinformthegovernmentonspecifictopicsandtechnologiesondemand.Inaddition,dataareusedtopreparereportsonenergystrategy.InstitutionalarrangementTheinstitutionresponsibleforthedatacollectionandcompilationistheNRDIO.TheDepartmentofStrategicPlanningandProgramming,undertheStateSecretariatforCircularEconomicDevelopment,EnergyandClimatePolicyintheMinistryofInnovationandTechnology,co-ordinatestheenergyRD&DdataandreportsittotheIEAintheannualcycle.Additionally,theHungarianEnergyandPublicUtilityRegulatoryAuthorityandtheHungarianCentralStatisticalOfficearealsoinvolvedinenergydatacollection(non-RD&D)andRD&Ddata(notlimitedtoenergy).TheseinstitutionsarecurrentlyworkingtoaligntheirinternaldatabaseswiththeNRDIOtofacilitatetheexchangeofdataandfindsynergiestotrackenergyRD&Dinitiatives.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE84IEA.CCBY4.0.FundinginstitutionsandmajorprogrammesTheNationalResearchandInnovationfund,asanumbrellaschememanagedbytheNRDIO,doesnotsetoutprogrammesorsub-fundsdedicatedtoenergy.However,itisthemanagingbodyforthefollowingprogrammes.EnergyRD&DfundinginstitutionsandperformersinHungaryFundinginstitutionMajorprogrammesNRDIONationalResearchandInnovationfund(forgeneralRD&D)FundedbytheMinistryforInnovationandTechnologyfromGreenEconomyFinancingSystems(managedbytheNRDIO)in2020ImplementationofDevelopmentProjectsImprovingtheStabilityandResilienceofPowerGridsThroughInnovationImplementationofDevelopmentProjectsAimedattheConversionofExcessCarbon-FreePowertoGas(Hydrogen,Biomethane)withInnovativeTechnologyEnsuringEnergySupplytoSettlementsUsingAlternativestoNaturalGasSupply,AdvancedTechnologiesandResilienceServicesPilotProjectPromotingtheEstablishmentandOperationofEnergyCommunitiesFundedbytheMinistryforInnovationandTechnologyfromtheEnergyandClimatePolicyModernisationSystem(managedbytheNRDIO)in2021TheImplementationofDevelopmentsfortheRecovery,StorageorMarket-BasedUseofWasteHeatThroughInnovativeStorageorConversionTechnologiesTheImplementationofDevelopmentsPromotingInnovativeElectrochemicalStorageofSurplusCarbon-FreeElectricityCollection,classificationandvalidationprocessTherearemultiplesystemsandprocessesinplacedependingonthefundingagencyandprogramme.FortheprojectsfundedbytheNRDIfund,applicantsfilloutstandardformswithproject-leveldatawhentheyrequestfunding.ThesedataarestoredinadatabasemanagedbytheNRDIO.Theprojectsarenotenergyexclusive,sodatamustbefilteredtocompileenergyRD&Dstatistics.Tofilterandclassifyeachproject,theNACERev.2codesandkeywordsareused.Someotherrelevantfieldsofthedatabasesusedfortheirinternalprocessesare:TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE85IEA.CCBY4.0.aconcise,contextualsummaryoftheachievedresultsbasedontheclosingreportbytheprojectownerthemostrelevantbusinessfigures(suchasnetturnover,totalbalancesheetandvalueofoffer)onthesubcontractorsinvolvedintheimplementationoftheproject.Additionally,tovalidateandcompletetheprojectdataset,twootherpublicdatabasesareusedtocompileenergyRD&Dstatistics:theHungarianCentralStatisticalOfficeandEurostat.Inthecaseofstatisticaldata,theNRDIOexaminesthedataaccordingtotheclassificationsstipulatedbytheHungarianCentralStatisticalOffice.FromEurostat,projectscanbefilteredbyscientificclassificationoftheSystemofEuropeanUnionProgrammes,recordedbythestaffoftheorganisationsmanagingthefundingrequests,suchastheNRDIO.Thesedataextractionsaredonetwiceayear:inJanuaryandJuly.HungaryexclusivelyusesgrantedpaymentfigurestocompileenergyRD&Dstatistics.EuropeanUnion-financedprojectsareexportedfromthee-CORDAdatabase,supervisedbytheEuropeanCommission’sDirectorateGeneralforResearchandInnovationforinternaluse.However,suchdataarenotincludedintheIEAquestionnaire,inordertonothaveduplicationswiththedatareporteddirectlyfromtheEuropeanUniontotheIEA.DatamanagementandtechnologyTheNRDIOextractsdatafromthedatabasesmentionedintheprevioussectioninExcelspreadsheetsandperformsthedataanalysisinExcel.Thefilteringandclassificationareconductedbyfieldsofscience(tiers1-3).DatadisseminationThereareseveralnationalpublicationsinHungaryusingenergyRD&Ddata,includingthefollowing:NationalEnergyStrategy2030NationalEnergyandClimatePlanNationalCleanDevelopmentStrategy2020-2050EnergyResearch,DevelopmentandInnovationinHungaryTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE86IEA.CCBY4.0.IrelandInstitutionalarrangementReportinginstitutionSustainableEnergyAuthorityofIreland(SEAI)RoleofreportinginstitutionNationalsustainableenergyauthority,anagencyundertheDepartmentoftheEnvironment,ClimateandCommunicationsoftheGovernmentofIrelandFundingresponsibilitiesofthereportinginstitutionFunderofRD&DprojectscontributingtothenationaltransitiontoacleanandsecureenergyfutureWaytoformaliserelationshipbetweeninstitutionsInformalagreementCollection,classificationandvalidationprocessTypeofdatacollectionSurveyofotherinstitutions(nineincludingtheSEAI)tocollectproject-leveldataviaanExceltemplateIEAsurvey?No.Project-leveldataSurveyfrequencyAnnualClassificationProjectsclassifiedbytheSEAIaccordingtoIEAclassificationDatavalidationAttheprojectleveltoavoiddoublecountingDatamanagementandtechnologyDataplatformNationalEnergyResearchDatabase,whichincludesinformationonRD&DprojectsreceivingpublicfundingAdvanceddataanalyticsNoDatadisseminationMaindatausersResearch,policy,industryandotherinterestedstakeholders,tofindoutmoreaboutongoingresearchprojectsandtosearchforresearchpartnersorcollaboratorsDisseminationchannelWebsiteMainpublicationsOpendatabasewithproject-leveldataNationalEnergyResearchDatabasePurposeIreland,asamemberoftheIEA,isrequiredtoreportstatisticaldataonnationalenergyRD&Dinvestmentand,forthispurpose,analysisofexpenditureonRD&Denergy-relatedprojectsinIrelandiscarriedout.Aspartofthisprocess,theSEAIhasdevelopedandmaintainsanonlineNationalEnergyResearchDatabase.ThisTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE87IEA.CCBY4.0.databaseaimstobeameetingpointandacentralsourceofinformationforallenergyRD&DprojectsinIreland.Thisway,researchersandkeystakeholderswhoworkorareinterestedinenergyRD&D,canidentifyrelevantongoingprojectsandseekpotentialpartners.InstitutionalarrangementTheinstitutionresponsibleforthedatacollectionandcompilationistheSEAI.TheSEAIisanagencyundertheDepartmentoftheEnvironment,ClimateandCommunicationsoftheGovernmentofIreland.ItsvisionistobealeadingauthoritydrivingIreland’ssustainableenergytransformationforthebenefitofsociety.OnekeyfocusareaoftheSEAIisthenationalco-ordinationofenergyresearchfundingandsupport.TheSEAIaimstoimprovethecoherenceofIrishenergyresearchanddevelopment.Itco-ordinatesandfundsarangeofRD&Dactivitiesrelatingtotheproduction,supplyanduseofenergy.TheprimarySEAIfundingprogrammetosupportenergyresearchistheSEAINationalEnergyRD&DFundingProgramme,whichinvestsininnovativeenergyRD&DprojectsthatcontributetoIreland'stransitiontoacleanandsecureenergyfuture.Additionally,theSEAIalsomaintainstheNationalEnergyResearchDatabaseandisresponsibleforcollectingnationalenergyRD&DdataandreportingittotheIEA,amongotheractivities.TheSEAIcollectsdatafromtheprimarypublicRD&DfundingorganisationsinIreland(nine,includingtheSEAI).Thereisnospecificlegalframeworkformalisingthisdatacollectionprocess,butaninformalagreementandongoingclosecollaborationeffortsbetweentherelevantpublicagenciessupportthisprocess.Thesecollaborationsarereinforcedbyparticipationindifferentcollaborativeworkinggroups,includingthenewlyestablishedNationalEnergyResearchFunders’Forumco-ordinatedbySEAI,aswellastheClimateResearchCoordinationGroup,amongothers.TheClimateResearchCoordinationGroupincludeskeyactorsinIreland’sclimatechange-relatedresearchactivitiesandissuesanannualpublicationsummarisingtheseactivities.Additionally,theSEAIco-fundsanumberofRD&Dprojectswiththeseotherinstitutions,furtherstrengtheningthecollaboration.Collection,classificationandvalidationprocessTheSEAIimplementedanewprocesstocollectenergyRD&Ddatain2019,whentheyreviseddatabackto2016.Eachyear,theSEAIissuesanExcelquestionnairetemplate(differentfromtheIEAquestionnaire)tonineinstitutions(includingtheSEAI)togatherdetailsonnationalenergyRD&Dinvestment.Thisquestionnaireisattheprojectlevel,andtheinformationgatheredisusedtoinputdataintotheTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE88IEA.CCBY4.0.onlineNationalEnergyResearchDatabase.Themaininformationgatheredinthisquestionnaireincludestheprojecttitle,theabstract,thestartandenddates,thefundingamount,thefundingagency,theleadorganisationandtheleadresearcher.Thefundingamountfigureincludedisthemaximumamountasagreedattheprojectawardstage,howevertheactualprojectexpendituremaydiffer.Theprojectcostinformationcollectedincludesdirectcostsonly,excludingoverheads.Formulti-annualprojectsthetotalbudgetisdividedbythenumberofyears(forexample,ifaprojectstartedinMay2018andendedinMarch2020,thetotalbudgetisdividedbythreeandallocatedequallytotheyears2018,2019and2020).TherespondentscompletethequestionnairewithdetailsofallactiveprojectsfortheyearofstudyandreturnittotheSEAI.Toreducetheadministrativeburdenontherespondents,theyareonlyaskedtoclassifyeachprojectaccordingtotheIEAclassificationtothetwo-digitlevel.Afterwards,theSEAIperformsthedetailedclassificationforeachprojectwiththecollectedinformationaccordingtotheIEAclassification.Thenumberofprojectsfundedcanvaryfromyeartoyeardependinguponvariousfactors,includingtheresponsetoeachresearchcall,theavailablebudgetandthenumberofresearchcallslaunchedbyeachofthefundinginstitutions.Onaverage,around80energy-relatedRD&Dprojectshavebeenfundedannuallysince2018,andin2021,therewere224activeprojectsinIreland.Ofthese,theSEAItypicallyfunds50energy-relatedRD&Dprojectseachyear.TheSEAIthenvalidatesthedataattheprojectlevelbycheckingfordoublereportinganddoublecountingofthereportedprojects.Dataarealsovalidatedbycomparingtheprojectsreportedwiththosereportedinpreviousyears.Ifthereareanydoubts,theSEAIfollows-uptoclarifydetailswiththeircontactsintherelevantfundinginstitutions.Oncealltheprojectdataarevalidated,theSEAIaggregatesandcompilestheproject-leveldataaccordingtotheIEAclassificationandreturnsthecompletedIEAenergyRD&DquestionnairetotheIEA.ThedatacollectedarealsousedtofeedintotheNationalEnergyResearchDatabasesubjecttotherelevantconfidentialityconditions.Thisdatabasecontainsdetailsofprojectsfundedbypublicbodies.TheSEAImanagesthisdatabase,whichishostedontheSEAIwebsite,andisresponsibleforupdatingandmaintainingit.TheSEAIoperatesonacontinuousimprovementbasis,andfurtherdevelopmentstothedatabasewilltakeplaceinfuture,including,forexample,broadeningthedatabasetoincludedetailsofenergyRD&DprojectsfundedbyECresearchandinnovationprogrammes.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE89IEA.CCBY4.0.DatamanagementandtechnologyTheNationalEnergyResearchDatabaseisacentraldatabaseforenergyRD&DprojectsinIrelandfundedbypublicorganisations.ItisanopendatabasemaintainedbytheSEAI.DataarecollatedusingtheExcelquestionnairesthattheSEAIsendsbyemailtoothernationalresearchfundingbodies.DatadisseminationCurrently,themainoutputsoftheenergyRD&DdatacollectionprocessareupdatestotheNationalEnergyResearchDatabaseandtheIEAquestionnaire.ThemainusersoftheenergyRD&DdatainIrelandareresearchersandotherinterestedstakeholdersinenergy-relatedRD&DinIreland,including,forexample,researchfunders,governmentdepartments,companiesandcommunitygroups.Thedatabaseisalsoagoodstartingpointtofindpartnersforfutureresearchprojectsandtounderstandthecurrentresearchareas.Additionally,thedataareusedbypublicbodiesdesigningfundingprogrammestominimiseduplicationofresearchandtoenhancetheco-ordinationofnationalresearchpolicies.TheSEAIalsoreceivesqueriesfrompolicymakersandotherstakeholdersaboutenergyRD&DactivityinIreland,andthedatabaseisausefulsourceofinformationtosupportthesequeries.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE90IEA.CCBY4.0.LithuaniaInstitutionalarrangementReportinginstitutionLithuanianEnergyAgency,withoversightfromtheMinistryofEnergyoftheRepublicofLithuaniaRoleofreportinginstitutionAssessingthestateofrenewableenergyandenergyefficiency,andtheprogresstowardstheenergysectortargetsundertheNationalEnergyandClimatePlan(NECP)FundingresponsibilitiesNotafundinginstitutionWaytoformaliserelationshipbetweeninstitutionsIntheprocessofsettingupalegalframeworkforenergyRD&DdatacollectionCollection,classificationandvalidationprocessTypeofdatacollectionVoluntarysurveyTypeofsurveySameastheIEAsurveySurveyfrequencyAnnualClassificationIEAclassificationatthesurveystageDatavalidationHigh-levelassessmentofthefiguresDatamanagementandtechnologyDataplatformExchangeofExcelfilesbyemailAdvanceddataanalyticsNoDatadisseminationMaindatausersPolicymakersCo-operativeresearchprogrammesintheBalticregionDisseminationchannelIEApublicationMainpublicationAssessmentoftheneedforaninternalpublicationPurposeIn2020,LithuaniastartedtocollectenergyRD&Ddata.Before,theonlydataavailablewerethegeneralRD&Ddataproducedbythenationalstatisticsoffice.However,thesestatisticswereatamuchhigherlevelthantheIEAclassification,withoutabreakdownbytechnology.Thisefforttocollectdatathataremoredetailedwasundertakenbecauseofacombinationofthreemaindrivers.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE91IEA.CCBY4.0.First,theLithuaniangovernmentpushedtohavesoliddatatomakeinformedpolicydecisionsonenergyresearch.Thiswastheleadingdrivertolaunchtheinitiativetoestablishthisdatacollectionsystem.Secondly,LithuaniaispartoftheNordic-Balticco-operation,whichhasajointenergyresearchfundingprogramme.Oneoftheaimsofthisprogramme,describedbytheRoadmap,istoidentify,prioritiseandsuggestenergy-relatedtechnologiestoinvestinintheshort-andlonger-termtoreachtheclimateandenergyobjectivesofthecountry.EnergyRD&Ddataareagoodindicatorfortrackingcompliancewiththisroadmap.Finally,oneofthecriteriatobecomeamemberoftheIEAistosubmitenergydata,includingenergyRD&Ddata.Afteroneyearandtheeffortoffourpeoplededicatedtothisproject,LithuaniamanagedtocollectenergyRD&Ddatawithreasonablecoverageanddataquality.InstitutionalarrangementTheLithuanianEnergyAgencyisresponsibleforthecollection,processingandsubmissionoftheenergyRD&DdatatotheIEA,withoversightfromtheMinistryofEnergyoftheRepublicofLithuania.Lithuaniaiscurrentlyworkingontheintroductionofalegalbackgroundthatwilldefinethespecificresponsibilitiesofeachoftheinstitutionsandformalisethedatacollectiontosupportthechangesrequiredtocollectthedatafromeachoftheinstitutions.WhenLithuaniaranthefirstdatacollectioncyclein2020,theyidentified19organisationsinvolvedinenergyRD&D.Asvoluntarysurveysareusedtocollectthedata,itiskeytoidentifytherightcontactsineachinstitution.Despitethesuccessoftheinitialdatacycles,theMinistryofEnergyandtheLithuanianEnergyAgencyarestillrefiningtheidentificationofcontacts.Asasmallandcentralisedcountry,itwaseasytodrawthehigh-levellandscapeofcompaniesandinstitutionsactiveinenergyRD&D,butitismorechallengingtoensuredataavailability.FundinginstitutionsandmajorprogrammesThefollowinglistofinstitutionsreceivedthequestionnairein2022.Theyincludeministries,agencies,scienceandtechnologycentres,state-ownedenergyenterprises,theResearchCouncilofLithuania,theLithuanianEnergyInstitute,RTOLithuaniaanduniversities.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE92IEA.CCBY4.0.EnergyRD&DfundingInstitutionssurveyedinLithuaniain2022InstitutionAdditionalinformationCentreforPhysicalSciencesandTechnologyVilniusGediminasTechnicalUniversityABAmberGridLithuaniannaturalgastransmissionsystemoperatorLITGRIDABLithuanianelectricitytransmissionsystemoperatorAgencyforScience,InnovationandTechnologyUABIgnitisLargestsupplierofelectricityandgasinLithuaniaMinistryofTransportandCommunicationsLithuanianBusinessSupportAgencyMinistryoftheEconomyandInnovationMinistryofEducation,ScienceandSportMinistryofEnvironmentResearchCouncilofLithuaniaKaunasUniversityofTechnologyVilniusUniversityKlaipedaUniversityVytautasMagnusUniversityLithuanianEnergyInstituteRTOLithuaniaAssociationNon-universityresearchandtechnologyorganisationsEnergijosSkirstymoOperatoriusABLithuanianelectricityandnaturalgasdistributorEPSO-GABState-ownedgroupofenergytransmissionandexchangecompaniesKlaipėdosNaftaABCompanyoperatingoilandliquefiednaturalgasterminalsinLithuaniaCollection,classificationandvalidationprocessAsof2022,Lithuaniahasrunthreedatacollectioncycles:oneinthefourthquarterof2020,oneinthefirsthalfof2021andthelatestoneatthebeginningof2022.Thespring2021datacollectionwastoalignwiththeIEAannualdatareportingcycle,andtokickofftheregularprocessthatwouldberepeatedannually.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE93IEA.CCBY4.0.DataarecollectedthroughvoluntaryquestionnairessentbyemaildirectlytodifferentinstitutionsinvolvedinenergyRD&D.Thequestionnaireisnotsentwithanyspecificsupportingdocumentation,apartfromalinktotheIEARD&DManual.Ifpossible,thetargetedcontactisintendedtobethepersonwhohasthetechnologicalknowledgetoclassifythedifferentprojectsandtofillinthequestionnaire.ThesurveyedinstitutionsareresponsibleforputtingtogetherallthefundingtheyreceivefrompublicbudgetstofinanceenergyRD&D,withmostinstitutionssubmittingfortheyearofstudy.Asthereisadatalagofafewmonths,thedataforthepreviousyearareavailablebytheendofthesecondquarterofthecurrentyear.TheseinstitutionsarealsoresponsibleforclassifyingthedataaccordingtotheIEAclassification,whichcanbechallenging.Thereisnonormalisedmethodologyforcollectingdataacrossinstitutions,soeachofthemhasdifferentdatacoverageandgranularity.Outofthe19questionnairestheMinistryofEnergyoftheRepublicofLithuaniasent,theyreceivedtenresponsesin2020,sevenin2021and15in2022.However,mostoftheenergyRD&Dfundsareaccountedforevenifnotalloftheinstitutionssubmitdata,becausethemainspendersreportdatawithgoodqualityandcoverage.Theresponsescollectedareverydetailedwithgooddataqualityandwell-accountedfiguresso,fornow,thereisnospecificdatavalidationapartfromahigh-levelassessmentofthefigures.ThemainchallengeencounteredbythecontactsistocorrectlyclassifyprojectsaccordingtotheIEAclassification.Demonstrationprojectsareseparatedfromtheotherresearchstates,but,accordingtotheLithuanianEnergyAgency,thesedemonstrationprojectsareunderrepresented.Oncealltheanswersarereceived,theyareaggregatedinaquestionnaireandsubmittedtotheIEA.DatamanagementandtechnologyFornow,nodatamanagementsystemhasbeenimplementedinLithuania.DataaremanagedthroughquestionnairesinExcelspreadsheetsandinformationisexchangedbyemail.Itmaytakesometimetosetupadatamanagementplatformandtoefficientlyconnectitwithotherinstitutions.Additionally,thesmallnumberofinstitutionsmakesitfeasibletomanagethistaskbyemail,thusdecreasingtheurgencyofhavingadatamanagementsystem.Inmanycases,someoftheinstitutionsarealreadypublishingRD&DdatabutaccordingtodifferentcriteriathantheIEAstandards,andthesedatabasesarealreadyinplace,soitwouldbechallengingtocreateaseparatesystem.Intheshorterterm,theco-ordinatingteammightmakearecommendationtoflagTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE94IEA.CCBY4.0.projectsthatarewithinthescopeoftheIEAenergyRD&Ddatacollectionatanearlystage.Thiswouldmaketheoverallprocessmoreefficient.DatadisseminationThereisnospecificnationalenergyRD&Ddatapublication.Instead,theIEApublicationisusedtodisseminatethedata.Lithuaniaisassessingtheinternalinterestinpreparingapublicationoncetheentireprocessiswellestablished.Nonetheless,thedataarewidelyusedinternallytoinformpolicydecisions.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE95IEA.CCBY4.0.NetherlandsInstitutionalarrangementReportinginstitutionNetherlandsEnterpriseAgencyoftheMinistryofEconomicAffairsandClimatePolicyRoleofreportinginstitutionHelpingbusinessownersrunsustainable,agricultural,innovativeorinternationalenterprisesFundingresponsibilitiesofthereportinginstitutionMostimportantfunderofenergyRD&DintheNetherlandsWaytoformaliserelationshipbetweeninstitutionsNationalobligationintheDutchClimateActCollection,classificationandvalidationprocessTypeofdatacollectionStructuredformattheprojectlevelfilledinbycompaniesUnstructuredprojectlistcollectedfromthetwootherfundingagenciesFrequencyContinuousforthecompanydataAnnualfortheotherfundingagencies’dataClassificationIEAclassificationdonebytheco-ordinatingteamDatavalidationComparisonbetweentheinternaldatabaseandtheoverallprogrammebudgetsDatamanagementandtechnologyDataplatformAutomatedformviaaweb-basedportalIn-housedatabasefortheprojectsExchangeofExcelfilesbyemailAdvanceddataanalyticsNoDatadisseminationMaindatausersPolicymakers,academicsandprivatecompaniesDisseminationchannelWebsiteMainpublicationsAnnualpublicationDashboardMotivationTheenergyRD&DstatisticsarecompiledintheNetherlandsmainlytoassistpolicymakersandadvisethegovernmentwhendesigningprogrammestosupportinnovation.Additionally,theNetherlandsEnterpriseAgencyalsopreparespublicreportstargetingprivatecompaniesandacademia,whobenefitfromnetworksanalysisandtheidentificationofsectorclusters.Thecollectionandclassificationprocessesareembeddedintothefundingrequest,sothereisnoseparatedatacollectionprocessinplace.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE96IEA.CCBY4.0.InstitutionalarrangementTheinstitutionresponsibleforthedatacollectionandcompilationistheEnergyInnovationTeamoftheNetherlandsEnterpriseAgency.TheagencyisinsidetheMinistryofEconomicAffairsandClimatePolicy,and,together,theysupportentrepreneurship,improvecollaborationsandstrengthenpositionsthroughfundingandnetworksforprivatecompanies.ThemainresponsibilityoftheEnergyInnovationTeamistoevaluateprojectproposalsandmanagefundingprogrammestoallocateenergyRD&Dfunds.TheyalsoundertaketheprocessofreportingandmonitoringenergyRD&D.TheEnergyInnovationTeamiscomprisedofaround70peopleandthereare5-6peopleworkingpart-timemonitoringenergyinnovation.ThisagencyisalsooneofthemainfundersofenergyRD&DintheNetherlands.Inaddition,theNetherlandsOrganisationforScientificResearchandtheNetherlandsOrganisationforAppliedScientificResearchalsomanagesignificantpublicfundingforenergyRD&D.Forthisreason,theNetherlandsEnterpriseAgencyworkscloselywiththeminacollaborativeefforttohavereliableenergyRD&Ddata,astheagencyisthecentralhubmonitoringenergyinnovation.Toguaranteedatasharingandacollaborativeframework,theagencyhasadatadeclarationagreementwiththesetwoinstitutions.Inaddition,alltheinstitutionsreceivingpublicfundingareobligedtoproviderequesteddatabytheDutchClimateAct.Collection,classificationandvalidationprocessTherearemultiplesystemsandprocessesinplacedependingontheinstitutionreceivingthepublicfundsandthefundingagency.ThevolumeofenergyRD&DprojectsreceivingpublicfundingintheNetherlandsisaround200projectsperyear,whichallowscentralisedmanagementofthereportingandclassificationattheprojectlevel.Regardingprojectsdeliveredbyprivatecompanies,thecollection,classificationandvalidationaredoneintegrallybytheNetherlandsEnterpriseAgency.WhencompaniesrequestasubsidytoperformenergyRD&D,theysubmittherelevantinformationabouttheprojectthroughtheNetherlandsEnterpriseAgencyplatform.Thisproposalincludesadetailedbudgetfortheprojectinaspecificformat,andtheproposalisloadedintotheagency’sinternaldatabase.TheEnergyInnovationTeamthoroughlyassessestheproposal.Iftheprojectisaccepted,theteamcategorisestheprojectaccordingtodifferentclassifications,includingtheIEAclassification,andupdatesitintheirdatabase.Theprojectsareclassifiedalmostimmediately,althoughtheremightbeafewweeksofdelayfromtheacceptancetotheclassification.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE97IEA.CCBY4.0.Forprojectsfundedthroughoneoftheotherfundingagencies,theproject-leveldataaresharedbytheseagenciesthroughspreadsheetsonceayear.Thesefilesdonothaveastandardformatastheyarelinkedtoeachagency’sinternalsysteminordertotrytominimisethedatacollectionburden.Additionally,thelevelofdetailofthesharedinformationisnotuniformacrossprojects.Inthesecases,theprojectshavealreadybeenclassifiedaccordingtointernalclassificationsbythefundingagencies.TheNetherlandsEnterpriseAgencythenusesamappingmatrixtoconverttheseinternalcategoriestotheIEAcategoriesandloadtheprojectsintotheirdatabase.Additionally,dataarevalidatedbycomparingthebudgetsoftheprojectsintheirinternaldatabasewithanotherdatabaseoftheadministrationsystemthatcontainstheinformationonsubsidies.OncealltheprojectsareloadedinthedatabaseandalignedwiththeannualIEAcycle,theagencyaggregatesthedata,completesthequestionnaireandsendsittotheIEA.Thefiguresreportedinthequestionnairearethemoneythathasbeenmadeavailablebythegovernmentinacertainyearforaspecificproject.Thisdoesnotmeanthatthemoneyisspentthatyear(formulti-yearprojects,100%ofthebudgetisallocatedtothefirstyear).Currently,theNetherlandsEnterpriseAgencyisintheprocessofexpandingthescopeoftheinnovationmonitoredfromjustenergytoallthefieldsrelatedtoclimate.EvenifthisdoesnotinfluencethereportingtotheIEA,theagencywillincludemoreprojectsintheinternaldatabase,interactingwithmorefundingagencies.DatamanagementandtechnologyTheNetherlandsEnterpriseAgencymanagesaninternaldatabasewithproject-leveldata.Theprojectproposalsarecollectedfromcompaniesthroughawebportalthatislinkedtothisdatabase.Additionally,theNetherlandsEnterpriseAgencymanagesExcelspreadsheetstocollectinformationfromotherfundingagencies.DatadisseminationApartfromsubmittingdatatotheIEA,theNetherlandsEnterpriseAgencyusesenergyRD&Ddatatoconductanalysisformanydifferentpublicationsfocusedonspecifictechnologies,clustersorareas.Thereisanannualpublicationonpublicspendinginenergyinnovation.Additionally,in2020,theypreparedaClimatePolicyDashboardthatincludesmanyenergyRD&Ddata,andtheyarecurrentlypreparingamoreinteractivedashboardonenergyinnovationtobenefitfromthecontinuousprocessoffeedingtheirinternaldatabase.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE98IEA.CCBY4.0.NorwayInstitutionalarrangementReportinginstitutionMinistryofPetroleumandEnergyRoleofreportinginstitutionResponsibleforthegovernment’senergypolicies,includingthemanagementofNorway’senergyresourcesFundingresponsibilitiesofthereportinginstitutionTheministryprovidestheoverallbudget,buttheresearchismainlyfundedbytheResearchCouncilWaytoformaliserelationshipbetweeninstitutionsInformalagreementReportingofenergyRD&Ddataincludedintheinstitutions’annualassignmentlettersCollection,classificationandvalidationprocessTypeofdatacollectionSurveytofundinginstitutionsTypeofsurveySamesurveyastheIEASurveyfrequencyAnnualClassificationIEAclassificationatthesurveystageDatavalidationCoherencychecksofthequestionnaireInconsistenciesresolvedincollaborationwiththecontactsDatamanagementandtechnologyDataplatformExchangeofExcelfilesbyemailAdvanceddataanalyticsNoDatadisseminationMaindatausersPolicymakersDisseminationchannelNoneoutsideoftheIEAsubmissionMainpublicationResearchcouncilprojectdatabankMotivationThemainmotivationtoundertaketheenergyRD&DdatacollectionprocessinNorwayistoreportthedatatotheIEA.NorwayiscommittedtoprovidingconsistentenergyRD&DdatainordertocollaboratewithIEAmembercountriestogenerateaninternationalbenchmark.Inaddition,theMinistryofEnergyandPetroleumusesenergyRD&Dstatisticstoassesstheperformanceofresearchprogrammesinplaceandtodesignnewfundingschemes.Toinformthesedecisions,NorwayusesthebudgetfiguresoftheResearchCouncil,themainfunderofRD&DinNorway,insteadofIEAstatistics.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE99IEA.CCBY4.0.InadditiontotheResearchCouncil,apartofthefundsgoesthroughotheragenciesandstate-ownedenterprisesorganisedunderdifferentministriesandisnotcoveredbythebudgetoftheResearchCouncil.EveniftheMinistryofEnergyandPetroleumdoesnothaveday-to-dayknowledgeoftheiractivities,theministryisawareofallthecalls,programmesandbudgetsfundingenergyresearchintheseagencies.ThecombinationofallthisinformationprovidestheMinistryofEnergyandPetroleumwithastrongbasistodesignpolicieswithoutusingthedatasubmittedtotheIEA.TheprioritiesfortheenergysectoraremainlydefinedthroughtheXXIPlatformsdesignedbytheMinistryofPetroleumandEnergy.ThemainplatformsareOG21(oilandgas)andEnergi21(energy),butthereareothers,suchasdigitalandmaritimeplatforms.Alltheseplatformsincludeexpertsfromindustry,publicagenciesandauthorities,andacademia.InstitutionalarrangementTheteamresponsibleforthedatacollectionandcompilationistheunitofResearchandTechnologyoftheDepartmentofClimate,IndustryandTechnology,withintheMinistryofPetroleumandEnergy.ThemainresponsibilityofthisunitistodesignthepoliciestomanagethepublicfundingfromthestatebudgettosupportRD&Dinrenewableenergy,petroleumandcarboncaptureandstorage.MostofthebudgetsupportingenergyRD&DgoesthroughtheResearchCouncil,themaininstitutionmanagingRD&DinallsectorsinNorway.Itisalsoresponsibleforcreatingspecificcallsandprogrammestodistributethefundsandforexecutingthegrants.TheResearchandTechnologyUnitoftheministryworkscloselywiththeResearchCouncil,andtheyareincontactalmostdaily.Forthisreason,communicationstoperformtheenergyRD&Ddatacollectionareincludedinthegeneralday-to-daywork.ApartfromtheResearchCouncil,asmallshareofthebudgetgoesthroughotheragenciesandstate-ownedenterprisesthatfundspecifictechnologies,suchascarboncaptureandstorage.SomeoftheseotheragenciesareorganisedunderotherministriesanddonothavesuchaclosecollaborationwiththeMinistryofPetroleumandEnergy,sotheco-ordinatingteamneedstorequestthedataannuallytocompilethestatistics.Thereisnospecificlegalframeworktocollectthedata,sothecollaborationisbasedonaninformalagreement.Toformalisethiscollaborationprocess,whenplanningtheannualactivitiesofministriesanddepartments,theMinistryofEnergyandPetroleummakessurethatthereportingofenergyRD&Ddataisincludedintheassignmentletteroftherelevantinstitutionssotheresourcesforthistaskareaccountedforintheirbudgets.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE100IEA.CCBY4.0.FundinginstitutionsandmajorprogrammesTheNorwegianenergyRD&DdatatotheIEAcoverssevenfundinginstitutions.EnergyRD&DfundinginstitutionsandmajorprogrammesinNorwayFundinginstitutionMinistryresponsiblefortheinstitutionMajorprogrammesResearchCouncilNorwayMinistryofEducationandResearchENERGIXPETROMAKS2Demo2000CLIMITCentresforEnvironment-friendlyEnergyResearchPETROSENTEREnovaMinistryofClimateandEnvironmentNorwegianWaterResourceandEnergyAgencyMinistryofPetroleumandEnergyInnovationNorwayMinistryofTrade,IndustryandFisheriesGassnova(state-ownedenterprise)MinistryofPetroleumandEnergyCLIMITDemonstrationTechnologyCentreMongstad(consideredgovernmentfundinginsteadofstate-ownedenterprise)Statnett(state-ownedenterprise)MinistryofPetroleumandEnergyStatKraft(state-ownedenterprise)MinistryofPetroleumandEnergyCollection,classificationandvalidationprocessEveryyear,whentherequestfromtheIEAarrivesattheMinistryofEnergyandPetroleum,theycreatesevencopiesoftheIEAquestionnaireandsendthemtothesevendifferentfundinginstitutionslistedintheprevioussection.Eachoftheseinstitutionscompilesthedatainternally,fillsinthequestionnairewiththedataandsendsitbacktotheministry.Theinstitutionsreportthedataslightlydifferentlydependingontheprogrammesandschemestheyusetodistributethebudgets.Forinstance,someoftheagenciesreport100%ofthebudgetallocatedtoaprojecteveniftheprojectismulti-year,whereasotheragenciesreporttheactualmoneyflowingeachyearfromthefundingagencytotheresearchinstitution.Thepersonresponsibleforco-ordinatingtheworkattheministrycheckstheconsistencyofthedataandaddressesanyinconsistenciesbydirectlyaskingthecontactsfromtheinstitutionsbyphoneorallocatingthedatatothe“unallocated”TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE101IEA.CCBY4.0.section.TheMinistryofEnergyandPetroleumaggregatesthesevenquestionnairesintooneandsendsittotheIEA.SomeofthedatacollectedinthequestionnairearealsousedforsubmissionstoMissionInnovationandtheEuropeanCommission.TheserequestsarealignedwiththeIEA’sannualdatacycle.Thedatacollectionprocesstakesaroundtwoweeksperyearandthereisonepersonleadingthistask.DatamanagementandtechnologyThereisnocentraldatabaseorplatforminNorway.Forthisreason,theexchangeofinformationbetweendifferentinstitutionsisdonebyemailusingtheIEAquestionnaire.Eachoftheinstitutionsmanagestheproject-specificdatacollection,sotheministryhasnovisibilityoftheprocessofeachreportinginstitutiontofillinthequestionnaire.DatadisseminationThequestionnaireisonlyusedtoreporttotheIEA.Ondemand,theministrywillprepareareportonRD&Dwithafocusonspecifictechnologiesofinterest.Asaresult,whenNorwaydisseminatesdataonenergyRD&D,itisusuallyfocusedonaspecificsectorortoansweraspecificpolicypriority.Forthisreason,theyundertakeanadhocprocesstoproducethestatisticstheyuseintheanalysis.ThereisannualreportingbytheResearchCouncilcoveringallthesectorsoftheNorwegianRD&Dwithhigher-leveldatasince2004.Additionally,theResearchCouncilhasaprojectdatabankwithdataandstatisticsonalltheprojectstheyfund,withinformationsuchasthetopic,thepriorityarea,theregioninNorwayandtheallocatedbudget.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE102IEA.CCBY4.0.PolandInstitutionalarrangementReportinginstitutionsMinistryofClimateandEnvironment–reportingtotheIEAMinistryofScienceandHigherEducation–R&DdatacollectionRoleofreportinginstitutionsResponsiblefortheimplementationofenvironmentalprotectionandclimatepoliciesResponsiblefortheimplementationofstatepolicyintheareaofscienceandhighereducationFundingresponsibilitiesofthereportinginstitutionFunderandsupervisorofmainfundingagenciesWaytoformaliserelationshipbetweeninstitutionsInformalagreementsExistingspecificlegalframeworkforstatistics,butenergyRD&DisoutofthescopeCollection,classificationandvalidationprocessTypeofdatacollectionStructuredsurveyTypeofsurveyIEAquestionnaireSurveyfrequencyAnnualClassificationIEAclassificationdonebythesurveyedinstitutionsDatavalidationBasicdatachecksDatamanagementandtechnologyDataplatformNocentralplatformAdvanceddataanalyticsNoDatadisseminationMaindatausersMainlyforIEAreportingAlsousedbytheMinistryofScienceandHigherEducationtobuildthenationalpolicyandtowritestrategydocumentsDisseminationchannelNotpublishedMainpublicationNotpublishedTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE103IEA.CCBY4.0.PurposeThemaingoaloftheenergyRD&DdatacollectionprocessistoreportthedatatotheIEA.However,thecollecteddataprovidesvaluableknowledgefortheMinistryofScienceandHigherEducation.Basedonthedata,theycanidentifythemaintopicswherePolishinstitutionsaremoreactiveinRD&D.ThisfacilitatesbuildingPolishnationalpolicyandcompilingstrategydocuments.InstitutionalarrangementTheresponsibilitytoreportdatatotheIEAinPolandlieswiththeMinistryClimateandEnvironment.AlthoughtheyareresponsibleforsubmittingtheenergyRD&Dquestionnaire,itistheMinistryofScienceandHigherEducationthatcollectsthedata(includingR&Dbutexcludingdemonstration,otherinstitutionsareresponsiblefordemonstrationprojectfunding,e.g.theNationalFundforEnvironmentProtection,supervisedbytheMinistryforClimateandEnvironment),morespecificallythepeopleworkingonenergyinthesciencedepartment.Inrecentyears,theMinistryofScienceandHigherEducationhassubmittedthequestionnairedirectlytotheIEA,asrequestedbytheMinistryofClimateandEnvironment.Thesetwoministriescollaborateactivelyinthisprocess.TheministryrequeststhedataonenergyR&Dprojectsfromtwomainfundingagencies:theNationalCentreforResearchandDevelopment(agencyfundingappliedresearchsupervisedbytheMinistryofScience)andtheNationalCentreofScience(basicresearchsupervisedbytheMinistryofScience).ThereisnospecificlegalframeworkfortheenergyRD&Ddatacollection.ThemainlegalframeworkcoversthegeneralRD&DdatacollectioncarriedoutbyStatisticsPoland.Inthisdatacollection,energyisjustoneofthe13objectives,sothelevelofdetailismuchlowerthanintheIEA’senergyRD&Dquestionnaire.EventhoughthereisastrongcollaborationbetweenministriesandStatisticsPoland,theenergyRD&DdatacollectedbytheMinistryofScienceandHigherEducationdoesnotmatchwiththehigher-levelstatisticscompiledbythestatisticsoffice.TheministrycollectsthesedatainaninformalprocessattherequestofandfortheIEA.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE104IEA.CCBY4.0.FundinginstitutionsandmajorprogrammesThescopeofthePolishenergyRD&Ddatacollectionislimitedtothefollowingfundingagencies.EnergyRD&DfundinginstitutionsandmajorprogrammesinPolandFundinginstitutionResponsibilitiesMinistryofScienceandHigherEducationNationalCentreforResearchandDevelopmentAppliedresearchsupervisedbytheMinistryofScienceNationalCentreofScienceBasicresearchsupervisedbytheMinistryofScienceMinistryofClimateandEnvironmentNationalFundforEnvironmentProtectionandWaterManagementDemonstrationandinvestmentprojectsCollection,classificationandvalidationprocessEveryyear,alignedwiththeIEAtimeline,theMinistryofClimateandEnvironmentaskstheMinistryofScienceandHigherEducationtosendtheIEAquestionnairetothetwofundingagencies:theNationalCentreforResearchandDevelopmentandtheNationalCentreofScience.ThisprocessisdoneexclusivelytoreporttotheIEA.ThereareotherRD&Ddatacollectionprocessesinparallel,butnoneofthemisexclusivetotheenergyfield.TocompletetheIEAquestionnaire,theMinistryofScienceandHigherEducationsendstheIEAquestionnairetothetwomainfundingagencies.Thetwoagenciesreportfundsbasedonobligations,sotheactualmoneyprovidedtoR&Dprojectsintheyearofstudyaccordingtothecontractssigned.DataareclassifiedaccordingtotheIEAclassificationandreportedintheIEAquestionnaire.Thisisdonebythefundingagencies,whogothroughtheirprojectdatabaseandclassifyeachindividualprojectbasedonthekeywordsinthetitlesandabstracts.ThecoverageofthePolishdatacollectionispartialasonlythesetwofundingagenciesandtheMinistryofScienceandHigherEducationitselfareincludedintheprocess.Otherfundingagenciessupervisedbyotherministriesarenotincluded,andthosearemainlyfundingdemonstrationprojects.Ingeneral,Polandreportsthedataatthetwo-digitlevel.Demonstrationprojectsandstate-ownedenterprisesarenotincludedinthecoverage.Abigpartofthedatavalidationisdonebythefundingagencies.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE105IEA.CCBY4.0.DatamanagementandtechnologyTheprocessissupportedbytheIEAquestionnaireinExcelfilesandemails.Thefundingagencieshaveinternaldatabasesofalltheprojectstheyfund,whicharethemaindatasourcetheyusetofillintheIEAquestionnaire.DatadisseminationTheprocessisdoneexclusivelyfortheIEA,whichcollectsthequestionnairefromIEAmembers,andthedataarenotpublishedinanynationalreport.Insomecases,thedataareusedbypolicymakerstodesignprogrammesandpolicies.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE106IEA.CCBY4.0.PortugalInstitutionalarrangementReportinginstitutionsDirectorateGeneralforEnergyandGeology(DGEG)DatacollectionbytheDirectorateGeneralforEducationandScienceStatistics(DGEEC),undertheMinistryforEducationandtheMinistryforScience,TechnologyandHigherEducationRoleofreportinginstitutionsDGEG:Designing,implementingandevaluatingpoliciesonenergyandgeologicalresourcesDGEEC:GuaranteeingtheproductionandstatisticalanalysisofeducationandscienceFundingresponsibilitiesNotfundinginstitutionsWaytoformaliserelationshipbetweeninstitutionsObligationunderLawNo.22/2008,whichmakesreportingdatatostatisticsauthoritiesmandatoryRelationshipbetweentheDGEGandDGEECbasedoninformalagreementsofcollaborationCollection,classificationandvalidationprocessTypeofdatacollectionStructuredsurveytoperformersTypeofsurveyGeneralsurveyforRD&D.NotexclusivetoenergySurveyfrequencyAnnualClassificationOnlyclassifiedtotheone-digitleveloftheIEAclassificationbyrespondentsofthesurveyDatavalidationGooddataqualityestimatedbasedonahighresponserateDatamanagementandtechnologyDataplatformDatacollectionplatformtomanagethesurveys(iPCTn)AdvanceddataanalyticsNoDatadisseminationMaindatausersMinistriesDisseminationchannelDGEECwebsiteMainpublicationNopublicationPurposeTheRD&DdatacollectioninPortugalprovidesthequantitativebasistoassesstheevolutionofthenationalscienceandtechnologysystem.PortugalusessurveystoidentifythevolumeofresourcesdevotedtoRD&DinpublicandprivateTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE107IEA.CCBY4.0.institutionsacrossthecountry.Inaddition,asamember,PortugaliscommittedtosubmittingenergyRD&DdatatotheIEA.InstitutionalarrangementTheinstitutionresponsibleforreportingenergyRD&DdatatotheIEAistheDGEG.However,thereporteddataarebasedonthedatacollectioncarriedoutbytheDGEECundertheMinistryforEducationandtheMinistryforScience,TechnologyandHigherEducation.Dataarecapturedbytwoannualsurveys:theSurveyoftheNationalScientificandTechnologicalPotential(IPCTN)forgovernment,state-ownedenterprisesandprivatenon-profitinstitutions,andtheIPCTNfortheprivatesector.LawNo.22/2008isthelegalframeworkthatsupportsthisdatacollection.Thislawmakesitcompulsoryforpublicandprivateinstitutionstoreporttoanofficialbodycollectingstatistics.ThemainRD&DfunderinPortugalistheFoundationofScienceandTechnology,thePortuguesepublicagencythatsupportsscience,technologyandinnovationinallscientificdomains,undertheresponsibilityoftheMinistryforScience,TechnologyandHigherEducation.Mostfundsareallocatedonacompetitivebasis.Collection,classificationandvalidationprocessPortugalhascollectedRD&DdatafrombothpublicandprivateorganisationsthroughtheIPCTNsincethe1960s.Thiswasabiannualsurveyuntilthe2008yearofstudy,afterwhichitbecameannual.ItfollowstheinternationallyestablishedguidelinesbytheOECDwithfourinstitutionalsectors:businessandenterprise,government,highereducationandprivatenon-profit.Everyyear,inMarch,theInstitutionsDirectory,whichincludestheinstitutionsthatreceivetherequesttoanswertheIPCTNonanannualbasis,isupdated.Portugalusesinformationfromthepreviousinquiriesandconsultsvariousinstitutionalsources,suchas:websitesofuniversities,colleges,polytechnicinstitutes,higherschoolsandresearchcentresTaxIncentiveSystemforBusinessR&DFoundationforScienceandTechnology,apublicagencyfundingRD&DprojectsalistofcompanieswithRD&DandinnovationprojectsfinancedunderPortugal2020,whichincludesgeneralandregionaloperationalprogrammesTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE108IEA.CCBY4.0.companiesparticipatinginprojectswithintheEuropeanUnion(FrameworkProgrammesforR&DandH2020)companieswithinvestmentinRD&Dorindeclareddevelopmentinthevariousitemsofsimplifiedbusinessinformationcompanieswithprimaryorsecondaryeconomicactivitiesclassifiedindivision72ofCAE-Rev.3(scientificresearchanddevelopmentactivities)companieslocatedintechnologyparksorRD&Dincubatortechnologycentresandotherinstitutionsthatinterfacewithcompanies,amongothers.Afterthis,theplatformforthesurvey(IPCTN)isopened,andcompaniesandpublicinstitutionsarerequiredtoprovidetheirRD&Ddata.Thisplatformincludesadigitalversionofthequestionnaires.Therearetwodifferentquestionnaires,oneforprivatecompaniesandanotherforpublicinstitutions.Thissurveyiscompletedbybothfundingagenciesandperformers.In2019,globally,12049potentialRD&Dexecutingentitiesweresurveyed,ofwhich10518answered,representingaresponserateof87%.Amongtherespondents,4707wereentitiesthatcarriedoutRD&D.Summaryof2019respondentsbyorganisationtypeOrganisationSurveyedAnswersResponserateActiveinRD&DCompanies10540911286.0%3761Stateentities81672188.0%310Highereducationunits62362099.5%599Privatenon-profitinstitutions7016593.0%37TheenergyRD&Ddataaresortedonthebasisofrepliestoquestion5(energy)ofthesurvey.Inthisquestion,thenomenclatureofsocio-economicobjectivesisbasedontheNomenclaturefortheAnalysisandComparisonofScientificProgrammesandBudgets.Startingfromthe2019survey,theIPCTNquestionnaireformdisaggregatedtheenergyobjectiveinordertocomplywiththeone-digitleveloftheIEAquestionnaire.TheplatformisopenuntilDecember.Then,thecollecteddataareprocessedthroughtheplatform.OncetheDGEGreceivestherequestfromtheIEAtoanswerthequestionnaire,consolidatedenergyRD&DdataforgovernmentandprivatesectorarecollectedfromtheDGEEC.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE109IEA.CCBY4.0.DatamanagementandtechnologyDuetothelargenumberofrespondentsfortheRD&Dsurvey,Portugalmaintainsaplatformwhererespondentscansubmitthedata.Theplatformcontainsdigitalquestionnaires,andtheusermanagementallowsonlytheentitiesintheInstitutionsDirectorytoinputthedata.TheplatformismanagedbytheDGEEC,whichprocessestheanswerstocompiletheRD&Dstatistics.DatadisseminationDataareexclusivelydisseminatedbytheDGEEConitswebsite,andthereisnospecificpublicationforenergyRD&D.Infact,theDGEGdoesnotpublishanyRD&Ddata.Nonetheless,theenergyRD&DdataareusedinternallytoevaluatetheprogressoftheNationalPlanforEnergyandClimateChange.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE110IEA.CCBY4.0.SpainInstitutionalarrangementReportinginstitutionsMinistryfortheEcologicalTransitionandtheDemographicChallenge(MITECO)–reportingtotheIEAMinistryofScienceandInnovation–datacollectionRoleofreportinginstitutionsMITECO:Responsiblefordevelopingpoliciesforthefightagainstclimatechange,preventionofpollutionandprotectionoftheenvironmentandenergyMinistryofScienceandInnovation:Responsiblefordevelopingandimplementingpoliciesonscientificresearch,technologicaldevelopmentandinnovationFundingresponsibilitiesofthereportinginstitutionsNodirectfunding,onlythroughfundingagenciesWaytoformaliserelationshipbetweeninstitutionsInformalagreementsGenerallegalframeworkthatallowsthepublicadministrationtocollectthedataneededtocompilethestatisticsCollection,classificationandvalidationprocessTypeofdatacollectionSurveyTypeofsurveyYesSurveyfrequencyAnnual,alignedwiththeIEAcycleClassificationIEAclassificationdonebythesurveyedinstitutionsDatavalidationBasicdataconsistencychecksDatamanagementandtechnologyDataplatformNoAdvanceddataanalyticsNoDatadisseminationMaindatausersProcessdesignedtoreporttotheIEADisseminationchannelNotpublishedMainpublicationNotpublishedPurposeThepurposeofcollectingenergyRD&DdatainSpainismainlyforsubmissiontotheIEAandtheEuropeanCommissionandtorespectitsengagementsasamember.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE111IEA.CCBY4.0.InstitutionalarrangementTheresponsibilitytoreportdatatotheIEAinSpainlieswithMITECO.Forthisreason,theyarealsoresponsibleforsubmittingtheenergyRD&Dquestionnaire.However,itistheMinistryofScienceandInnovationwhocollectsthedata.TheycompilethedataandsendthemtoMITECO,whosubmitsthemtotheIEA.Thesetwoministriescollaborateactivelyacrossthisprocess.TocompletetheIEAquestionnaire,theMinistryofScienceandInnovationrequeststheenergyRD&Dprojectdatafromthetwocentralfundingagencies:theStateResearchAgencyandtheCentrefortheDevelopmentofIndustrialTechnology.ThecoverageoftheSpanishdatacollectionispartialasonlythesetwofundingagenciesareincludedintheprocess.Othersmallerfundingagencies,universityfundsandfundinginstitutionsfromtheautonomouscommunitiesarenotincluded.ThereisnospecificlegalframeworkfortheenergyRD&Ddatacollection.However,thereisagenerallegalframeworkthatallowsthepublicadministrationtocollectthedataneededtocompilethestatisticsandmakesitcompulsoryfortherespondenttoprovidethedata,includingprivatesector.However,RD&DdataareoutofthescopeoftheregulationofenergystatisticsinEuropeandSpain.Thislegalframeworkwouldbeapowerfultoolformemberstatestostrengthentheprocess.EventhoughthereisstrongcollaborationbetweentheministriesandtheNationalStatisticsInstitute,theenergyRD&DdatacollectedbytheMinistryofScienceandInnovationarenotsharedwiththem.However,thisinteractionbetweentheministriesandthestatisticsofficeiscurrentlygrowing.FundinginstitutionsandmajorprogrammesThescopeoftheSpanishenergyRD&Ddatacollectionislimitedtothetwofollowingfundingagencies.FundinginstitutionMajorprogrammesStateResearchAgencyNationalPlanforScientificandTechnicalResearchandInnovation2021-2023Thereisaspecificstrategyworkstream:climate,energyandmobility.CentrefortheDevelopmentofIndustrialTechnologyOffersdifferenttypesofaid(reimbursableaid,partiallyreimbursableaidandsubsidies),whicharepartoftheNationalPlanforScientificandTechnicalResearchandInnovation2021-2023.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE112IEA.CCBY4.0.MinistryfortheEcologicalTransitionandtheDemographicChallenge(MITECO)InstituteforDiversificationandSavingofEnergyIntheframeworkoftheResilienceandRecoveryPlan,severalcomponentsdedicatedtotheenergysector(components7,8,9and10)containRD&Dprogrammestopromotetheuseofnewtechnologies.ThePERTEERHA,apublic-privatepartnershipprogrammeintheframeworkoftheResilienceandRecoveryPlan,containsseverallinesofsupportrelatedtotheRD&Dphaseofdevelopmentofenergytechnologies,suchasenergystorage,hydrogenandoffshorewind.Collection,classificationandvalidationprocessEveryyear,alignedwiththeIEAdeadlines,MITECOaskstheMinistryofScienceandInnovationtosendtheIEAquestionnairetothetwofundingagencies:AEIandCDTI.ThisprocessisdoneexclusivelytoreporttotheIEA.ThereareotherRD&Ddatacollectionprocessesinparallel,butnoneofthemisexclusivetotheenergyfield.ThereareinternaldiscussionstoharmonisethisprocesswiththegeneralRD&Ddatacollectionprocess.ThetwoagenciesreporttheactualmoneyprovidedtoRD&Dprojectsintheyearofstudyaccordingtothecontractssigned.DataareclassifiedaccordingtotheIEAclassificationandreportedintheIEAquestionnaire.Theministriesdonothavealotofvisibilityoftheinternalprocessesofthefundingagencies.Thecoverageincludesonlythemoneyflowsfromthesetwofundingagenciestoresearchinstitutions,andthefundsprovidedbytheresearchinstitutionsthemselvesorotherfundingagenciesarenotcovered.Ingeneralterms,Spainreportsthedataatthetwo-digitlevel.Insomecases,apartofthecollecteddatamayhaveabiggergranularity(tothetwo-digitlevel),butthedataareaggregatedtothehighestlevelofthetwofundingagenciestoprovideuniformityofthedataset.Demonstrationprojectsarenotreportedseparately,andstate-ownedenterprisesarenotincludedinthecoverage.Asignificantpartofthedatavalidationisdonebythefundingagencies,anddespitetheproblemswiththecoverage,thecollecteddatahasgoodquality.Sometimes,theMinistryofScienceandInnovationperformsin-depthanalysesofspecificprogrammesandfundingactivities.Theseopportunitiesareusedtofurthervalidatethedatasetbytheministryandtocollectmetadata.Eventhoughitmaynothappenintheshortterm,Spainisplanningtoimprovethisdatacollection.PromotedbytheEuropeanUnionandEurostat,SpainisTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE113IEA.CCBY4.0.participatinginaworkinggrouptodefineaprocesstocollectenergyRD&DinEurope.SpainwillneedtoadaptandtransformitscurrentprocesstomeettheobjectiveandtoreporttheprogressoftheNationalEnergyandClimatePlan.ItwillbekeytohaveacommontaxonomybetweentheEuropeanUnionandtheIEAtominimisetheburdenofthisprocess.DatamanagementandtechnologyTheprocessissupportedbytheIEAquestionnaireinExcelfilesandemails.DatadisseminationTheprocessisexclusivelydonefortheIEAandtheEuropeanCommission,whichcollectstheIEAquestionnairefromIEAmembers.Forthisreason,thedataarenotpublishedinanynationalreport.Insomeparticularcases,thereareinternalusers,butthisisnotcommon.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE114IEA.CCBY4.0.SwitzerlandInstitutionalarrangementReportinginstitutionSwissFederalOfficeofEnergy,EnergyResearchandCleantech,intheDepartmentoftheEnvironment,Transport,EnergyandCommunicationsRoleofreportinginstitutionEnergyministryresponsibleforalltheaspectsofenergypolicy,includingenergyresearchpolicyFundingresponsibilitiesOneofthemainfundinginstitutionsintheenergydomain,coveringtheinnovationchainbetweenfundamentalresearchandproduct-relateddevelopmentWaytoformaliserelationshipbetweeninstitutionsPartsofthedatacollectioncoveredbyarticle53oftheFederalActonthePromotionofResearchandInnovationCollection,classificationandvalidationprocessTypeofdatacollectionPublicdatabasesSurveyTypeofsurveySurveyofallrelevantresearchorganisationsrequestingalistofin-houseprojectswithnoEuropeanUnionorfederalfundingSurveyfrequencyAnnualDataextractionProjectsincludingEuropeanUnionorfederalfundingCo-ordinationandoverheadcostsFrequencyofdataextractionAnnualClassificationIEAclassificationdonebytheco-ordinatingteamSwissinternalclassificationalsousedDatavalidationContinuityofspendingClosecollaborationwithfundingandresearchinstitutionstoensuredataqualityTop-downcheckDatamanagementandtechnologyDataplatformInternalofflinedatabasefedbypre-processeddatafromthreepublicdatabasesandsurveysAdvanceddataanalyticsManyautomaticprocesseswithRscriptstodownloadandfilterthedataDatadisseminationMaindatausersEnergyResearchCommission,internalusers,internationalreportinganduniversities,media,publicandtheparliamentDisseminationchannelWebsiteTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE115IEA.CCBY4.0.DatadisseminationMainpublicationsRawdataatthetopiclevelSwissEnergyResearchStatisticsPurposeSwitzerlandhasbeencollectingdatarelatedtoenergyRD&DdatasincebeforetheIEAstartedcollectingthesedatafromitsmembercountries.ThemainobjectiveofthiscollectionistousethemasthequantitativebasisforthedesignofSwissenergyresearchpolicies(alsousedbytheResearchandInnovationMinistry).ItisalsothequantitativebasisfortheevaluationofSwissresearchprogrammesandprojectfundingandisusedtoanswerquestionsfromparliamentandthepublic.Forthesereasons,SwitzerlandtriestohaveacompleteviewofnationalenergyRD&Dfunds,includingtheco-ordinationandoverheadcosts.Ittracksthemoneyflows,identifyingthefundersandthespenderswhileclassifyingprojectspertopicandprojecttype.InstitutionalarrangementThedatacollectionisdonebytheEnergyResearchandCleantechteamoftheSwissFederalOfficeofEnergy,whichisresponsibleforthenationalandinternationalco-ordinationofenergyresearchinSwitzerland.ThisofficeisinsidetheDepartmentoftheEnvironment,Transport,EnergyandCommunications,aministryofthefederalgovernmentofSwitzerland.Additionally,therearedifferentcantonalfundingbodiesthatreportthedatafromanannualsurvey.EventhoughtheSwissFederalOfficeofEnergyisoneofthemainfundersofthecountry,aconsiderableeffortiscarriedouttocollectdatafromotherspendinginstitutionsandfundingbodies.Thus,theco-ordinatingteamcontinuouslyscreensenergyRD&DactivitiesinSwitzerlandtomakesurethattheyidentifythekeyactorsandgatherrelevantinformationaboutthem,suchasthefieldofresearchtheyareactiveinandthemainresearchersandprojectmanagersinalluniversities,universitiesofappliedsciences,researchcentresandtheprivatesector.Thesameisdoneforthemainfundinginstitutionsandprogrammes.TheSwissFederalOfficeofEnergyidentifiescontactsinalltheactiveinstitutions.Thereisnospecificlegislationregulatingtheresponsibilitiesofeachmemberofthenetwork,butpartsofthedatacollectionbytheSwissFederalOfficeofEnergyarebasedonarticle53ofFederalActonthePromotionofResearchandInnovation.Additionally,theresearchersreceivinganyfederalpublicfundingareobligedtoagreethatthemaininformationoftheprojectisvisibleinapublicTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE116IEA.CCBY4.0.database,makingtheprocessveryefficient.Asthesedataarethequantitativebasisfortheevaluationofresearchprogrammes,allthemembersofthenetworkhavethecommoninteresttohaveasgooddataqualityaspossible.Duetotheefficiencyoftheprocess,theSwissprocessrequireslimitedpersonnelresources(0.1-0.2FTE)andhasverylimitedexternaldependency,relyingasmuchaspossibleonpubliclyavailabledata.FundinginstitutionsandmajorprogrammesTheSwissenergyRD&DdatasubmittedtotheIEAcoverthefollowingmainfundinginstitutionsandprogrammes.EnergyRD&DfundinginstitutionsandmajorprogrammesinSwitzerlandFundinginstitutionMajorprogrammesETHDomainBasicfinancingandinternalcompetitiveprogrammesofthefederaltechnicaluniversitiesandresearchorganisations(SwissFederalInstituteofTechnologyinZürich,SwissFederalInstituteofTechnologyLausanne,PaulScherrerInstitute,SwissFederalLaboratoriesforMaterialScienceandTechnology,SwissFederalInstituteofAquaticScienceandTechnology,SwissFederalInstituteforForest,SnowandLandscapeResearch)SwissNationalScienceFoundationOpenprojectfunding(fundamentalresearch)NationalResearchProgrammesNationalCentresofCompetenceinResearchEuropeanCooperationinScienceandTechnologySwissInnovationAgencyOpenprojectfunding(appliedresearchanddevelopment)BRIDGEFlagshipInitiativeEUREKA/EurostarsSwissFederalOfficeofEnergySWissEnergyresearchfortheEnergyTransitionEnergyResearchProgrammesPilotandDemonstrationProgrammeSwissFederalNuclearSafetyInspectorateNuclearSafetyResearchProgrammeRadioactiveWasteResearchProgrammeTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE117IEA.CCBY4.0.FundinginstitutionMajorprogrammesStateSecretariatforEducationResearchandInnovationReplacementmeasuresHorizon2020ReplacementmeasuresHorizonEuropeEuratomCantonsBasicfinancingofcantonaluniversitiesanduniversitiesofappliedsciencesCollection,classificationandvalidationprocessTheSwissprocesstocollect,classify,validateandpublishthedataisdividedintofivestepsanddoneinanannualcycle:step1:analysisofthelandscapestep2:federalandEUdatamanagementstep3:regionalandinstitutionaldatamanagementstep4:co-ordinationandoverheadcostsstep5:publication.ThefirststepconsistsofacontinuousprocessofoverviewandidentificationofkeyactorsintheenergyRD&Dlandscape.Theoutputofthisprocessistoconnectwithacontactpersonineachoftheseinstitutionsandtomakesurethatalltherelevantprogrammesareconsideredintheprocess.Thesecontactsarekeytotherobustnessoftheprocessastheywillassistintheclassificationofprojectsandprovideadditionaldata.ThesecondstepisthebiggestoneandiscarriedoutbetweenMarchandMay,whenprojectinformationisavailableinpublicdatabaseswithfederalorEUfunding.Dataavailabilityismanuallychecked,andoncethisisdone,theSwissFederalOfficeofEnergydownloadsthedatafromthreepublicprojectdatabases:SwissNationalScienceFoundation,AramisandCORDIS.Therearearound3000newprojectstobefilteredeveryyear,10%beingenergyrelevant.Thisisdoneautomatically,usingRcode.Thesedatabasesincludeeithertherealpaymentsortheapprovedtotalcontributionsfrompublicfundingbodiestoresearchorganisations.Oncethedataaredownloaded,theyarefilteredbasedondifferentcriteria,suchasthekeywordsinthetitleandprojectdescription,theprogrammeandthefundingarea.Thisresultsinthecompilationofalistofenergyprojects.ThisisalsodoneusingRcode.Afterthefilteringprocess,thereisamanualverificationtoreducefalsepositivesandfalsenegatives.Then,eachoftheprojectsisclassifieddowntothemostdetailedleveloftheIEAandtheSwissclassifications.Thisisthemosttime-consumingpartoftheprocess.Twopeopleundertakeasemi-automaticprocesstoclassifythetypeofresearchprojectandthenamanualclassificationofTrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE118IEA.CCBY4.0.thetopic.Finally,theavailabilityofannualpaymentdataisassessed,andthebudgetarystageisselectedbasedonthefollowingprioritycriteria,convertingthecurrencywhenneeded:1.effectiveannualpayment2.annualpaymentsaccordingtothebudget3.estimatedannualamountsfromthetotalbudget.Onceallthedataareselectedandarranged,theyaretransformedintoanExcelformattoperformafinalmanualconsistencycheck.Thethirdstepisthecollectionthroughsurveysofnon-federalandnon-EUfunding.ThisisdonebycollectingtheinformationdirectlyfromthecontactswithsurveysbetweenJuneandAugust.UsingRscripts,threefilesarecreatedwithalistofprojectsperresearchorganisation:1.Projectsaccordingtostep2(withfederalorEUfundingfortheyearofinterest).Thisismainlyfortheirinformation.2.Projectsaccordingtostep3ofthepreviousyearthatarestillongoing(withownorcantonalfundsinthepreviousyear).Theyareaskedtocompletethespendingfortheyearofstudy.3.Alistwithemptyrowstoindicatenewprojectsorprojectsmissedlastyear.Thesequestionnairesaresentbyemailtoallthecontactpersonswithadeadlinetosendthembackwithinafewweeks.Assoonasthesefilesarereceivedback,theyarecheckedmanuallylookingattheduplicates,thescopeandclassificationaccordingtotheSwissandIEAguidelines,andtheprojecttype,etc.Includingfederalfunding,therearearound600newprojectseveryyeartobeclassified.Finally,theconsolidatedlistofprojectsisloadedintothesystemandtransformedintoanExcelcomma-separatedvalueformat.Atotalofmorethan2000projectsandactivitiesareincludedintheannualstatistics.Thefourthstepisthecollectionoftheco-ordinationandoverheadcosts.Thiscanbedoneinparallelwithstep3assoonasthefederalinstitutions,theuniversitiesandtheuniversitiesofappliedsciencereportthesecoststotheFederalStatisticalOffice.Forotherfundingagencies,suchastheSwissNationalScienceFoundation,thesedataareextractedfromtheirpublicannualreports.Then,co-ordinationandoverheadcostsareproportionallyallocatedtotheprojectsfundedbyeachagency.In2019,CHF427millionwereaccountedforinthestatistics,ofwhich53%correspondedtoprojectsinthedatabasesinstep2,21%tothequestionnairesinstep3and26%totheestimatesofoverheadcostsinstep4.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE119IEA.CCBY4.0.Thefifthstepispublicationanddatadissemination.InNovember,thefirstdraftversionofthedataisprepared.Publicationisfurtherexplainedinthedatadisseminationsection.TopreparethesubmissionfortheIEA,theEUcontributionsareexcluded.DatamanagementandtechnologyTheenergyRD&DstatisticsinSwitzerlandareconditionedbytwomainpremises:limitedpersonnelresourcesandminimumdependencyonthirdparties.Forthesereasons,theprocessiswell-engineered,andthedataextractionsfrompublicdatabasesareautomated.Thereisnocentraldatabaseorplatform,butRscriptsareusedtodothequeriesonexternaldatabases,thefilteringandtheexportintotheExcelformat.DatadisseminationOnceayear,thedataarepublishedontheSwissFederalOfficeofEnergywebsiteinthepublicationSwissEnergyResearchStatistics.DataarepublishedaccordingtobothIEAandSwissclassificationsinanExcelspreadsheet.Dataarearrangedindifferenttablesaccordingto:Researchorganisation.Fundingsource.Typeofresearch.Swissclassificationsystem.IEAclassificationsystem.Switzerlandhasstartedpublishingtherawdataatthetopiclevelaspartoftheopengovernmentdatainitiativethatwasstartedtwoyearsago.Additionally,theenergyRD&Ddataarealsodisseminatedinasummaryandinspecialisedarticlesfordifferenttechnologies.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE120IEA.CCBY4.0.UnitedKingdomInstitutionalarrangementReportinginstitutionDepartmentforBusiness,EnergyandIndustrialStrategyRoleofreportinginstitutionGovernmentdepartmentFundingresponsibilitiesofthereportinginstitutionMajorfunderofenergyinnovationWaytoformaliserelationshipbetweeninstitutionsInformalagreementCollection,classificationandvalidationprocessTypeofdatacollectionSurveytootherinstitutionsTypeofsurveySamesurveyasIEASurveyfrequencyAnnualClassificationIEAclassificationDatavalidationCoherencecheckofthequestionnaireandalignmentwiththepreviousyear’sreporting.InconsistenciesaresolvedincollaborationwiththecontactsDatamanagementandtechnologyDataplatformExcelAdvanceddataanalyticsNoDatadisseminationMaindatausersPolicymakersDisseminationchannelWebsiteMainpublicationThereisnoUKdocumentexclusivelyonenergyRD&Ddata,butthedataareusedinmanypublicationsPurposeTheDepartmentforBusiness,EnergyandIndustrialStrategyco-ordinatestheUnitedKingdom’s(UK)energyRD&DdatacollectionacrossallrelevantdepartmentsandbodiesandprovidesthistotheIEAaswellasamoredetailedsplitbetweendepartmentstothegovernment’sNetZeroInnovationBoard.TheNetZeroInnovationBoardprovidesstrategicoversightofthegovernmentfundingofnetzeroinnovationprogrammes.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE121IEA.CCBY4.0.InstitutionalarrangementTheinstitutionresponsibleforthedatacollectionandcompilationintheUnitedKingdomistheDepartmentforBusiness,EnergyandIndustrialStrategy,whichleadthecountry’sanalysisofenergyinnovationandco-ordinatesthecollectionofenergyRD&Ddataacrossthepublicsector.Thereisnospecificpieceofregulationgoverningthisactivity,butitismanagedthroughinformalagreementswithdifferentdepartmentsandpublicsectorbodies,eachofwhichnamesacontacttoprovidethedatatotheco-ordinatingteam.Collection,classificationandvalidationprocessEveryyear,theDepartmentforBusiness,EnergyandIndustrialStrategycontactsallpublicRD&DfundingbodiesacrosstheUnitedKingdomtopreparethemfordatacollection.ThedepartmentdistributestheIEAquestionnairetoalltheorganisationsactiveinRD&DandasksthemtocompleteitforspendingduringtheUnitedKingdom’sfinancialyear(from6Aprilto5Aprilofthefollowingyear).Wheninconsistenciesarefoundindatareturns,teamsacrossthegovernmentareconsultedtoensurethefiguresarebeingcorrectlyreported.Guidanceonclassificationmethodologyisalignedacrossthegovernment,howeverthereisadegreeofinterpretation,especiallyfororganisationsrunninginnovationprogrammesthathaveawidescope.TheUKgovernment’sfinancialyearfinishesinApril,andtheirdataupdateisusuallyavailablearoundAugust.DatamanagementandtechnologyThereisnocentraldatabaseorplatformintheUnitedKingdom.Forthisreason,theexchangeofinformationbetweendifferentinstitutionsisdonebyemailusingtheExceltemplateoftheIEA,whenpossible,orotherExcelfiles.Theproject-specificinformationismanagedbyeachofthebodiesandorganisations,sotheDepartmentforBusiness,EnergyandIndustrialStrategydoesnothavevisibilityoftheprocessesofeachinstitutioninthenetworkforfillinginthequestionnaire.DatadisseminationThequestionnaireisusedtoreporttotheIEAandtosupporttheUKgovernment’sanalysisonenergyinnovation.Thereisnospecificpublicationofthedata,buttheyareusedasanevidencesourceinvariousUKstrategydocuments.TrackingPublicInvestmentinEnergyTechnologyResearch:ARoadmapAnnexPAGE122IEA.CCBY4.0.AbbreviationsandacronymsDGEGDirectorateGeneralforEnergyandGeologyECLACEconomicCommissionforLatinAmericaandtheCaribbeanFTEFull-timeequivalentsIEAInternationalEnergyAgencyITInformationtechnologyNRDIONationalResearch,DevelopmentandInnovationOfficeR&DResearchandexperimentaldevelopmentRD&DResearch,developmentanddemonstrationSEAISustainableEnergyAuthorityofIrelandSETStrategicEnergyTechnologySETISStrategicEnergyTechnologyPlanInformationSystemInternationalEnergyAgency(IEA).ThisworkreflectstheviewsoftheIEASecretariatbutdoesnotnecessarilyreflectthoseoftheIEA’sindividualMembercountriesorofanyparticularfunderorcollaborator.Theworkdoesnotconstituteprofessionaladviceonanyspecificissueorsituation.TheIEAmakesnorepresentationorwarranty,expressorimplied,inrespectofthework’scontents(includingitscompletenessoraccuracy)andshallnotberesponsibleforanyuseof,orrelianceon,thework.SubjecttotheIEA’sNoticeforCC-licencedContent,thisworkislicencedunderaCreativeCommonsAttribution4.0InternationalLicence.Thisdocumentandanymapincludedhereinarewithoutprejudicetothestatusoforsovereigntyoveranyterritory,tothedelimitationofinternationalfrontiersandboundariesandtothenameofanyterritory,cityorarea.Unlessotherwiseindicated,allmaterialpresentedinfiguresandtablesisderivedfromIEAdataandanalysis.IEAPublicationsInternationalEnergyAgencyWebsite:www.iea.orgContactinformation:www.iea.org/contactTypesetinFrancebyIEA-October2022Coverdesign:IEAPhotocredits:©GettyImagesThispublicationhasbeenproducedwiththefinancialassistanceoftheEuropeanUnionaspartoftheCleanEnergyTransitionsinEmergingEconomiesprogram.TheCleanEnergyTransitionsinEmergingEconomiesprogramhasreceivedfundingfromtheEuropeanUnion’sHorizon2020researchandinnovationprogramundergrantagreementNo952363.

1、当您付费下载文档后，您只拥有了使用权限，并不意味着购买了版权，文档只能用于自身使用，不得用于其他商业用途（如 [转卖]进行直接盈利或[编辑后售卖]进行间接盈利）。
2、本站所有内容均由合作方或网友上传，本站不对文档的完整性、权威性及其观点立场正确性做任何保证或承诺！文档内容仅供研究参考，付费前请自行鉴别。
3、如文档内容存在违规，或者侵犯商业秘密、侵犯著作权等，请点击“违规举报”。

碎片内容

碳中和的最新文档