<?xml version="1.0" encoding="UTF-8" standalone="no"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="other" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">Open Res Europe</journal-id>
            <journal-title-group>
                <journal-title>Open Research Europe</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2732-5121</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/openreseurope.13069.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Case Study</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Promoting citizen science in the energy sector: Generation Solar, an open database of small-scale solar photovoltaic installations</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>del Ca&#xF1;izo</surname>
                        <given-names>Carlos</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-1287-6854</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Crist&#xF3;bal</surname>
                        <given-names>Ana Bel&#xE9;n</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-4314-6160</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Barbosa</surname>
                        <given-names>Luisa</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-1994-0030</uri>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Revuelta</surname>
                        <given-names>Gema</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-0701-2026</uri>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Haas</surname>
                        <given-names>Sabine</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-8480-5409</uri>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Victoria</surname>
                        <given-names>Marta</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Brocklehurst</surname>
                        <given-names>Martin</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a5">5</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Instituto de Energ&#xED;a Solar, Universidad Polit&#xE9;cnica de Madrid, Madrid, Spain</aff>
                <aff id="a2">
                    <label>2</label>Centro de Estudios de Ciencia, Comunicaci&#xF3;n y Sociedad, Universitat Pompeu Fabra, Barcelona, Spain</aff>
                <aff id="a3">
                    <label>3</label>Reiner Lemoine Institut, Berlin, Germany</aff>
                <aff id="a4">
                    <label>4</label>Department of Engineering, Aarhus University, Aarhus, Denmark</aff>
                <aff id="a5">
                    <label>5</label>KempleyGreen Consultants, Gloucestershire, UK</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:carlos.canizo@upm.es">carlos.canizo@upm.es</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>24</day>
                <month>3</month><year>2021</year>
            </pub-date>
            <pub-date pub-type="collection"><year>2021</year>
            </pub-date><volume>1</volume>
            <elocation-id>21</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>22</day>
                    <month>1</month><year>2021</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#xA9; 2021 del Ca&#xF1;izo C et al.</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://open-research-europe.ec.europa.eu/articles/1-21/pdf"/>
            <abstract>
                <p>Citizen science is becoming an effective approach in building a new relationship between science and society, in which the desire of citizens to participate actively in knowledge production meets the needs of researchers. A citizen science initiative dealing with the development of photovoltaics (PV) is presented. To generate a &#x201C;responsible&#x201D; initiative, the research question has been designed collectively from the beginning, involving diverse actors in order to encourage creativity while addressing their interests and concerns. The result has been called Generation Solar. It aims at co-creating an open database of PV installations including their technical characteristics, and an online map for visualizing them. The initiative responds to a clear scientific demand; an important drawback for researchers working on energy modelling and predictions of production lays precisely in the lack of information about these installations&#x2019; locations and characteristics. The initiative invites citizens, companies and public institutions with a PV installation to collaborate by providing such data. Data will follow the format of Open Power System Data in order to be fully exploitable by the scientific community and society. The success of the initiative will rely on the capacity to mobilize citizens and register the largest possible number of installations worldwide.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Citizen Science</kwd>
                <kwd>Public Engagement</kwd>
                <kwd>Energy</kwd>
                <kwd>Photovoltaics</kwd>
                <kwd>Open Data</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="http://dx.doi.org/10.13039/100010661">
                    <funding-source>Horizon 2020 Framework Programme</funding-source>
                    <award-id>787289</award-id>
                </award-group>
                <funding-statement>This work has been supported by the European Union&#x2019;s Horizon 2020 research and innovation programme under the grant agreement No 787289 (project GRECO).</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec sec-type="intro">
            <title>1 Introduction</title>
            <p>The achievement of the Sustainable Development Goals (SDGs) established by the international community as part of the 2030 Agenda will only be possible with the determined commitment of society as a whole (governments, companies, academy and civil society), and needs the deployment of all available tools, with science and technology among them
                <sup>
                    <xref ref-type="bibr" rid="ref-1">1</xref>
                </sup>. Research and innovation should focus on these challenges, and important efforts have been made in the last few years to base this demand for alignment with societal goals on solid principles, giving birth to the concept of responsible research and innovation (RRI)
                <sup>
                    <xref ref-type="bibr" rid="ref-2">2</xref>
                </sup>. RRI implies introducing changes in the way research and development is conducted, in particular by engaging all stakeholders in the entire research and innovation cycle, and not only in the evaluation of results.</p>
            <p>In this context, citizen science emerges as a powerful tool to match the potential benefits that research can bring to the needs, values and aspirations of citizens. It is a rapidly growing field, with an explosion of related activities and experiences in a wide range of science disciplines
                <sup>
                    <xref ref-type="bibr" rid="ref-3">3</xref>
                </sup>, including astronomy, biodiversity, medicine, metrology and transport.</p>
            <p>These experiences in the energy sector are more scarce, perhaps due to the configuration of the traditional energy systems, but it is clear that the urgent energy transition in which we are immersed, with the relevance of renewable energies, will only be possible through the concerted action of all stakeholders, putting into practice the benefits of a &#x201C;quadruple helix of innovation&#x201D;
                <sup>
                    <xref ref-type="bibr" rid="ref-4">4</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref-6">6</xref>
                </sup>, and going beyond social acceptance by reinforcing the participation in decision-making processes
                <sup>
                    <xref ref-type="bibr" rid="ref-7">7</xref>
                </sup>.  </p>
            <p>This paper presents a citizen science initiative in the photovoltaic (PV) sector, that intends to build an open database of PV installations that can give input, among others, to researchers working on energy modelling and predictions of production from PV plants.</p>
            <p>Firstly, in section 2 we highlight the role that citizen science is beginning to play in the European Research Agenda, and how our initiative aligns with it. Then, in section 3 we describe the engagement process that has led to this specific initiative, as it was carefully designed to make sure that it responds to a real need in the research field, and at the same time meets the expectations of citizens. Section 4 describes in detail the initiative Generation Solar, implemented as an app.</p>
        </sec>
        <sec>
            <title>2	Citizen science as part of the European research agenda</title>
            <sec>
                <title>2.1	Matching science achievements and citizens&#x2019; aspirations</title>
                <p>Citizen science refers to the &#x201C;
                    <italic toggle="yes">general public engagement in scientific research activities when citizens actively contribute to science either with their intellectual effort or surrounding knowledge or with their tools and resources</italic>&#x201D;
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>
                    </sup>. The concept of citizen science emerged and developed in the second half of the 20
                    <sup>th</sup> century, but it has been in the 21
                    <sup>st</sup> century when its potential has exploded, as a consequence of the democratization of knowledge, the internet revolution and the move towards open science
                    <sup>
                        <xref ref-type="bibr" rid="ref-9">9</xref>
                    </sup>.</p>
                <p>The European Commission has embraced the idea that opening the research and innovation system to the participation and collective intelligence of society can significantly contribute to its success in finding solutions to the challenges we face. In Horizon 2020 it has dedicated a relevant budget (462 million &#x20AC;) to citizen science and citizen engagement projects under the SwafS program (Science with and for Society), under the premise that &#x201C;
                    <italic toggle="yes">Citizen science can make science more socially relevant, accelerate and enable production of new scientific knowledge, increase public awareness about science and ownership of policy making, as well as increase the prevalence of evidence-based policy making</italic>&#x201D;
                    <sup>
                        <xref ref-type="bibr" rid="ref-10">10</xref>
                    </sup>. This approach is also present in some of the recent calls included in the energy-climate work programmes in Horizon 2020 and Horizon Europe, confirming its relevance for policy and decision makers. For example, the calls in Horizon 2020 - Work Programme 2018&#x2013;2020 &#x2013; Cross-cutting activities included in 
                    <italic toggle="yes">Area 10: Empowering citizens for the transition towards a climate neutral, sustainable Europe</italic>, in particular the call &#x201C;LC-GD-10-3-2020: Enabling citizens to act on climate change, for sustainable development and environmental protection through education, citizen science, observation initiatives, and civic engagement&#x201D;.</p>
                <p>There is already enough evidence to be able to systematize the key principles that define citizen science
                    <sup>
                        <xref ref-type="bibr" rid="ref-11">11</xref>
                    </sup>, and it is clear that the benefits that citizen science brings can be very large, but important challenges need to be tackled: among them, the avoidance of ethical lapses and security risks, or the design and adoption of indicators to measure outcomes
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>,
                        <xref ref-type="bibr" rid="ref-9">9</xref>
                    </sup>.</p>
                <p>On the other hand, it is probably unrealistic to expect that all researchers involved in projects related to societal challenges are going to include citizen science as normal practice within their research activities, because defining and launching such initiatives is quite time-consuming and effort-demanding, and raising a new community takes time, effort and money. It is clear that adopting citizen science implies taking academic-based research away from its &#x201C;comfort zone&#x201D;; among other things, it has to learn how to involve different stakeholders in the research process, it should define new incentives for interaction with citizens, and also design models for the long-term sustainability of citizen science projects. It should also adopt Open Science policies and provide appropriate tools
                    <sup>
                        <xref ref-type="bibr" rid="ref-7">7</xref>
                    </sup>, and lay out success stories that can inspire researchers
                    <sup>
                        <xref ref-type="bibr" rid="ref-9">9</xref>
                    </sup>.</p>
                <p>GRECO (Fostering the next generation of a European photovoltaic society through Open Science), a SwafS project funded by Horizon 2020, wants to put these principles of RRI and public engagement into practice in a research project in the PV field, studying the conditions in which they can improve the quality of the research and strengthen the social acceptance of the PV products under development
                    <sup>
                        <xref ref-type="bibr" rid="ref-12">12</xref>
                    </sup>.</p>
            </sec>
            <sec>
                <title>2.2	Public engagement in a research project</title>
                <p>The 
                    <ext-link ext-link-type="uri" xlink:href="https://cordis.europa.eu/project/id/787289/es">GRECO project</ext-link> addresses several research lines in the PV field at different technologies readiness levels (TRLs), with the goal of demonstrating that public funded science can be performed in a more responsible way. This is being tested in a research line related to the ageing and repairing of PV modules, in a second one devoted to PV solutions for irrigation, and in a third one related to the development of next generation PV concepts, which includes novel tandem solar cells, micro-concentration PV systems and PV heat pumps.</p>
                <p>	From GRECO&#x2019;s experience, we can identify three lines for the involvement of citizens which can have high impact: public engagement through mobilization and mutual learning actions, through open innovation processes, and through the direct collaboration of citizens. They are described in more detail in 
                    <xref ref-type="bibr" rid="ref-13">13</xref>. Here we will focus in one of the experiences of the latter case, the Citizen Science initiative.</p>
            </sec>
        </sec>
        <sec>
            <title>3	Development of a responsible citizen science initiative</title>
            <p>Promoting a citizen science initiative for a research project, without taking into account citizens in its design, is somewhat contradictory. To avoid that, we aimed at the development of a &#x201C;responsible&#x201D; citizen science initiative, in the sense it respects the RRI principles and is the result of a co-creation process between citizens and scientists.</p>
            <p>We call this approach 
                <italic toggle="yes">Citizen Science for Citizen Science</italic>, and even if it is particularized here for the PV sector, we think that our experience is hence relevant for the promotion of citizen science in a wide range of technological sectors.</p>
            <p>The methodology that we have established to develop a responsible Citizen Science Initiative consists of the following four steps.</p>
            <sec>
                <title>3.1	Step 1: input from professionals</title>
                <p>In order to launch a citizen science initiative with real value for the advancement of professional science, academic researchers must be included in the design phase. Otherwise, we take the risk of generating a movement of people collecting or analyzing data with the unique purpose of supporting science education, which is valid but not useful as input for a scientific project.</p>
                <p>For that, face-to-face brainstorming activities were carried out in several sessions in different countries to explore ideas from PV-related personnel around three questions: How can citizens collaborate in our research? What are the main barriers towards the integration of PV in society? What does our research give in return to citizens? Approximately 60 researchers participated. Their input was complemented by an online survey that was distributed during two months among academic networks and other communities involved with solar energy and communication. Information about the data treatment was given for both the face-to-face meetings and for the online survey, and consent sheets collected.</p>
                <p>A 9-page document summarizing all responses collected (around 100, see underlying data) was compiled and is openly available in Zenodo
                    <sup>
                        <xref ref-type="bibr" rid="ref-14">14</xref>
                    </sup>.</p>
            </sec>
            <sec>
                <title>3.2	Step 2: co-creation with society</title>
                <p>In this second phase, a call for participation was launched (
                    <xref ref-type="fig" rid="f1">Figure 1</xref>). An online contest, inspired in a hackathon
                    <sup>
                        <xref ref-type="bibr" rid="ref-15">15</xref>
                    </sup>, was designed to motivate participants to develop a working plan and submit it for evaluation. A strong dissemination campaign was undertaken, including flyers, a newsletter, a videoclip and constant communication with relevant networks.</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <title>Call for ideas to design a PV citizen science initiative.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://openreseurope-files.f1000.com/manuscripts/14139/0b7b9f70-6dfa-4793-a0ad-95d8826e0596_figure1.gif"/>
                </fig>
                <p>The contest ran for an entire week and around 60 registered participants from 15 different countries worked individually or in teams to propose an initiative in citizen science for PV. The participants had to consider the responses gathered in step 1, and they made use of the open source e-learning software 
                    <ext-link ext-link-type="uri" xlink:href="https://chamilo.org/es/">Chamilo</ext-link> to participate in the contest.</p>
            </sec>
            <sec>
                <title>3.3	Step 3: assessment and selection</title>
                <p>After the contest had been closed, an assessment committee revised 12 proposals that represented the submission of 30 teams and individuals. Several criteria covering different aspects were established and tabulated (see 
                    <xref ref-type="table" rid="T1">Table 1</xref>), to support the selection of the winning proposal, that would be implemented within the GRECO project. Other prizes were established to reward specific traits as creativity and team-building. This served as recognition for brilliant ideas that deserved attention, even if they could not be developed by the GRECO project.</p>
                <table-wrap id="T1" orientation="portrait" position="anchor">
                    <label>Table 1. </label>
                    <caption>
                        <title>Assessment criteria for the selection of the citizen science initiative.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Assessment criteria</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Description</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Mastering the challenge
                                    <break/>(20%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The idea successfully responds to the challenge, by developing a working plan of a citizen science project
                                    <break/>for solar energy research.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Creativity (20%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The proposal suggests original and unusual ideas, either by creating something new or by giving new uses
                                    <break/>to the existing tools.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Feasibility (20%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The proposal can be developed by GRECO during the following six months and it considers responsibly the
                                    <break/>technical, economic, social and environmental aspects. Moreover, it can be implemented in the solar energy
                                    <break/>research community.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Methodological exactness
                                    <break/>(15%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The working plan describes how to develop the proposal, including the target group (i.e., schools,
                                    <break/>universities, solar energy electricity users, etc.), resources, main tasks and timetable. Furthermore, if the
                                    <break/>proposal includes the development of specific software or device, their description is also included.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Global reproducibility
                                    <break/>(15%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The proposal presents an idea that might be used across the globe and promotes international
                                    <break/>cooperation.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Clarity and visual
                                    <break/>presentation (10%)</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The idea is presented in a clear, understandable and visually appealing way.</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>	The major prize was awarded to the proposal &#x201C;Open database of rooftop solar PV installations&#x201D;, which fully satisfied the characteristics demanded for GRECOs&#x2019; Citizen Science initiative (in particular, relevant citizen participation to respond to a relevant research question) while keeping its development within the framework of what the project could achieve.</p>
            </sec>
            <sec>
                <title>3.4	Step 4: technical development</title>
                <p>The technical implementation of the open database, named &#x201C;Generation Solar&#x201D;, was subcontracted to a company specialized in software development, and it was launched in April 2020.</p>
                <p>The web version of the initiative is accessible at 
                    <ext-link ext-link-type="uri" xlink:href="https://generationsolar.ies.upm.es">https://generationsolar.ies.upm.es</ext-link>, and apps are available for iOS and Android.</p>
                <p>Special attention has been taken so that data follows the format and instructions from the Open Power System Data, in order to be fully exploitable by the scientific community and society
                    <sup>
                        <xref ref-type="bibr" rid="ref-16">16</xref>
                    </sup>. This will enable the maintenance of an open approach in energy modelling which is key to ensure transparency and reproducibility of the results
                    <sup>
                        <xref ref-type="bibr" rid="ref-17">17</xref>
                    </sup>. The details of Generation Solar are presented in the next section.</p>
            </sec>
        </sec>
        <sec>
            <title>4	Generation Solar</title>
            <p>When scientists model future energy systems with high renewable penetration, they need to know where the current installations are located, as well as make hypotheses on their future deployment. This information is not fully available now; although some databases for PV exist, they are private, include only information from very few countries
                <sup>
                    <xref ref-type="bibr" rid="ref-18">18</xref>,
                    <xref ref-type="bibr" rid="ref-19">19</xref>
                </sup>, are outdated
                <sup>
                    <xref ref-type="bibr" rid="ref-20">20</xref>
                </sup>, only provide 
                <ext-link ext-link-type="uri" xlink:href="https://data.open-power-system-data.org/renewable_power_plants/2020-08-25">approximate locations</ext-link>, or lack important data such as the orientation and inclination of the modules. On the other side, citizens are willing to take part in the energy transition and small-scale rooftop PV allows them to become energy producers. Participating in the collaborative database of PV installations, Generation Solar can promote interest in, and acceptance of, PV. Compared to large power plants, the distributed nature of PV makes it more difficult to gather information regarding the installed capacity, the spatial distribution, and the configuration of the systems. Citizens can play a key role here, creating and updating a detailed database of rooftop PV installations that will be key to enhance the modelling and understanding of future distributed power systems. It may, for example, help answer research questions such as:</p>
            <list list-type="bullet">
                <list-item>
                    <p>Is the latitude determining the tilt of the panels, or the rooftop inclination? How is this evolving through time? (i.e., change of azimuth towards the West to match the consumption)</p>
                </list-item>
                <list-item>
                    <p>How is the DC/AC ratio sized, and how is this changing with time?</p>
                </list-item>
                <list-item>
                    <p>How are batteries being introduced in these types of installations?</p>
                </list-item>
                <list-item>
                    <p>Can the information in Generation Solar complement, or help to find inconsistencies with, the current information available in some countries on registered PV installations?</p>
                </list-item>
                <list-item>
                    <p>Can it help to contrast with the data gathered by approaches based on satellite images?</p>
                </list-item>
                <list-item>
                    <p>What are the differences in type of ownership (rooftop vs share in large plants)? How is this influenced by country or region?</p>
                </list-item>
            </list>
            <sec>
                <title>4.1	The app</title>
                <p>The citizens introduce data from the installation that they are familiar with (location, latitude, longitude, orientation and inclination of the panels, technology used, commissioning date, etc.) and will keep this information updated, e.g., by indicating if the installation is upgraded to higher capacity or decommissioned.</p>
                <p>Screenshots are shown in 
                    <xref ref-type="fig" rid="f2">Figure 2</xref> as an example of the appearance of the web interface.</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>Some screenshots of Generation Solar app.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://openreseurope-files.f1000.com/manuscripts/14139/0b7b9f70-6dfa-4793-a0ad-95d8826e0596_figure2.gif"/>
                </fig>
            </sec>
            <sec>
                <title>4.2	Registering a PV installation</title>
                <p>In the landing page you may click on &#x201C;public access&#x201D;, giving access to a public map where you can find all the solar installations that have been registered, or &#x201C;log-in&#x201D; after signing up, to fully exploit Generation Solar&#x2019;s possibilities.</p>
                <p>Once logged in, you can explore the map with all the registered installations and their characteristics, chat with other users, check some global statistics, including a rough estimate of how much CO
                    <sub>2</sub> these installations are saving, and also access to some functionalities that have been added to motivate people: adding many installations and a lot of solar power, getting as many likes as possible, and engaging in debates with the community, or becoming an influencer by inviting others, aspects that have been demonstrated to be very relevant in many studies of social acceptance of the PV technology (see for example
                    <sup>
                        <xref ref-type="bibr" rid="ref-21">21</xref>&#x2013;
                        <xref ref-type="bibr" rid="ref-23">23</xref>
                    </sup>).</p>
                <p>The centrepiece of Generation Solar is the possibility to add installations. There you should fill in as much information on your solar power system as you can: installed capacity, module technology, inverter capacity, coordinates, orientation and tilt are the main ones. You can also upload some pictures of the installation, and give other details you consider relevant in a &#x201C;observations&#x201D; field.</p>
                <p>That way, you will have your installation appearing on the global map.</p>
            </sec>
            <sec>
                <title>4.3 Data output</title>
                <p>Some basic statistics are shown, such as the total number of installations and their power, as a well as a rough estimation of the CO
                    <sub>2</sub> emissions saved by them.</p>
                <p>The full Generation Solar database can be easily downloaded as csv file under a CC BY 4.0 license.</p>
                <p>Note that in order to protect the privacy of the citizen scientists, the information about the installations is stored in a way that it has a spatial resolution of 1.1 km, to avoid the precise identification of their locations.</p>
            </sec>
        </sec>
        <sec sec-type="conclusions">
            <title>5	Conclusions</title>
            <p>Generation Solar is a Citizen Science Initiative in the energy field that takes advantage of the participation of citizens to build an open database of distributed solar PV installations, to give input to researchers working on energy modelling and predictions of production from PV plants. It will be a useful tool for research as long as it succeeds in bringing together the input from a very large number of citizens all over the world.</p>
            <p>A web version of the app is accessible at 
                <ext-link ext-link-type="uri" xlink:href="https://generationsolar.ies.upm.es">https://generationsolar.ies.upm.es</ext-link>, and it can also be freely downloaded for iOS and Android devices.</p>
            <p>There are already plans for upgrading the app to incorporate new functionalities, such as an estimation of the energy production of registered installations to benchmark the real production indicated by the electricity meter, and a more detailed calculation of the CO
                <sub>2</sub> emission savings due to this PV production.</p>
            <p>The design steps of the initiative may serve as a guide for the development of other Citizen Science initiatives, as a participatory and co-creation process was developed to make sure that the initiative responds to a real need in the research field, and at the same time meets the expectations of citizens.</p>
            <p>The urgent changes that we need to implement in the way we consume and produce energy will only be possible with the commitment of the whole society, beginning with the citizens themselves, and Citizen Science is a powerful means to accomplish this engagement. It has already demonstrated its success in many scientific domains, and should also be promoted in the energy sector, and for that researchers and professionals need support, tools, resources, and successful stories to get inspiration from.</p>
        </sec>
        <sec>
            <title>Data availability</title>
            <p>Zenodo: Underlying data - Results from the Open Call: How Citizens can participate in solar energy research?</p>
            <p>
                <ext-link ext-link-type="uri" xlink:href="http://doi.org/10.5281/zenodo.4452416">http://doi.org/10.5281/zenodo.4452416</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref-24">24</xref>
                </sup>
            </p>
            <p>This project contains the following underlying data:</p>
            <list list-type="bullet">
                <list-item>
                    <p>Answers to the online survey "Call for ideas_answers online_survey.xlsx"</p>
                </list-item>
                <list-item>
                    <p>Notes from secretary groups of World Cafe and other meetings: "notes_MMLs_GRECO_2019.pdf&#x201D;</p>
                </list-item>
            </list>
            <p>Data are available under the terms of the 
                <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0).</p>
        </sec>
    </body>
    <back>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sachs</surname>
                            <given-names>JD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Schimdt-Traub</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mazzucato</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Six transformations to achieve the Sustainable Development Goals.</article-title>
                    <source>

                        <italic toggle="yes">Nat Sustain.</italic>
</source><year>2019</year>;<volume>2</volume>:<fpage>805</fpage>&#x2013;<lpage>814</lpage>.
                    <pub-id pub-id-type="doi">10.1038/s41893-019-0352-9</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <article-title>Rome Declaration on Responsible Research and Innovation in Europe</article-title>.<fpage>2014</fpage>.
                    <ext-link ext-link-type="uri" xlink:href="https://ec.europa.eu/research/swafs/pdf/rome_declaration_RRI_final_21_November.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <article-title>Citizen Science: Innovation in Open Science, Society and Policy.</article-title>Ed. S. Hecker, M. Haklay, A. Bowser, Z. Makuch, J. Voger, A. Bonn, UCL Press<fpage>2018</fpage>.
                    <pub-id pub-id-type="doi">10.14324/111.9781787352339</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Carayannis</surname>
                            <given-names>EG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Campbell</surname>
                            <given-names>DFJ</given-names>
                        </name>
</person-group>:
                    <article-title>Mode 3 Knowledge Production in Quadruple Helix Innovation Systems.</article-title>Springer Briefs in Business.<year>2012</year>;<volume>7</volume>.
                    <pub-id pub-id-type="doi">10.1007/978-1-4614-2062-0</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sanderink</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nasiritousi</surname>
                            <given-names>N</given-names>
                        </name>
</person-group>:
                    <article-title>How institutional interactions can strengthen effectiveness: The case of multi-stakeholder partnerships for renewable energy.</article-title>
                    <source>

                        <italic toggle="yes">Energy Policy.</italic>
</source><year>2020</year>;<volume>141</volume>:<fpage>111447</fpage>.
                    <pub-id pub-id-type="doi">10.1016/j.enpol.2020.111447</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sauermanna</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vohland</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Antoniou</surname>
                            <given-names>V</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Citizen science and sustainability transitions.</article-title>
                    <source>

                        <italic toggle="yes">Res Policy.</italic>
</source><year>2020</year>;<volume>49</volume>(<issue>5</issue>):<fpage>103978</fpage>.
                    <pub-id pub-id-type="doi">10.1016/j.respol.2020.103978</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Komendantova</surname>
                            <given-names>N</given-names>
                        </name>
</person-group>:
                    <article-title>Transferring awareness into action: A meta-analysis of the behavioral drivers of energy transitions in Germany, Austria, Finland, Morocco, Jordan and Iran.</article-title>
                    <source>

                        <italic toggle="yes">Energy Res Soc Sci.</italic>
</source><year>2021</year>;<volume>71</volume>:<fpage>10182649</fpage>.
                    <pub-id pub-id-type="doi">10.1016/j.erss.2020.101826</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <article-title>Green Paper on Citizen Science &#x2013; Citizen Science for Europe.</article-title>Socientize Consortium.<year>2013</year>.</mixed-citation>
            </ref>
            <ref id="ref-9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <article-title>Citizen science in the Internet era.</article-title>Declaration in the Summit of the G7 science academies.<year>2019</year>;<volume>24</volume>(<issue>9</issue>):<fpage> 9_113</fpage>&#x2013;<lpage>9_115</lpage>.
                    <pub-id pub-id-type="doi">10.5363/tits.24.9_113</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <article-title>Citizen science and citizen engagement. Achievements in Horizon 2020 and recommendations of the way forward.</article-title>European Commission.<year>2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.upm.es/sfs/Rectorado/Vicerrectorado%20de%20Investigacion/Oficina%20de%20Transferencia%20de%20Resultados%20de%20Investigacion%20(OTRI)/Divulgacion/CitizenScience_CitizenEngagementH2020_andbeyond.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <article-title>Ten principles of citizen science.</article-title>European Citizen Science Association.<year>2015</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://ecsa.citizen-science.net/2016/05/17/10-principles-of-citizen-science/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Crist&#xF3;bal</surname>
                            <given-names>AB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>del Ca&#xF1;izo</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Narvarte</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Open Science: New challenges and opportunities for the PV sector.</article-title>Proc. 36
                    <sup>th</sup>European Photovoltaic Solar Energy Conference.<year>2019</year>.</mixed-citation>
            </ref>
            <ref id="ref-13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Crist&#xF3;bal</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Narvarte</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Barbosa</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The role of citizens in energy transition through research and innovation and their prospects. An example in photovoltaics. submitted for publication.</article-title></mixed-citation>
            </ref>
            <ref id="ref-14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Crist&#xF3;bal</surname>
                            <given-names>AB</given-names>
                        </name>
</person-group>:
                    <article-title>Results from the Open Call: How Citizens can participate in solar energy research?</article-title>
                    <source>

                        <italic toggle="yes">Zenodo</italic>
</source>.
                    <pub-id pub-id-type="doi">10.5281/zenodo.3362238</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Briscoe</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mulligan</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>Digital Innovation: The Hackathon Phenomenon.</article-title>Creativeworks London Working Paper n&#xBA;<year>2014</year>;<fpage>6</fpage>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.creativeworkslondon.org.uk/wp-content/uploads/2013/11/Digital-Innovation-The-Hackathon-Phenomenon1.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <article-title>
                        <ext-link ext-link-type="uri" xlink:href="https://open-power-system-data.org/contribute">https://open-power-system-data.org/contribute</ext-link>.</article-title></mixed-citation>
            </ref>
            <ref id="ref-17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Pfenninger</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Energy scientists must show their workings.</article-title>
                    <source>

                        <italic toggle="yes">Nature.</italic>
</source><year>2017</year>;<volume>542</volume>(<issue>7642</issue>):<fpage>393</fpage>.
                    <pub-id pub-id-type="pmid">28230147</pub-id>
                    <pub-id pub-id-type="doi">10.1038/542393a</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>van Sark WGJHM, Hart</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>de Jong</surname>
                            <given-names>MM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>&#x201C;Counting the Sun&#x201D; &#x2013; a Dutch Public Awareness Campaign on PV Performance.</article-title>Proc. 29th European Photovoltaic Solar Energy Conference,<year>2014</year>;<fpage>4161</fpage>-<lpage>4164</lpage>.
                    <pub-id pub-id-type="doi">10.4229/EUPVSEC20142014-7AV.6.72</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-19">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Yu</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wang</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Majumdar</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>DeepSolar: a machine learning framework to efficiently construct a solar deployment database in the United States.</article-title>
                    <source>

                        <italic toggle="yes">Joule.</italic>
</source><year>2018</year>;<volume>2</volume>(<issue>12</issue>):<fpage>2605</fpage>-<lpage>2617</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.joule.2018.11.021</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <collab>National Renewable Energy Laboratory</collab>:
                    <article-title>The Open PV Project</article-title>. (As explained at
                    <ext-link ext-link-type="uri" xlink:href="https://openpv.nrel.gov">https://openpv.nrel.gov</ext-link>, the project application is no longer available).
                    <ext-link ext-link-type="uri" xlink:href="https://openpv.nrel.gov">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-21">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Schaffer</surname>
                            <given-names>AJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Brun</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Beyond the sun&#x2014;Socioeconomic drivers of the adoption of small-scale photovoltaic installations in Germany.</article-title>
                    <source>

                        <italic toggle="yes">Energy Res Soc Sci.</italic>
</source><year>2015</year>;<volume>10</volume>:<fpage>220</fpage>&#x2013;<lpage>227</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.erss.2015.06.010</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-22">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wolske</surname>
                            <given-names>KS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Stern</surname>
                            <given-names>PC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dietz </surname>
                            <given-names>T</given-names>
                        </name>
</person-group>:
                    <article-title>Explaining interest in adopting residential solar photovoltaic systems in the United States: Toward an integration of behavioral theories.</article-title>
                    <source>

                        <italic toggle="yes">Energy Res Soc Sci.</italic>
</source><year>2017</year>;<volume>25</volume>:<fpage>134</fpage>&#x2013;<lpage>151</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.erss.2016.12.023</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-23">
                <label>23</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Palm</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Peer effects in residential solar photovoltaics adoption&#x2014;A mixed methods study of Swedish users.</article-title>
                    <source>

                        <italic toggle="yes">Energy Res Soc Sci.</italic>
</source><year>2017</year>;<volume>26</volume>:<fpage>1</fpage>&#x2013;<lpage>10</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.erss.2017.01.008</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-24">
                <label>24</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>del Canizo</surname>
                        </name>
</person-group>:
                    <article-title>Underlying data - Results from the Open Call: How Citizens can participate in solar energy research? </article-title>
                    <source>[Data set].

                        <italic toggle="yes">Zenodo.</italic>
</source><year>2021</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.5281/zenodo.4452416">http://www.doi.org/10.5281/zenodo.4452416</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report26633">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/openreseurope.14139.r26633</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>van Sark</surname>
                        <given-names>Wilfried</given-names>
                    </name>
                    <xref ref-type="aff" rid="r26633a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-4738-1088</uri>
                </contrib>
                <aff id="r26633a1">
                    <label>1</label>Copernicus Institute of Sustainable Development, Utrecht University, Utrecht, The Netherlands</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>21</day>
                <month>4</month><year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#xA9; 2021 van Sark W</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport26633" related-article-type="peer-reviewed-article" xlink:href="10.12688/openreseurope.13069.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The authors describe the process to achieve a open data base especially targeted at small sized residential PV systems. This is an outcome of a process to define a suitable project focusing on citizen science.&#xA0;</p>
            <p> </p>
            <p> While the process described to define such a project, it may be biased by the scientists involved in the brainstorming activities. It is unclear who those scientists were, or rather, their expertise and research field. Also, a strong dissemination campaign was undertaken to support a call for participation, with a result of 60 participants. This is a rather small amount.&#xA0;</p>
            <p> </p>
            <p> Within the PV community as well as on various national levels, the need for proper registration of PV systems and especially their contribution to the renewable electricity generation is identified. Larger systems typically are required to report their energy yield in order to receive some kind of financial support from governments. Smaller systems not.&#xA0;</p>
            <p> </p>
            <p> The change towards decentralised power systems requires knowledge about performance of those systems. This is important for utilities and network operators, but also for PV system owners, who typically do not know if their system is performing as promised by the installer.</p>
            <p> </p>
            <p> The paper does not recognise the work of Leloux
                <sup>
                    <xref ref-type="bibr" rid="rep-ref-26633-1">1</xref>
                </sup> and Killinger
                <sup>
                    <xref ref-type="bibr" rid="rep-ref-26633-2">2</xref>
                </sup>, partly based on databases such as pvoutput.org and sonnenertrag.eu. Those databases include the metadata of systems with power generation data.</p>
            <p> </p>
            <p> What is the reason for the 1.1. km spatial resolution, other than privacy? Why not 1 or 2 km, for example.</p>
            <p> </p>
            <p> In addition to Reference 18, an analysis by Tsafarakis 
                <italic>et al.</italic>
                <sup>
                    <xref ref-type="bibr" rid="rep-ref-26633-3">3</xref>
                </sup>&#xA0;provides more details.</p>
            <p>Is the case presented with sufficient detail to be useful for teaching or other practitioners?</p>
            <p>Partly</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>No</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Is the background of the case&#x2019;s history and progression described in sufficient detail?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Photovoltaics performance analysis, next generation PV design, integration of PV in the electricity system.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <back>
            <ref-list>
                <title>References</title>
                <ref id="rep-ref-26633-1">
                    <label>1</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Performance to Peers (P2P): A benchmark approach to fault detections applied to photovoltaic system fleets</article-title>.
                        <source>
                            <italic>Solar Energy</italic>
                        </source>.<year>2020</year>;<volume>202</volume>:
                        <elocation-id>10.1016/j.solener.2020.03.015</elocation-id><fpage>522</fpage>-<lpage>539</lpage>
                        <pub-id pub-id-type="doi">10.1016/j.solener.2020.03.015</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-26633-2">
                    <label>2</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>On the search for representative characteristics of PV systems: Data collection and analysis of PV system azimuth, tilt, capacity, yield and shading</article-title>.
                        <source>
                            <italic>Solar Energy</italic>
                        </source>.<year>2018</year>;<volume>173</volume>:
                        <elocation-id>10.1016/j.solener.2018.08.051</elocation-id><fpage>1087</fpage>-<lpage>1106</lpage>
                        <pub-id pub-id-type="doi">10.1016/j.solener.2018.08.051</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-26633-3">
                    <label>3</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Three years experience in a Dutch public awareness campaign on photovoltaic system performance</article-title>.
                        <source>
                            <italic>IET Renewable Power Generation</italic>
                        </source>.<year>2017</year>;<volume>11</volume>(<issue>10</issue>) :
                        <elocation-id>10.1049/iet-rpg.2016.1037</elocation-id><fpage>1229</fpage>-<lpage>1233</lpage>
                        <pub-id pub-id-type="doi">10.1049/iet-rpg.2016.1037</pub-id>
                    </mixed-citation>
                </ref>
            </ref-list>
        </back>
        <sub-article article-type="response" id="comment3091-26633">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>del Canizo</surname>
                            <given-names>Carlos</given-names>
                        </name>
                        <aff>Universidad Polit&#xE9;cnica de Madrid, Spain</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>11</day>
                    <month>5</month><year>2021</year>
                </pub-date>
            </front-stub>
            <body>
                <p>We thank the reviewer for his valuable comments. 
                    <italic>Comment #1: While the process described to define such a project, it may be biased by the scientists involved in the brainstorming activities. It is unclear who those scientists were, or rather, their expertise and research field. Also, a strong dissemination campaign was undertaken to support a call for participation, with a result of 60 participants. This is a rather small amount.&#xA0;</italic>
                </p>
                <p> Unfortunately, we did not collect info on the professional background of the people answering the online survey. We do know it from the world caf&#xE9;s: energy, materials, physics,&#x2026; We agree that the responses to the survey in step 1 will be biased by the scientists involved in the brainstorming activities. Clearly, the higher the number of experts and the variety of their origin and area of expertise, the better. But our point is in having as a starting point inputs from those who will benefit from the citizen engagement in their research, more than in guaranteeing that the survey is comprehensive and covers all potentially relevant topics. The dissemination campaign was devoted to the second step, that of the participation in the online hackathon. Taking into account that the participation meant the commitment to develop a project, alone or in a group, along a whole week, we think that reaching 60 people from 15 countries is a result of our efforts to reach public beyond what we are used to in our research projects... It is true that &#x201C;strong&#x201D; is an ambiguous word here&#x2026; We have rephrased the text in section 3.2: &#x201C;a call for participation was launched (Figure 1), and disseminated with the support of flyers, a newsletter, press releases, and a videoclip, translated to several languages, throughout different communication channels: GRECO website and social networks, local newspapers and magazines, networks of the GRECO partners.&#x201D;</p>
                <p> 
                    <italic>Comment #2: Within the PV community as well as on various national levels, the need for proper registration of PV systems and especially their contribution to the renewable electricity generation is identified. Larger systems typically are required to report their energy yield in order to receive some kind of financial support from governments. Smaller systems not.&#xA0; The change towards decentralised power systems requires knowledge about performance of those systems. This is important for utilities and network operators, but also for PV system owners, who typically do not know if their system is performing as promised by the installer.</italic> We share the view expressed by the reviewer, and hope that Generation Solar can grow to deliver meaningful contributions to this knowledge.</p>
                <p> 
                    <italic>Comment #3: The paper does not recognise the work of Leloux and Killinger, partly based on databases such as pvoutput.org and sonnenertrag.eu. Those databases include the metadata of systems with power generation data</italic>.</p>
                <p> We thank the reviewer for providing the references, which have been included in the paper. At the end of section 4, the text now says: &#x201C;In this respect, Generation Solar can contribute to give support and continuation to works such as those of [Killinger et al], [Leloux et al], guaranteeing an open an easy access to its database.&#x201D;&#xA0;</p>
                <p> </p>
                <p> 
                    <italic>Comment #4: What is the reason for the 1.1. km spatial resolution, other than privacy? Why not 1 or 2 km, for exampl</italic>e.</p>
                <p> This comes from the fact the way the app finds an equilibrium between privacy and location of the installation, the database takes only two decimals in the latitude and longitude coordinates, and discarding the rest of the decimals</p>
                <p> </p>
                <p> 
                    <italic>Comment #5: In addition to Reference 18, an analysis by Tsafarakis et al.&#xA0;provides more details</italic>.</p>
                <p> Thank you for providing the reference of Tsafarakis et al, which updates and complements the findings of van Sark et al., and has been included in the introduction: &#x201C;Efforts have been made to incorporate this kind of practices in the energy sector, covering aspects such as the evaluation of transition scenarios [H&#xF6;fer et al], the engagement in energy efficiency and energy demand management [Cappa et al] [Filippo et al], the support in the performance assessment of photovoltaic systems [Tsafarakis et al] and the mapping of existing PV installations into OpenStreetMap [Stowell et al].&#x201D;</p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report26625">
        <front-stub>
            <article-id pub-id-type="doi">10.21956/openreseurope.14139.r26625</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Nock</surname>
                        <given-names>Destenie</given-names>
                    </name>
                    <xref ref-type="aff" rid="r26625a1">1</xref>
                    <xref ref-type="aff" rid="r26625a2">2</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-1739-7027</uri>
                </contrib>
                <aff id="r26625a1">
                    <label>1</label>Civil and Environmental Engineering Department, Carnegie Mellon University, Pittsburgh, PA, USA</aff>
                <aff id="r26625a2">
                    <label>2</label>Engineering and Public Policy Department, Carnegie Mellon University, Pittsburgh, PA, USA</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>8</day>
                <month>4</month><year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#xA9; 2021 Nock D</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport26625" related-article-type="peer-reviewed-article" xlink:href="10.12688/openreseurope.13069.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This case study details a citizen science engagement project for PV solar in Europe. The authors use surveys and face-to-face meetings to engage with professionals and a hack-a-thon type event to engage with a broader public. They use the hack-a-thon to gather citizen science ideas about solar projects and then present the final outcome of a PV generation database.</p>
            <p> </p>
            <p> Is the background of the case&#x2019;s history describing in sufficient detail?</p>
            <p> I believe the contest used in section 3.2. is not described in enough detail. What was the goal of the working plan? What do you mean by strong dissemination? How is this like a hackathon?</p>
            <p> </p>
            <p> Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p> </p>
            <p> I find this approach title (&#x201C;Citizen Science for Citizen Science&#x201D;) confusing. It seems redundant. I think the phrasing you used above &#x201C;responsible citizen science&#x201D; makes more sense.</p>
            <p> In the case study the authors state that citizen science experiences in the energy sector are scarce, and then goes to cite two papers. I think the comment about citizen science in the medical, astronomy, and other fields is distracting, because there is a wealth of citizen science initiatives in the energy sector. It would be better to provide citizen science approaches for different parts of the energy sector (generation, efficiency, renewables, etc.). I believe the work could also benefit from some citations about citizen science from a broader global context. This would aid in helping the energy community see possible learnings and opportunities for methods sharing across the globe. I offer possible citations below, but this is by no means exhaustive. One of the citations below points out that there are over 300 papers that investigate both energy efficiency and citizen science, so I am sure the authors will be able to find more for PV programs. 
                <list list-type="bullet">
                    <list-item>
                        <p>H&#xF6;fer, Tim, and Reinhard Madlener. "A participatory stakeholder process for evaluating sustainable energy transition scenarios."
                            <sup>
                                <xref ref-type="bibr" rid="rep-ref-26625-1">1</xref>
                            </sup>
                        </p>
                    </list-item>
                    <list-item>
                        <p>Pocock, M. J., Roy, H. E., August, T., Kuria, A., Barasa, F., Bett, J., ... &amp; Trevelyan, R. (2019). Developing the global potential of citizen science: Assessing opportunities that benefit people, society and the environment in East Africa.
                            <sup>
                                <xref ref-type="bibr" rid="rep-ref-26625-2">2</xref>
                            </sup>
                        </p>
                    </list-item>
                    <list-item>
                        <p>Baker, Erin, et al. "Who is marginalized in energy justice? Amplifying community leader perspectives of energy transitions in Ghana."]ref-3].</p>
                    </list-item>
                    <list-item>
                        <p>Leach, M., &amp; Fairhead, J. (2002). Manners of contestation:&#x201C;citizen science&#x201D; and &#x201C;indigenous knowledge&#x201D; in West Africa and the Caribbean
                            <sup>
                                <xref ref-type="bibr" rid="rep-ref-26625-4">4</xref>
                            </sup>.</p>
                    </list-item>
                    <list-item>
                        <p>Cappa, Francesco, et al. "Nudging and citizen science: The effectiveness of feedback in energy-demand management." 
                            <sup>
                                <xref ref-type="bibr" rid="rep-ref-26625-5">5</xref>
                            </sup>.</p>
                    </list-item>
                    <list-item>
                        <p>Filippo, Daniela De, et al. "Scientometric analysis of research in energy efficiency and citizen science through projects and publications."
                            <sup>
                                <xref ref-type="bibr" rid="rep-ref-26625-6">6</xref>
                            </sup>
                        </p>
                    </list-item>
                </list> </p>
            <p> If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p> N/A</p>
            <p> </p>
            <p> Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p> Yes</p>
            <p> </p>
            <p> Are the conclusions drawn adequately supported by the results?</p>
            <p> </p>
            <p> One of the challenges I see in this paper is the survey participants in step 1 of the citizen science approach in the paper. The main questions presented in this section were: 1. How can citizens collaborate in our research? 2. What are the main barriers towards the integration of PV in society? 3. What does our research give in return to citizens? Yet, the brainstorming activities were conducted with 60 researchers, and the survey was delivered through academic channels. I would have expected the researchers to involved some members of the public who may be interested in the PV sector but are not directly involved in researching or deploying this technology. I understand that the public was involved in the hack-a-thon, but more detail should be given as to how the professional survey aided in the hack-a-thon. Also I expected to see some key takeaways from the survey.</p>
            <p> </p>
            <p> In section 3.4 the authors claim that the open model will aid in energy modeling. I am not seeing the connection. I think energy modelling is such a broad term that the authors need to comment on what type of open energy model they are hoping to aid. Based on section 4 it seems like the focus is on generation expansion modeling. Also I think for renewable energy modeling researchers need estimates for how much sun is in an area (this work might benefit from references to NREL PV Watts model, or Google&#x2019;s Rooftop Solar Project).</p>
            <p> </p>
            <p> The conclusions section would benefit from a discussion about the value of this approach. How did the results here differ from other citizen science approaches, and how was the project enhanced by using the community engagement process? Also there should be some results from the professional survey, and then detail about how this survey fed into the citizen designs.</p>
            <p> </p>
            <p> Is the case presented with sufficient detail to be useful for other teachers and practitioners?</p>
            <p> </p>
            <p> I think that the case needs more detail on why the &#x201C;Open database of rooftop solar PV installations&#x201D;, was chosen as the winner. What set this project apart?</p>
            <p> Also there should be more detail about how the survey from the professionals connects to the final citizen science project. Right now it feels disjointed. Did the professionals get to help decide which project would move forward?</p>
            <p> </p>
            <p> Other notes:</p>
            <p> The text in Table 1 is off. In random places the words jump to the next line.</p>
            <p>Is the case presented with sufficient detail to be useful for teaching or other practitioners?</p>
            <p>Partly</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>No</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>No</p>
            <p>Is the background of the case&#x2019;s history and progression described in sufficient detail?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>I am the director of the Energy, Equity, and Sustainability Group at Carnegie Mellon University. My work lies at he intersection of energy systems modeling, generation investment planning, and stakeholder decision analysis. In previous work I have led a stakeholder engagement in Ghana, and I have led an analysis of Northern Ireland's renewable energy deployment policies.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <back>
            <ref-list>
                <title>References</title>
                <ref id="rep-ref-26625-1">
                    <label>1</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>A participatory stakeholder process for evaluating sustainable energy transition scenarios</article-title>.
                        <source>
                            <italic>Energy Policy</italic>
                        </source>.<year>2020</year>;<volume>139</volume>:
                        <elocation-id>10.1016/j.enpol.2020.111277</elocation-id>
                        <pub-id pub-id-type="doi">10.1016/j.enpol.2020.111277</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-26625-2">
                    <label>2</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Developing the global potential of citizen science: Assessing opportunities that benefit people, society and the environment in East Africa</article-title>.
                        <source>
                            <italic>Journal of Applied Ecology</italic>
                        </source>.<year>2019</year>;<volume>56</volume>(<issue>2</issue>) :
                        <elocation-id>10.1111/1365-2664.13279</elocation-id><fpage>274</fpage>-<lpage>281</lpage>
                        <pub-id pub-id-type="doi">10.1111/1365-2664.13279</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-26625-3">
                    <label>3</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Who is marginalized in energy justice? Amplifying community leader perspectives of energy transitions in Ghana</article-title>.
                        <source>
                            <italic>Energy Research &amp; Social Science</italic>
                        </source>.<year>2021</year>;<volume>73</volume>:
                        <elocation-id>10.1016/j.erss.2021.101933</elocation-id>
                        <pub-id pub-id-type="doi">10.1016/j.erss.2021.101933</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-26625-4">
                    <label>4</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Manners of contestation: &#x201C;citizen science&#x201D; and &#x201C;indigenous knowledge&#x201D; in West Africa and the Caribbean</article-title>.
                        <source>
                            <italic>International Social Science Journal</italic>
                        </source>.<year>2002</year>;<volume>54</volume>(<issue>173</issue>) :
                        <elocation-id>10.1111/1468-2451.00383</elocation-id><fpage>299</fpage>-<lpage>311</lpage>
                        <pub-id pub-id-type="doi">10.1111/1468-2451.00383</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-26625-5">
                    <label>5</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Nudging and citizen science: The effectiveness of feedback in energy-demand management.</article-title>
                        <source>
                            <italic>J Environ Manage</italic>
                        </source>.<year>2020</year>;<volume>269</volume>:
                        <elocation-id>10.1016/j.jenvman.2020.110759</elocation-id><fpage>110759</fpage>
                        <pub-id pub-id-type="pmid">32425166</pub-id>
                        <pub-id pub-id-type="doi">10.1016/j.jenvman.2020.110759</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-26625-6">
                    <label>6</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Scientometric Analysis of Research in Energy Efficiency and Citizen Science through Projects and Publications</article-title>.
                        <source>
                            <italic>Sustainability</italic>
                        </source>.<year>2020</year>;<volume>12</volume>(<issue>12</issue>) :
                        <elocation-id>10.3390/su12125175</elocation-id>
                        <pub-id pub-id-type="doi">10.3390/su12125175</pub-id>
                    </mixed-citation>
                </ref>
            </ref-list>
        </back>
        <sub-article article-type="response" id="comment3090-26625">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>del Canizo</surname>
                            <given-names>Carlos</given-names>
                        </name>
                        <aff>Universidad Polit&#xE9;cnica de Madrid, Spain</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>11</day>
                    <month>5</month><year>2021</year>
                </pub-date>
            </front-stub>
            <body>
                <p>We thank the reviewer for her critical and constructive comments. We have tried to address her concerns in the new version of the paper. Find below our response to the specific comments:</p>
                <p> 
                    <italic>Comment #1: I believe the contest used in section 3.2. is not described in enough detail. What was the goal of the working plan? What do you mean by strong dissemination? How is this like a hackathon?</italic>
                </p>
                <p> Section 3.2 have been rewritten to give more details on the second step of our initiative. The text now reads: &#x201C;In this second phase, a call for participation was launched (Figure 1), and disseminated with the support of flyers, a newsletter, press releases, and a videoclip, translated to several languages, throughout different communication channels: GRECO website and social networks, local newspapers and magazines, networks of the GRECO partners. An online contest, inspired in a hackathon [Briscoe et al], was designed to motivate participants to develop a working plan and submit it for evaluation. In a hackathon, participants are brought virtually together to engage in brief, intensive collaborative work to solve a challenge. Although hackathons started linked to the field of software or IT development, they have more and more been used in all disciplines and proven very powerful for knowledge exchange and broader problem framing [Pe-Than et al], [Ghouila et al]. The contest finally gathered around 60 registered participants from 15 different countries, ran for an entire week and made use of the open source e-learning software Chamilo. Having as starting point the responses gathered in step 1, the participants, individually or in teams, had an entire week to propose an initiative in citizen science for the PV field, conveying a clear and feasible idea, together with the methodology and the tools to develop it.&#xA0;</p>
                <p> 
                    <italic>Comment #2: I find this approach title (&#x201C;Citizen Science for Citizen Science&#x201D;) confusing. It seems redundant. I think the phrasing you used above &#x201C;responsible citizen science&#x201D; makes more sense.</italic>
                </p>
                <p> With the expression &#x201C;Citizen Science for Citizen Science&#x201D;, even if it sounds redundant, we wanted to emphasize that as we see clearly the concept of Citizen Science for Health, Citizen Science for Energy&#x2026; (in general, Citizen Science for a specific discipline), this &#x201C;Citizen Science for&#x2026;&#x201D; can be applied to the Citizen Science itself, in the sense of engaging citizens in the co-creation and design of the initiative. This may be in the full Citizen Science concept, but it does not always happen. Anyway, we have removed the expression from the paper to avoid confusion.</p>
                <p> 
                    <italic>Comment #3: In the case study the authors state that citizen science experiences in the energy sector are scarce, and then goes to cite two papers. I think the comment about citizen science in the medical, astronomy, and other fields is distracting, because there is a wealth of citizen science initiatives in the energy sector. It would be better to provide citizen science approaches for different parts of the energy sector (generation, efficiency, renewables, etc.). I believe the work could also benefit from some citations about citizen science from a broader global context. This would aid in helping the energy community see possible learnings and opportunities for methods sharing across the globe. I offer possible citations below, but this is by no means exhaustive. One of the citations below points out that there are over 300 papers that investigate both energy efficiency and citizen science, so I am sure the authors will be able to find more for PV programs. </italic>
                </p>
                <p> We thank the reviewer for suggesting to broaden the focus and reference citizen science initiatives in energy-related aspects, and offering some very interesting references. We have included some of them in the new version of the paper, and we have also incorporated some specific of the PV field. The paragraph now reads: &#x201C;Efforts have been made to incorporate this kind of practices in the energy sector, covering aspects such as the evaluation of transition scenarios [H&#xF6;fer et al], the engagement in energy efficiency and energy demand management [Cappa et al] [de Filippo et al], the support in the performance assessment of photovoltaic systems [Tsafarakis et al] and the mapping of existing PV installations into OpenStreetMap [Stowel et al]. It is clear that the urgent energy transition in which we are immersed, with the relevance of renewable energies, will only be possible through the concerted action of all stakeholders, putting into practice the benefits of a &#x201C;quadruple helix of innovation&#x201D; [Carayannis et al][Sanderik et al][Sauermanna et al], and going beyond social acceptance by reinforcing the participation in decision-making processes [Komentantoba et al] [Baker et al].&#x201C;&#xA0; &#xA0;</p>
                <p> 
                    <italic>Comment #4:&#xA0; One of the challenges I see in this paper is the survey participants in step 1 of the citizen science approach in the paper. The main questions presented in this section were: 1. How can citizens collaborate in our research? 2. What are the main barriers towards the integration of PV in society? 3. What does our research give in return to citizens? Yet, the brainstorming activities were conducted with 60 researchers, and the survey was delivered through academic channels. I would have expected the researchers to involved some members of the public who may be interested in the PV sector but are not directly involved in researching or deploying this technology. I understand that the public was involved in the hack-a-thon, but more detail should be given as to how the professional survey aided in the hack-a-thon. Also I expected to see some key takeaways from the survey.</italic>
                </p>
                <p> Step 1 was actually designed to include citizens as well, but it just so happened that, at the end, the majority of the responses (not all) came from researchers and professionals in the PV sector. Anyway, the focus here in our opinion is to consider that a citizen science initiative will only succeed if the researchers understand that it responds to a research question they are interested in, and realize that the participation of citizens indeed allows to address it with guarantees. We have made explicit this idea in the text by adding in section 3.1 the following text: &#x201C;In order to launch a citizen science initiative with real value for the advancement of professional science, academic researchers must be included in the design phase, with the double objective of identifying relevant research questions and raising awareness of the support that citizens can provide to address them. This is especially valuable in engineering fields, less represented than biomedical and biological disciplines in public engagement actions.&#x201D; The input from the interested public may be implicitly considered as the researchers themselves are not isolated and receive input from their professional and personal environments. Also, the questions in the survey were defined to broaden the perspective and make the respondents think beyond their specific research topic. This has been specified in the text: &#x201C;For that, face-to-face brainstorming activities were carried out in several sessions in different countries to explore ideas from PV-related personnel around three questions, that were formulated to help the respondents think beyond their specific topics of expertise&#x201D;. On the other hand, the text has been changed to explain that this professional survey was a starting point offered to the hack-a-thon participants to get inspired with the ideas. The last paragraph in section 3.1 now reads: &#x201C;A 9-page document summarizing all responses collected (around 100, see underlying data) was compiled and is openly available in Zenodo [Crist&#xF3;bal et al]. It gathers a handful of ideas that were offered as a starting inspiring point to the participants in step 2.&#x201D;. This idea is also mentioned again in the modified text in section 3.2.: &#x201C;Having as starting point the responses gathered in step 1, the participants, individually or in teams, had an entire week to propose an initiative in citizen science for the PV field&#x2026;&#x201D;</p>
                <p> 
                    <italic>Comment #5:&#xA0; In section 3.4 the authors claim that the open model will aid in energy modeling. I am not seeing the connection. </italic>
                    <italic>I think energy modelling is such a broad term that the authors need to comment on what type of open energy model they are hoping to aid. Based on section 4 it seems like the focus is on generation expansion modeling. </italic>
                    <italic>Also I think for renewable energy modeling researchers need estimates for how much sun is in an area (this work might benefit from references to NREL PV Watts model, or Google&#x2019;s Rooftop Solar Project).</italic>
                </p>
                <p> The remark is very pertinent, and a clarification on what we mean by energy modelling is included in the last paragraph of section 3.3.: &#x201C;The winning proposal aimed at providing support to scientists that model future energy systems with high renewable penetration by creating a collaborative database under an open license regarding the main characteristics of PV installations around the world, fed with the information provided by citizens.&#x201D;. The mention to the energy modelling in the conclusions has also been modified to clarify this point: &#x201C;Generation Solar is a Citizen Science Initiative in the energy field that takes advantage of the participation of citizens to build an open database of distributed solar PV installations, to give input to researchers working on future energy systems simulating different energy supply scenarios and predicting production from PV plants.&#x201D; In this contribution we do not tackle the way that the &#x201C;energy modellers&#x201D; can use the data and elaborate on it; for sure, if they want to estimate the energy generated by the PV installations, they will need to complement the Generation Solar database with data on radiation and temperature. Today there are many tools to facilitate the calculation, the reviewer mentions a couple of online resources that can help on that, and many energy modellers have their own, with different degrees of sophistication.</p>
                <p> 
                    <italic>Comment #6: </italic>
                    <italic>The conclusions section would benefit from a discussion about the value of this approach. How did the results here differ from other citizen science approaches, and how was the project enhanced by using the community engagement process? </italic>
                    <italic>Also there should be some results from the professional survey, and then detail about how this survey fed into the citizen designs.</italic>
                </p>
                <p> We tackle some of these questions in section 4. Besides, the conclusion section has been enriched with a paragraph tackling the aspects that the reviewer is pointing at: &#x201C;The value of Generation Solar is not restricted to the usefulness of the database itself, for which the engagement of citizens is crucial due to the decentralized nature of PV installations; it also comes from the design process, that may serve as a guide for the development of other Citizen Science initiatives. Conceived to build a &#x201C;responsible&#x201D; citizen science initiative, it gives emphasis to participatory and co-creation aspects, to make sure that the initiative responds to a real need in the research field, and at the same time meets the expectations of citizens.&#x201D;</p>
                <p> 
                    <italic>Comment #7: I think that the case needs </italic>
                    <italic>more detail on why the &#x201C;Open database of rooftop solar PV installations&#x201D;, was chosen as the winner. What set this project apart? Also there should be more detail about how the survey from the professionals connects to the final citizen science project</italic>
                    <italic> Right now it feels disjointed. Did the professionals get to help decide which project would move forward?</italic>
                </p>
                <p> The winner scored the highest in the application of the assessment criteria in Table 1. This is now specified in section 3.3: &#x201C;The highest score and hence the major prize&#x2026;&#x201D;. Also, the last paragraph in section 3.3 was rephrased to give more details about why the winning proposal was chosen, and a mention to the connection with the survey from professionals in step 1: &#x201C;The winning proposal aimed at providing support to scientists that model future energy systems with high renewable penetration by creating a collaborative database under an open license regarding the main characteristics of PV rooftop installations around the world, fed with the information provided by citizens. In this way, it addressed some of the ideas coming from the survey in step 1 and summarized in [14]: for example, &#x201C;Identifying locations where solar energy could replace other sources&#x201D;, &#x201C;Providing their experience, especially those that have installed a PV system at home&#x201D;, &#x201C;Sharing data from their solar devices&#x201D;, &#x201C;Send data of photovoltaic installations&#x201D;, &#x201C;[get to know] how solar energy will fulfil the energy needs in their daily life&#x201D;, etc.&#x201D;</p>
                <p> 
                    <italic>Comment #8: The text in Table 1 is off. In random places the words jump to the next line.</italic> We have reformatted the table, and hopefully everything is Ok now.</p>
            </body>
        </sub-article>
    </sub-article>
</article>