Open Energy Docs
Share
Explore

Introduction to Open Energy

The operational guidelines aim to provide practical advice to all types of actors participating in the ecosystem. The guidelines are supplemented by links to more detailed technical and membership documentation.
Overarching aims of these operational guidelines:
To deliver a safe and effective Open Energy ecosystem that meets the needs of members and supports the broader sector transition to Net Zero by enabling better discovery and sharing of data via a robust trust framework.
To support the operational requirements of and , stimulating an active Open Energy ecosystem. This includes ensuring that all members understand the sensitivity classes, access, and licensing models for data shared in the ecosystem.
To encourage an active data sharing ecosystem in which transparency and interoperability are incentivised.
To ensure positive member experiences that demonstrate the value of and encourage them to continue participating in the ecosystem.
To minimise potential costs associated with insufficient
or other technical system testing, downtime, or other common faults.
To reduce any reputational risks associated with individual members, incorrect application of core policies, or the ecosystem as a whole.
These guidelines are structured in six sections, outlining:
Introduction (this section): background to the Open Energy project, clarifications of the roles and responsibilities of different types of actors operating in the Open Energy ecosystem.
: definitions of common acronyms, terminology, and technical tools used in documentation.
: ‘at a glance’ list of items that all types of new members will need to consider in order to meet operational requirements.




Note: The Considerations before you start is still in review and so is not present in this version of the documentation

: operational principles and policies central to Open Energy function. Includes policies governing data sensitivity classification, access controls, and licensing.

and : guidelines outlining how can share data safely and securely via the Open Energy ecosystem while retaining strong control, provide appropriate and timely metadata, and design safe and effective
enabling data-sharing. Guidelines outlining how can meet the requirements for offering data services, access and licensing conditions for different data classes, and best practice with regards to testing, security, ethics and dispute management.

: links to other relevant documentation (e.g. technical, legal, etc.) sitting outside the operational guidelines.


Warning
Disclaimer: The contents of the Operational Guidelines do not constitute legal advice. While they have been drafted with regard to relevant regulatory provisions and best practice, they are not a complete list of the regulatory or legal obligations that apply to members and users of Open Energy. Although intended to be consistent with relevant regulations and laws, in the event of any conflict, those regulations and laws will take priority. Participants are responsible for their own compliance with all applicable regulations and laws, including but not limited to: data protection and privacy, consumer protection laws, and energy sector licences and codes (where applicable). The Open Energy operational guidelines will be revised in future in accordance with further development of services offered in the ecosystem, or changes to the regulatory and policy environment in which it operates. Please ensure that you are referring to the most current version of the guidelines prior to reading.
Open Energy is an ambitious, non-profit project working with the energy industry, government and the regulator to modernise access to energy data and break down barriers to data sharing. Open Energy makes it easier to discover, share, access and use energy and related datasets, supporting the sector’s drive towards decarbonisation and its related social and economic benefits.
Open Energy received initial development funding from the Modernising Energy Data Access competition, backed by the Office for Gas and Electricity Markets (Ofgem), the Department for Business, Energy and Industrial Strategy (
), and . The project has built on learning from Open Banking - identifying which elements are transferable to the energy sector, and which require adaptation or fresh thinking. Throughout this process, the Open Energy team has engaged in extensive consultation with the energy sector, in order to ensure that the project meets the widest possible variety of needs. The ethos of Open Energy will remain grounded in sector engagement and a collaborative approach as the project moves forward.
Open Energy aims to serve all actors in the energy sector, and appropriate parts of allied sectors, who are looking to share data, access data, or both. Membership is open to a wide range of organisations - from large corporations through to charities, researchers, or community groups. Both
: and can flow within the Open Energy ecosystem.
Open Energy consists of two core functions: dataset search and discovery, and the Open Energy Governance Service. These functions are described below.
Open Energy’s first core function - Open Energy Search - enables dataset search and discovery. Open Energy Search empowers users to find out what datasets exist and who owns/controls them. Search results also outline the , , and associated with a certain dataset, meaning that access and licensing details are transparent. This works through a search engine designed specifically to search for datasets, with options to search by different parameters in order to refine results. It can also be used to discover datasets adjacent to searches; helping users to build up a more rounded picture of the energy data landscape in their sphere of interest. Open Energy search is free, available to all, and will remain so. Access pathways to Open and Shared data are described in the following section.
Datasets provided by Open Energy members () and non-Open Energy members (e.g. web scraped Open Data) may both be visible in Open Energy Search. Datasets provided by an Open Energy member will be demarcated with a green tick to indicate that the provenance of the dataset has been verified, uptime is monitored, documentation format is known, and users have a mechanism to provide feedback on the dataset if issues are detected. (Please note that this does not indicate that Open Energy has carried out further, more extensive checks on data quality within members’ datasets.)
Open Energy’s second core function - our Governance Service (
) - supports members to provide, share and access different classes of Shared data (see ) on the basis of preemptive licensing (see ). Shared Data accessed via the
will be provided by members only (). The Governance Service aims to provide a secure, trusted mechanism to improve data sharing across the sector by reducing the time and financial costs currently associated with accessing Shared data. For providers of Shared data, the Governance Service offers a secure and effective way to list datasets and set appropriate access and licensing requirements. For actors wishing to access Shared data, the Governance Service provides a mechanism to reduce friction and bilateral contract negotiation, even when requesting access to multiple datasets from different providers.
During Phase 3, Open Energy was governed by two Advisory Groups (Membership and Delivery) and a Steering Group. The groups met once a month and a brief description of each group’s activities is given below.
Membership Advisory Group: Consulted on the Membership contract, key policies, including conditions to participate, roles, responsibilities and liabilities, draft preemptive licence, funding model, operational guidelines, and ongoing governance.
Delivery Advisory Group: Consulted on the drafting of operational guidelines and understanding data production and usage. Fed into the requirements for technical delivery of the Open Energy Governance Service and the Energy Data Search to ensure they meet user needs. Alongside this, examined the day-to-day operational aspects of Open Energy including security and systems.
Steering Group: Supported the overarching strategy, ensured the delivery of our objectives, and helped disseminate work.
The membership of these groups was designed to represent a range of different types of organisations in the energy sector, and broader digital sector where relevant. Open Energy is guided by our principle of ‘by the sector, for the sector’ and we will review our governance beyond Phase 3 to ensure we continue to align with this principle. Open Energy members can apply to join the Advisory and Steering Groups. However, membership of these groups will not be restricted to members only and non-members may be invited to join in order to balance representation. If you are interested in participating in future Open Energy governance mechanisms please contact .
Open Energy supports both Open and Shared datasets containing energy, and energy-related, data. Different classes of data within the Open Energy ecosystem, assessed by their levels of sensitivity, are described in .
Open data is defined in the Open Energy ecosystem as: ‘Data that anyone can use, for any purpose, for free and is accessible under an Open data licence’. Examples of open datasets include (non-exhaustive): Lower Super Output Layer
(
) data, Digest of
Energy Statistics, and OpenStreetMap data.
Open data is visible via Open Energy Search, which is free and open to all users. Open datasets provided by Open Energy members () and non-Open Energy members will both be visible. There are no barriers to accessing Open data once it is discovered - users are directed to an appropriate
or
to access the data themselves. Open data access is not moderated via the
as no additional access controls are required.
Shared data is defined in the Open Energy ecosystem as: ‘Data that is neither open nor closed, but can be shared under specific terms and conditions.’ Examples of datasets currently licensed as Shared data include (non-exhaustive): primary substation capacity, network outage data, weather predictions, European space agency data, Electralink daily smart meter installations, certain geolocation information for energy assets and building typologies. As illustrated in these examples, Shared data is extremely diverse and can include datasets with a range of different commercial, personal and security sensitivity levels. To provide nuance in this area, Open Energy consultations have established a set of five data sensitivity classes, in which three classes describe separate categories of Shared data.
Due to the sheer diversity of data types in the energy sector, Open Energy had to limit focus for Phase 3 development. At present, the
can facilitate the sharing of non-personal Shared data classes only. This means that currently, sharing of non-aggregated personal data (including datasets using forms of anonymisation other than aggregation conforming to
/
best practice) is not permitted in the Open Energy ecosystem. Functionality to share personal data (class ), and data that has been anonymised using techniques other than aggregation, may be extensible in future subject to further consultation.
The metadata and sensitivity class of Shared datasets are listed in Open Energy Search and are visible to any user. Shared datasets provided by Open Energy members () and non-Open Energy members are both visible (where the latter are known), as described later in this section. Access to Shared datasets provided by Open Energy members is moderated through the Open Energy Governance Service, on the basis of preemptive licensing. Access to Shared data listed on the Search that is not provided by an Open Energy member is not supported - users should contact the non-member organisation directly to arrange access.
Closed data is defined in the Open Energy ecosystem as: ‘Data that either cannot be shared or requires a per-use, custom licence negotiated on a case-by-case basis’. Under our current model, closed data is never suitable to share within the Open Energy ecosystem and is not visible through Open Energy Search. While we acknowledge industry feedback flagging potential value in using Open Energy infrastructure to privately share Closed data not listed in the Search or
Directory, this is not a focus of project development in the present phase. Any extensibility of this function in future will be subject to consultation.
Members of the Open Energy ecosystem have different roles: , , or both. This section outlines the meaning of the different roles and outlines their basic responsibilities.
are organisations that control datasets that they wish to make visible and/or accessible through the Open Energy ecosystem. can provide Open and/or Shared datasets. are responsible for: data sensitivity classification, creation of access rules, creation of capability grants, data provision, data integrity and correctness, metadata provision, and
availability, stability and change management. Full guidance regarding responsibilities can be found in .
are organisations that seek to find and access datasets through the Open Energy Governance Service Service. can be established to serve internal organisational needs, to serve external customers, or both. is a catch-all term referring to all parties accessing data via the
. Full guidance can be found in
who access data to serve external customers, potentially including customers outside the Open Energy ecosystem, are categorised as a specific type of called a . See .
Organisations wishing to both provide and access data through the Open Energy ecosystem are able to do so, so long as they fulfill the responsibilities of both roles. who do not want to register as , but who wish to access Open Energy datasets, are able to do so by using the services of a Service Provider (a type of in the Open Energy ecosystem that provides services to customers, potentially including non Open Energy members).
Open Energy has consulted publicly and with industry on policies pertaining to: the types of conditions on which data access controls can be based, the process by which establish access rules for a dataset, and the model for associating access rules with the grant of particular capabilities and obligations (licensing model). These policies are outlined briefly below, and set out in full detail in Section 3 of the Operational Guidelines.
Open Energy has established a set of conditions which may be specified for to meet in order to gain access to datasets in different sensitivity classes. These include, but are not limited to: payment, security compliance, regulatory compliance, standards compliance, group-based access, and use case-based access.
To operationalise Data Access conditions above, we propose a system whereby access grants are determined, for each request to the
of a , on the basis of a set of rules defined and published by that in the dataset metadata.
A data licence is a legal instrument setting out what a can do with a particular artefact (e.g. dataset). This grants certain ‘capabilities’ to the , comprising a clear expression of things they can do with the artefact. Capability grants are accompanied by any obligations that the must abide by when exercising a capability. The capabilities and obligations associated with each
call will be converted into a licence through the Open Energy Governance Service (
).
operates through a range of standardised capability grants and obligations. Standardisation includes legal text, ‘human readable’ text and summary notation. must specify which capabilities and obligations are associated with each access rule, and publish this transparently in the dataset metadata.
This version of the guidelines contains details of operational requirements defined within Phase 3 (ending 31 July 2021). The guidelines are designed as an iterative document that will develop in accordance with future phases of Open Energy. If you have any suggestions regarding areas of the operational guidelines that could benefit from further development, please contact .1. Introduction to Open Energy
The operational guidelines aim to provide practical advice to all types of actors participating in the ecosystem. The guidelines are supplemented by links to more detailed technical and membership documentation.
Overarching aims of these operational guidelines:
To deliver a safe and effective Open Energy ecosystem that meets the needs of members and supports the broader sector transition to Net Zero by enabling better discovery and sharing of data via a robust trust framework.
To support the operational requirements of and , stimulating an active Open Energy ecosystem. This includes ensuring that all members understand the sensitivity classes, access, and licensing models for data shared in the ecosystem.
To encourage an active data sharing ecosystem in which transparency and interoperability are incentivised.
To ensure positive member experiences that demonstrate the value of and encourage them to continue participating in the ecosystem.
To minimise potential costs associated with insufficient
or other technical system testing, downtime, or other common faults.
To reduce any reputational risks associated with individual members, incorrect application of core policies, or the ecosystem as a whole.
These guidelines are structured in six sections, outlining:
Introduction (this section): background to the Open Energy project, clarifications of the roles and responsibilities of different types of actors operating in the Open Energy ecosystem.
: definitions of common acronyms, terminology, and technical tools used in documentation.
: ‘at a glance’ list of items that all types of new members will need to consider in order to meet operational requirements.
Note
The Considerations before you start is still in review and so is not present in this version of the documentation
: operational principles and policies central to Open Energy function. Includes policies governing data sensitivity classification, access controls, and licensing.
and : guidelines outlining how can share data safely and securely via the Open Energy ecosystem while retaining strong control, provide appropriate and timely metadata, and design safe and effective
enabling data-sharing. Guidelines outlining how can meet the requirements for offering data services, access and licensing conditions for different data classes, and best practice with regards to testing, security, ethics and dispute management.
: links to other relevant documentation (e.g. technical, legal, etc.) sitting outside the operational guidelines.
Warning
Disclaimer: The contents of the Operational Guidelines do not constitute legal advice. While they have been drafted with regard to relevant regulatory provisions and best practice, they are not a complete list of the regulatory or legal obligations that apply to members and users of Open Energy. Although intended to be consistent with relevant regulations and laws, in the event of any conflict, those regulations and laws will take priority. Participants are responsible for their own compliance with all applicable regulations and laws, including but not limited to: data protection and privacy, consumer protection laws, and energy sector licences and codes (where applicable). The Open Energy operational guidelines will be revised in future in accordance with further development of services offered in the ecosystem, or changes to the regulatory and policy environment in which it operates. Please ensure that you are referring to the most current version of the guidelines prior to reading.
Open Energy is an ambitious, non-profit project working with the energy industry, government and the regulator to modernise access to energy data and break down barriers to data sharing. Open Energy makes it easier to discover, share, access and use energy and related datasets, supporting the sector’s drive towards decarbonisation and its related social and economic benefits.
Open Energy received initial development funding from the Modernising Energy Data Access competition, backed by the Office for Gas and Electricity Markets (Ofgem), the Department for Business, Energy and Industrial Strategy (
), and . The project has built on learning from Open Banking - identifying which elements are transferable to the energy sector, and which require adaptation or fresh thinking. Throughout this process, the Open Energy team has engaged in extensive consultation with the energy sector, in order to ensure that the project meets the widest possible variety of needs. The ethos of Open Energy will remain grounded in sector engagement and a collaborative approach as the project moves forward.
Open Energy aims to serve all actors in the energy sector, and appropriate parts of allied sectors, who are looking to share data, access data, or both. Membership is open to a wide range of organisations - from large corporations through to charities, researchers, or community groups. Both
: and can flow within the Open Energy ecosystem.
Open Energy consists of two core functions: dataset search and discovery, and the Open Energy Governance Service. These functions are described below.
Open Energy’s first core function - Open Energy Search - enables dataset search and discovery. Open Energy Search empowers users to find out what datasets exist and who owns/controls them. Search results also outline the , , and associated with a certain dataset, meaning that access and licensing details are transparent. This works through a search engine designed specifically to search for datasets, with options to search by different parameters in order to refine results. It can also be used to discover datasets adjacent to searches; helping users to build up a more rounded picture of the energy data landscape in their sphere of interest. Open Energy search is free, available to all, and will remain so. Access pathways to Open and Shared data are described in the following section.
Datasets provided by Open Energy members () and non-Open Energy members (e.g. web scraped Open Data) may both be visible in Open Energy Search. Datasets provided by an Open Energy member will be demarcated with a green tick to indicate that the provenance of the dataset has been verified, uptime is monitored, documentation format is known, and users have a mechanism to provide feedback on the dataset if issues are detected. (Please note that this does not indicate that Open Energy has carried out further, more extensive checks on data quality within members’ datasets.)
Open Energy’s second core function - our Governance Service (
) - supports members to provide, share and access different classes of Shared data (see ) on the basis of preemptive licensing (see ). Shared Data accessed via the
will be provided by members only (). The Governance Service aims to provide a secure, trusted mechanism to improve data sharing across the sector by reducing the time and financial costs currently associated with accessing Shared data. For providers of Shared data, the Governance Service offers a secure and effective way to list datasets and set appropriate access and licensing requirements. For actors wishing to access Shared data, the Governance Service provides a mechanism to reduce friction and bilateral contract negotiation, even when requesting access to multiple datasets from different providers.
During Phase 3, Open Energy was governed by two Advisory Groups (Membership and Delivery) and a Steering Group. The groups met once a month and a brief description of each group’s activities is given below.
Membership Advisory Group: Consulted on the Membership contract, key policies, including conditions to participate, roles, responsibilities and liabilities, draft preemptive licence, funding model, operational guidelines, and ongoing governance.
Delivery Advisory Group: Consulted on the drafting of operational guidelines and understanding data production and usage. Fed into the requirements for technical delivery of the Open Energy Governance Service and the Energy Data Search to ensure they meet user needs. Alongside this, examined the day-to-day operational aspects of Open Energy including security and systems.
Steering Group: Supported the overarching strategy, ensured the delivery of our objectives, and helped disseminate work.
The membership of these groups was designed to represent a range of different types of organisations in the energy sector, and broader digital sector where relevant. Open Energy is guided by our principle of ‘by the sector, for the sector’ and we will review our governance beyond Phase 3 to ensure we continue to align with this principle. Open Energy members can apply to join the Advisory and Steering Groups. However, membership of these groups will not be restricted to members only and non-members may be invited to join in order to balance representation. If you are interested in participating in future Open Energy governance mechanisms please contact .
Open Energy supports both Open and Shared datasets containing energy, and energy-related, data. Different classes of data within the Open Energy ecosystem, assessed by their levels of sensitivity, are described in .
Open data is defined in the Open Energy ecosystem as: ‘Data that anyone can use, for any purpose, for free and is accessible under an Open data licence’. Examples of open datasets include (non-exhaustive): Lower Super Output Layer
(
) data, Digest of
Energy Statistics, and OpenStreetMap data.
Open data is visible via Open Energy Search, which is free and open to all users. Open datasets provided by Open Energy members () and non-Open Energy members will both be visible. There are no barriers to accessing Open data once it is discovered - users are directed to an appropriate
or
to access the data themselves. Open data access is not moderated via the
as no additional access controls are required.
Shared data is defined in the Open Energy ecosystem as: ‘Data that is neither open nor closed, but can be shared under specific terms and conditions.’ Examples of datasets currently licensed as Shared data include (non-exhaustive): primary substation capacity, network outage data, weather predictions, European space agency data, Electralink daily smart meter installations, certain geolocation information for energy assets and building typologies. As illustrated in these examples, Shared data is extremely diverse and can include datasets with a range of different commercial, personal and security sensitivity levels. To provide nuance in this area, Open Energy consultations have established a set of five data sensitivity classes, in which three classes describe separate categories of Shared data.
Due to the sheer diversity of data types in the energy sector, Open Energy had to limit focus for Phase 3 development. At present, the
can facilitate the sharing of non-personal Shared data classes only. This means that currently, sharing of non-aggregated personal data (including datasets using forms of anonymisation other than aggregation conforming to
/
best practice) is not permitted in the Open Energy ecosystem. Functionality to share personal data (class ), and data that has been anonymised using techniques other than aggregation, may be extensible in future subject to further consultation.
The metadata and sensitivity class of Shared datasets are listed in Open Energy Search and are visible to any user. Shared datasets provided by Open Energy members () and non-Open Energy members are both visible (where the latter are known), as described later in this section. Access to Shared datasets provided by Open Energy members is moderated through the Open Energy Governance Service, on the basis of preemptive licensing. Access to Shared data listed on the Search that is not provided by an Open Energy member is not supported - users should contact the non-member organisation directly to arrange access.
Closed data is defined in the Open Energy ecosystem as: ‘Data that either cannot be shared or requires a per-use, custom licence negotiated on a case-by-case basis’. Under our current model, closed data is never suitable to share within the Open Energy ecosystem and is not visible through Open Energy Search. While we acknowledge industry feedback flagging potential value in using Open Energy infrastructure to privately share Closed data not listed in the Search or
Directory, this is not a focus of project development in the present phase. Any extensibility of this function in future will be subject to consultation.
Members of the Open Energy ecosystem have different roles: , , or both. This section outlines the meaning of the different roles and outlines their basic responsibilities.
are organisations that control datasets that they wish to make visible and/or accessible through the Open Energy ecosystem. can provide Open and/or Shared datasets. are responsible for: data sensitivity classification, creation of access rules, creation of capability grants, data provision, data integrity and correctness, metadata provision, and
availability, stability and change management. Full guidance regarding responsibilities can be found in .
are organisations that seek to find and access datasets through the Open Energy Governance Service Service. can be established to serve internal organisational needs, to serve external customers, or both. is a catch-all term referring to all parties accessing data via the
. Full guidance can be found in
who access data to serve external customers, potentially including customers outside the Open Energy ecosystem, are categorised as a specific type of called a . See .
Organisations wishing to both provide and access data through the Open Energy ecosystem are able to do so, so long as they fulfill the responsibilities of both roles. who do not want to register as , but who wish to access Open Energy datasets, are able to do so by using the services of a Service Provider (a type of in the Open Energy ecosystem that provides services to customers, potentially including non Open Energy members).
Open Energy has consulted publicly and with industry on policies pertaining to: the types of conditions on which data access controls can be based, the process by which establish access rules for a dataset, and the model for associating access rules with the grant of particular capabilities and obligations (licensing model). These policies are outlined briefly below, and set out in full detail in Section 3 of the Operational Guidelines.
Open Energy has established a set of conditions which may be specified for to meet in order to gain access to datasets in different sensitivity classes. These include, but are not limited to: payment, security compliance, regulatory compliance, standards compliance, group-based access, and use case-based access.
To operationalise Data Access conditions above, we propose a system whereby access grants are determined, for each request to the
of a , on the basis of a set of rules defined and published by that in the dataset metadata.
A data licence is a legal instrument setting out what a can do with a particular artefact (e.g. dataset). This grants certain ‘capabilities’ to the , comprising a clear expression of things they can do with the artefact. Capability grants are accompanied by any obligations that the must abide by when exercising a capability. The capabilities and obligations associated with each
call will be converted into a licence through the Open Energy Governance Service (
).
operates through a range of standardised capability grants and obligations. Standardisation includes legal text, ‘human readable’ text and summary notation. must specify which capabilities and obligations are associated with each access rule, and publish this transparently in the dataset metadata.
This version of the guidelines contains details of operational requirements defined within Phase 3 (ending 31 July 2021). The guidelines are designed as an iterative document that will develop in accordance with future phases of Open Energy. If you have any suggestions regarding areas of the operational guidelines that could benefit from further development, please contact .
Share
 
Want to print your doc?
This is not the way.
Try clicking the ⋯ next to your doc name or using a keyboard shortcut (
CtrlP
) instead.