Octopus Download Smart Meter Data ((FULL))

I am getting a smart meter from Octopus as I wish to move to Agile. I currently have EmonPI and use it as a meter to show the difference between solar and usage so we can decide when to turn on devices/ charge up the car. I wanted to compare the consumption feed from the smart meter with the EmonTx feed and perhaps move to the smart meter.

Be aware the consumption data from Octopus is not real time. If its SMETS2 meter it is usually at least 48 hours late. This is because the meter data is collected by the smart meter network every 24 hours. It is then pulled by Octopus from the smart meter network servers some time later and is then available to you.

Octopus Download Smart Meter Data

Download File 🔥 https://cinurl.com/2y3iwN 🔥

The main reason for the smart meter is to go to Agile or Go. I have an electric car ( BMW i3 - for about a year now ) but we only need a 13 amp charge and I have this mounted in a tether style so did not want to get a OHME type charger. Wanted to work out how to charge - primarily overnight but every now and then immediately.

A low cost, Wifi enabled consumer access device (CAD) to bridge smart metering with value added services designed to benefit you, the energy consumer. Features Real time electricity and gas monitoring through an app or API Easy to install...

If people with SMETS2 meters are happy to have their data on an historic basis (as in not real-time), we can support that at no charge - although, as mentioned above, as a DCC Other User, we need to have the individual go through a verification and validation / consent process first.

With the Glow API and Octopus API I can pull accurate smart meter data and TOU tariff data with a crude python programme that has start and end date and gives a totalled print out within a few seconds (depending on the length of the period). I should probably also say that my Octopus bills have always been correct within a few pence which I guess are rounding errors.

I've tried to reach out to Octopus to get some proper answers on smart meters, but clearly they have grown so much - recently taking on Bulb customers - that they have now reached the point of being unable to respond.

You can't get "current usage" from their api as it is using the data uploaded to the (government) smart metre cloud platform. This is sent in thirty minute chunks and I think you can only see the previous calendar day.

The Glow consumer access device (CAD) is for people who'd like a real-time view of their energy consumption from their smart meters and access to that data via our Bright app, APIs and MQTT. Internet options are Wifi or...

One of the impressive features of Octopus Energy is its REST API (Representational State Transfer Application Programming Interface), by which smart meter customers and developers can reliably access data to populate web and mobile apps. While Octopus do have their own guide to the API it isn't as helpful as I would like it to be. As a result, I've written this documentation in the hope that it will help new users getting started. Some of what I write might be somewhat critical of the API as it currently stands. It should be remembered that even the most unintuitive or difficult to use API is a hundred times better than not having an API. I hope that by making clear the points that I find less helpful, it will help others getting started, and ultimately will feed into improvements that I know are in the pipeline. Also, if there is anything you find unclear in what I write, please ask on the Octopus forum and I or someone else will try and get it clarified.For more general information on Octopus and its products, I have an Unofficial Guide that you may find useful.

The API offers a standardised way to request information from Octopus's system.A user makes an http request. This request is essentially a URL, made up of three parts: a base url, the end-point, and the parameters. For example, if we request =OCTOPUS_ENERGY&is_green=true, then is the base url, v1/products/ is the end-point, and ?brand=OCTOPUS_ENERGY&is_green=true contains the parameters. This request is for a list of all products that are green and for brand OCTOPUS_ENERGY. The first parameter is always preceded by a question mark, while subsequent parameters are preceded by ampersands, as in the example above.The response comes back as json, which is a flexible format that can be directly read, or easily unpacked by a downstream application. For example, here is the response from (formatted to look pretty - some applications will do this automatically):

{ "count": 96, "next": null, "previous": null, "results": [ { "code": "1201", "direction": "IMPORT", "full_name": "Affect Standard Tariff", "display_name": "Affect Standard Tariff", "description": "Affect Standard Tariff", "is_variable": true, "is_green": false, "is_tracker": false, "is_prepay": false, "is_business": false, "is_restricted": false, "term": null, "available_from": "2016-01-01T00:00:00Z", "available_to": null, "links": [ { "href": " ", "method": "GET", "rel": "self" } ], "brand": "AFFECT_ENERGY" }, { "code": "AFFECT-FIX-12M-20-02-12", "direction": "IMPORT", At the top of the response it will tell you the number of records returned in the response (in this case 103). If the number of records exceeds the page_size (usually 100), you will have to explicitly ask for the next page - if so this will be given in the "next" field of the response.In many cases like this one, the data being requested won't be private, so it won't need any authentication. In other cases, you'll be requesting private data (like your consumption data), and your request will require authentication. The form of authentication the Octopus API uses is called "basic access", with a security key (but with the password left blank). You can find your security key from the Octopus website (you will need to log in). You shouldn't share your security key with others, and if you do suspect someone else knows it, you can generate a new key from that page. You can make the request in a range of ways, a number of which are documented in the sections below. However, if you're just getting started I'd recommend trying in this Generic API tool. It lets you enter a url, your security key (if needed) and a choice of how you want the output formatted. This file just runs in your browser, but if you feel safer you can save down generic.html and just run it on your own machine. If that doesn't work, you can just put the API endpoint directly in your web browser. If it is an end-point that requires authentication, your browser should prompt you for your username and password, in which case just enter your security key in the username field and leave the password blank. I have two final general points on the API. First, each request you make of the API has a performance impact on Octopus's servers. If too many requests are made, the service won't be sustainable. As a result, when designing any applications that make requests, try to not to overwhelm the API (for example, don't create something that sends a request to the API every second). Second, try to make any applications that process API responses as robust as possible. For example, if you use a few elements from the json response, try to code things so that it won't break if the json contains extra elements. On the other hand, if they are removing data from the response, you can usually expect that they'll notify you before they do it. The basics of mpans/meters/tariffs/products/timezones/unitsBefore I describe the various API end-points, I think it is helpful to distinguish a few terms. Each customer has an account number, which will be of the form A-AAAA1111. If you login to your account dashboard you will see the account number in the URL. Next, each each account will have one or more meter points, each with an mpan (meter point administration number). If you are paid for the electricity you export (as opposed to being on a Feed-in Tariff), you will have a second mpan for your export. Each mpan will generally be populated a meter, and each meter will have a meter serial number. There may be multiple meters for a single mpan, and the same meter may populate multiple The same meter can apply to multiple mpans. There is more information about mpans on wikipedia. For gas, it works similarly, but instead of mpans there are mprns (meter point reference numbers) and you can't export. Each mpan is in a region, and has a region code, which is a letter from A to P. You can lookup the region code from the first two digits of the mpan in this table.Each mpan/mprn will be be subject to a single tariff code at a time (though you can change tariff codes over time). Each tariff will have defined standing charges and usage charges, though these can change over time. Each tariff belongs to a product. There are multiple tariffs for each product, mostly distinguished by the region, whether it is a single or dual register (economy 7 is an example of dual register) and whether it electricity or gas. To identify the product code for a particular tariff, you can usually take off the first few letters of the tariff (E-1R-, E-2R- or G-1R) which indicate if it is electricity single register, electricity dual register (eg economy7) or gas single register, and the letter at the end (eg -A) which indicates the region code. So, for example, E-1R-VAR-19-04-12-N is one of the tariffs for product VAR-19-04-12.When dealing with the API, you're going to need to get used to working in two different time formats. The first is known as UTC or GMT or Zulu. In this format, you can enter a datetime with a Z on the end, like 2018-11-10T00:00:00Z. The second format is UK summer time, which looks like 2019-04-12T13:40:00+01:00 (to indicate that it is one hour ahead of UTC. In requests, you should always put any datetime parameters in UTC format, with a Z at the end, otherwise they may behave inconsistently. With results, all end-points return dates in UTC format in winter, while in summer some end-points return dates in UTC format while others return them in local format. Local time jumps from 1am to 2am on the last Sunday of March, and from 2am back to 1am on the last Sunday of October. There is talk about ending the clock change in the UK, which would make dealing with APIs so much easier!Electricity is typically measured in kwh (kilowatt hour), which is the amount of electricity you get if you use 1 kilowatt for an hour. It is a bit of a crazy unit - but if it helps, 1kwh is equal to 3600 kilojoules. We typically quote the price of electricity in pence/kwh. Wholesale electricity is typcially measured in mwh (megawatt hour), and priced in /mwh. 10/mwh is equivalent to 1p/kwh (ie you divide by 1000 and multiply by 10).Gas is more complicated and depends on the country. In the UK, retail gas is priced in pence/kwh, but is metered in cubic metres. As a result, you need to use a calorific value to convert between cubic metres to kwh - it is roughly 10kwh per cubic metre. Wholesale gas is priced in pence per therm. There are 29.3071 kwh per therm. API end-pointsThere are a lot of end-points available via the Octopus API - here I will run through the main ones that are likely to be useful to Octopus customers. A very useful end-point is < ACCOUNT >/ - this provides you with mpan/mprn and serial numbers for each of your meters, as well as what tariffs you are currently on (and those that you were previously on). You will need to replace with your actual account, which should be something like A-AAAA1111, and you will need to authenticate using your security key. The response will look something like:{"number":"A-AAAA1111","properties":[{"id":123455,"moved_in_at":"2018-10-19T00:00:00+01:00","moved_out_at":null,"address_line_1":"1 SMITH STREET","address_line_2":"","address_line_3":"","town":"LONDON","county":"","postcode":"W1 1AA","electricity_meter_points":[{"mpan":"1200000000000","profile_class":0,"consumption_standard":1428,"meters":[{"serial_number":"1111111111","registers":[{"identifier":"01","rate":"STANDARD","is_settlement_register":true}]}],"agreements":[{"tariff_code":"E-1R-VAR-18-10-05-C","valid_from":"2018-11-10T00:00:00Z","valid_to":"2018-11-27T00:00:00Z"},{"tariff_code":"E-1R-AGILE-18-02-21-C","valid_from":"2018-11-27T00:00:00Z","valid_to":"2019-11-27T00:00:00Z"},{"tariff_code":"E-1R-AGILE-18-02-21-C","valid_from":"2019-11-27T00:00:00Z","valid_to":"2020-11-27T00:00:00Z"}]}],"gas_meter_points":[]}]}One thing to be aware of with this response is that if you have mutliple mpans, it may not be completely obvious which is which. You may be able to work it out by looking at the tariff codes for each mpan. Another thing to be aware of is that variable tariffs will auto-extend when they reach the end, while I expect fixed tariffs switch to the variable tariff when they reach the end of the term.One of the most useful end-points is the one to get consumption data for a particular mpan and meter: -meter-points/< mpan >/meters/< meter serial number >/consumption/. This is discussed in much more detail below. To get the region code, I'd suggest looking up the first two digits of the mpan in this table. However, there are also two API end-points for finding out the region code. The first is useful if you know the postcode but not the mpan: -supply-points/?postcode=W1A1AA (replace with the postcode you want it for). The second can work if you have the mpan: -meter-points/1200000000000/ (replace the code at the end with your mpan). This second end-point isn't always complete, so occasionally this doesn't return a result. (If this is causing a problem for you, contact Octopus and they can add it manually.) Neither of these end-points require authentication.To get a list of all currently active products, use end-point . This endpoint doesn't require authentication. For each record it will give you, among other things, the product code, display name, full name, and a url to get all the tariffs for that product. Don't forget that if it returns more than 100 records, you will have to look at page=2 for the subsequent entries. There are a few parameters that may be useful for this end-point:brand=OCTOPUS_ENERGY - filters on a certain brandis_variable=false - filters on fixed tariffsis_business=false - filters for non-business productsavailable_at=2019-01-01T00:00Z - shows the products that were available at a past datais_green=trueis_prepay=trueA sample response from this is:{"count":3,"next":null,"previous":null,"results":[{"code":"AGILE-18-02-21","direction":"IMPORT","full_name":"Agile Octopus February 2018","display_name":"Agile Octopus","description":"","is_variable":true,"is_green":true,"is_tracker":false,"is_prepay":false,"is_business":false,"is_restricted":false,"term":12,"available_from":"2017-01-01T00:00:00Z","available_to":null,"links":[{"href":" -18-02-21/","method":"GET","rel":"self"}],"brand":"OCTOPUS_ENERGY"},{"code":"GO-18-06-12","direction":"IMPORT","full_name":"Octopus Go June 2018","display_name":"Octopus Go","description":"","is_variable":true,"is_green":true,"is_tracker":false,"is_prepay":false,"is_business":false,"is_restricted":false,"term":12,"available_from":"2018-06-13T00:00:00+01:00","available_to":null,"links":[{"href":" -18-06-12/","method":"GET","rel":"self"}],"brand":"OCTOPUS_ENERGY"},{"code":"VAR-19-04-12","direction":"IMPORT","full_name":"Flexible Octopus April 2019 v1","display_name":"Flexible Octopus","description":"Flexible Octopus offers great value and 100% renewable electricity. As a variable tariff, your prices can rise and fall with wholesale prices - but we'll always give you at least 30 days' notice of a change, and you can switch to a fixed tariff at any time.","is_variable":true,"is_green":false,"is_tracker":false,"is_prepay":false,"is_business":false,"is_restricted":false,"term":null,"available_from":"2019-04-12T13:40:00+01:00","available_to":null,"links":[{"href":" -10-04-12/","method":"GET","rel":"self"}],"brand":"OCTOPUS_ENERGY"}]}If you know the product name, you can get a list of all the tariffs available - mostly split by region, and whether single register electricity, dual register electricity or gas. The end-point for this is -18-02-21/ (or replace with a different product name). Again, this end-point doesn't require authentication. In all cases these results show the current standing charges, and in some cases it also shows the current unit rates (though you can include the parameter tariffs_active_at=2019-01-01T00:00Z to see it as of that historic date). However, it also shows the urls to get the history of standing charges and unit rates for each tariff, which is especially useful for tariffs that change price frequently like AGILE or GO. A sample response from this is:{"code":"AGILE-18-02-21","full_name":"Agile Octopus February 2018","display_name":"Agile Octopus","description":"","is_variable":true,"is_green":true,"is_tracker":false,"is_prepay":false,"is_business":false,"is_restricted":false,"term":12,"available_from":"2017-01-01T00:00:00Z","available_to":null,"tariffs_active_at":"2020-06-03T03:38:24.818834Z","single_register_electricity_tariffs":{"_A":{"direct_debit_monthly":{"code":"E-1R-AGILE-18-02-21-A","standing_charge_exc_vat":20.0,"standing_charge_inc_vat":21.0,"online_discount_exc_vat":0,"online_discount_inc_vat":0,"dual_fuel_discount_exc_vat":0,"dual_fuel_discount_inc_vat":0,"exit_fees_exc_vat":0,"exit_fees_inc_vat":0,"links":[{"href":" -18-02-21/electricity-tariffs/E-1R-AGILE-18-02-21-A/standing-charges/","method":"GET","rel":"standing_charges"},{"href":" -18-02-21/electricity-tariffs/E-1R-AGILE-18-02-21-A/standard-unit-rates/","method":"GET","rel":"standard_unit_rates"}],"standard_unit_rate_exc_vat":3.36,"standard_unit_rate_inc_vat":3.528}}, ...},"brand":"OCTOPUS_ENERGY"} The final end-point I mention are those for price history for each tariff. You can get them from the links within the product response (as shown above). These take one of the following forms: -19-04-12/electricity-tariffs/E-1R-VAR-19-04-12-A/standing-charges/ -19-04-12/electricity-tariffs/E-1R-VAR-19-04-12-A/standard-unit-rates/ -19-04-12/electricity-tariffs/E-2R-VAR-19-04-12-A/day-unit-rates/ -19-04-12/electricity-tariffs/E-2R-VAR-19-04-12-A/night-unit-rates/ -19-04-12/gas-tariffs/G-1R-VAR-19-04-12-A/standing-charges/ -19-04-12/gas-tariffs/G-1R-VAR-19-04-12-A/standard-unit-rates/None of these require authentication, and they will be discussed in more detail below. ff782bc1db