Latest comments on all datasets published by Department for Environment, Food and Rural Affairs
Open data?Posted by Owen Boswarva on Tue, 11/04/2017 - 04:27
There is some ambiguity around the re-use status of this data, as the spreadsheets include the following copyright notice:
"Copyright of data and/or information presented or attached in this document may not reside solely with this Department. Please contact us or see guidance on Copyright at: http://www.defra.gov.uk/statistics/environment/"
-- Owen Boswarva, 11/04/2017
Open data ?Posted by John Joseph on Tue, 18/04/2017 - 11:11
We agree, that the term is ambiguous and appears in numerous datasets as its derived from an older template. We are working on making the most recent release more accessible and this ambiguity has been removed from the recent update (which we will upload shortly) and replaced with the OG licence.
Municiple waste arising dataPosted by akbp1n16 on Wed, 23/08/2017 - 14:45
I need data on municiple waste arising for the year 2013/2014 at local authority level. Thank you
Municipal waste araising 2013/2014Posted by John Joseph on Wed, 23/08/2017 - 15:47
Apologies for the oversight. I have included the data in as an xls file hope that is ok. Going forward we will be publishing in accessible csv. Any comments on what is good, not so good and suggestions can be sent to the email@example.com mailbox. We are interested to learn what the data is being used for of DGUK. - cheers
Dataset releasePosted by Annemcx on Tue, 26/12/2017 - 08:02
Is this dataset being updated?
Dataset releasePosted by John Joseph on Wed, 27/12/2017 - 15:18
Apologies, but I have updated this dataset with the most recent release. I will have to add in the notable authorities for 2016. Otherwise, the rest of the 2017 information contains the figures for 2016. Please get back to me if there are any issues.
Dataset: Family food open data
Is this correctly labledPosted by digitaldickinson on Wed, 24/02/2016 - 08:53
The download "18/2/2016 NFSopen all data" is shown as a PDF. It's a zip file containing text files.
file format issuesPosted by John Joseph on Wed, 24/02/2016 - 10:56
Thank you for your comment. The file format labels have been updated to reflect content more accurately.
Older National Food Survey dataPosted by LisaJones on Thu, 26/10/2017 - 17:43
Where can I obtain NFS data from 1946? Thanks,
Older National Food Survey dataPosted by John Joseph on Thu, 02/11/2017 - 15:07
You can obtain the older reports from here: https://www.gov.uk/government/statistics/family-food-historic-reports and there is also a summary dataset available via the National Archive: http://webarchive.nationalarchives.gov.uk/20130103024837/http://www.defr...
Mis-information regarding reduction of plastic bags being usPosted by Dbpaperbag on Sat, 09/09/2017 - 06:44
Several fundemental points are being lost when claims of a massive 80% reduction in plastic bag numbers is heralded namely
When the weight of a plastic bag for life is taken into account , the actual volume/weight reduction of plastic in our society is only 10-15%
Virtually all plastic bag for life are imported solving other countries plastic waste issue and worsening ours
The vast majority of these bags re only used 2-5 times
Virtually all paper bags are manufacturered in the UK
Approximately only 26% of plastic is recycled
Approximately 72% of all paper is recycled
Paper comes from trees and trees using photosynthesis ctively takes co2 from the atmosphere and replaces it with clean free oxygen
The land under forrestation has grown since 2005 to 2015 by approximately the size of Switzerland
A plastic bag is the by product of the single most polluting item the world has ever known - petrochemicals
While paper is very much a part of the new Circular Economy
Ultra frugal Defra spending?Posted by Dane Wright on Fri, 04/09/2015 - 18:36
Can it really be true that Defra made just 5 spend transactions in Mar 2011 and, even more incredibly, only 1 in Dec 2011?
Files for May and June 2012 look identicalPosted by Dane Wright on Mon, 07/09/2015 - 13:16
The file for May 2012 seems to be a copy of the June 2012 file.
Environment Agency spend dataPosted by Owen Boswarva on Sat, 29/04/2017 - 20:32
Environment Agency's spend data is missing after September 2015.
-- Owen Boswarva, 29/04/2017
Environment Agency spend data - updatePosted by Owen Boswarva on Wed, 14/06/2017 - 06:09
Update from EA in a Freedom of Information response dated 13/06/2017:
"We have not been able to publish our recent reports because our outsourced transaction services provider has not been able to provide a working report for us to use since implementation of a new cross government system. We are currently testing a report. As soon as we are satisfied it is complete and accurate we will commence publishing the information.
"We are working through a backlog in purchasing card data for publishing which arose from the implementation of the new system. We are required under data protection legislation to ensure we remove personal information from published data. In addition we need to expand on descriptions where they are of technical items that would be difficult for a reader to understand. This takes time and we have constrained resources with budget reductions which mean that it is taking longer to publish our information than in previous years. We expect to soon be publishing a data in the upcoming months."
-- Owen Boswarva, 14/06/2017
Envrionment Agency spend dataPosted by John Joseph on Wed, 03/05/2017 - 11:41
The key reason for the delay is that since the EA implemented a new financial system in October 2015, they have not been happy with the output of the report they run to provide the £25k data. They submitted a change request, asking our shared services provider - which created and owns the report - to make suitable amendments to the report's structure, but this has taken a long time to work through the shared service provider's approval process. Once full approval is given, the revised report will be made available and the EA will be able to produce the data for the missing months. Unfortunately, we don't currently have a timescale for this.
Dataset: Natural England INSPIRE WMS Service
the link appears to be brokenPosted by Visitor on Tue, 06/12/2011 - 14:31
the link appears to be broken
The links still aren'tPosted by Visitor on Tue, 28/02/2012 - 16:44
The links still aren't working in the browser. It'd be good to have this fixed!
GetFeatureInfo requests not fully workingPosted by davidm06 on Tue, 09/02/2016 - 16:33
In some GIS systems e.g. QGIS and MapServer, the GetFeatureInfo requests do not work for these layers as the format Text/HTML is not one of the formats offered. Using GetCapabilities, this shows that the formats offered are only Text/Plain, Text/xml and application/vnd.ogc.gml. If Text/HTML was offered, then users of this service could find out the name of the SSSI etc in most GIS systems. Would this be possible to add to the service?
GetFeatureInfo requests not fully working (2)Posted by davidm06 on Tue, 09/02/2016 - 18:03
The Info does not work in MapInfo either. The only GIS platform I can get it working is ArcGIS
Link Not workingPosted by Jo Hickling on Tue, 13/06/2017 - 09:53
The Link to the data in the download is not working. Please could you rectify.
Dataset: Sensitive areas currently identified in the UK under the Urban Waste Water Treatment Directive since 1994
River Yealm ShellfisheryPosted by limosafarmsltd@... on Thu, 23/02/2017 - 18:34
I am an oyster farmer working above waters currently cat B oysters cat C mussels.
The village of Brixton has consented around 100 new houses in the last 3 years, another 90 plus are currently being applied for through planing applications.This is in addition to 5500 new homes planning approved over next 20 years also in our parish ( Sherford new town not discharging to Yealm but pumping stations may have emergency overflows into Yealm).
The EA provided me with spill data for Brixton Sewage treatment works period 15/16, this shows works spilling for over 48 hours every month (620 hours for the year), and total spills of 58 just from the one works.
Planners at South Hams District Council state that EA discussions should take place to discuss how impacts can be overcome, yet at the same time planning officers report on outlined evelopment for 29 houses reccomends approval with no conditions in respect of sewage loadings.I have made representations on this application asking for shellfishery protection to be taken into account.
How can my business gain some influence on the additional loadings being put on our shellfish water?
The planners are not taking proper account of the protection which our shellfishery is entitled to under WFD.
Dataset: Sheep and Goats annual inventory
sheep annual inventory formPosted by dgcraigs on Fri, 11/11/2016 - 09:08
i need a copy of my december 20015 annual inventory form are you able to send me a copy by e mail.My holding no is 31/273/0001 J Craigs ltd Tritlington Hall morpeth ne613ed many thanks
decision makersPosted by Diallo on Tue, 05/07/2016 - 15:12
need list of decision makers on animal health
Decision makersPosted by John Joseph on Thu, 14/07/2016 - 15:52
The Animal Health and Welfare Board of England members list is available from: https://www.gov.uk/government/groups/animal-health-and-welfare-board-for.... The Animal Health and Welfare Board for England (AHWBE) is the principal source of departmental advice to Defra ministers on all strategic health and welfare matters relating to all kept animals in England. If this is not what you are looking for please contact the following with further information about your requirements: firstname.lastname@example.org
Dataset: Requests for Defra publications
Bad linkPosted by Owen Boswarva on Sat, 14/05/2016 - 19:51
The resource link above doesn't currently work because the file name should contain underscores not hyphens. The following works:
-- Owen Boswarva, 14/05/2016
This is NOT the entire raw dataset - WasteDataFlowPosted by Visitor (not verified) on Wed, 25/06/2014 - 12:27
Many thanks for supplying this data in bulk, easy to download files. Compared to getting the data from WasteDataFlow, this is much easier to access. However, I have a contention with your statement that is is the 'entire raw dataset'. With respect to question number 19, i.e. 'Recycling Destination', the data from WasteDataFlow includes the company name and post code of where the waste was destined. In your compiled data set, this crucial information is missing. Hence, this is not the entire raw dataset. Important information is missing and I would like to request that you update your compiled data to include the missing 'destinations' please. I request this purely from a research point of view. Many thanks for your help.
These DatasetsPosted by arctellion on Thu, 15/01/2015 - 14:59
I am using Waste Data Flow to get information on a regular basis, when I saw the datasets above I was glad, its about time, even though it's a year to two out of step with WDF. But the data is not the same as if you were to conduct a RAW Download yourself from WDF, which is what I would expect RAW DATA to be.
If you do a dump to a zip on WDF you get a lot of information per question, not all of which of course is relevant, but most is. So when you say "This is the entire raw dataset." what you are actually meaning, is this is the processed dataset that we want to put out there and pretend that it's the RAW Data?
If you could actually put up the raw data as you would download it, it would be of more use to the world, than your estimation of raw data, and it wouldn't be trying to sell itself as something it isn't.
Trying to access the WMS link for the information. The link provided is not working and needs to be updated.
This comment was generated from feedback about the potential value of this dataset
Please clarify the licence for this dataset.Posted by Owen Boswarva on Wed, 19/11/2014 - 17:13
Please clarify the licence for this dataset.
The Defra website currently says the dataset is re-usable under the Open Government Licence: http://uk-air.defra.gov.uk/aqma/maps. If the dataset is open but contains Ordnance Survey derived data then presumably the OS OpenData Licence could apply instead.
However just saying "Ordnance Survey licence constraints apply" does not provide re-users with sufficient information.
-- Owen Boswarva, 19/11/2014
Dataset: Noise exposure data - England
More informationPosted by Owen Boswarva on Tue, 01/07/2014 - 16:55
Dataset: Organic Statistics Database
Currently registered organic farms and farm shops in the UKPosted by Owen Boswarva on Thu, 13/03/2014 - 15:52
Although it's not open data, Defra has recently released the following dataset in response to a FOI request:
-- Owen Boswarva, 13/03/2013
Dataset: Defra Transparency Panel
Not a datasetPosted by Owen Boswarva on Sun, 29/12/2013 - 16:04
These are meeting minutes, not a dataset. The documents should be posted in the Library section of Data.gov.uk and/or in Defra's area on GOV.UK.
-- Owen Boswarva, 29/12/2013
Effective Public Services
I have just joined Defra. Is this where I should go to find out how we are doing against our key performance indicators? If so, I can only find some financial information (no safety, other key deliverables). Perhaps you could point me tot he right place?
This comment was generated from feedback about the potential value of this dataset
Technical reasons for not making data available?Posted by Visitor (not verified) on Tue, 10/12/2013 - 10:46
Been told by the DWI that their "data is made available internally via a bespoke application which cannot be made available to the public for technical reasons". However, I'm hopeful that this application provides some means by which comprehensive, anonymised customer contact and regulatory sampling datasets can be made available on data.gov.uk under the Open Government Partnership.
Effective Public Services
Releasing this data set (and similar data sets) allows transparency and better understanding of the performance of the water industry, and allows research groups to prioritise and target water industry related research, and to promote innovation in the industry which ultimately leads to higher quality customer service.It goes without saying that customer-identifying information needs to be filtered from the dataset before it is made public.
Potential links to other datasets
To learn more about the causes of water quality issues in water distribution networks the dataset could be explored in conjunction with the OFWAT service failure dataset, which catalogues events such as inadequate pressures at customer supply points and service interruptions. See http://www.ofwat.gov.uk/regulating/aboutconsumers/levelsofservice for more information on OFWAT Levels of Service.
Saves the time and expense associated with numerous different people / groups contacting the same organisations for the same data and saves the organisations the overheads of dealing with multiple requests. Also, at present the way in which data is aggregated in high-level DWI reports varies from year to year; through having access to these reports as well as ‘raw’ regulatory sampling data and anonymised customer contact data the public and academia are able to aggregate data in the way that is most appropriate given the nature of their research.
This comment was generated from feedback about the potential value of this dataset
Dataset: Cereal Stocks, England and Wales
Dataset: Air Quality Management Areas
AQMA Boundaries DatasetPosted by Owen Boswarva on Fri, 11/10/2013 - 14:34
This is an important and useful dataset that in my opinion Defra should prioritise for open data release.
There is more information about the dataset here: AQMA maps
Unfortunately, based on this recent public consultation, Defra is proposing that councils in England should no longer be required to collect the air quality data used to produce this dataset. However we have not yet had the outcome of the consultation.
-- Owen Boswarva, 11/10/2013
Edit: link to information about AQMA maps updated 20/02/2014 and again 14/11/2014.
Update: My post above is out of date as Defra has now released the AQMA boundary dataset as open data for re-use under the Open Government Licence. The dataset may be downloaded in shapefile format from the Defra website: http://uk-air.defra.gov.uk/aqma/maps
-- Owen Boswarva, 14/11/2014
Dataset: Wild Bird Populations in England
detailed bathing water dataPosted by alexrcoley on Fri, 28/09/2012 - 10:20
a richer dataset is available at: http://environment.data.gov.uk/lab this provides information on individual bathing waters / beaches in season and the full history broken down by determinand. it also includes information in general about hte beach (the profile of)
Would be more useful if ..Posted by Visitor on Sat, 14/01/2012 - 09:53
the data was available for individual beaches
Individual beach (bathing water data)Posted by alexrcoley on Fri, 28/09/2012 - 10:16
a richer dataset is available at: http://environment.data.gov.uk/lab this provides information on individual beaches in season and the full history broken down by determinand. it also includes information in general about hte beach (the profile of)
Dataset: Carbon emissions
Incorrect LinkPosted by Visitor on Thu, 08/11/2012 - 11:25
Dead linkPosted by Owen Boswarva on Sun, 23/09/2012 - 06:40
The above link to this download is dead. (The current Government archived a lot of material on the Defra website without using URL forwarding.)
The Excel spreadsheet is currently available at the following link: http://archive.defra.gov.uk/corporate/docs/data/wsr-data-2006.xls
-- Owen Boswarva, 23/09/2012
Dataset: UK's Carbon Footprint 1990 to 2009
Renamed UK's Carbon FootprintPosted by John Joseph on Thu, 08/03/2012 - 12:18
Further updates for this dataset is now available through data.gov under 'UK's Carbon footprint - carbon dioxide emissions relating to UK consumption'
Contractor Pay?Posted by Visitor on Thu, 16/02/2012 - 23:58
These data sets don't show the pay for all the Contractor's that AHVLA are employing
naPosted by Visitor on Sat, 25/02/2012 - 12:00
Obviously you cant read, they only give info on what the company is willing to show.
Dataset: Marine Conservation Zones
I think there is a datapoint in this dataset that is wrong as it is much, much higher than any other of the readings
According to the spreadsheet, on the 05/08/10, an incredible 2,245,413.28 kWh was used between 23.30 and 00.00 (column E)
This can't be right. To give some perspective, this is equivalent to the peak use of half a million households in the UK!
Please can you look into this asap as this will heavily affect any analysis conducted on this data.
Response to 'Error in the data?'Posted by Visitor on Thu, 25/11/2010 - 10:34
This arose because part of the Data Acquisition commissioning process (as a result of the interface between two pieces of metering equipment) produced the illusion of massive consumption for a very short time. This was never based on any real spike in energy use; it was an anomaly which occurred during the set up of the system. We have now built tools to spot occasions when it may happen again.
Many thanks for raising this query.
Defra Built Environment Sustainable Development Team
Night time usePosted by Visitor on Sun, 30/10/2011 - 17:45
There appears to be some very high night time use in this dataset. Seems like the building management system needs to be adjusted.
CSV formatPosted by Visitor on Mon, 31/10/2011 - 10:29
Thank you for providing all these data. I wonder why you decided to put comments in the first lines of each data set. They are always the same and pose work on people automatically retrieving the data. If this is supposed to be a CSV format I would recommend to remove all the comments, or at least use comment characters to mark them. Otherwise, these files will confuse many software packages. Just an idea.
Broken links / login requiredPosted by Visitor on Wed, 05/10/2011 - 14:27
Several of the links to datasets are broken, or take you to an error page saying that a login is required. I'm searching various environmental datasets so it may just be due to the Defra website reshuffle. Are there any plans to update the links anytime soon?
Dataset: Water leakage: 1992/3 to 2009/10
could we have more detail?Posted by Visitor on Wed, 03/08/2011 - 10:45
This is interesting (given that the distribution figures don't seem to be improving at all). Could we have a breakdown by responsible organisation, which would be more useful? And preferably by region as well.
Defra meetingsPosted by Visitor on Tue, 19/04/2011 - 00:04
These links don't work!
Links not workingPosted by Visitor on Wed, 25/05/2011 - 05:51
These links still don't seem to work. Please prod Defra!
I will follow up with our colleagues at defra to see if someone can update the links.
In the mean time you might find the following useful http://www.defra.gov.uk/corporate/docs/data/#permsec
LinksPosted by Visitor on Thu, 28/04/2011 - 09:42
As with the other areas of the Defra pages, none of the links work.
Dataset: CAP Scheme Payments including the Single Payment Scheme (SPS) made to UK beneficiaries 2009
Removal of CAP payments dataPosted by Andrewwharrad on Wed, 24/11/2010 - 08:51
European Courts of Justice have made a ruling that invalidates parts of the EU legislation that requires Member States to publish the data of beneficiaries of CAP funds. As such this information has been taken down from Defra’s website.
More information is available at http://europa.eu/rapid/pressReleasesAction.do?reference=CJE/10/110&format=HTML&aged=0&language=EN&guiLanguage=en
Dataset: NI 194 Air quality - % reduction in NOx and primary PM10 emissions through local authorities estate and operations
download doesn't seem toPosted by Visitor on Fri, 19/11/2010 - 17:54
download doesn't seem to work.
How to see this data,Posted by Visitor on Thu, 17/06/2010 - 14:17
not really user friendly!? go to another website select options? I just wanted to see the data?
Dataset: Local Authority recycling rates
Data QualityPosted by Visitor on Thu, 21/01/2010 - 16:41
Interesting concept - if only the links to data were correct.