#HighwaysHack - Data sets

We are only two weeks away from #HighwaysHack. We've already described the three challenges in a previous blog post so now is a good time to give you an idea of the data that already exist and some that will become available for #HighwaysHack. We've collated links to Highways England datasets on data.gov.uk and datasets on Data Mill North into handy lists for strategy/planning, traffic/flow/accidents/road works, infrastructure, public transport, other.

Strategy/planning

1. National Transport Model
   The National Transport Model (NTM) provides a systematic means of comparing the national consequences of alternative national transport policies or widely-applied local transport policies. These policies can be compared against a range of background scenarios which take into account major factors affecting future patterns of travel.
   Geographic range: National
2. Road traffic forecasts 2015
   See also the DfT's Transport appraisal and strategic modelling (TASM) research reports.
   Geographic range: National
3. NEW Roads Investment Strategy Schemes 2015-2020
   Period: 2015 to 2020
   Geographic range: National
4. NEW Agreed Diversion Routes Area 12
   A shapefile to show the agreed diversion routes from the Strategic Road Network on to Local Authority roads. Diversion routes cover Area 12 of the SRN Yorkshire and the Humber. The diversion routes are currently being reconstructed from .pdfs and resurveyed as to their ongoing suitability. The routes included may not therefore be relied upon and are representative only.
   Format: shapefile
   Geographic range: Leeds, Bradford, Calderdale, Kirklees, Wakefield
5. Road schemes
   Period: post 2020
   Geographic range: National
6. Planning applications for Leeds
   Geographic range: Leeds
7. Planning applications for Bradford
   Geographic range: Bradford
8. Planning applications for Calderdale
   Geographic range: Calderdale

Traffic/flow/accidents/road works

1. Highways England network journey time and traffic flow data
   Period: 2009-01 to 2015-03
   Geographic range: National
2. NEW M62 Flow data
   M62 Junction 25 to 30 traffic flow, occupancy (%), speed (km/h), and headway (deciseconds) per lane per minute.
   Period: 2016-10-03 (Monday) to 2016-10-16 (Sunday)
3. Live traffic information from Highways England (previously Highways Agency)
   Live traffic information data showing traffic information on the strategic road network in England, maintained by Highways England (previously called the Highways Agency).
   Period: Live
   Geographic range: England
4. Webtris
   Interactive web app to view TMU/MIDAS site reports
   Format: web app
   Geographic range: National
5. Webtris: Locations of TMU sites
   Traffic monitoring units. Contains longitude, latitude, Id, SiteId, and description
   Format: json
   Geographic range: National
6. Webtris: Locations of MIDAS sites
   Induction loops. Contains longitude, latitude, Id, SiteId, and description
   Format: json
   Geographic range: National
7. Webtris: Daily report for a TMU/MIDAS site
   Daily reports of traffic flow. Modify the URL to change the date range (from and to) and the SiteId
   Format: csv
   Geographic range: National
8. Webtris: Monthly report for a TMU/MIDAS site
   Monthly reports of traffic flow. Modify the URL to change the date range (from and to) and the SiteId
   Format: csv
   Geographic range: National
9. Webtris: Annual report for a TMU/MIDAS site
   Annual reports of traffic flow. Modify the URL to change the date range (from and to) and the SiteId
   Format: csv
   Geographic range: National
10. The mean and median carriageway impact duration times and number of incidents by impact duration on all motorways
    Period: 2011-01 to 2014-03
    Geographic range: National
11. Percentage of 'journeys' on Highways Agency motorways and A roads that are 'on time' by road section by rolling year
    Period: 2011-10 to 2012-06
    Geographic range: National
12. HALOGEN AMI Signal Setting information
    The reports are provided as text files and contains the following columns: Date Time : The date/time of the setting (eg. 28/11/14 12:51:51)) Subsystem : The originating system (eg. SIG for Signals) Equipment Reference : An identifier for the AMI itself (eg. M6/5999A2) Setting: The actual setting on the sign (eg. 40R) Junction Range: The location of the AMI (eg M6 J8 - 10A)
    Period: 2014-10 to 2015-11
    Geographic range: National
13. The DatexII toolkit and schema on the Traffic England site are relevant for live traffic information
14. Planned road works on the HE road network
    This dataset provides information on planned roadworks carried out on the Highways England network. Roadworks listed cover the period up to 15 days in advance from the date of publication. It should be taken as a general indication of what is planned but individual closures could change right up to point of 'go live'. It is not to be considered as 'real time' information.
    Period: Live
    Geographic range: England
15. NEW Planned closures
    Format: csv
    Geographic range: National
16. Live roadworks API
    This link provides access to the live data held behind www.roadworks.org. Information such as live roadworks and gritting routes can be found here.
    Format: api (requires api key)
    Geographic range: National
17. Leeds historic roadworks
    Data related to historic roadworks across Leeds. Automated update This dataset is updated automatically on the 1st day of each quarter.
    Format: csv
    Geographic range: Leeds
18. Stats19
    Road accidents in the UK
    Geographic range: National
19. Leeds Road traffic accidents
    Information on accidents across Leeds. Data includes location, number of people and vehicles involved, road surface, weather conditions and severity of any casualties.
    Format: csv
    Geographic range: Leeds
20. Leeds annual traffic growth
    A dataset to show the traffic count from 30 cameras located around Leeds.
    Format: csv
    Geographic range: Leeds

Infrastructure

1. NEW Strategic Road Network Permanent Speed Limit Start and End Points
   Format: csv
   Geographic range: National
2. NEW Strategic Road Network (Area 12)
   Format: shapefile
   Geographic range: Leeds, Bradford, Calderdale, Kirklees, Wakefield
3. NEW Lighting columns in area 12 (Yorkshire and Humber)
   Format: shapefile
   Geographic range: Leeds, Bradford, Calderdale, Kirklees, Wakefield
4. NEW Marker posts for the Strategic Road Network
   Format: csv
   Geographic range: National
5. NEW Motorway Service Area/Rest Area
   Format: csv
   Geographic range: National
6. Traffic signals in Leeds
   This dataset provides details of all traffic signals in Leeds including their address and Easting/Northing coordinates.
   Format: csv
   Geographic range: Leeds
7. Leeds traffic orders
   The following shape file datasets show the traffic orders for Lines (e.g. double yellow and parking bay restrictions) and Region (e.g. restricted parking zones for residents). Using appropriate Geographic Information Software (GIS) tools the datasets allow you to identify traffic orders across the city.
   Format: shapefile
   Geographic range: Leeds
8. Historic potholes data
   Dataset showing recorded potholes across the city. Information includes location as well as recorded, action and completion dates.
   Format: csv
   Geographic range: Leeds
9. Street lights (unmetered)
   This dataset provides a list of all street lighting apparatus in Leeds that is unmetered (e.g. without an electricty meter). This forms the vast majority of our apparatus.
   Format: csv
   Geographic range: Leeds
10. Leeds pedestrian crossing points
    Format: csv
    Geographic range: Leeds
11. Leeds parking spaces
    Format: csv
    Geographic range: Leeds
12. Calderdale parking spaces
    Parking Spaces information. Includes Locality, Car Park Name and Number of Spaces. This information is published as part of the Local Government Transparency Code.
    Format: xls, csv
    Geographic range: Calderdale
13. Leeds Live car park spaces API
    Leeds City Council can provide you with free access to live car park availability across the city.
    Format: api
    Geographic range: Leeds
14. Council car parks
    List of council-owned car parks, their locations and number of spaces available.
    Format: csv
    Geographic range: Leeds
15. Roadee
    This is a pilot project in partnership with Leeds Beckett University to review road roughness and potentially identify potholes before they appear. Ten mobile phones were installed in 10 council vehicles and software continually collected and uploaded data whilst the vehicle was in use.
    Format: csv
    Geographic range: Leeds
16. OpenStreetMap roads in West Yorkshire (36 MB)
    Format: geojson
    Period: as of 2016-09-27
    Geographic range: Leeds, Bradford, Calderdale, Kirklees, Wakefield

Public transport

1. NaPTAN
   NaPTAN is Britain's national system for uniquely identifying points of access to public transport. It is a core component of the national transport information infrastructure
   Geographic range: National
2. National Rail Enquiries data feeds
   National Rail Enquiries (NRE) support the principle of transparency and contribute to the wider industry agenda by making data openly available in the public domain.
   Geographic range: National
3. Network Rail transparency
   Format: api
   Geographic range: National
4. Bus information API
   Information about bus companies and bus stop locations around the UK. Developers should contact Traveline directly to discuss terms of usage
   Format: api
   Geographic range: National
5. Bus stops
   This dataset lists all the bus stops in the region of the 5 West Yorkshire District Councils (there are over 14,400 stops, although this figure includes each stop at bus stations
   Format: csv
   Geographic range: Leeds, Bradford, Calderdale, Kirklees, Wakefield
6. Leeds Bus lane fines
   Data files that contain every fine issued for unauthorised vehicles being in bus lanes. The data contains date, time, location, fine issued, discount available, and total paid
   Format: csv
   Geographic range: Leeds

Other

1. NEW Open Street Map for West Yorkshire
   A series of Geojson files derived from Open Street Map data for West Yorkshire.
   Period: as of 19th October 2016
   Format: geojson
   Geographic range: Leeds, Bradford, Calderdale, Kirklees, Wakefield
2. Northern Powergrid Industrial fleet mileage
   The following datasets provide a breakdown of the mileage and number of vehicles of the Northern Powergrid fleet.
   Period: 2012 to 2014
   Format: csv, xls
   Geographic range: Leeds, Bradford, Calderdale, Kirklees, Wakefield
3. Leeds Taxi and private hire licences - total number
   Breakdown of the number of each type of taxi and private hire licence issued in Leeds
   Format: csv
   Geographic range: Leeds
4. Hackney carriage and private hire vehicle licences issued in Leeds
   List of all hackney carriage driver (taxi) and private hire (minicab) vehiclelicences issued by Leeds City Council
   Format: csv
   Geographic range: Leeds
5. Hackney carriage and private hire drivers licences issued in Leeds
   List of all hackney carriage driver (taxi) and private hire (minicab) driver licences issued by Leeds City Council
   Format: csv
   Geographic range: Leeds
6. Private hire operator licences issued in Leeds
   All current private hire operators licences (including operator licences that do not currently have any vehicles or drivers associated with them).
   Format: csv
   Geographic range: Leeds
7. Leeds private hire drivers and vehicles registered to each licensed operator
   Private hire operators licensed in leeds and the number of private hire vehicles and drivers that are registered as working with them.
   Format: csv
   Geographic range: Leeds
8. Leeds primary gritting routes
   Dataset showing main primary gritting routes in Leeds. Includes information of starting and end points and ward locations. Automated update
   Format: csv
   Geographic range: Leeds
9. Calderdale Gritting Routes
   Data contains the names of streets in Calderdale which are included on the Precautionary and Classified Gritting Routes.
   Format: csv
   Geographic range: Calderdale
10. Leeds Dropped kerb applications
    This dataset provides information on the number of dropped kerb applications received by Leeds City Council per calender year, and the income received from these applications
    Format: csv
    Geographic range: Leeds
11. Leeds fleet vehicles
    Dataset showing all council owned vehicles.
    Format: csv
    Geographic range: Leeds
12. Leeds On-street parking fines
    Data files that contain fines issued for unauthorised parked vehicles in on-street locations. The data contains date, time, location, fine issued, discount available, and total paid.
    Format: csv
    Geographic range: Leeds
13. Leeds Off-street parking fines
    Data files that contain every fine issued for vehicles not having a valid parking ticket whilst in car parks. The data contains date, time, location, fine issued, discount available, and total paid.
    Format: csv
    Geographic range: Leeds
14. Number of Penalty Charge Notices (PCNs) Issued and Ranked by Street in Calderdale
    List of the streets where Penalty Charge Notices (PCNs) are issued ranked from the most at the top to the least at the bottom.
    Format: xls, csv
    Geographic range: Calderdale
15. Leeds Rain gauge rainfall data
    This dataset shows rainfall data from 6 rain gauges located at various locations across the city. Please note The siting of the gauges is not to Met Office standards
    Format: csv
    Geographic range: Leeds
16. Leeds Air quality - nitrogen dioxide
    Datasets showing nitrogen dioxide levels (NO2) at various locations around Leeds.
    Format: csv
    Geographic range: Leeds
17. ONS Population estimates
    Geographic range: National
18. Flood Risk Register (Environment Agency)
    This dataset and supporting document provides useful information to be able to easily access relevant flooding open data made available by DEFRA.
    Format: csv

Stuart Lowe

ODI Leeds Data Projects