UK PlanIt FAQ

How is PlanIt supported?

The site is run as a retirement hobby. It is not a commercial or for-profit enterprise. Donations are appreciated but they do not currently provide anywhere near enough funds to support the site. Instead it is funded by a small income from a few clients who pay for access to the underlying scraping software.

What is the future of PlanIt?

The site is run by one person on a "best efforts" basis which means that there are no guaranteed service standards or formal support mechanisms. While I have every intention of continuing to maintain the site for the medium term it would not be wise to base any commercial services on the API.

Is the full PlanIt dataset available?

No. I don't make the full dataset available or charge for basic access via the API. This is because the planning data are scraped from local government sites many of which are hedged round with legal disclaimers. These mean that I want to avoid any potential legal and contractual issues which might arise if my actions could be interpreted as implying ownership of the data.

What are the API rate limits?

To preserve functionality there is rate limiting to deter those trying to hoover up large quantities of data. I don't specify exactly what the limits are because I do not want users pushing the site capabilities - but you can safely make one request to the /api/applics endpoint every two minutes.

Is the underlying scraping software available?

A very early (2017) version of my open source scraping software UKPlanning is publicly available. The current UKPlanning code base is kept up to date but is not available publicly as I believe that many target sites would become swamped if a large cohort of users started to use the scrapers frequently. This step is taken so that PlanIt is perceived as a good net citizen and to encourage local planning authorities to remove blocking mechanisms such as ReCaptcha (see News)

Why are there no names or documents in the API data?

Names of applicants, agents and case officers are not stored in the underlying database (to avoid any Data Protection issues). Instead there is a note ('See source') in the API data if the name is available in the source information. In addition document details (titles and links) are not routinely collected for the database due to time constraints. However, if there is time during the display of a single planning application web page, the system will make a 'live' query to fill in these fields e.g. /planapplic/Bassetlaw/23/01395/HSE/

Andrew Speakman 01/12/2023