Services
Everything from source review to a documented, analysis-ready dataset.
Core services
Pick one, or combine them into a full project.
Feasibility and source review
Before any collection, we check whether your sources are suitable.
- Terms of use and robots review
- Personal data risk notes
- Coverage and effort estimate
Regional web collection
Careful collection of public pages and open data for your region.
- Rate-limited, identified collector
- Raw page snapshots archived
- Full collection logs
Data cleaning and structuring
We turn raw pages into consistent tables.
- Deduplication
- Place, date and language standardisation
- Validation against a codebook
Datasheets and codebooks
Documentation your reviewers and future self will thank you for.
- Source list and dates
- Field definitions
- Known limits and licence notes
Repeated snapshots
Track how a region's web presence changes over time.
- Weekly, monthly or custom schedule
- Versioned datasets
- Change summaries
Advice for researchers
Help planning ethical, defensible use of web data.
- Support for ethics applications
- Sampling and bias discussion
- Method write-up help
Example research uses
Regional economy
Study the spread of local businesses, services or public procurement notices across an area.
Language and culture
Build regional text collections for linguistics and digital humanities.
Public policy
Compare how councils and agencies publish information over time.
Tourism and heritage
Map cultural sites, events and visitor information in a region.
What you receive
Data files
CSV, JSON, Parquet or Excel, whichever fits your tools.
Datasheet
Sources, dates, method and limits in one clear document.
Codebook
Every field defined, with types and allowed values.
Collection log summary
Evidence of what was collected, when and how.
Describe your dataset
Region, sources, time frame and output format: we will take it from there.
Request a quote