The Data City matches UK companies on Companies House to Lightcast companies and presents jobs and skills data for each company.
Lightcast is a global pioneer in the collection and big-data analysis of information on the labor market.
They state their data provides the world’s most detailed information about occupations, skills in demand, and career pathways.
You can read more about their data/methodology on their website.
We have combined our data with Lightcast's to build a more complete view of each sector. Our RTICs provide a comprehensive and accurate picture of the economy, going beyond the limitations of traditional systems such as SIC codes. RTICs combined with job and skills information is a rich dataset which can be used for economic analysis. This data is not available to all customers. It is available as an add-on.
We've developed a paid, yet fully reproducible and downloadable economic analysis platform which stems from Companies House.
We incorporate jobs and skills data from Lightcast for further analysis. Our unique platform stands out by offering company-level data access, setting it apart from the IDBR and ONS datasets, which are not publicly accessible.
Our data: Keen to find out more about our data? Make sure you check out our full list of data guides and knowledge base articles.
Method for matching
We take all UK companies we have matched to a website on Companies House and all of Lightcast's companies then we create a shortlist of Lightcast possible matches to TDC companies using a combination of different fields.
We score the shortlist based on similarity metrics and add some sensible restraints. The highest scored matched is assigned the match subject to the match score exceeding a threshold.
Our match rate is currently around 90% accurate.
Due to issues with companies registering multiple entities of the same company, we may accidentally match one Lightcast company to many Companies House companies.
Data
We extract specific datasets from Lightcast's API which are most useful for analysis.
We consider the most useful datasets to be: Jobs by Standard Occupational Classification (SOC4), Jobs by Lightcast Occupation Taxonomy (LOT), Specialised Skills, Software Skills, Common Skills and Certification Skills. The data is updated quarterly and we take this data on a timeseries basis.
Here's how it looks on the platform:
Lightcast timeseries data is available from 2019.