
The open research record is now complete enough to auto-assemble a researcher's whole output, some notes on coverage and dedup
I've been building an open-source tool that assembles a researcher's full output from open metadata (disclosure: I'm the dev), and doing it surfaced a few things about the current state of open publishing metadata that I think are worth discussing here.
Short version: between ORCID, OpenAlex, Crossref, DataCite, DBLP, OpenAIRE and the funder/patent/trial registries, you can now pull a fairly complete, structured record of someone's outputs — not just journal articles, but datasets, software, grants, patents, clinical trials, editorial/peer-review roles and conference papers. A few years ago this meant scraping or manual entry; now it's mostly public APIs.
What's actually hard, and where it gets interesting for this crowd:
- Deduplication. The same output shows up across sources with different (or missing) DOIs and inconsistent metadata, so merging by identifier and resolving conflicts is most of the work. OpenAlex vs Crossref vs a funder record for the same paper rarely agree perfectly.
- Author disambiguation. Matching by author identifier (ORCID / OpenAlex author ID) is night-and-day better than name-string matching, which mangles common and non-Western names — but it depends on people actually having and using their ORCID.
- Coverage is very uneven by field and output type. STEM works are well covered via OpenAlex, CS conference papers via DBLP, datasets/software via DataCite/OpenAIRE. Humanities coverage is noticeably thinner, and editorial roles or software are only as good as what people deposit.
Genuinely curious what people here have run into: how complete do you find the open record for your own (or your authors') outputs? Where does it fall down worst — coverage, metadata quality, disambiguation? And is anyone treating OpenAlex as the backbone now, or still stitching in Scopus/WoS?
(The tool, for context: https://sigmacv.org, code at https://github.com/BasileChretien/sigmacv free and open-source, but I'm mainly here for the metadata discussion.)