Warnings, Caveats and Weasel Words

Most of the experiments linked to here are running on R&D equipment in a non-production environment. They may disappear without warning and/or perform erratically. If one of them isn’t working for some reason, come back later and try again.

Labs

 4 minute read.

Crossref Labs is the dedicated R&D arm of Crossref. In late 2021 we announced that we are re-energizing our R&D efforts after a period of working mostly on development tasks.

What’s our focus?

The division between what the R&D group does at the group-level, and what the wider organisation does will always be more of a gradient than a line. But at the highest level we’d say that R&D will focus on projects that:

  • Address new constituencies.
  • Involve fundamentally new approaches (technology or process or both).
  • Are exploratory with no clear product application yet.

And that a “strategic initiative” (as opposed to a new feature, service, or product) is something that:

  • Involves something we’ve never done before.
  • Involves potential changes to our membership model and fees.
  • Would require a large investment of resources outside of normal budget.

We’re certainly not the only group at Crossref who experiment, build proof of concepts (POCs), and do research, but we hope to support other groups who do - both inside our organization and in the wider research ecosystem.

Sound right up your street? Interested in collaborating on something you’re working on? Let us know.

labs_email

What are we working on now?

We’re experimenting with tracking current and planned work on via GitLab so you can see projects there. A few current highlights are:

  • Playing around with Crossref member information.
  • Conversations about how we might crowdsource retraction information.
  • Setting up our test journal on Open Journal Systems (OJS) so that we have a proper test environment. Many of our members use OJS so having a test site helps us help them with queries and our own testing.
  • Looking into the potential for a pull-based metadata deposit method.

This planning board is also linked to via Crossref’s public roadmap:

Crossref roadmap

And our plan is for these to integrate more closely in future, especially for Labs projects that ‘graduate’.

A flavor of Labs research and experiments

Graduated to production services (or became part of them)

Once upon a time, PLOS ran a project called Article Level Metrics (ALM). It worked well for them internally and had garnered interest and support from other organizations. It had enough potential that we decided to pick it up as a Labs project. The idea was to collect information from various online sources mentioning their DOIs, a version of altmetrics.

The project had a couple of aims:

  • Scale effectively beyond one publisher to all Crossref DOIs.
  • Work out what would be needed to create a production version of such a tool.

The output was intended to be open data to provide context around outputs, while avoiding creating yet another set of metrics. If successful, it had the potential to centralise collection of this kind of data, providing significant efficiencies to publisher and sources. Read more about the early stages of the project at [https://www.crossref.org/blog/many-metrics-such-data-wow/].

The initial experimenting proved successful and by Spring 2014 we were in a position to run a pilot with the cooperation of a number of organisations. The project had become the DOI Event Tracker (DET), which built on Lagotto, the successor of ALM. Read about the DET pilot at [https://www.crossref.org/blog/det-poised-for-launch/].

DET was now ready to be passed over to the production team and in 2017 entered a beta phase.

It has continued as Crossref Event Data, with over 800 million events collected (up until October 2021) and available via a public API.

Page owner: A Crossref Labs creature   |   Last updated 2018-March-06