Skip to content

Harvest details of periodicals submitted to Trove through the National edeposit scheme (NED)

This notebook harvests details of periodicals submitted to Trove through the National edeposit scheme (NED). It creates two datasets, one containing details of the periodical titles, and the other listing all the available issues.

There are two main harvesting steps. The first is to search for periodicals using the API's /result endpoint using the following parameters:

  • q set to "nla.obj" nuc:"ANL:NED"
  • format facet to Periodical
  • and l-availability set to y

The work records returned by this search are unpacked, and individual versions saved to make sure we get everything. Once this is complete, any duplicate records are merged.

The second step harvests details of issues by extracting a list of issues for each title from the collection viewer. It then supplements the issue metadata by extracting information for each issue from the journal viewer.

Preview

Expand

Using this notebook

To run this notebook using the ARDC Binder service you'll need to log in using an account from an Australian university or research organisation. If you don't have an account, try MyBinder instead.

Run live on ARDC Binder

The MyBinder service doesn't require any authentication, but it can be slow to start and will sometimes fail when busy. If you have a login at an Australian university, you'll probably get better results with ARDC Binder.

Run live on MyBinder

Binder is great for experimentation and quick tasks, but for some projects you might need a dedicated, persistent environment in which to work. There's information on other options in the run these notebooks section.

Additional documentation

Getting help