Summary
The objective of the pilot was to migrate a large Newspaper title (187,331 objects) and a modern digitised Journal with complex rights issues.
Project Details
To start the process we are migrating 6 objects 1 Newspaper Title, 1 issue and 4 pages so we can analize in detail how the migration has affected the Fedora 3 objects. Once this small batch has completed successfully we can test with a larger batch.
We went through a useful process of mapping the Newspaper objects and hierarchy to PCDM which introduced staff at the library to the power of Fedora 4. Results of this mapping can be seen at PCDM Mapping for Welsh Newspapers (NLW).
Migration Process
We choose to migrate from a native fcrepo3 filesystem as the Newspaper Content will take a long time to export. We developed a script which takes in a list of PIDs and creates a native fedora 3 file system with only the objects and datastreams we are interested in. This allowed us to use Fedora 4 migration utils with the following configuration:
- Native fcrepo3 filesystem ( nativeFoxmlDirectoryObjectSource )
- Legacy Fedora filesystem ( legacyIDResolver )
We are currently testing this configuration and analyzing the results.
Issues
We have encountered the following issues:
- A problem with how related collections are created
https://github.com/fcrepo4-labs/migration-utils/issues/15
The resolution was to develop a customer ID Mapper:
and to customize the locations of created resources.
- A problem with multiple versions of RELS-EXT
The Newspaper title has 203 versions of the RELS-EXT datastream which is causing some problems for the migration:
https://github.com/fcrepo4-labs/migration-utils/issues/18
Feedback
How did the migration process compare to your expectations? How could the tools, documentation, etc. be improved? Was the upgration pilot a useful exercise?
Future Plans
What are your plans for continuing to migrate to Fedora 4? When do you expect to be in production?
