...
- Test compatibility of exported Bags with:
- APTrust
- Perseids
- Archivematica
- Test compatibility of import/export round-tripping between community and alternate Fedora implementations
- Import/export of versions
- Note: Want to keep upcoming Memento API alignment
- Lossless round-tripping (particularly dates)
- other round-tripping issues, e.g.: FCREPO-2429 - Semantic differences between exports Open
- Resolve import bugs that were reported from v0.1 testing
- Verification tool
- Unicode-escaping when resources are exported leads to mismatch when those resources are re-imported
- Users are confused by the tool output
- Lower priority:
- Gracefully handling server-managed triples and timestamps that can't be updated
- Verifying Fedora-to-Fedora and disk-to-disk
- Anything special required for Bags?
- Lower-priority
- Importing into non-empty containers
- There may be several facets to this: importing into a container that already exists (other children of the same resource already exist) seems very useful, but syncing with an existing resource may be much more complex. We should support the easy things, and be careful when tackling the more complex scenarios to maintain a good scope with stakeholder input.
- Maintain links in Bags with links to resources outside of Bags
- Revisit whether this is still an issue given the current Bag export/import functionality
- Incremental diffs of Bags, relating to sending updated Bags to preservation services, not re-transmitting large files that haven't changed, and not overwriting good content with content that's been corrupted, etc.
- Interesting functionality once the other functionality is solid
- Importing into non-empty containers
Resources
- Design - Import - Export
- Applications / tools for using and testing the import export
- Fedora 4.7.2 one-click (jetty-console jar : https://github.com/fcrepo4/fcrepo4/releases/tag/fcrepo-4.7.2
- Fedora 0.1.0 Import / Export utility : https://github.com/fcrepo4-labs/fcrepo-import-export/releases/tag/fcrepo-import-export-0.1.0
- Do not use:
Updated May 23, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-5240eae2.jar Updated May 24, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-d4780ca2.jar- Updated May 26, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-0e42348f.jar
- Do not use:
- Fedora 0.0.3 Import / Export verification utility : https://github.com/fcrepo4-labs/fcrepo-import-export-verify/releases/tag/0.0.3
Steps for using the above
Expand Panel # Download the utility:
https://github.com/fcrepo4-labs/fcrepo-import-export/releases# Have a running Fedora
If you do not have a Fedora to test with, you may want to start up the "one-click run":
https://wiki.duraspace.org/display/FEDORA4x/Quick+Start#QuickStart-One-ClickRun# Have data in your Fedora
If you do not have data in your Fedora, you will likely want to load some of your own or one of the existing example datasets:
https://github.com/fcrepo4-labs/fcrepo-sample-dataset/tree/master/additional_datasetsAlthough there are minimal instructions in the readme linked above, if you run into issues loading any of these datasets, I would be happy to help... the possibility of issues arising is not inconceivable.
# Export your data as Bagit bags
Here are some minimal instructions:
https://github.com/fcrepo4-labs/fcrepo-import-export/blob/master/README.md#running-the-importexport-utility-with-a-bagit-supportTo export APTrust-style bags, use the ''--bag-profile aptrust" argument when running the utility.
Import / Export utility tickets
Expand Jira server DuraSpace JIRA jqlQuery filter=13801 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 Import / Export verification tickets
Expand Jira server DuraSpace JIRA jqlQuery filter=14101 serverId c815ca92-fd23-34c2-8fe3-956808caf8c5
Meetings
Expand | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Meeting 01 - 2017-05-15
Attendees
Agenda
Minutes
|
Expand | ||
---|---|---|
| ||
Meeting 02 - 2017-05-17
Attendees
Agenda
NotesJIRAReview of JIRA process/workflow Individual feedback
|
Expand | ||
---|---|---|
| ||
Questions
Team
|
Expand | ||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||||||||||||
Meeting 04 - 2017-05-26
Attendees
Agenda
NotesRetrospective
|
Standups
IRC Template
No Format |
---|
[Import/Export Standup] Finished yesterday: {ticket titles and associated JIRA links} {and/or brief textual description} Working on today: {ticket titles and associated JIRA links} {and/or brief textual description} Blockers: {brief textual description} |
Expand | ||
---|---|---|
| ||
<escowles> [Import/Export standup] <awoods> [Import/Export Standup] <youn> [Import/Export Standup] <mikeAtUVa> [Import/Export Standup] <benpennell> Finished yesterday: <westgard> [Import/Export Standup] <coblej> |
Expand | ||
---|---|---|
| ||
<lsitu> [Import/Export Standup] <dbernstein> [Import/Export Standup] <bridgetalmas> [Import/Export Standup] Working on today: Verify Perseids BagIt Profile https://jira.duraspace.org/browse/FCREPO-2440 Blockers: Mapping to LDP model Import of tag manifest contents (https://jira.duraspace.org/browse/FCREPO-2444) <youn> [Import/Export Standup] <coblej> [Import/Export Standup] <escowles> [Import/Export Standup] <mikeAtUVa> [Import/Export Standup] <awoods> [Import/Export Standup] |
Expand | ||
---|---|---|
| ||
<dbernstein> [Import/Export Standup] <lsitu> [Import/Export Standup] <coblej> [Import/Export Standup] <mikeAtUVa> [import/export standup] <youn> [Import/Export Standup] <escowles_> [Import/Export Standup] <benpennell> Finished yesterday: <awoods> [Import/Export Standup] <westgard> [Import/Export Standup] |
Expand | ||
---|---|---|
| ||
<coblej> youn: about to try it so we'll see ... will let you know <youn> [Import/Export Standup] <escowles> [Import/Export Standup] <benpennell> Finished yesterday: <awoods> [Import/Export Standup] <westgard> [Import/Export Standup] <mikeAtUVa> [Import/Export standup] <dbernstein> [Import/Export Standup] |
Expand | ||
---|---|---|
| ||
<coblej> [Import/Export Standup] <mikeAtUVa> [import/export standup] <escowles> [Import/Export Standup] <benpennell> Finished yesterday: <awoods> [Import/Export Standup] <lsitu> [Import/Export Standup] <youn> [Import/Export Standup] <westgard> [Import/Export Standup] <dbernstein> [Import/Export Standup] |
Expand | ||
---|---|---|
| ||
<youn> [Import/Export Standup] westgard> [Import/Export Standup] <coblej> [Import/Export Standup] <awoods> [Import/Export Standup] <mikeAtUVa> [import/export sprint standup] <escowles> [Import/Export Standup] <benpennell> [Import/Export Standup] <lsitu> [Import/Export Standup] |
Expand | ||
---|---|---|
| ||
<coblej> [Import/Export Standup] <awoods> Import/Export Standup] <mikeAtUVa> [import/export sprint standup] <youn> [Import/Export Standup] <lsitu> [Import/Export Standup] <escowles> [Import/Export Standup] <benpennell> [Import/Export Standup] <westgardj> [Import/Export Standup] <dbernstein> [Import/Export Standup] |
Expand | ||
---|---|---|
| ||
<coblej> [Import/Export Standup] <youn> [Import/Export Standup] <escowles> [Import/Export Standup] <awoods> Import/Export Standup] <mikeAtUVa> [import/export sprint standup] <benpennell> [Import/Export Standup] <lsitu> [Import/Export Standup] |
Expand | ||
---|---|---|
| ||
<coblej> [Import/Export Standup] <youn> [Import/Export Standup] <escowles> [Import/Export Standup] <lsitu> [Import/Export Standup] <awoods> Import/Export Standup] ... |