Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Design - Import - Export
  2. Applications / tools for using and testing the import export
    1. Fedora 4.7.2 one-click (jetty-console jar : https://github.com/fcrepo4/fcrepo4/releases/tag/fcrepo-4.7.2
      1. Updated May 23, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-webapp-4.8.0-SNAPSHOT-jetty-console-a07a1a46.jar
    2. Fedora 0.1.0 Import / Export utility : https://github.com/fcrepo4-labs/fcrepo-import-export/releases/tag/fcrepo-import-export-0.1.0
      1. Do not use: Updated May 23, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-5240eae2.jar
      2. Updated May 24, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-d4780ca2.jar
      3. Updated May 26, 2017: https://s3.amazonaws.com/f4-artifacts/fcrepo-import-export-0.1.1-SNAPSHOT-0e42348f.jar
    3. Fedora 0.0.3 Import / Export verification utility : https://github.com/fcrepo4-labs/fcrepo-import-export-verify/releases/tag/0.0.3
    4. Steps for using the above

      Expand


      Panel

      # Download the utility:
      https://github.com/fcrepo4-labs/fcrepo-import-export/releases

      # Have a running Fedora
      If you do not have a Fedora to test with, you may want to start up the "one-click run":
      https://wiki.duraspace.org/display/FEDORA4x/Quick+Start#QuickStart-One-ClickRun

      # Have data in your Fedora
      If you do not have data in your Fedora, you will likely want to load some of your own or one of the existing example datasets:
      https://github.com/fcrepo4-labs/fcrepo-sample-dataset/tree/master/additional_datasets

      Although there are minimal instructions in the readme linked above, if you run into issues loading any of these datasets, I would be happy to help... the possibility of issues arising is not inconceivable.

      # Export your data as Bagit bags
      Here are some minimal instructions:
      https://github.com/fcrepo4-labs/fcrepo-import-export/blob/master/README.md#running-the-importexport-utility-with-a-bagit-support

      To export APTrust-style bags, use the ''--bag-profile aptrust" argument when running the utility.



  3. Import / Export utility tickets

    Expand

    Jira
    serverDuraSpace JIRA
    jqlQueryfilter=13801
    serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5


  4. Import / Export verification tickets

    Expand

    Jira
    serverDuraSpace JIRA
    jqlQueryfilter=14101
    serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5


...

Expand
titleMeeting 03 - 2017-05-23

Questions

  1. Do you have a full load of tasks between now and the end of the week?
  2. In what areas do you need help or see a gap with respect to achieving the sprint objectives?

Team

  1. Youn - need work to do, tickets have been addressed, can do testing
    1. testing changes to import/export
    2. testing steps
      1. start 4.7.2
      2. import plantpatents (and other datasets)
      3. export
      4. verify
      5. delete 4.7.2 (new port/context)
      6. import
      7. verify
  2. Ben - need testing for versioning, plate-full, need review of PR
  3. Danny - verification with bags, configuration file is not right
  4. Jim - need testing inbound links, will be testing duke data, testing-p-f
  5. Josh - need a ticket for verifying external content that is downloaded, p-f
  6. Esme - trailing slash
  7. Mike - plate-full
  8. Longshou - working verify digest
  9. Danny - verify bags and remaining issues

Standups

IRC Template

No Format
[Import/Export Standup]
Finished yesterday: 
  {ticket titles and associated JIRA links}
  {and/or brief textual description}
Working on today:
  {ticket titles and associated JIRA links}
  {and/or brief textual description}
Blockers:
  {brief textual description}


Expand
titleMeeting 04 - 2017-05-26

Meeting 04 - 2017-05-26

  • 11am ET

Attendees

Agenda

  1. Retrospective, from a process perspective...
    1. What went well?
    2. What went wrong?
    3. What could we do differently to improve?
  2. Outstanding tasks/work

    1. Expand
      titleImport/Export tickets

      Jira
      serverDuraSpace JIRA
      jqlQueryfilter=13801
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5



    2. Expand
      titleImport/Export Verification tickets

      Jira
      serverDuraSpace JIRA
      jqlQueryfilter=14101
      serverIdc815ca92-fd23-34c2-8fe3-956808caf8c5


Notes

Retrospective
  1. Ben
    • well: pairing
    • wrong: challenge of speculating about future versioning
    • change: who to ask for feedback, availability of team
  2. Danny
    • well: pairing (youn wanted to be in hangouts earlier)
    • well: productive
    • wrong: not fully available
    • wrong: synchronizing import/export with verification
    • change: meeting on Friday of first week (Mon1/Wed1/Fri1/Tue2/Fri2)
  3. Esme
    • well: good and plenty of tickets
    • well: pairing
    • well: current meeting schedule was good
    • wrong: merge conflicts
    • wrong: f4 issues
    • wrong: synchronizing import/export with verification
    • change: smaller, more frequent sprints
  4. Harsha
    • wrong: did not fully participate
  5. Jim
    • well: productive and connected with team
    • wrong: not paired
    • wrong: not fully available
    • wrong: synchronizing import/export with verification
  6. Josh
    • well: productive, kudos to Danny
    • wrong: synchronizing import/export with verification
    • wrong: verification tool ended up in a broken state
    • change: verification sprint follows import/export sprint
    • change: would be good for there to be activity between sprints
  7. Longshou
    • well: pairing
    • well: focused on testing
  8. Andrew
    • wrong: too non-sprint many meetings
    • wrong: merging conflicts
    • change: do people read standups?
  9. General
    • maybe different timeframes for different roles
      • dev: 2week sprints
      • testing: 1week sprints
    • having pairing hangouts was helpful
  10. Mike - mail-in
    • well: pairing
    • productive
    • interest in working after sprint
  11. Youn - mail-in
    • wrong: two weeks too long
    • change: verification sprint follows import/export sprint
    • wanted to be in hangouts with danny/josh earlier

Standups

IRC Template

No Format
[Import/Export Standup]
Finished yesterday: 
  {ticket titles and associated JIRA links}
  {and/or brief textual description}
Working on today:
  {ticket titles and associated JIRA links}
  {and/or brief textual description}
Blockers:
  {brief textual description}


Expand
titleStand-up report - 2017-05-16

 

<escowles> [Import/Export standup]
<escowles> Finished yesterday:
<escowles> * Adding option to overwrite tombstones on import https://jira.duraspace.org/browse/FCREPO-2202
<escowles> * Suppressing duplicate RDF types on re-import https://jira.duraspace.org/browse/FCREPO-2429
<escowles> Today:
<escowles> * Responding to code review comments
<escowles> * Support changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
<escowles> Blockers:
<escowles> * None

<awoods> [Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Created and assigned several tickets based on Sprint Kickoff meeting: https://wiki.duraspace.org/display/FF/2017-05+Import+-+Export+Sprint+04+Meetings
<awoods> - Reviewed Adding option to overwrite tombstones on import https://jira.duraspace.org/browse/FCREPO-2202
<awoods> Working on today:
<awoods> - Reviewing any tickets that are completed
<awoods> - Working "import tool looks for sha1 manifest file with capitalized filename" :
<awoods> https://jira.duraspace.org/browse/FCREPO-2443
<awoods> Blockers:
<awoods> - None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - Ran export and import using one-click jar and 10KIndirectContainers
<youn> - Attempted to run verify.py
<youn> Working on today:
<youn> - Run verify.py
<youn> - FCREPO-2369: verify.py fails on unicode-escaped characters; attempt to replicate error
<youn> - FCREPO-2438: document use of CND for namespaces; attempt to apply fix
<youn> - Will be offline in the afternoon for meetings, etc.
<youn> Blockers:
<youn> - urllib module in verify.py?

<mikeAtUVa> [Import/Export Standup]
<mikeAtUVa> Finished yesterday:
<mikeAtUVa> Spoke breifly with benpennell to strategize
<mikeAtUVa> Working on today:
<mikeAtUVa> https://jira.duraspace.org/browse/FCREPO-2432 adding support to update certain server-managed triples
<mikeAtUVa> - replace code that simplifies PUT interactions to use existing "handling-lenient, received-minimal" pattern
<mikeAtUVa> - attempt to implement intuitive date updates adding children with provided creation dates
<mikeAtUVa> - add test cases for binaries and ensure that they work
<mikeAtUVa> - address test failure on travis (didn't appear locally) : https://travis-ci.org/fcrepo4/fcrepo4/builds/232586336?utm_source=github_status&utm_medium=notification
<mikeAtUVa> - determine the interaction of forced modification dates with etags and their implications on caching and if-modified headers
<mikeAtUVa> Blockers:
<mikeAtUVa> - none

<benpennell> Finished yesterday:
<benpennell> * environment setup
<benpennell> * read through Mike's work on https://jira.duraspace.org/browse/FCREPO-2432
<benpennell> Working on today:
<benpennell> * familiarize myself with import/export codebase.
<benpennell> * familiarize myself with current and new versioning specifications, the challenges involved.
<benpennell> * strategize about how to represent versions
<benpennell> * work towards generating some tickets with Mike.
<benpennell> Blockers:
<benpennell> * is there previous work/discussion about exporting versions to reference?


<westgard> [Import/Export Standup]
<westgard> Finished yesterday:
<westgard> re-familiarized myself with code and tickets
<westgard> consulted with dbernstein regarding logging behavior ticket (FCREPO-2368)
<westgard> identified test data that demonstrates bug in unicode escaping (FCREPO-2369)
<westgard> Working on today:
<westgard> FCREPO-2303 (verify triples)
<westgard> FCREPO-2329 (handle missing resources during verification)
<westgard> Blockers:
<westgard> More feedback from stakeholders regarding desired logging behavior & command line options would be helpful (relates to FCREPO-2368)

<coblej>
Finished yesterday:
  Installed applications / tools for import export testing on workstation.
Working on today:
Verifying installation of applications / tools.
Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
Blockers:
Cannot load “main” sample datasets into one-click run Fedora 4.7.2.  “mvn -Dfcrepo.url=http://localhost:8080/rest/ exec:java” command results in “ERROR 08:29:39.119 (FedoraInvalidNamespaceExceptionMapper) NamespaceExceptionMapper caught an exception: Prefix fcr has not been registered” for each dataset.  (Loading the “additional datasets” via fcr:restore seems to work fine.)


Expand
titleStand-up report - 2017-05-17

<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Re-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-2428
<lsitu> Working on today:
<lsitu> Add support for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
<lsitu> Blockers:
<lsitu> N/A.

<dbernstein> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> https://jira.duraspace.org/browse/FCREPO-2448
<dbernstein> * Added setup.py to verify tool and setup up support for adding unit tests
<dbernstein> * Did some minor refactoring of command line parser using ‘click’ module
<dbernstein> * Add support for installing verify (now fcrepo-verify) on the path.
<dbernstein> * Pull request is in.
<dbernstein>
<dbernstein> Working on today:
<dbernstein>
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
<dbernstein> (provide full DEBUG-level logging for import-export verification tool)
<dbernstein> Blockers:
<dbernstein> None.

<bridgetalmas> [Import/Export Standup] Working on today:   Verify Perseids BagIt Profile  https://jira.duraspace.org/browse/FCREPO-2440 Blockers:   Mapping to LDP model   Import of tag manifest contents (https://jira.duraspace.org/browse/FCREPO-2444)

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - Ran verify.py to verify export of 10KIndirectContainers; attempted to verify import but stopped when I ran into lots of verification errors
<youn> - Started repository with modified repository.json and namespaces.cnd
<youn> Working on today:
<youn> -

Expand
titleStand-up report - 2017-05-16

 

<escowles> [Import/Export standup]
<escowles> Finished yesterday:
<escowles> * Adding option to overwrite tombstones on import https://jira.duraspace.org/browse/FCREPO-2202
<escowles> * Suppressing duplicate RDF types on re-import -2369 - backup and import data set that caused error
<youn> - https://jira.duraspace.org/browse/FCREPO-2429
<escowles> Today:
<escowles> * Responding to code review comments
<escowles> * Support changing repository baseURL -2438 - finish
<youn> - look into import verification errors
<youn> Blockers:
<youn> - none
<youn> Correction: - https://jira.duraspace.org/browse/FCREPO-2335
<escowles> Blockers:
<escowles> * None-2369 - restore and export data set that caused error

<coblej> <awoods> [Import/Export Standup]
<awoods> <coblej> Finished yesterday:
<awoods> - Created and assigned several tickets based on Sprint Kickoff meeting: https://wiki.duraspace.org/display/FF/2017-05+Import+-+Export+Sprint+04+Meetings
<awoods> - Reviewed Adding option to overwrite tombstones on import
<coblej> Verified installation of applications / tools.
<coblej> Working on today:
<coblej> Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2202
<awoods> Working on today:
<awoods> - Reviewing any tickets that are completed
<awoods> - Working "import tool looks for sha1 manifest file with capitalized filename" :
<awoods> 2425
<coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-24432450
<awoods> <coblej> Blockers:
<awoods> - <coblej> None<youn>

<escowles> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - Ran export and import using one-click jar and 10KIndirectContainers
<youn> - Attempted to run verify.py
<youn> Working on today:
<youn> - Run verify.py
<youn> - FCREPO-2369: verify.py fails on unicode-escaped characters; attempt to replicate error
<youn> - FCREPO-2438: document use of CND for namespaces; attempt to apply fix
<youn> - Will be offline in the afternoon for meetings, etc.
<youn> Blockers:
<youn> - urllib module in verify.py?<escowles> Yesterday:
<escowles> * Updated PR for overwriting tombstones: https://github.com/fcrepo4-labs/fcrepo-import-export/pull/76
<escowles> * Worked on support for changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
<escowles> Today:
<escowles> * Continue working on changing repository baseURL
<escowles> * Meetings
<escowles> Blockers:
<escowles> * None

<mikeAtUVa> [Import/Export Standup]
<mikeAtUVa> Finished yesterday:
<mikeAtUVa> Spoke breifly with benpennell to strategize
<mikeAtUVa> Working on today:
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2432 adding support to update certain server-managed triples
<mikeAtUVa> - replace code that simplifies PUT interactions rolled back changes (in my work) that simplified PUT semantics
<mikeAtUVa> - identified additional work necessary to use existing "handling-lenient, received-minimal" patterntriples requests
<mikeAtUVa> - attempt to implement intuitive date updates adding children with provided creation dates
<mikeAtUVa> - add test cases for binaries and ensure that they work
<mikeAtUVa> - address test failure on travis (didn't appear locally) : https://travis-ci.org/fcrepo4/fcrepo4/builds/232586336?utm_source=github_status&utm_medium=notification
<mikeAtUVa> - determine the interaction of forced modification dates with etags and their implications on caching and if-modified headerslearned some more about how binary properties are stored, devised strategy for updating previously server-managed properties for binaries
<mikeAtUVa> Working on today:
<mikeAtUVa> - Hope to finish up https://jira.duraspace.org/browse/FCREPO-2432
<mikeAtUVa> Blockers:
<mikeAtUVa> - none- None

<awoods> [Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Completed: "import tool looks for sha1 manifest file with capitalized filename" : <benpennell> Finished yesterday:
<benpennell> * environment setup
<benpennell> * read through Mike's work on https://jira.duraspace.org/browse/FCREPO-2432
<benpennell> Working on today:
<benpennell> * familiarize myself with import/export codebase.
<benpennell> * familiarize myself with current and new versioning specifications, the challenges involved.
<benpennell> * strategize about how to represent versions
<benpennell> * work towards generating some tickets with Mike.
<benpennell> Blockers:
<benpennell> * is there previous work/discussion about exporting versions to reference?2443
<awoods> - Reviewed: "Add ability to delete or overwrite tombstone on import" : https://jira.duraspace.org/browse/FCREPO-2202
<awoods> - Reviewed / Merged: "Semantic differences between exports" : https://jira.duraspace.org/browse/FCREPO-2429
<awoods> Working on today:
<awoods> - Reviewing any tickets that are completed
<awoods> Blockers:
<awoods> - None


Stand-up report - 2017-05-17
Expand
titleStand-up report - 2017-05-18
title

<dbernstein> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> *

<westgard> [Import/Export Standup]
<westgard> Finished yesterday:
<westgard> re-familiarized myself with code and tickets
<westgard> consulted with dbernstein regarding logging behavior ticket (FCREPO-2368)
<westgard> identified test data that demonstrates bug in unicode escaping (FCREPO-2369)
<westgard> Working on today:
<westgard> FCREPO-2303 (verify triples)
<westgard> FCREPO-2329 (handle missing resources during verification)
<westgard> Blockers:
<westgard> More feedback from stakeholders regarding desired logging behavior & command line options would be helpful (relates to FCREPO-2368)

<coblej>
Finished yesterday:
  Installed applications / tools for import export testing on workstation.
Working on today:
Verifying installation of applications / tools.
Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
Blockers:
Cannot load “main” sample datasets into one-click run Fedora 4.7.2.  “mvn -Dfcrepo.url=http://localhost:8080/rest/ exec:java” command results in “ERROR 08:29:39.119 (FedoraInvalidNamespaceExceptionMapper) NamespaceExceptionMapper caught an exception: Prefix fcr has not been registered” for each dataset.  (Loading the “additional datasets” via fcr:restore seems to work fine.)

Expand

2451
<dbernstein> (Break up verify.py into smaller more focused modules.)
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
<dbernstein> (provide full DEBUG-level logging for import-export verification tool)
<dbernstein>
<dbernstein> Working on today:
<dbernstein>
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)

<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Re-import of hierarchyAdd support for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-24282426
<lsitu> Working on today:
<lsitu> Add support Update PR for round-tripping with binaries excludedRe-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-24262428
<lsitu> Blockers:
<lsitu> N/A.<dbernstein>

<coblej> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> ]
<coblej> Finished yesterday:
<coblej> Logging documentation for import/export: https://jira.duraspace.org/browse/FCREPO-2425
<coblej> Working on today:
<coblej> Attempting to replicate verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369
<coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-2448
<dbernstein> * Added setup.py to verify tool and setup up support for adding unit tests
<dbernstein> * Did some minor refactoring of command line parser using ‘click’ module
<dbernstein> * Add support for installing verify (now fcrepo-verify) 2450
<coblej> Blockers:
<coblej> None

<mikeAtUVa> [import/export standup]
<mikeAtUVa> Yesterday
<mikeAtUVa> * issued a PR for the server-managed-triples changes to fcrepo
<mikeAtUVa> * chatted with benpennell about versions
<mikeAtUVa> Today
<mikeAtUVa> * addressing reviewer comments for https://github.com/fcrepo4/fcrepo4/pull/1193
<mikeAtUVa> * identifying/completing changes necessary to import tooling
<mikeAtUVa> Blockers
<mikeAtUVa> None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - on the path.
<dbernstein> * Pull request is in.
<dbernstein>
<dbernstein> Working on today:
<dbernstein>
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
<dbernstein> (provide full DEBUG-level logging for import-export verification tool)
<dbernstein> Blockers:
<dbernstein> None.<bridgetalmas> [Import/Export Standup] Working on today:   Verify Perseids BagIt Profile  https://jira.duraspace.org/browse/FCREPO-2440 Blockers:   Mapping to LDP model   Import of tag manifest contents (-2438 - in review
<youn> Working on today:
<youn> - https://jira.duraspace.org/browse/FCREPO-2444)<youn> 2369 - restore and export data set that caused Unicode errors; look into errors
<youn> Blockers:
<youn> - none

<escowles_> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - Ran verify.py to verify export of 10KIndirectContainers; attempted to verify import but stopped when I ran into lots of verification errors
<youn> - Started repository with modified repository.json and namespaces.cnd
<youn> Working on today:
<youn> - <escowles_> Yesterday:
<escowles_> * Support for changing repository baseURL https://github.com/fcrepo4-labs/fcrepo-import-export/pull/81
<escowles_> Today:
<escowles_> * Started looking at re-enabling support for user-supplied namespace prefixes https://jira.duraspace.org/browse/FCREPO-2369 - backup and import data set that caused error
<youn> - 2376
<escowles_> * Reviewing PR for allowing server-managed triples https://jira.duraspace.org/browse/FCREPO-2438 - finish
<youn> - look into import verification errors
<youn> Blockers:
<youn> - none
<youn> Correction: - github.com/fcrepo4/fcrepo4/pull/1193
<escowles_> Blockers:
<escowles_> * None

<benpennell> Finished yesterday:
<benpennell> * Created ticket for export naming convention collisions https://jira.duraspace.org/browse/FCREPO-23692452
<benpennell> * Discussed a proposed structure for exported versions with mikeAtUVa
<benpennell> Working on today:
<benpennell> * Make revisions to versioning proposal and share it for feedback
<benpennell> * Create tickets for export of versions, begin work if practical
<benpennell> * Check about previous work on version exporting (umgrosscol?)
<benpennell> Blockers:
<benpennell> * Need feedback on questions related to requirements/issues with exporting versions before proceeding

<awoods> - restore and export data set that caused error<coblej> [Import/Export Standup]
<coblej> <awoods> Finished yesterday:
<coblej> Verified installation of applications / tools.
<coblej> Working on today:
<coblej> Logging documentation for import/export<awoods> - Reviewed: "Re-import of hierarchy" : https://jira.duraspace.org/browse/FCREPO-2425
<coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-2450
<coblej> Blockers:
<coblej> None<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Updated PR for overwriting tombstones2428
<awoods> - Reviewed: "Optionally Update Server Managed Triples" : https://githubjira.duraspace.comorg/fcrepo4-labsbrowse/fcrepoFCREPO-import-export/pull/76
<escowles> * Worked on support for 2432
<awoods> - Reviewed: "Support changing repository baseURL" : https://jira.duraspace.org/browse/FCREPO-2335
<escowles> Today:
<escowles> * Continue working on changing repository baseURL
<escowles> * Meetings
<escowles> Blockers:
<escowles> * None<mikeAtUVa> [Import/Export Standup]
<mikeAtUVa> Finished yesterday:
<mikeAtUVa> - <awoods> - Reviewed / Merged: "Add ability to delete or overwrite tombstone on import" : https://jira.duraspace.org/browse/FCREPO-24322202
<mikeAtUVa> - rolled back changes (in my work) that simplified PUT semantics
<mikeAtUVa> - identified additional work necessary to use existing "minimal" triples requests
<mikeAtUVa> - learned some more about how binary properties are stored, devised strategy for updating previously server-managed properties for binaries
<mikeAtUVa> Working on today:
<mikeAtUVa> - Hope to finish up <awoods> - Reviewed / Merged: "Import/Export: Logging documentation" : https://jira.duraspace.org/browse/FCREPO-2432
<mikeAtUVa> -2425
<awoods> Working on today:
<awoods> - Reviewing any tickets that are completed
<awoods> Blockers:
<mikeAtUVa> <awoods> - None

<awoods> <westgard> [Import/Export Standup]
<awoods> <westgard> Finished yesterday:
<awoods> - Completed: "import tool looks for sha1 manifest file with capitalized filename" : <westgard> revised https://jiragithub.duraspace.org/browse/FCREPO-2443
<awoods> - Reviewed: "Add ability to delete or overwrite tombstone on import" : com/fcrepo4-labs/fcrepo-import-export-verify/pull/23
<westgard> created new tickets for handling of edge cases and errors in verification
<westgard> Working on today:
<westgard> continue testing for cause of https://jira.duraspace.org/browse/FCREPO-2202
<awoods> - Reviewed / Merged: "Semantic differences between exports" : 2369
<westgard> finish review of https://jira.duraspace.org/browse/FCREPO-2429
<awoods> Working on today:
<awoods> - Reviewing any tickets that are completed
<awoods> 2448
<westgard> Blockers:
<awoods> - <westgard> None


Expand
titleStand-up report - 2017-05-1819

<coblej> youn: about to try it so we'll see ... will let you know
<coblej> <dbernstein> [Import/Export Standup]
<dbernstein> <coblej> Finished yesterday:
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2451
<dbernstein> (Break up verify.py into smaller more focused modules.)
<dbernstein> * <coblej> Verified that verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2368
<dbernstein> (provide full DEBUG-level logging for import-export verification tool)
<dbernstein>
<dbernstein> 2369 does not appear to apply to exports from Fedora 4.7.2.
<coblej> Working on today:
<dbernstein>
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Add support for round-tripping with binaries excluded: <coblej> Attempt to replicate verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2426
<lsitu> Working on today:
<lsitu> Update PR for Re-import of hierarchy2369 with exports from Fedora 4.6.0. Consult with westgard and youn on remaining work to be done on that issue (if any).
<coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-24282450
<lsitu> <coblej> Blockers:
<coblej> None

<youn> <lsitu> N/A<coblej> [Import/Export Standup]
<coblej> <youn> Finished yesterday:
<coblej> Logging documentation for import/export: <youn> - https://jira.duraspace.org/browse/FCREPO-2438: Document use of CND for namespaces: closed
<youn> - https://jira.duraspace.org/browse/FCREPO-2425
<coblej> Working on today:
<coblej> Attempting to replicate verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369
<coblej> Testing with subset of production-like Duke data: https://jira.duraspace.org/browse/FCREPO-2450
<coblej> Blockers:
<coblej> None

<mikeAtUVa> [import/export standup]
<mikeAtUVa> Yesterday
<mikeAtUVa> * issued a PR for the server-managed-triples changes to fcrepo
<mikeAtUVa> * chatted with benpennell about versions
<mikeAtUVa> Today
<mikeAtUVa> * addressing reviewer comments for https://github.com/fcrepo4/fcrepo4/pull/1193
<mikeAtUVa> * identifying/completing changes necessary to import tooling
<mikeAtUVa> Blockers
<mikeAtUVa> None

2369: Import-export verification tool's rdf comparison fails on unicode-escaped characters: restored, exported, and verified resources from 4.7.2 repository without any verification failures
<youn> Working on today:
<youn> - follow up on FCREPO-2369; possibly, version issues, as noted on ticket
<youn> - familiarize myself with bag export and with bagit-python
<youn> Blockers:
<youn> - none

<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Finished support for changing repository baseURL https://jira.duraspace.org/browse/FCREPO-2335
<escowles> Today:
<escowles> * User-supplied namespace prefixes <youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - https://jira.duraspace.org/browse/FCREPO-2438 - in review
<youn> Working on today:
<youn> - 2376
<escowles> * Export collections based on inbound links https://jira.duraspace.org/browse/FCREPO-2369 - restore and export data set that caused Unicode errors; look into errors
<youn> Blockers:
<youn> - none

<escowles_> [Import/Export Standup]
<escowles_> Yesterday:
<escowles_> * Support for changing repository baseURL https://github.com/fcrepo4-labs/fcrepo-import-export/pull/81
<escowles_> Today:
<escowles_> * Started looking at re-enabling support for user-supplied namespace prefixes https://jira.duraspace.org/browse/FCREPO-2376
<escowles_> * Reviewing PR for allowing server-managed triples https://github.com/fcrepo4/fcrepo4/pull/1193
<escowles_> Blockers:
<escowles_> * None

2453
<escowles> Blockers:
<escowles> * None

<benpennell> Finished yesterday:
<benpennell> * Initial proposal for version export plan in https://jira.duraspace.org/browse/FCREPO-2446
<benpennell> Working on today:
<benpennell> * Implementation of version export for https://jira.duraspace.org/browse/FCREPO-2458
<benpennell> * Revisions to version export structure as needed
<benpennell> Blockers:
<benpennell> * None

<awoods> [Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> - Please let me know if you have any tickets whose review you would like to be prioritized
<awoods> Blockers:
<awoods> - None

<westgard> [Import/Export Standup]
<westgard> Finished yesterday:
<westgard> Reviewed PRs for
<westgard> <benpennell> Finished yesterday:
<benpennell> * Created ticket for export naming convention collisions https://jira.duraspace.org/browse/FCREPO-2452
<benpennell> * Discussed a proposed structure for exported versions with mikeAtUVa
<benpennell> Working on today:
<benpennell> * Make revisions to versioning proposal and share it for feedback
<benpennell> * Create tickets for export of versions, begin work if practical
<benpennell> * Check about previous work on version exporting (umgrosscol?)
<benpennell> Blockers:
<benpennell> * Need feedback on questions related to requirements/issues with exporting versions before proceeding<awoods> [Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed: "Re-import of hierarchy" : 2448 (Add python project setup scaffolding for fcrepo-import-export-verify),
<westgard> https://jira.duraspace.org/browse/FCREPO-2368 (provide full DEBUG-level logging for import-export verification tool), and
<westgard> https://jira.duraspace.org/browse/FCREPO-2451 (Break up verify.py into smaller more focused modules)
<westgard> Continued troubleshooting https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
<westgard> Working on today:
<westgard> Try to get to resolution on https://jira.duraspace.org/browse/FCREPO-2469;
<westgard> https://jira.duraspace.org/browse/FCREPO-2428
<awoods> - Reviewed: "Optionally Update Server Managed Triples" : 2460 (update readme (help text) and inline comments in newly refactored codebase);
<westgard> Attempt again to reproduce https://jira.duraspace.org/browse/FCREPO-2432-2462 (verification tool gives random incorrect responses) and resolve if not possible.
<westgard> Blockers:
<westgard> None.

<mikeAtUVa> [Import/Export standup]
<mikeAtUVa> Yesterday
<mikeAtUVa> * addressed comments, improved
<awoods> - Reviewed: "Support changing repository baseURL" : https://jira.duraspace.org/browse/FCREPO-2335
<awoods> - Reviewed / Merged: "Add ability to delete or overwrite tombstone on import" : 2432 (relaxed server managed triples)
<mikeAtUVa> * started settinng up environment to work on https://jira.duraspace.org/browse/FCREPO-2202
<awoods> - Reviewed / Merged: "Import/Export: Logging documentation" : 2461 (add support for roundtripping of server managed triples)
<mikeAtUVa> Today:
<mikeAtUVa> * https://jira.duraspace.org/browse/FCREPO-2425
<awoods> Working on today:
<awoods> - Reviewing any tickets that are completed
<awoods> FCREPO-2461
<mikeAtUVa> Blockers:
<awoods> - <mikeAtUVa> * None

<westgard> <dbernstein> [Import/Export Standup]
<westgard> <dbernstein> Finished yesterday:
<westgard> revised <dbernstein> * https://githubjira.duraspace.comorg/fcrepo4-labsbrowse/fcrepo-FCREPO-2368
<dbernstein> (retool logging for import-export -verify/pull/23
<westgard> created new tickets for handling of edge cases and errors in verification
<westgard> Working on today:
<westgard> continue testing for cause of https://jira.duraspace.org/browse/FCREPO-2369
<westgard> finish review of verification tool)
<dbernstein> More improvements - feature branch rebased with master and pull request is in.
<dbernstein>
<dbernstein> Working on today:
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2448
<westgard> 2408
<dbernstein> (make verification tool work with BagIt Bags)
<dbernstein>
<dbernstein> Blockers:
<westgard> <dbernstein> None.


<coblej> youn: about to try it so we'll see ... will let you know
Expand
titleStand-up report - 2017-05-19
22

<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Verified that verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369 does not appear to apply to exports from Fedora 4.7.2.
<coblej> Working on today:
<coblej> Attempt to replicate Replicated verification tool Unicode-escaped characters failure reported in https://jira.duraspace.org/browse/FCREPO-2369 with exports from Fedora 4.6.0. Consult with westgard and youn on remaining work to be done on that issue (if any).
<coblej> Testing with subset of production-like Duke data:
<coblej> Working on today:
<coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-24502455
<coblej> Blockers:
<coblej> None

<youn> <mikeAtUVa> [Importimport/Export Standupexport standup]
<youn> Finished yesterday:
<youn> <mikeAtUVa> Finished last Friday:
<mikeAtUVa> - last modifications and changes to https://github.com/fcrepo4/fcrepo4/pull/1193 (relaxed server managed triples)
<mikeAtUVa> Today:
<mikeAtUVa> - mostly unrelated meetings
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2438: Document use of CND for namespaces: closed
<youn> 2464 (documenting relaxed server managed triples)
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2369: Import-export verification tool's rdf comparison fails on unicode-escaped characters: restored, exported, and verified resources from 4.7.2 repository without any verification failures
<youn> Working on today:
<youn> - follow up on FCREPO-2369; possibly, version issues, as noted on ticket
<youn> - familiarize myself with bag export and with bagit-python
<youn> Blockers:
<youn> - none/browse/FCREPO-2461 (updating importer to support relaxed server managed triples)
<mikeAtUVa> Blockers:
<mikeAtUVa> - probably can't fully finish the importer updates without a version of 4.7.4 available for download for integration tests

<escowles> [Import/Export Standup]
<escowles> YesterdayLast Friday:
<escowles> * Finished support for changing repository baseURL Debugged parallel build failures https://jira.duraspace.org/browse/FCREPO-23352466
<escowles> Today:
<escowles> * User-supplied namespace prefixes https://jira.duraspace.org/browse/FCREPO-2376
<escowles> * Export collections Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
<escowles> Blockers:
<escowles> * None

<benpennell> Finished yesterday:
<benpennell> * Initial Second proposal for version export plan in for structure of version exports for https://jira.duraspace.org/browse/FCREPO-2446
<benpennell> Working on today:
<benpennell> * Implementation of Finish up implementation and unit tests for version export for , create PR https://jira.duraspace.org/browse/FCREPO-2458
<benpennell> * Revisions to version export structure as neededStart thinking about implementation of versions importing
<benpennell> Blockers:
<benpennell> * Nonenone

<awoods> [Import/Export Standup]
<awoods> Finished yesterdaylast Friday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> - Please let me know if you have any tickets whose review you would like to be prioritized
<awoods> Blockers:
<awoods> - None

<westgard> <lsitu> [Import/Export Standup]
<westgard> Finished yesterday:
<westgard> Reviewed PRs for
<westgard> <lsitu> Finished last Friday:
<lsitu> Rebase PR and refactor codes to fix conflicts for Re-import of hierarchy: https://jira.duraspace.org/browse/FCREPO-2428
<lsitu> Updated PR for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2448 (Add python project setup scaffolding for fcrepo-import-export-verify),
<westgard> 2426
<lsitu> Working on today:
<lsitu> Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2368 (provide full DEBUG-level logging for import-export verification tool), and
<westgard> 2418
<lsitu> Imporve PR for round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2451 (Break up verify.py into smaller more focused modules)
<westgard> Continued troubleshooting 2426
<lsitu> Blockers:
<lsitu> None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
<westgard> - added note on Unicode errors to README
<youn> - tested bag export and verification with bagit-python
<youn> Working on today:
<youn> - follow up on comments on FCREPO-2369
<youn> - get feedback on (and work on) ideas for videos
<youn> Blockers:
<youn> - none

<westgard> [Import/Export Standup]
<westgard> Finished Friday:<westgard> Try to get to resolution on https://jira.duraspace.org/browse/FCREPO-2469;
<westgard> https://jira.duraspace.org/browse/FCREPO-2460 (update readme (help text) and inline comments in newly refactored codebase);
<westgard> Attempt again to reproduce https://jira.duraspace.org/browse/FCREPO-24622463 (minor formatting fixes in verification tool gives random incorrect responses) and resolve if not possible.
<westgard> Blockers:
<westgard> None.<mikeAtUVa> [Import/Export standup]
<mikeAtUVa> Yesterday
<mikeAtUVa> * addressed comments, improved
<westgard> Continued troubleshooting of https://jira.duraspace.org/browse/FCREPO-2432 (relaxed server managed triples)
<mikeAtUVa> * started settinng up environment to work on 2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
<westgard> Working on today:
<westgard> https://jira.duraspace.org/browse/FCREPO-2461 (add support for roundtripping of server managed triples)
<mikeAtUVa> Today:
<mikeAtUVa> * 2457 (handle failed connection gracefully)
<westgard> Continued troubleshooting of https://jira.duraspace.org/browse/FCREPO-2461
<mikeAtUVa> -2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
<westgard> Blockers:
<mikeAtUVa> * <westgard> None.

<dbernstein> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2368
<dbernstein> (retool logging for import-export verification tool)
<dbernstein> More improvements - feature branch rebased with master and pull request is in.
<dbernstein> Nothing finished (out most of the day)
<dbernstein> Working on today:
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)
<dbernstein>
<dbernstein> Blockers:
<dbernstein> None.


...

Expand
titleStand-up report - 2017-05-2223

<coblej> <youn> [Import/Export Standup]
<coblej> <youn> Finished yesterday:
<coblej> Replicated verification tool Unicode-escaped characters failure reported in <youn> - https://jira.duraspace.org/browse/FCREPO-2369 with exports from Fedora (Import-export verification tool's rdf comparison fails on unicode-escaped characters) - used sample RDF containing Unicode to test the verification tool with the one click for 4.6.0 and 4.
<coblej> 7.3-RC
<youn> - started proposal for videos
<youn> Working on today:
<coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-2455
<coblej> Blockers:
<coblej> None<youn> - finish proposal for videos
<youn> Blockers:
<youn> - none

westgard> [Import/Export Standup]
<westgard> Finished yesterday:
<westgard> started https://jira.duraspace.org/browse/FCREPO-2457 (handle failed connection gracefully)
<westgard> Working on today:
<westgard> finish FCREPO-2457
<westgard> Blockers:
<westgard> None.

<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Working on today:
<coblej> Document import structural expectations — <mikeAtUVa> [import/export standup]
<mikeAtUVa> Finished last Friday:
<mikeAtUVa> - last modifications and changes to https://github.com/fcrepo4/fcrepo4/pull/1193 (relaxed server managed triples)
<mikeAtUVa> Today:
<mikeAtUVa> - mostly unrelated meetings
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2464 (documenting relaxed server managed triples)
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2461 (updating importer to support relaxed server managed triples)
<mikeAtUVa> Blockers:
<mikeAtUVa> - probably can't fully finish the importer updates without a version of 4.7.4 available 2455
<coblej> Blockers:
<coblej> None

<awoods> [Import/Export Standup]
<awoods> Finished last Friday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - None

<mikeAtUVa> [import/export sprint standup]
<mikeAtUVa> Yesterday:
<mikeAtUVa> - mostly worked on urelated things
<mikeAtUVa> Today:
<mikeAtUVa> - Finish up for download for integration tests<escowles> [Import/Export Standup]
<escowles> Last Friday:
<escowles> * Debugged parallel build failures https://jira.duraspace.org/browse/FCREPO-2466
<escowles> Today:
<escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
<escowles> Blockers:
<escowles> * None2461
<mikeAtUVa> - Determine if more changes to fcrepo are in order (for versioning) in the scope of this sprint
<mikeAtUVa> Blockers:
<mikeAtUVa> - none

<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Exporting members based on inbound links <benpennell> Finished yesterday:
<benpennell> * Second proposal for structure of version exports for https://jira.duraspace.org/browse/FCREPO-2446
<benpennell> Working on today:
<benpennell> * Finish up implementation and unit tests for version export, create PR 2453
<escowles> * Fix Bag import using config file https://jira.duraspace.org/browse/FCREPO-2458
<benpennell> * Start thinking about implementation of versions importing
<benpennell> Blockers:
<benpennell> * none

<awoods> [Import/Export Standup]
<awoods> Finished last Friday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - None

2462
<escowles> Today:
<escowles> * Rebase PR #84 (exporting members based on inbound links)
<escowles> * Not sure after that: whatever needs help
<escowles> Blockers:
<escowles> * None

<benpennell> <lsitu> [Import/Export Standup]
<lsitu> <benpennell> Finished last Fridayyesterday:
<lsitu> Rebase PR and refactor codes to fix conflicts for Re-import of hierarchy: <benpennell> * Create PR for export of versions https://jira.duraspace.org/browse/FCREPO-2428
<lsitu> Updated PR for round-tripping with binaries excluded: 2458
<benpennell> Working on today:
<benpennell> * Planning and implementation of version import https://jira.duraspace.org/browse/FCREPO-2459
<benpennell> * Some local stuff
<benpennell> Blockers:
<benpennell> * none

<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday2426
<lsitu> Working on today:
<lsitu> Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2418
<lsitu> Imporve PR for Consolidate the findRepositoryRoot method for PR with round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
<lsitu> BlockersWorking on today:
<lsitu> None<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - Improve Import of Bags should verify binary digest: https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters) - added note on Unicode errors to README
<youn> - tested bag export and verification with bagit-python
<youn> Working on today:
<youn> - follow up on comments on FCREPO-2369
<youn> - get feedback on (and work on2418?
<lsitu> Will find more tickets.
<lsitu> Blockers:
<lsitu> None


Expand
titleStand-up report - 2017-05-24

<coblej> ) ideas for videos
<youn> Blockers:
<youn> - none<westgard> [Import/Export Standup]
<westgard> Finished Friday:
<westgard> <coblej> Finished yesterday:
<coblej> Working on today:
<coblej> Testing sprint changes using interim code releases
<coblej> Document import structural expectations — https://jira.duraspace.org/browse/FCREPO-2460 (update readme (help text) and inline comments in newly refactored codebase)
<westgard> -2455
<coblej> Blockers:
<coblej> None

<awoods> Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed tickets
<awoods> - Created testing recipes (please everyone do at least one unique test): https://jirawiki.duraspace.org/display/browseFF/FCREPO-2463 (minor formatting fixes in verification tool)
<westgard> Continued troubleshooting of Import+-+Export+Testing+Recipes
<awoods> - Uploaded recent versions of import/export utility and Fedora-master: https://jirawiki.duraspace.org/display/browseFF/FCREPO2017-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
<westgard> Working on today:
<westgard> 05+Import+-+Export+Sprint+04+Meetings#id-2017-05Import-ExportSprint04Meetings-Resources
<awoods> - Created ticket for testing import into Cavendish: https://jira.duraspace.org/browse/FCREPO-2457 (handle failed connection gracefully)
<westgard> Continued troubleshooting of https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters)
<westgard> Blockers:
<westgard> None.<dbernstein> [Import/Export Standup]
<dbernstein> Finished yesterday:
<dbernstein> * Nothing finished (out most of the day)
<dbernstein> Working on today:
<dbernstein> * 2476
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - Waiting on resolution to: new bug "import-export does not respect containment predicates when pointed at rest/" (https://jira.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)
<dbernstein> Blockers:
<dbernstein> None.

Expand
titleStand-up report - 2017-05-23

2474)

<mikeAtUVa> [import/export sprint standup]
<mikeAtUVa> Yesterday:
<mikeAtUVa> - https://github.com/fcrepo4-labs/fcrepo-import-export/pull/88 updated importer to support lossless roundtripping of RDF
<mikeAtUVa> Today:
<mikeAtUVa> <youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - https://jira.duraspace.org/browse/FCREPO-2369 (Import-export verification tool's rdf comparison fails on unicode-escaped characters) - used sample RDF containing Unicode to test the verification tool with the one click for 4.6.0 and 4.7.3-RC
<youn> - started proposal for videos
<youn> 2464 (document "relaxed" triples mode)
<mikeAtUVa> - I'll take a look at https://github.com/fcrepo4-labs/fcrepo-import-export/pull/85 if it's not already reviewed/merged
<mikeAtUVa> - Look into aligning versioning with spec, providing feedback where necessary
<mikeAtUVa> Blockers:
<mikeAtUVa> - none

<youn> Working on today:
<youn> - finish proposal for videos
<youn> Blockers:
<youn> - nonewestgard> [Import/Export Standup]
<westgard> <youn> Finished yesterday:
<westgard> started <youn> - draft proposal for videos and ***WELCOME YOUR FEEDBACK*** https://jiradocs.duraspace.org/browse/FCREPO-2457 (handle failed connection gracefully)
<westgard> Working on today:
<westgard> finish FCREPO-2457
<westgard> Blockers:
<westgard> None.<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> google.com/document/d/1CzvJlZ3m3eEhHgVJJY0hdGerPMxRIRaK9X05WhCLKpo/edit?usp=sharing
<youn> Working on today:
<coblej> Document import structural expectations — <youn> - test bag import export and version import export
<youn> - test predicates and inbound with lubm
<youn> - https://jira.duraspace.org/browse/FCREPO-2455
<coblej> Blockers:
<coblej> None

<awoods> [Import/Export Standup]
<awoods> Finished last Friday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - None

2473 (verification tool should handle import-export v1.1 config files)
<youn> Blockers:
<youn> - none

<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Improved and rebased the PR for Import of Bags should verify binary digest: <mikeAtUVa> [import/export sprint standup]
<mikeAtUVa> Yesterday:
<mikeAtUVa> - mostly worked on urelated things
<mikeAtUVa> Today:
<mikeAtUVa> - Finish up https://jira.duraspace.org/browse/FCREPO-2461
<mikeAtUVa> - Determine if more changes to fcrepo are in order (for versioning) in the scope of this sprint
<mikeAtUVa> Blockers:
<mikeAtUVa> - none2418
<lsitu> Working on today:
<lsitu> Not sure: can help on anything else.
<lsitu> Blockers:
<lsitu> None

<escowles> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
<escowles> * Fix Bag import using config file https://jira.duraspace.org/browse/FCREPO-2462
<escowles> Today:
<escowles> * Rebase PR #84 (exporting members based on inbound links)
<escowles> * Not sure after that: whatever needs helpTrailing slash issues https://jira.duraspace.org/browse/FCREPO-2467
<escowles> * Containment predicates don't work when pointed at /rest https://jira.duraspace.org/browse/FCREPO-2474
<escowles> * Squashing bugs from testing
<escowles> Blockers:
<escowles> * None

<benpennell> [Import/Export Standup]
<benpennell> Finished yesterday:
<benpennell> * A bunch of local stuff
<benpennell> * Create PR for export of versions https://jira.duraspace.org/browse/FCREPO-2458Some decisions about requirements for import of versions related to timestamps
<benpennell> Working on today:
<benpennell> * Planning and implementation Implementation of version import https://jira.duraspace.org/browse/FCREPO-2459
<benpennell> * Some local stuff
<benpennell> Blockers:
<benpennell> * none

<lsitu> <westgardj> [Import/Export Standup]
<lsitu> <westgardj> Finished yesterday:
<lsitu> Import of Bags should verify binary digest: <westgardj>   Finished https://jira.duraspace.org/browse/FCREPO-2418
<lsitu> Consolidate the findRepositoryRoot method for PR with round-tripping with binaries excluded: https://jira.duraspace.org/browse/FCREPO-2426
<lsitu> Working on today:
<lsitu> Improve Import of Bags should verify binary digest: 2457 (handle failed connection gracefully)
<westgardj>   Tested current master branch of import-export tool
<westgardj> Working on today:
<westgardj>   https://jira.duraspace.org/browse/FCREPO-2418?
<lsitu> Will find more tickets.
<lsitu> 2449
<westgardj>   Additional testing of import-export and verifier
<westgardj> Blockers:
<lsitu> <westgardj>   None

Expand
titleStand-up report - 2017-05-24

.

<dbernstein> <coblej> [Import/Export Standup]
<coblej> <dbernstein> Finished yesterday:
<dbernstein> *
<coblej> <dbernstein> Working on today:
<coblej> Testing sprint changes using interim code releases
<coblej> Document import structural expectations — <dbernstein> * finishing up https://jira.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)this morning
<dbernstein> * https://jira.duraspace.org/browse/FCREPO-2455
<coblej> Blockers:
<coblej> None2475
<dbernstein> (verifcation tool should log to timestamped log files)
<dbernstein>
<dbernstein> Blockers:
<dbernstein> None.


Expand
titleStand-up report - 2017-05-25

<coblej> [Import/Export Standup]
<coblej> Finished yesterday:
<coblej> Document export format in partial response to <awoods> Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed tickets
<awoods> - Created testing recipes (please everyone do at least one unique test): https://wiki.duraspace.org/display/FF/Import+-+Export+Testing+Recipes
<awoods> - Uploaded recent versions of import/export utility and Fedora-master: https://wiki.duraspace.org/display/FF/2017-05+Import+-+Export+Sprint+04+Meetings#id-2017-05Import-ExportSprint04Meetings-Resources
<awoods> - Created ticket for testing import into Cavendish: https://jira.duraspace.org/browse/FCREPO-2476
<awoods> 2455 (Import/Export: Document import structural expectations)
<coblej> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - Waiting on resolution to: new bug "import-export does not respect containment predicates when pointed at rest/" (https://jira.duraspace.org/browse/FCREPO-2474)<mikeAtUVa> [import/export sprint standup]<coblej> Testing sprint changes using interim code releases
<coblej> Blockers:
<coblej> None

<youn> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - tested export with lubm
<youn> - regenerated lubm backup, replacing link for external content; https://yale.box.com/s/0rkv4q1akg7g1w3oq4zhnrkafeppmplg needs to be added to github repo; previous versions should be deleted
<youn> Working on today:
<youn> - test lubm import and verify export and import
<youn> - test versions and bags
<youn>
<mikeAtUVa> Yesterday:
<mikeAtUVa> - https://github.com/fcrepo4-labs/fcrepo-import-export/pull/88 updated importer to support lossless roundtripping of RDF
<mikeAtUVa> Today:
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2464 (document "relaxed" triples mode)
<mikeAtUVa> - I'browse/FCREPO-2473 (verification tool should handle import-export v1.1 config files)
<youn> Blockers:
<youn> - none

<escowles> ll take a look at https://github.com/fcrepo4-labs/fcrepo-import-export/pull/85 if it's not already reviewed/merged
<mikeAtUVa> - Look into aligning versioning with spec, providing feedback where necessary
<mikeAtUVa> Blockers:
<mikeAtUVa> - none<youn> [Import/Export Standup]
<youn> Finished yesterday<escowles> Yesterday:
<youn> - draft proposal for videos and ***WELCOME YOUR FEEDBACK*** <escowles> * Trailing slash issues https://docsjira.googleduraspace.com/document/d/1CzvJlZ3m3eEhHgVJJY0hdGerPMxRIRaK9X05WhCLKpo/edit?usp=sharing
<youn> Working on today:
<youn> - test bag import export and version import export
<youn> - test predicates and inbound with lubm
<youn> - org/browse/FCREPO-2467
<escowles> * Containment predicates don't work when pointed at /rest https://jira.duraspace.org/browse/FCREPO-2473 (verification tool should handle import-export v1.1 config files)
<youn> Blockers:
<youn> - none<lsitu> [Import/Export Standup]
<lsitu> Finished yesterday:
<lsitu> Improved and rebased the PR for Import of Bags should verify binary digest: 2474
<escowles> * Test import into Cavendish https://jira.duraspace.org/browse/FCREPO-2476
<escowles> Today:
<escowles> * findRepositoryRoot should have a sensible fallback https://jira.duraspace.org/browse/FCREPO-2477
<escowles> * Error importing export with inbound references https://jira.duraspace.org/browse/FCREPO-24182483
<escowles> * Squashing bugs from testing
<escowles> * Couple meetings
<escowles> Blockers:
<escowles> * None

<awoods>
<lsitu> Working on today:
<lsitu> Not sure: can help on anything else.
<lsitu> Blockers:
<lsitu> None<escowles> [ Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - None

<mikeAtUVa> [import/export sprint standup]
<mikeAtUVa> Finished Yesterday:
<mikeAtUVa> - <escowles> Yesterday:
<escowles> * Exporting members based on inbound links https://jira.duraspace.org/browse/FCREPO-2453
<escowles> * Fix Bag import using config file https://jira.duraspace.org/browse/FCREPO-2462
<escowles> Today:
<escowles> * Trailing slash issues 2464 documented "relaxed" triple mode
<mikeAtUVa> Working on Today:
<mikeAtUVa> - testing scenarios
<mikeAtUVa> - comments for https://jiragithub.duraspace.org/browse/FCREPO-2467
<escowles> * Containment predicates don't work when pointed at /rest com/fcrepo4-labs/fcrepo-import-export/pull/88
<mikeAtUVa> Blockers:
<mikeAtUVa> none

<benpennell> [Import/Export Standup]
<benpennell> Finished yesterday:
<benpennell> * Created ticket for issue with generated relations in versions https://jira.duraspace.org/browse/FCREPO-2474
<escowles> * Squashing bugs from testing
<escowles> Blockers:
<escowles> * None

<benpennell> [Import/Export Standup]
<benpennell> Finished yesterday:
<benpennell> * A bunch of local stuff
<benpennell> * Some decisions about requirements for import of versions related to timestamps
<benpennell> Working on today:
<benpennell> * Implementation of version import https://jira.duraspace.org/browse/FCREPO-2459
<benpennell> Blockers:
<benpennell> * none

2479
<benpennell> Working on today:
<benpennell> * Respond to feedback on version export PR
<benpennell> * Continue to work on initial implementation of version import ticket
<benpennell> * Can't guarantee version import will be done by the end of the sprint, it will depend on how smoothly today goes and feedback on the export, but I hope to have a first pass at it
<benpennell> Blockers
<benpennell> * none

<lsitu> <westgardj> [Import/Export Standup]
<westgardj> <lsitu> Finished yesterday:
<westgardj>   Finished <lsitu> Testing export and import the plant patent dataset (restored from plants.tar.gz) with options -b, -g (default/aptrust), -i, -p, -t, -x in https://jirawiki.duraspace.org/display/browseFF/FCREPO-2457 (handle failed connection gracefully)
<westgardj>   Tested current master branch of import-export tool
<westgardj> Import+-+Export+Testing+Recipes
<lsitu> Working on today:
<westgardj>   https://jira.duraspace.org/browse/FCREPO-2449
<westgardj>   Additional testing of import-export and verifier
<westgardj> Blockers:
<westgardj>   None.<lsitu> Use the verification tool to verify import/export.
<lsitu> Fix bugs that coming up from from testing.
<lsitu> Blockers:
<lsitu> It seems that the verification tool works fine for binary export at this time but has limitation on other options. What can we test now?


Expand
titleStand-up report - 2017-05-26

<coblej> <dbernstein> [Import/Export Standup]
<dbernstein> <coblej> Finished yesterday:
<dbernstein> *
<dbernstein> Working on today:
<dbernstein> * finishing up <coblej> Two test scenarios using then-current code, documented at https://jirawiki.duraspace.org/browse/FCREPO-2408
<dbernstein> (make verification tool work with BagIt Bags)this morning
<dbernstein> * .org/display/FF/Import+-+Export+Testing+Recipes .
<coblej> Working on today:
<coblej> Testing sprint changes using interim code releases against subset of production-like Duke data ( https://jira.duraspace.org/browse/FCREPO-2475
<dbernstein> (verifcation tool should log to timestamped log files2450 )
<dbernstein>
<dbernstein> <coblej> Blockers:
<dbernstein> <coblej> None.

Expand
titleStand-up report - 2017-05-25

<youn> <coblej> [Import/Export Standup]
<coblej> <youn> Finished yesterday:
<coblej> Document export format in partial response to <youn> - tested export with lubm; tried to test import
<youn> - responded to feedback on https://jira.duraspace.org/browse/FCREPO-24552299 (Import / Export : Document import structural expectationsVideos)
<coblej> <youn> Working on today:
<coblej> Testing sprint changes using interim code releases
<coblej> <youn> - sprint feedback
<youn> Blockers:
<coblej> None<youn> <youn> - none

<escowles> [Import/Export Standup]
<youn> Finished yesterday:
<youn> - tested export with lubm
<youn> - regenerated lubm backup, replacing link for external content; https://yale.box.com/s/0rkv4q1akg7g1w3oq4zhnrkafeppmplg needs to be added to github repo; previous versions should be deleted
<youn> Working on today:
<youn> - test lubm import and verify export and import
<youn> - test versions and bags
<youn> - <escowles> Yesterday:
<escowles> * findRepositoryRoot should have a sensible fallback https://jira.duraspace.org/browse/FCREPO-2477
<escowles> * Error importing export with inbound references https://jira.duraspace.org/browse/FCREPO-2483
<escowles> * Only writing config file if specified https://jira.duraspace.org/browse/FCREPO-2430
<escowles> * Adding If-Modified-Since header to PUT-to-update requests https://jira.duraspace.org/browse/FCREPO-2473 (verification tool should handle import-export v1.1 config files)
<youn> Blockers:
<youn> - none<escowles> 2498
<escowles> Today:
<escowles> * Rebasing PRs and responding to code review
<escowles> * Available to fix any last-minute bugs
<escowles> Blockers:
<escowles> * None

<lsitu> [Import/Export Standup]
<escowles> Yesterday:
<escowles> * Trailing slash issues <lsitu> Finished yesterday:
<lsitu> Improve logging for HTTP exception in export with binary excluded: https://jira.duraspace.org/browse/FCREPO-2467
<escowles> * Containment predicates don't work when pointed at /rest https://jira.duraspace.org/browse/FCREPO-2474
<escowles> * Test import into Cavendish https://jira.duraspace.org/browse/FCREPO-2476
<escowles> Today:
<escowles> * findRepositoryRoot should have a sensible fallback https://jira.duraspace.org/browse/FCREPO-2477
<escowles> * Error importing export with inbound references https://jira.duraspace.org/browse/FCREPO-2483
<escowles> * Squashing bugs from testing
<escowles> * Couple meetings
<escowles> Blockers:
<escowles> * 2480.
<lsitu> Tested the the vrification tool and replcate the errors.
<lsitu> Tested the export/import tool and the vrification tool from master branch with Fedora fcrepo-webapp-4.8.0-SNAPSHOT-jetty-console-a07a1a46: https://wiki.duraspace.org/display/FF/Import+-+Export+Testing+Recipes.
<lsitu> Working on today:
<lsitu> Test export/import tool and use the verification tool to verify the result.
<lsitu> Fix bugs that are coming up from from testing.
<lsitu> Blockers:
<lsitu> None

<awoods> Import/Export Standup]
<awoods> Finished yesterday:
<awoods> - Reviewed tickets
<awoods> Working on today:
<awoods> - Reviewing tickets
<awoods> Blockers:
<awoods> - None<mikeAtUVa> [import/export sprint standup]
<mikeAtUVa> Finished Yesterday:
<mikeAtUVa> - https://jira.duraspace.org/browse/FCREPO-2464 documented "relaxed" triple mode
<mikeAtUVa> Working on Today:
<mikeAtUVa> - testing scenarios
<mikeAtUVa> - comments for https://github.com/fcrepo4-labs/fcrepo-import-export/pull/88
<mikeAtUVa> Blockers:
<mikeAtUVa> none