Version 6.3

This page drafts the scope of the DSpace 6.3 release. Most of these tickets are almost ready or can move quickly. Important issues tend to be listed at the top, but as new items come in, the list won't be purely in order of priority.

If you know of an open JIRA issue or contribution that you really want to see make it into v6.3 that isn't listed on this page, you can give it some attention by posting a message to the DSpace Developer mailing list, and/or giving it a shout-out in the #dev channel in the DSpace Slack

If you're able to volunteer time to code up a solution related to a JIRA issue that needs a volunteer, send in that Pull Request against the dspace-6_x branch!

If you're able to review and test an open Pull Request to help get it approved and merged, please do try out some PRs currently waiting for reviews and give your comments / results to help us keep things moving.

Suggested pre-release application (usability, functional) tests for DSpace 6

The below cover most of the fixes and improvements in DSpace 6.3. If we can get volunteers pooled / assigned so that a couple of people are thoroughly testing each of the below functional areas, that'll help confidence in release stability and in catching any last minute problems:

•  Discovery (Solr) searches, including browsing, pagination, filters, special characters and very long requests - Kim Shepherd
•  General test of OAI-PMH (both ways)
•  General test of REST API (aka Legacy REST) and REST Reports - Terrence W Brady
•  Flyway upgrades, fresh installs, database migrations
•  ORCID authority control - Kim Shepherd
•  Subscriptions (with the sub-daily script)
•  Statistics GeoIP (location) lookups and display - Kim Shepherd
•  CSV metadata exporting
•  General performance (and particularly: XMLUI + items with many bitstreams)
•  MathJAX rendering - Kim Shepherd

Approved PRs that just need merging

...

...

TODO - Port to master branch and/or add documentation

All issues in this list are now merged for dspace-6.x, but need porting to master, or documentation added to the wiki, or both

• Flyway migration errors on XMLWorkflow for Oracle: 
  • DS-3788: Flyway migration "Hibernate Workflow Migration" fails

    Jira
    server DuraSpace JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId c815ca92-fd23-34c2-8fe3-956808caf8c5 key DS-3788

     
    PR: (https://github.com/DSpace/DSpace/pull/1912)
    
    •  First Review
    •  Second Review
    •  Test
    •  Merge
    •  Port to 6.x branch
    •  Add documentation for Oracle users who have already run previous migration

...

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Test
•  Merge
•  Port to master: via PR https://github.com/DSpace/DSpace/pull/1963
•  PR requires rebasing

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Test
•  Third Review (PR is from a non-committer)
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Test
•  Third Review (PR is from a non-committer)
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer) skipping for small change / quick win
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer) 
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master (WIP https://github.com/DSpace/DSpace/pull/2059)

...

Summary

DSpace 6.3 is a bug fix release to resolve several issues located in previous 6.x releases. As it only provides only bug fixes, DSpace 6.3 should constitute an easy upgrade from DSpace 6.x for most users. No database changes should be necessary when upgrading from DSpace 6.x to 6.3. One configuration addition (orcid.api.url property) has been made to the default dspace.cfg to support the new ORCID API v2, for ORCID Authority Control users.

JSPUI security fixes include

• [HIGH SEVERITY] A user can inject malicious Javascript into the names of EPeople or Groups. This is most severe in sites which allow anyone to register for a new account. (https://jira.duraspace.org/browse/DS-3866 - requires a JIRA account to access.) 

  • Reported by Julio Brafman

• [MEDIUM SEVERITY] Any user was able to export metadata to CSV format if they knew the correct JSPUI path/parameters. Additionally, the exported CSV included metadata fields which are flagged as hidden in configuration. (https://jira.duraspace.org/browse/DS-3840 - requires a JIRA account to access.) 

  • Reported by Eike Kleiner (ZHAW, Zurich University of Applied Sciences)

Major bug fixes include

• Update DSpace ORCID Integration to use ORCID API v2 (instead of now obsolete ORCID v1): DS-3447
• Update DSpace Statistics to use GeoIP API v2 (instead of now discontinued GeoIP API v1): DS-3832
• Database specific fixes
  • Oracle database migration fix. Configurable Workflow migration threw errors: DS-3788
  • PostgreSQL JDBC driver upgraded to latest version (to allow for full compatibility with PostgreSQL v10): DS-3854
  • Fix issue where DSpace wasn't starting if it used a database connection pool supplied through JNDI: DS-3434
• Bitstream deletion issues ("dspace cleanup" command)
  • Fixed issues where Bitstreams were not being flagged for deletion when an Item was deleted: DS-3729
  • Fixed issues where Bitstreams were not being removed from assetstore even when flagged as deleted: DS-3627 and DS-3461
    • Note: This issue was limited to 6.0, 6.1 or 6.2, and specifically occurred when Item Level Versioning was NOT enabled (which is the default setting) or when Item Level Versioning was first enabled on DSpace version 6.0, 6.1 or 6.2
  • Fixed issues where Bitstreams were removed from all versions of an Item (resulting in inaccurate versioning) when deleted from the latest version of an Item: DS-3627
    • Note: This issue was limited to 6.0, 6.1 or 6.2, and specifically ONLY occurred when Item Level Versioning was first enabled on DSpace version 4.x or 5.x (and that old versioning data had since been migrated to 6.x).
• Other API-level fixes (affecting all UIs)
  
  • Fixed issues where Item Level Versioning accidentally duplicated both metadata (DS-3703) and bitstreams (DS-3702)
  • Fixed issue where Shibboleth authentication plugin appeared to login when no password provided: DS-3662
  • Fixed issues with Solr Search Query escaping in both UIs: DS-3507
  • Update last modified timestamp (on Item) when a new bitstream is added: DS-3734
  • Ensure ImageMagick thumbnails respect the orientation of original file: DS-3839
  • Fix MediaFilter "too many open files" issues (where it forgot to close an input stream): DS-3700
  • Fix PubMed Import submission step (StartSubmissionLookupStep) to use updated URL of PubMed API:  DS-3933
  • Cleanup EHCache configuration: DS-3694 and DS-3710
• JSPUI fixes
  • Fixed issues with authority control popup: DS-3404
  • Fixed issues with pausing HTML5 uploads: DS-3865
• XMLUI fixes
  • Fixed Mirage v2 build issues caused by Bower Registry URL change: DS-3936
  • Fixed performance issues for Items with 100+ bitstreams: DS-3883
  • Fixed occasional Hibernate LazyInitializationException when completing submissions: DS-3775
  • Fixed Unicode character issues in metadata: DS-3733
  • Fix issue where search results lose Community/Collection context when sorting: DS-3835
  • Fixed bitstream download issues which could leave AWS connections open when using S3 storage backend: DS-3870
  • Update Mirage to use recommended MathJax inline delimiters (DS-3087) and to use new CDN location (DS-3560)
• OAI-PMH Fixes
  • Ensure OAI-PMH updates harvestable items when an item is made private (DS-3707) or an embargo expires (DS-3715)
  • Fixed Unicode character issues in metadata: DS-3733 and DS-3556
  • Fix content type of OAI-PMH response: DS-3889
  • Enhanced "oai import" command to report on items that cause indexing issues: DS-3852
• REST API fixes and minor improvements
  • Fixed issue where REST API was no longer able to return JSON responses: DS-3903
  • Fixed update bitstream data returning 500 response: DS-3511
  • Improvements to REST Based Quality Control Reports:
    • Enable login via Shibboleth: DS-3811
    • Add bitstream field data to item listing: DS-3704
    • Fix bug filtering for bitstream permissions: DS-3713
    • Improve ability to find withdrawn items: DS-3714

For more information, see the Changes section below.

Upgrade Instructions

• For upgrade instructions from ANY PRIOR VERSION to 6.3, please see Upgrading DSpace

No new features in DSpace 6.3

Changes

The following bug fixes were released in 6.3.

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Add Unit Tests
•  Test
•  Merge
•  Port to master

...

DS-3822: Don't guess XML structure during ingest 

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Add Unit Tests
•  Test
•  Merge
•  Port to master

...

DONE

https://github.com/DSpace/DSpace/pull/1896

Withdrawn or shifted to 6.4

Items in this list are either withdrawn or are shifted over to a 6.4 milestone in Github because there are outstanding issues, or there is not enough movement on reviewing / testing / merging to get the code into DSpace 6.3 for a timely release

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to dspace-6_x (or resubmit.. PR is against 5.x)
•  Port to master

...

...

•  First Review
•  Second Review
•  Test
•  Third Review (PR is from a non-committer)
•  Merge
•  Port to master

...

•  Create PR / proposed fix:  https://github.com/DSpace/DSpace/pull/1912
  New PR:  https://github.com/DSpace/DSpace/pull/1954 – needs review/confirmation after 1912 merged?
•  First Review
•  Second Review
•  Test
•  Merge

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  Created PR / proposed fix
•  First Review
•  Second Review
•  Test
•  Merge

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Force Travis-CI to re-test this PR, either with a rebase, or close/re-open the PR
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Third Review (PR is from a non-committer)
•  Test
•  Merge
•  Port to master

...

...

•  First Review
•  Second Review
•  Test
•  Merge
•  Port to 6.x?
  (looks like  this PR got switched to master / 7.0)

...

Organizational Details

Release Coordination

• Release Coordinator: Kim Shepherd