Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

One of the requirements for Fedora 6 is that it continues to implement the Fedora API Specification. Compliance with the specification is measured by the results of running the Fedora API Test Suite. The Earlier results of running the test suite results of Fedora 5 are published below:

Leading up to the release of Fedora 6, we will be running the API Test Suite against the in-progress Fedora 6 to track progress.

Recommended Method for Running Tests:

Table of Contents
maxLevel2

Instructions

  1. Download / Install Fedora
    1. Deploying Fedora - Complete Guide

    2. The following system properties are important to include when starting up a Fedora that will be the target of the Fedora API Test Suite:
      1. -Dfcrepo.home=<some_directory>
      2. -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/
      3. -Dfcrepo.auth.webac.groupAgent.baseUri=http://example.com/
      4. -Dfcrepo.external.content.allowed=fcrepo-http-api/src/test/resources/allowed_external_paths.txt
    3. For example: command for starting Fedora from within the source code base:


      No Format
      mvn jetty:run -Dfcrepo.home=target/
    Start Fedora 
    1. No Format
      
      mvn jetty:run -Dfcrepo.ocfl.staging.dir=target/fcrepo-data/staging -Dfcrepo.ocfl.storage.root.dir=target/fcrepo-data/ocfl-root \ 
      	-Dfcrepo.ocfl.work.dir=target/fcrepo-data/work -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/ \
      	-Dfcrepo.auth.webac.groupAgent.baseUri=http://example.com/ \
      	-Dfcrepo.external.content.allowed=fcrepo-http-api/src/test/resources/allowed_external_paths.txt \
          -Dfcrepo.cache.webac.acl.timeout.minutes=0 \ 
      	-pl fcrepo-webapp


  2. Run tests

    1. No Format
      java -jar target/testsuite-1.0-SNAPSHOT-shaded.jar -c config-local.yml


    2. Where "config-local.yml" contains:

      No Format
      default:
        rooturl: http://localhost:8080/rest/
        root-controller-user-webid: http://example.com/fedoraAdmin
        root-controller-user-name: fedoraAdmin
        root-controller-user-password: fedoraAdmin
        permissionless-user-webid: http://example.com/testuser
        permissionless-user-name: testuser
        permissionless-user-password: testpass
        broker-url: tcp://127.0.0.1:61616
        topic-name: fedora
        queue-name: 
        implementation-name: Fedora
        implementation-version: 6.0.0


Test Runs and Results

...

Date:

...

2022-05-31

Fedora commit: 879f528f473f6c35a528eeea3d6b427623ab3d82
Test suite commit: 5eca0de34c162205d66913b1979967d487619018

Who: Jared Whiklo 

Results:

No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 1, Skips: 28
===============================================

Details: testsuite-execution-report-2022-05-31.html


Date: 2021-06-28

Fedora commit: RC-2
Test suite commit:5eca0de34c162205d66913b1979967d487619018

Who: Danny Bernstein 

Expand

Execution

  1. Start Fedora
    1. Using "mvn jetty:run"

      No Format
      mvn jetty:run -Dfcrepo.home=target/ -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/  -Dfcrepo.auth.webac.groupAgent.baseUri=http://example.com/  -Dfcrepo.external.content.allowed=fcrepo-http-api/src/test/resources/allowed_external_paths.txt  -Dfcrepo.cache.webac.acl.timeout.minutes=0 -pl fcrepo-webapp


  2. Run tests

    1. No Format
      java -jar target/testsuite-1.0-SNAPSHOT-shaded.jar -c config-local.yml


    2. Where "config-local.yml" contains:


      No Format
      default:
      rooturl: http://localhost:8080/rest/
      root-controller-user-webid: http://example.com/fedoraAdmin
      root-controller-user-name: fedoraAdmin
      root-controller-user-password: fedoraAdmin
      permissionless-user-webid: http://example.com/testuser
      permissionless-user-name: testuser
      permissionless-user-password: testpass
      broker-url: tcp://127.0.0.1:61616
      topic-name: fedora
      queue-name: 
      implementation-name: Fedora
      implementation-version: 6.0.0-RC-2


Results

Summary:

No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 1, Skips: 28
===============================================


Details:  testsuite-execution-report-2021-06-28.html


Date: 2021-03-10

Fedora commit: 7a6e5eb0829a769aaf9a03cbb78e325b1ff0ba5d
Test suite commit: 7a6d398f3d0d2cf0ae2a072e334a22f61fdd61ae

Who: Danny Bernstein 

Expand

Execution

  1. Start Fedora
    1. Using "mvn jetty:run"

      No Format
      mvn jetty:run -Dfcrepo.home=target/ -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/ \ -Dfcrepo.auth.webac.groupAgent.baseUri=http://example.com/ \

Commit: ?

Who: awoods

Expand
titleSetup

Execution

  1. Start Fedora
    1. No Format
      java -Dfcrepo.log=DEBUG -Dfcrepo.external.content.allowed=fcrepo-http-api/src/test/resources/allowed_external_paths.txt \ -pl fcrepo-webapp


  2. Run tests

    1. No Format
      java -jar target/testsuite-1.0-SNAPSHOT-shaded.jar -c config-local.yml


    2. Where "config-local.yml" contains:


      No Format
      default:
      rooturl: http://localhost:8080/rest/
      root-controller-user-webid: http://example.com/fedoraAdmin
      root-controller-user-name: fedoraAdmin
      root-controller-user-password: fedoraAdmin
      permissionless-user-webid: http://example.com/testuser
      permissionless-user-name: testuser
      permissionless-user-password: testpass
      broker-url: tcp://127.0.0.1:61616
      topic-name: fedora
      queue-name: 
      implementation-name: Fedora
      implementation-version: 6.0.0-SNAPSHOT


Results

Summary:

No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 1, Skips: 28
===============================================

Details: testsuite-execution-report-2021-03-10..html 



Date: 2021-02-09

Fedora commit: 41b13034fbfe70f2607a71d0e1cedec29b0fd196
Test suite commit: 7df5e2fd857a6cc36740ce86a51a6e834d4a7ed5

Who: Danny Bernstein 

Expand

Execution

  1. Start Fedora
    1. Using "mvn jetty:run"

      No Format
      mvn jetty:run -Dfcrepo.home=target/ -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/ \ -Dfcrepo.auth.webac.groupAgent.baseUri=http://example.com/ \ -Dfcrepo.external.content.allowed=fcrepo-http-api/src/test/resources/allowed_external_paths.txt \ -pl fcrepo-webapp


  2. Run tests

    1. No Format
      java -jar target/testsuite-1.0-SNAPSHOT-shaded.jar -c config-local.yml


    2. Where "config-local.yml" contains:


      No Format
      default:
      rooturl: http://localhost:8080/rest/
      root-controller-user-webid: http://example.com/fedoraAdmin
      root-controller-user-name: fedoraAdmin
      root-controller-user-password: fedoraAdmin
      permissionless-user-webid: http://example.com/testuser
      permissionless-user-name: testuser
      permissionless-user-password: testpass
      broker-url: tcp://127.0.0.1:61616
      topic-name: fedora
      queue-name: 
      implementation-name: Fedora
      implementation-version: 6.0.0-SNAPSHOT


Results

Summary:

No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 8, Skips: 26
===============================================

Details: testsuite-execution-report-2021-02-09.html


Date: 2021-01-08

Fedora commit: cc660dd207432a5baa6b78cfacc304973ec0fc6c
Test suite commit: 4a4dc9f0e32c5a2962d08156efea140e243fe6bd

Who: Andrew Woods

Expand

Execution

  1. Start Fedora
    1. Using "mvn jetty:run"

      No Format
      mvn jetty:run -Dfcrepo.home=target/ -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/ \ -Dfcrepo.auth.webac.groupAgent.baseUri=http://example.com/ \ -Dfcrepo.external.content.allowed=fcrepo-http-api/src/test/resources/allowed_external_paths.txt \ -pl fcrepo-webapp


  2. Run tests

    1. No Format
      java -jar target/testsuite-1.0-SNAPSHOT-shaded.jar -c config-local.yml


    2. Where "config-local.yml" contains:


      No Format
      default:
      rooturl: http://localhost:8080/rest/
      root-controller-user-webid: http://example.com/fedoraAdmin
      root-controller-user-name: fedoraAdmin
      root-controller-user-password: fedoraAdmin
      permissionless-user-webid: http://example.com/testuser
      permissionless-user-name: testuser
      permissionless-user-password: testpass
      broker-url: tcp://127.0.0.1:61616
      topic-name: fedora
      queue-name: 
      implementation-name: Fedora
      implementation-version: 6.0.0-SNAPSHOT


Results

Summary:

No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 14, Skips: 26
===============================================

Details: testsuite-execution-report-2021-01-08.html

Date: 2020-10-08

Fedora commit: 2fae76d702c8f8074fdd511f99977b0826f4f0f3
Test suite commit: 558cda79b224616a4135fdb2836509766e2a0029

Who: awoods

Expand

Execution

  1. Start Fedora
    1. Using "mvn jetty:run"

      No Format
      mvn jetty:run -Dfcrepo.home=target/ -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/ \ -Dfcrepo.auth.webac.groupAgent.baseUri=http://example.com/ \ -Dfcrepo.external.content.allowed=fcrepo-http-api/src/test/resources/allowed_external_paths.txt \ -pl fcrepo-webapp-jar fcrepo-webapp/target/fcrepo-webapp-6.0.0-SNAPSHOT-jetty-console.jar --headless


  2. Run tests

    1. No Format
      java -jar target/testsuite-1.0-SNAPSHOT-shaded.jar -c config-local.yml


    2. Where "config-local.yml" contains:


      No Format
      default:
      rooturl: http://localhost:8080/rest/
      root-controller-user-webid: http://example.com/fedoraAdmin
      root-controller-user-name: fedoraAdmin
      root-controller-user-password: fedoraAdmin
      permissionless-user-webid: http://example.com/testuser
      permissionless-user-name: testuser
      permissionless-user-password: testpass
      broker-url: tcp://127.0.0.1:61616
      topic-name: fedora
      queue-name: 
      implementation-name: Fedora
      implementation-version: 6.0.0-SNAPSHOT


Results

Summary:

No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 27, Skips: 25
===============================================

Details: testsuite-execution-report-2020-10-08.html

Date: 2020-06-12

Commit: bd01b67

Who: whikloj

Expand
titleSetup

Execution

  1. Start Fedora

    1. No Format
      mvn  -Dfcrepo.external.content.allowed=fcrepo-http-api/src/test/resources/allowed_external_paths.txt -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/ -Dfcrepo.ocfl.staging.dir=/Users/whikloj/www/fcrepo4/ocfl_temp/staging -Dfcrepo.ocfl.storage.root.dir=/Users/whikloj/www/fcrepo4/ocfl_temp/storage_root -Dfcrepo.ocfl.work.dir=/Users/whikloj/www/fcrepo4/ocfl_temp/work jetty:run -pl fcrepo-webapp


  2. Run tests

    1. No Format
      java -jar target/testsuite-1.0-SNAPSHOT-shaded.jar -c config-local.yaml


    2. where "config-local.yml" contains:

      No Format
      default:
        rooturl: http://localhost:8080/rest/
        root-controller-user-webid: http://example.com/fedoraAdmin
        root-controller-user-name: fedoraAdmin
        root-controller-user-password: fedoraAdmin
        permissionless-user-webid: http://example.com/testuser
        permissionless-user-name: testuser
        permissionless-user-password: testpass
        broker-url: tcp://127.0.0.1:61616
        topic-name: fedora
        queue-name: 
        implementation-name: Fedora
        implementation-version: 6.0.0


Results

Summary:

No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 7447, Skips: 2425
===============================================

Details Details: testsuite-execution-report-2020-06-12.html

Date: 2020-05-27

Commit: df2982c01

Who: dbernstein

Expand
titleSetup

Execution

  1. Start Fedora

    1. No Format
      mvn jetty:run -Dfcrepo.ocfl.staging.dir=target/fcrepo-data/staging -Dfcrepo.ocfl.storage.root.dir=target/fcrepo-data/ocfl-root \ 
      	-Dfcrepo.ocfl.work.dir=target/fcrepo-data/work -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/ \
      	-Dfcrepo.auth.webac.groupAgent.baseUri=http://example.com/ \
      	-Dfcrepo.external.content.allowed=../fcrepo-http-api/src/test/resources/allowed_external_paths.txt \
      	-pl fcrepo-webapp


  2. Run tests

    1. No Format
      java -jar target/testsuite-1.0-SNAPSHOT-shaded.jar -c config-local.yml


    2. Where "config-local.yml" contains:

      No Format
      default:
        rooturl: http://localhost:8080/rest/
        root-controller-user-webid: http://example.com/fedoraAdmin
        root-controller-user-name: fedoraAdmin
        root-controller-user-password: fedoraAdmin
        permissionless-user-webid: http://example.com/testuser
        permissionless-user-name: testuser
        permissionless-user-password: testpass
        broker-url: tcp://127.0.0.1:61616
        topic-name: fedora
        queue-name: 
        implementation-name: Fedora
        implementation-version: 6.0.0


No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 61, Skips: 25
===============================================

testsuite-execution-report.html


Results

Summary:

No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 61, Skips: 25
===============================================

Details: testsuite-execution-report-2020-05-27-1250.html


Date: 2020-05-05

Commit: ?

Who: awoods

Expand
titleSetup

Execution

  1. Start Fedora

    1. No Format
      java -Dfcrepo.log=DEBUG -Dfcrepo.external.content.allowed=fcrepo-http-api/src/test/resources/allowed_external_paths.txt -Dfcrepo.auth.webac.userAgent.baseUri=http://example.com/ -jar fcrepo-webapp/target/fcrepo-webapp-6.0.0-SNAPSHOT-jetty-console.jar --headless


  2. Run tests

    1. No Format
      java -jar target/testsuite-1.0-SNAPSHOT-shaded.jar -c config-local.yml


    2. Where "config-local.yml" contains:

      No Format
      default:
        rooturl: http://localhost:8080/rest/
        root-controller-user-webid: http://example.com/fedoraAdmin
        root-controller-user-name: fedoraAdmin
        root-controller-user-password: fedoraAdmin
        permissionless-user-webid: http://example.com/testuser
        permissionless-user-name: testuser
        permissionless-user-password: testpass
        broker-url: tcp://127.0.0.1:61616
        topic-name: fedora
        queue-name: 
        implementation-name: Fedora
        implementation-version: 6.0.0



Results

Summary

No Format
===============================================
Fedora API Specification Test Suite
Total tests run: 241, Failures: 74, Skips: 24
===============================================

Details testsuite-execution-report.html