Versions Compared

Old Version 5

changes.mady.by.user Tim Donohue

Saved on

compared with

New Version Current

changes.mady.by.user Tim Donohue

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • The schedule has now been finalized (see top of this page)

Docker Request Issues

  • https://github.com/DSpace/DSpace/issues/10092
  • We have been removed from open-source access to DockerHub.
  • Tim has reapplied, we are waiting for a response from DockerHub
  • This has impacted Tim's work in terms of testing and merging
  • We can currently merge only 2-4 PRs / day. After that we are blocked & we can no longer push images to DockerHub. 
    • This can also negatively impact Angular e2e tests because they rely on those DockerHub images.  If we hit the rate limit while pushing images to DockerHub, then the images in DockerHub may end up in an unexpected state.  In some cases, this has caused e2e tests to fail because they cannot download the expected image from DockerHub.
    • Once we hit this rate limit, we are blocked entirely for up to 6 hours.  No Docker images can be pushed to DockerHub.
  • Tim has worked on a solution to become less dependent on DockerHub by building Docker images against the GitHub Container Registry to avoid hitting rate limits in DockerHub.  We then copy the built image to DockerHub in a single command, which decreases the number of requests we make to DockerHub.
  • Question from Kim: do we need to copy every single build over to DockerHub or only main images (for releases)?
    • Not necessarily, if we use the GitHub container registry, we may not need to push as much to DockerHub as we used to
    • For example: We may be able to exclude pushing test images (e.g. "dspace-test") to DockerHub, or even just push release images (dspace-8.0, dspace-7.6.2, etc)
  • Question: are there valid alternatives to DockerHub?
    • Yes, Google, Amazon, others have them, but they are not free; DockerHub seems to be the main registry used by open-source
  • If anyone has knowledge of a viable alternative, please let Tim know
  • Pascal researched the Google registry, but their free plan does not work within the capacity load we need
  • Next Steps:
    • Tim will need to merge this PR: https://github.com/DSpace/DSpace/pull/10080   This PR allows our Dockerfiles to use a different registry (not DockerHub) for our own images.
    • Tim is working on an additional PR to move the build process to using GitHub Container Registry which builds off of #10080.  This will hopefully be coming later today or Monday.

...