DSpace news

Syndicate content
Updated: 8 hours 41 min ago

Fedora Migration Paths and Tools Project Update: December 2020

Wed, 16/12/2020 - 19:27

This is the third in a series of monthly updates on the Fedora Migration Paths and Tools project – please see last month’s post for a summary of the work completed up to that point. This project has been generously funded by the IMLS.

The Principal Investigator, David Wilcox, participated in a presentation for CNI that also included Robin Ruggaber from the University of Virginia pilot and Amy Blau from the Whitman College pilot. This was a great opportunity to communicate progress on the grant work so far to a broader audience. The recording is now available on Vimeo.

The Whitman College team has largely completed their metadata remediation and mapping work. This work is being documented in terms of process, resources, decisions made, and lessons learned, and will be shared with the community as part of the grant toolkit. Meanwhile, Born Digital has nearly completed work on the new Islandora 8 theme, and the grant team is just about ready to begin conducting test migrations with sample content.

The University of Virginia team conducted a detailed investigation of the errors that were encountered during migration testing. These errors were revealed to be linked to objects in the legacy Fedora 3 repository that were missing datastreams, which caused the migration utility to skip them. The team determined that these objects were related to content that had already been migrated to newer systems, so they could be safely left behind during the migration. However, had the objects still been relevant from a preservation perspective, the team was prepared to create a script to repair the objects by removing references to missing datastreams in order to migrate what remained.

December is a short month due to the upcoming holidays, but the Whitman team plans to complete their metadata work and review the results of initial test migrations, while the University of Virginia team plans to complete the migration of working content and index these resources into the new Fedora 6 installation.

Stay tuned for further updates next month!

The post Fedora Migration Paths and Tools Project Update: December 2020 appeared first on Duraspace.org.

Fedora 6 Alpha Release is Here

Mon, 23/11/2020 - 18:35

Today marks a milestone in our progress toward Fedora 6 – the Alpha Release is now available for download and testing! Over the past year, our dedicated Fedora team, along with an extensive list of active community members and committers, have been working hard to deliver this exciting release to all of our users.

So what does Alpha mean? Fedora 6.0 Alpha-1 is our initial release of the newly updated software. The 3 primary goals for Fedora 6 are robust migration support, enhanced digital preservations features, and improved performance and scale. We have been actively working on a strong feature set that we hope to release with the full version in early 2021.

Features Available in Alpha Release

For now, we are happy to deliver the following features with the Alpha:

Alpha Migration Tooling for Fedora 3, 4 & 5 to Fedora 6
Native Amazon S3 Support
Support for Oxford Common File Layout persistence
Built-in search service
Metrics collection available
Docker deployment option

To showcase what’s in store for Fedora 6, we also created this mini Highlight Reel featuring the Top 4 Features we thought you would be most excited about.


In the coming weeks, as we work toward Beta release, we want to ensure the broader community has ample opportunity to confirm the functionality of the software against local needs and use cases. We cannot emphasize enough how valuable your feedback will be. It is only through the feedback of those within our own community that we can help guide the development efforts and deliver a product you are proud to use.

Feedback and Testing

Please feel free to use the fedora-tech mailing list, the #fedora-6-testing channel in Fedora Slack or reach out to David Wilcox at david.wilcox@lyrasis.org to provide any and all feedback on this release. Even letting us know that you are testing the software would be greatly appreciated!

Stay tuned on the Road to Fedora 6 for more exciting updates as we move toward Beta and eventually full production release. Thanks to all involved, we couldn’t have done it without your support and dedication.

The post Fedora 6 Alpha Release is Here appeared first on Duraspace.org.

Fedora Migration Paths and Tools Project Update: November 2020

Mon, 16/11/2020 - 23:30

This is the second in a series of monthly updates on the Fedora Migration Paths and Tools project – please see last month’s post for a summary of the work completed up to that point. This project has been generously funded by the IMLS.

The University of Virginia pilot project work continued this month, primarily with migration-utils testing. The UVA repository is running an older version of Fedora (3.2.1), and most of the staff members who created and managed the repository are no longer with the university. This is a common situation at many institutions, and it can lead to problems understanding the purpose and function of the contents of the repository. In this case, some of the content has been replicated elsewhere and the total number of external access points to the repository was unknown. To address this, the team went through a process of cataloguing the repository contents and investigating touch points with external systems. This process will be documented for the benefit of other Fedora users with legacy systems.

The UVA team engaged in extensive testing of the migration utility and ran into several issues along the way. Some of the issues were related to the legacy Fedora repository itself, so these need to be disambiguated and resolved in order to determine which issues are related solely to the migration utility. Issues related to the migration utility were reported to the Fedora team via JIRA issues so they could be resolved.

Spreadsheet of functional requirements

The Whitman College pilot team continued last month’s requirements gathering efforts by completing the functional requirements spreadsheet. This spreadsheet identifies which functions are required for the new Islandora 8 repository and prioritizes them. The grant PI reviewed these requirements with the Islandora Tech Lead to identify solutions and determine which requirements are currently satisfied by Islandora 8 or a plugin module, which ones would be satisfied within the next 3-6 months, and which requirements would need to be addressed via custom development. The next step is to demonstrate the currently available functionality for the pilot project team and determine which outstanding functions will need to be prioritized for custom development.

The focus in November and December will be on finalizing a validation tool that will be tested by the UVA team – this tool will allow Fedora users to validate that all their Fedora 3 objects were successfully migrated to Fedora 6. At the same time, the Whitman College team will be documenting their metadata mapping and remediation process for the benefit of the wider community.

Stay tuned for future blog posts as we make progress on this project. All relevant resources can be found linked off the project landing page. Please contact David Wilcox with any questions or feedback.

The post Fedora Migration Paths and Tools Project Update: November 2020 appeared first on Duraspace.org.

Fedora Migration Paths and Tools Project Update: October 2020

Wed, 14/10/2020 - 20:15

This is the first in a series of monthly blog posts that will provide updates on the IMLS-funded Fedora Migration Paths and Tools: a Pilot Project. The first phase of the project began in September with kick-off meetings for each pilot partner: the University of Virginia and Whitman College. These meetings established roles and responsibilities for the pilots, goals and deliverables, and timelines to accomplish the work. Following the meetings we established project infrastructure, including publicly-accessible GitHub project boards.

The project plan for each pilot is available on the wiki: University of Virginia and Whitman College. These plans will be updated as work progresses and goals are met. Relevant project deliverables will be shared publicly as they are completed.

This month, the University of Virginia pilot will focus on working with a sample of their Fedora 3 content to document data models and metadata and make decisions with regard to mappings. An initial test migration will be conducted to determine what changes will need to be made in order to accomplish the complete migration. They are also setting up a new cloud-based Fedora 6.x instance using fcrepo-docker and the newly-created fcrepo-aws-deployer. These tools can be used by others interested in setting up a Fedora instance using Docker and AWS. At the same time, the grant team is working on a validation tool that will compare Fedora 3 data with migrated Fedora 6 data to ensure completeness and integrity of the migration.

The Whitman College team is focused on metadata this month, both in terms of remediation and mapping. Scope, goals, and a timeline for these activities has been established, and deliverables will be shared with the community for feedback as they are completed. The team is also working on a detailed set of functional requirements, which will be used to conduct a gap analysis and prioritize and development efforts that might be needed. This list of functional requirements will be shared once it has been completed.

Stay tuned for future blog posts as we make progress on this project. All relevant resources can be found linked off the project landing page. Please contact David Wilcox with any questions or feedback.


The post Fedora Migration Paths and Tools Project Update: October 2020 appeared first on Duraspace.org.

DSpace 7.0 Beta 4 Release Announcement

Tue, 13/10/2020 - 21:09

Dear DSpace Community,

The DSpace Leadership Group, the DSpace Committers and LYRASIS are proud to announce that DSpace 7.0 Beta 4 is now available for download and testing.

Beta 4 is the fourth scheduled Beta release provided for community feedback and to introduce the new features of the 7.0 platform. As a Beta release, we highly advise against running this version in production. Rather, we ask that you consider installing it in a test environment, try it out, and report back any issues or bugs you notice through GitHub (UI issues, Backend/API issues).

DSpace 7.0 Beta 4 is deployed for public testing on a dedicated demo site and it can be installed manually or via a Docker “quick install”. Instructions are available at: Try out DSpace 7.

Included in Beta 4
  • Live Import framework (video) support has been added to the Submission Form (and REST API /api/integration/externalsources endpoint). This includes importing from an external API or drag & drop upload of a bibliographic file.
  • Controlled Vocabulary support (video) in Submission Form. Depending on the field configuration, this can include autocomplete of known terms (see default “Subject Keywords” field), dropdown support (see default “Type” field) and hierarchical tree views
  • Curation Tasks are now supported via the Admin UI and the Processes UI.
  • Import / Export metadata from/to CSV (i.e. Batch Metadata Editing) is now available from the Admin UI.
  • Basic Usage Statistics (video) are available for the entire site, or specific Communities, Collections or Items
    • Support for exchanging usage data to IRUSwas added.  See new “irus-statistics.cfg” and DS-626
  • Improved GDPR Alignment (video), including
    • User Agreement required for all authenticated users to read and agree to.
    • Cookie Preferences are now available for all users (anonymous or authenticated), along with a Privacy Statement.
    • User Accounts can be deleted even if they’ve submitted content in the past.
  • Language preferences are now kept for all users (anonymous or logged in). By default, DSpace will try to use your browser’s preferred language, but you can specify a preferred language just for DSpace.
  • IP-based authorization lets you restrict (or provide access to) objects based on the user’s IP address.
  • Search Engine Optimization: Addition of robots.txt, Sitemaps and Google Scholar “citation” tags. Sitemaps are now enabled by default and automatically update once per day.

Source: DSpace 7 Release Notes

Coming soon
  • Beta 5: Our final beta release will include code cleanup, bug fixes, performance improvements and theming enhancements. Coinciding with this release, we will also be hosting a community-wide 7.0 Testathon to look for any remaining bugs.
  • 7.0 Final Release: The final, production-ready release of 7.0 will be released as soon as all the above Betas have been completed and any outstanding major bugs have been resolved. Roughly estimated at 1-2 months after the last Beta.

More information and the latest changes can be found on DSpace 7 Release Goals.

Thanks to major code contributors!

The following organizations have been major code contributors to DSpace 7.

  • Atmire
  • 4Science

We gratefully recognize the following institutions who together have generously contributed financially to support the DSpace 7 staged release program, and individuals who devoted time to fundraising:

  • Auburn University
  • Cornell University
  • Pascal Becker
  • Dalhousie University
  • Duke University
  • ETH Zurich, ETH Library
  • Fraunhofer Gesellschaft
  • Imperial College London
  • Indiana University–Purdue University, Indianapolis
  • National Library of Finland
  • Beate Rajski
  • Staats- und Universitätsbibliothek Hamburg – Carl von Ossietzky
  • Technische Universität Berlin
  • Technische Universität Hamburg (TUHH)
  • The DSpace-Konsortium Deutschland
  • The German Consortium
  • The Helmut-Schmidt-Universität/Universität der Bundeswehr Hamburg
  • The Library Code GmbH
  • The Ohio State University
  • Texas Digital Library
  • University of Arizona
  • University of Edinburgh
  • University of Kansas
  • University of Minnesota
  • University of Missouri
  • University of Toronto
  • World Bank
  • ZHAW

The post DSpace 7.0 Beta 4 Release Announcement appeared first on Duraspace.org.