Version 2 (modified by 9 years ago) (diff) | ,
---|
Responsible for this page: Menzo Windhouwer?.
Last content check: 28-10-2015
Purpose
The purpose of this page is to collect relevant information about the OAI Harvester.
Project: OAI Harvester
The OAI Harvester manages the regular harvests of CMD records from endpoints provided by the CLARIN centers and additionally harvests of OLAC and DC records from various other endpoints.
Contents
People
Getting code
- You can browse the code https://github.com/TheLanguageArchive/oai-harvest-manager
- Git clone from:
https://github.com/TheLanguageArchive/oai-harvest-manager.git
Usage
System Requirements
Dependencies
Building and Deploying
Interfaces
Design
Tickets
https://github.com/TheLanguageArchive/oai-harvest-manager/issues
Status, Planning and Roadmap
Status: active
Planning and roadmap:
- switch to the ListRecords scenario
- get rid of OCLC harvester2 library, which prevents timeouts etc. for specific endpoints
- get rid of always building a DOM, which blows up memory consumption
- create a new OAI harvester viewer
Resources
History
- Kees Jan van de Looij
- Lari Lampen