wiki:OAIHarvester

Version 1 (modified by Menzo Windhouwer, 9 years ago) (diff)

--

Responsible for this page: Menzo Windhouwer?.
Last content check: 28-10-2015

Purpose

The purpose of this page is to collect relevant information about the OAI Harvester.

Project: OAI Harvester

The OAI Harvester manages the regular harvests of CMD records from endpoints provided by the CLARIN centers and additionally harvests of OLAC and DC records from various other endpoints.


Contents

  1. Project: OAI Harvester
    1. People
    2. Getting code
    3. Usage
    4. System Requirements
    5. Dependencies
    6. Building and Deploying
    7. Interfaces
    8. Design
    9. Tickets
    10. Status, Planning and Roadmap
    11. Resources
    12. History


People


Getting code


Usage


System Requirements


Dependencies


Building and Deploying


Interfaces


Design


Tickets

https://github.com/TheLanguageArchive/oai-harvest-manager/issues


Status, Planning and Roadmap

Status: active

Planning and roadmap:

  • switch to the ListRecords profile
  • get rid of OCLC harvester2 library, which prevents timeouts etc. for specific endpoints
  • get rid of always building a DOM, which blows up memory consumption
  • create a new OAI harvester viewer

Resources


History

  • Kees Jan van de Looij
  • Lari Lampen