wiki:OAIHarvester/TestHarvesting

Version 3 (modified by Twan Goosen, 4 years ago) (diff)

--

Testing harvest + import of individual endpoints

Objective: harvest a specific endpoint and include the harvested result in the alpha instance of the VLO for testing purposes.

Running the test harvest

  • Clone https://github.com/clarin-eric/test-oai-harvest in a location with write access on the server (or locally if you prefer)
  • Prepare a harvester XML configuration file for the harvesting scenario to test. The repositories contains several configuration files that can be used as an example or template
  • Optionally: customise configuration (see the test-oai-harvest project's README for instructions)
  • Run the harvest - it's probably a good idea to do this in the background:
cd test-oai-harvest
nohup ./harvest.sh my-config &

This assumes that you have made a configuration file my-config.xml. Output will in this case (assuming default configuration settings) go to test-oai-harvest/output/my-config.

Importing the result into the alpha VLO

After the harvest has completed, you can import the results into the VLO