Opened 9 years ago

Closed 8 years ago

#742 closed feature (fixed)

Collect VLO statistics

Reported by: Twan Goosen Owned by: Twan Goosen
Priority: trivial Milestone:
Component: VLO web app Version:
Keywords: harvester, workflow, harvester-workflow Cc: teckart@informatik.uni-leipzig.de

Description (last modified by Twan Goosen)

Write a script or small utility that queries the SOLR on a regular basis (probably once or twice per day will be sufficient), collecting facet value counts for the top values for some facets:

  • Data provider
  • National Project
  • Collection
  • Language

The data could be stored in a running XML or CSV file (or one per facet if its easier). Also store 'others' to make the counts add up to the total.

Generate visualisations for these statistics (probably stacked area graphs are most suitable) using something like ​CanvasJS (or integrate with web app using ​Wicket Charts).

Change History (13)

comment:1 Changed 9 years ago by DefaultCC Plugin

Cc: teckart@informatik.uni-leipzig.de added

comment:2 Changed 9 years ago by Twan Goosen

Description: modified (diff)

!CanvasJS supports stacked graphs

comment:3 Changed 9 years ago by Twan Goosen

Description: modified (diff)

comment:4 Changed 9 years ago by Twan Goosen

Milestone: → VLO-3.3

Moved a number of existing VLO tickets to 3.3 milestone

comment:5 Changed 9 years ago by Twan Goosen

Willem suggests: use ​StatsD.
Server runs ​collectd to which these stats can serve as input (see ​StatsD plugin)

Last edited 9 years ago by Twan Goosen (previous) (diff)

comment:6 Changed 9 years ago by Twan Goosen

Milestone: VLO-3.3

Taken off milestone, not relevant to any specific VLO release

comment:7 Changed 9 years ago by Twan Goosen

Owner: set to Twan Goosen
Status: new → assigned

comment:8 Changed 9 years ago by Twan Goosen

Milestone: → VLO-3.5 or later

Decided to be put on '3.5 or later' milestone in developer video conference

comment:9 Changed 9 years ago by Twan Goosen

Keywords: harvester workflow added

comment:10 Changed 9 years ago by Twan Goosen

Keywords: harvester-workflow added

comment:11 Changed 8 years ago by Twan Goosen

Milestone: VLO-3.5 or later → VLO-4.0 or later

Milestone renamed

comment:12 Changed 8 years ago by Twan Goosen

Milestone: VLO-4.0 or later → VLO-4.1 or later

Milestone renamed

comment:13 Changed 8 years ago by Twan Goosen

Milestone: VLO-4.1 or later
Resolution: → fixed
Status: assigned → closed

vlo-statistics module has been ​integrated into the development branch and will be included in VLO 3.4.1.

Note: See TracTickets for help on using tickets.