Changes between Version 18 and Version 19 of InfrastructureOverview
- Timestamp:
- 10/01/18 15:40:59 (6 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
InfrastructureOverview
v18 v19 5 5 ## Gateway applications ## 6 6 7 ### Virtual Language Observatory ### 8 Metadata exploration web application, with faceted browser. 9 10 Own software. Stable. 11 12 Public info: http://www.clarin.eu/vlo 13 Technical info: https://trac.clarin.eu/wiki/CmdiVirtualLanguageObservatory 14 15 ### Federated Content Search engine ### 16 Search engine to interact with the federated content search endpoints. 17 18 Own software. Stable. 19 20 Public info: https://www.clarin.eu/content/content-search 21 Technical info: https://trac.clarin.eu/wiki/FCS%20Aggregator 22 23 ### Virtual Collection Registry ### 24 Web application to manage and publish digital bookmark sets (virtual collections). 25 26 Own software. Stable. 27 28 Public info: http://www.clarin.eu/content/virtual-collections 29 Technical info: https://trac.clarin.eu/wiki/VirtualCollectionRegistry 30 31 ## Infrastructure applications ## 32 ### Centre Registry ### 33 Database with information about the CLARIN centres. 34 35 Own software. Stable. 36 37 Public info: https://www.clarin.eu/clarin-eric-datatables/centres 38 Technical info: https://centres.clarin.eu/about 39 40 ### Metadata ### 41 #### Metadata Harvester #### 7 ### Virtual Language Observatory ### Metadata exploration web application, with faceted browser. 8 9 Own software. Stable. 10 11 Public info: http://www.clarin.eu/vlo Technical info: https://trac.clarin.eu/wiki/CmdiVirtualLanguageObservatory 12 13 ### Federated Content Search engine ### Search engine to interact with the federated content search endpoints. 14 15 Own software. Stable. 16 17 Public info: https://www.clarin.eu/content/content-search Technical info: https://trac.clarin.eu/wiki/FCS%20Aggregator 18 19 ### Virtual Collection Registry ### Web application to manage and publish digital bookmark sets (virtual collections). 20 21 Own software. Stable. 22 23 Public info: http://www.clarin.eu/content/virtual-collections Technical info: https://trac.clarin.eu/wiki/VirtualCollectionRegistry 24 25 ## Infrastructure applications ## ### Centre Registry ### Database with information about the CLARIN centres. 26 27 Own software. Stable. 28 29 Public info: https://www.clarin.eu/clarin-eric-datatables/centres Technical info: https://centres.clarin.eu/about 30 31 ### Metadata ### 32 33 #### Metadata Harvester #### 34 42 35 Application to harvest the metadata descriptions from centres. 43 36 44 37 Own software. Stable. 45 38 46 Public info: http://clarin.eu/harvester 47 Technical info: https://trac.clarin.eu/wiki/OAIHarvester 48 49 #### Component Registry #### 39 Public info: http://clarin.eu/harvester Technical info: https://trac.clarin.eu/wiki/OAIHarvester 40 41 #### Component Registry #### 42 50 43 Application to manage and create CLARIN-compliant metadata profiles. 51 44 52 45 Own software. Stable. 53 46 54 Public info: http://clarin.eu/componentregistry 55 Technical info: https://trac.clarin.eu/wiki/ComponentRegistryAndEditor 56 57 #### Concept Registry #### 47 Public info: http://clarin.eu/componentregistry Technical info: https://trac.clarin.eu/wiki/ComponentRegistryAndEditor 48 49 #### Concept Registry #### 50 58 51 Application to manage and create CLARIN-compliant concept definitions 59 52 60 53 Existing software (OpenSKOS) from CatchPLUS, with some modifications. Stable. 61 54 62 Public info: http://www.clarin.eu/ccr 63 Technical info: http://openskos.org/ 64 65 #### Curation module #### 55 Public info: http://www.clarin.eu/ccr Technical info: http://openskos.org/ 56 57 #### Curation module #### 58 66 59 Application to detect and correct errors in CLARIN-compliant metadata descriptions. 67 60 … … 70 63 Technical info: https://github.com/acdh-oeaw/clarin-curation-module 71 64 72 ### Federated Identity ### 73 #### SAML metadata aggregation: PyFF #### 65 ### Federated Identity ### 66 67 #### SAML metadata aggregation: PyFF #### 68 74 69 Application to merge technical information from national identity federations into 1 file. 75 70 … … 78 73 Technical info: https://github.com/leifj/pyFF 79 74 80 #### CLARIN Identity Provider #### 75 #### CLARIN Identity Provider #### 76 81 77 Application for the registration of accounts for those who do not have an academic Identity Provider. 82 78 83 Mix of existing software (Drupal, OpenDJ, Shibboleth IdP) and custom scripting. Will be replaced by one overarching and externally maintained application([http://unity-idm.eu/ Unity IDM]), which is also used by EUDAT for [https://www.eudat.eu/services/b2access B2ACCESS]. See [[ServiceProviderFederation/CLARIN IdP]].84 85 Public info: https://user.clarin.eu/ 86 Technical info: http://www.clarin.eu/content/clarin-identity-provider 87 88 #### Discovery Service #### 79 Our instance of ([http://unity-idm.eu/ Unity IDM]), which is also used by EUDAT for [https://www.eudat.eu/services/b2access B2ACCESS]. See [[ServiceProviderFederation/CLARIN IdP]]. 80 81 Public info: https://user.clarin.eu/ Technical info: http://www.clarin.eu/content/clarin-identity-provider 82 83 #### Discovery Service #### 84 89 85 Application to select an identity provider upon federated login. 90 86 91 Mix of existing software (!DiscoJuice) and own connecting components. Stable.87 Self-developed lightweight solution. Stable. 92 88 93 89 Technical info: http://www.clarin.eu/content/clarin-discovery-service 94 90 95 #### Authorisation Service #### 91 #### Authorisation Service #### 92 96 93 Middleware that allows a web application or service to perform user delegation: act on behalf of an authenticated user (e.g. writing to her/his protected workspace). 97 94 … … 102 99 Technical info: [[OAuthDelegation]], https://www.clarin.eu/content/user-delegation 103 100 104 ### Piwik ### 101 ### Matomo (formerly Piwik) ### 102 105 103 Application that keeps usage statistics of various web applications and sites. 106 104 … … 109 107 Technical info: https://trac.clarin.eu/wiki/AccessStatistics 110 108 111 ### Validators ### 112 #### OAI-PMH (metadata) validator #### 109 ### Validators ### 110 111 #### OAI-PMH (metadata) validator #### 112 113 113 Application to check the validity of an OAI-PMH endpoint for metadata harvesting. 114 114 115 115 Third-party software (self hosted). Stable. 116 116 117 Public info: http://clarin.eu/oaivalidator 118 Technical info: http://dl.cs.uct.ac.za/projects/re/ 119 120 #### CMDI (metadata) validator #### 121 Command-line application to check the validity of large sets of CMDI files. 117 Public info: http://clarin.eu/oaivalidator Technical info: http://dl.cs.uct.ac.za/projects/re/ 118 119 #### CMDI (metadata) validator #### Command-line application to check the validity of large sets of CMDI files. 122 120 123 121 Own software. Stable. … … 125 123 Technical info: https://trac.clarin.eu/browser/CMDIValidator 126 124 127 #### SRU-CQL (FCS) validator #### 128 Application to check the validity of an SRU-CQL endpoint for content search. 129 Own software. 130 131 Stable 132 Public info: http://clarin.eu/oaivalidator 133 Technical info: http://dl.cs.uct.ac.za/projects/re/ 134 135 ### Language Resource Switchboard ### 136 Application to suggest web applications that can process a specific file type. 125 #### SRU-CQL (FCS) validator #### Application to check the validity of an SRU-CQL endpoint for content search. Own software. 126 127 Stable Public info: http://clarin.eu/oaivalidator Technical info: http://dl.cs.uct.ac.za/projects/re/ 128 129 ### Language Resource Switchboard ### Application to suggest web applications that can process a specific file type. 137 130 138 131 Experimental, under development by EKUT … … 140 133 Technical info: https://trac.clarin.eu/wiki/LanguageResourceSwitchboard 141 134 142 ## Software development ##143 ### Subversion repository ### 144 Source code repository for self-developed software. Will be gradually migrated to [[GitHub]].135 ## Software development ## 136 137 ### Subversion repository ### Source code repository for self-developed software. Will be gradually migrated to [[GitHub]]. 145 138 146 139 Third-party software (self hosted) … … 148 141 Technical info: http://www.clarin.eu/svn 149 142 150 ### Trac ### 151 Issue tracker for software development and wiki. The issue tracker will be gradually migrated to !GitHub, while the wiki will remain for internal information exchange. 143 ### Trac ### Issue tracker for software development and wiki. The issue tracker will be gradually migrated to !GitHub, while the wiki will remain for internal information exchange. 152 144 153 145 Third-party software (self hosted) … … 155 147 Technical info: http://www.clarin.eu/svn 156 148 157 158 ### Nexus maven repository ### 149 ### Nexus maven repository ### 150 159 151 Repository to share compiled Java packages (jars) and Maven files (poms). 160 152 … … 163 155 Technical info: https://trac.clarin.eu/wiki/Nexus 164 156 165 ### Docker repository ### 157 ### Docker repository ### 158 166 159 Third-party software (self hosted). Stable. 167 160 168 Technical info: https://trac.clarin.eu/wiki/ServerConfig/docker 169 170 ### Third-party infrastructure (hosted in the cloud) ### 171 #### !GitHub #### 161 Technical info: https://trac.clarin.eu/wiki/ServerConfig/docker 162 163 ### Third-party infrastructure (hosted in the cloud) ### 164 165 #### !GitHub #### 166 172 167 Issue tracking and code repository. 173 168 174 169 Technical info: https://trac.clarin.eu/wiki/GitHub 175 170 176 #### Travis #### 177 Continuous Integration platform, tightly coupled with !GitHub. 171 #### Travis #### Continuous Integration platform, tightly coupled with !GitHub. 178 172 179 173 Technical info: https://trac.clarin.eu/wiki/GitHub#Travis 180 174 181 #### Jenkins #### 182 Continuous Integration platform, used to build and test a number of tools (co)-developed at MPI-PL. Plans to migrate this to Travis. 183 184 Technical info: https://lux16.mpi.nl/jenkins/ (not publicly accessible) 185 186 ## System management ## 187 ### Icinga ### 175 ## System management ## 176 ### Icinga ### 177 188 178 Monitoring system. 189 179 … … 192 182 Technical info: [[SystemAdministration/Monitoring/Icinga]] 193 183 194 ### Grafana ### 184 ### Grafana ### 185 195 186 Computing Resource Dashboard. 196 187 … … 199 190 Technical info: [[SystemAdministration/Monitoring/collectd]] 200 191 201 ## Office systems ## 202 ### Document (CE) archive ### 203 Simple web application for the CLARIN document archive.192 ## Office systems ## 193 194 ### Document (CE) archive ### Simple web application for the CLARIN document archive. 204 195 205 196 Own software. Stable. … … 207 198 Technical info: https://github.com/dietervu/ce-archive (private) 208 199 209 ### People and Organisation database ###210 Simple web application to manage the CLARIN contacts. Will be replaced by e.g. a lightweight Drupal-based CRM solution. 211 212 Own software. Stable.213 214 ## Communication systems ##215 ### Website ###200 ### People and Organisation database ### 201 Lightweight Drupal-based CRM solution ([https://www.drupal.org/project/redhen RedHen]) to manage the CLARIN contacts. 202 203 Third-party software. Stable (self hosted). 204 205 ## Communication systems ## 206 ### Website ### 216 207 Drupal-based content management system. 217 208 218 209 Third-party software, with a few own additions. Stable. 219 210 220 Public info: http://www.clarin.eu/ 221 Technical info: https://trac.clarin.eu/wiki/ServerConfig/vz07-clarin-eu.im.hum.uu.nl 222 223 ### Mailing Lists ### 224 Mailman system. 211 Public info: http://www.clarin.eu/ Technical info: https://trac.clarin.eu/wiki/Webdev 212 213 ### Mailing Lists ### Mailman system. 225 214 226 215 Third-party software, hosted at Utrecht University. 227 216 228 Public info: http://www.clarin.eu/content/mailing-lists 229 Technical info: https://trac.clarin.eu/wiki/lists.clarin.eu 230 231 ### !MailChimp ### 232 Newsflash distribution system. 217 Public info: http://www.clarin.eu/content/mailing-lists Technical info: https://trac.clarin.eu/wiki/lists.clarin.eu 218 219 ### !MailChimp ### Newsflash distribution system. 233 220 234 221 Third-party software, hosted in the cloud. … … 236 223 Public info: http://www.clarin.eu/content/newsflash 237 224 238 ### Basecamp ### 239 Internal project management platform, used for CLARIN-PLUS. 225 ### Slack ### Chat platform for developers. Experimental. 240 226 241 227 Third-party software, hosted in the cloud. 242 228 243 Public info: https://basecamp.com/3008549 244 245 ### Slack ### 246 Chat platform for developers. Experimental. 247 248 Third-party software, hosted in the cloud. 249 250 Public info: https://clarineric.slack.com 251 Technical info: https://trac.clarin.eu/wiki/Slack 252 253 ### Social media ### 254 #### Facebook #### 255 https://www.facebook.com/ClarinEric/ 256 257 #### Twitter #### 258 https://twitter.com/CLARINERIC 259 260 #### !LinkedIn #### 261 https://www.linkedin.com/company/9411460 262 263 #### !YouTube #### 264 https://www.youtube.com/channel/UCJPks1mzisqsS4NrBFKIWag 265 266 ## Third-party infrastructure applications & services ## 267 ### B2DROP [EUDAT] ### 229 Public info: https://clarineric.slack.com Technical info: https://trac.clarin.eu/wiki/Slack 230 231 ### Social media ### 232 #### Facebook #### https://www.facebook.com/ClarinEric/ 233 234 #### Twitter #### https://twitter.com/CLARINERIC 235 236 #### !LinkedIn #### https://www.linkedin.com/company/9411460 237 238 #### !YouTube #### https://www.youtube.com/channel/UCJPks1mzisqsS4NrBFKIWag 239 240 ## Third-party infrastructure applications & services ## 241 ### B2DROP [EUDAT] ### 242 268 243 Cloud-storage platform based on ownCloud, similar to !DropBox. Also referred to (within CLARIN) as “workspaces”. 269 244 270 Public info: https://b2drop.eudat.eu/ 271 Technical info: https://trac.clarin.eu/wiki/Workspaces 272 273 ### B2SHARE [EUDAT] ### 245 Public info: https://b2drop.eudat.eu/ Technical info: https://trac.clarin.eu/wiki/Workspaces 246 247 ### B2SHARE [EUDAT] ### 248 274 249 Simple data upload platform, “scientific youtube”, based on CERN’s Invenio repository. 275 250 276 251 Public info: https://b2share.eudat.eu/ 277 252 278 ### B2SAFE [EUDAT] ### 253 ### B2SAFE [EUDAT] ### 254 279 255 Data replication service based on [http://irods.org/ iRODS]. 280 256 281 Public info: https://eudat.eu/services/b2safe 282 Technical info: http://www.clarin.eu/event/2015/clarin-b2safe-workshop 283 284 ### B2ACCESS [EUDAT] ### 257 Public info: https://eudat.eu/services/b2safe Technical info: http://www.clarin.eu/event/2015/clarin-b2safe-workshop 258 259 ### B2ACCESS [EUDAT] ### 260 285 261 Authentication module (proxy Service Provider) for EUDAT services. 286 262 287 Public info: https://b2access.eudat.eu 288 Technical info: https://eudat.eu/services/b2access 289 290 ### Potential A-services ### 263 Public info: https://b2access.eudat.eu Technical info: https://eudat.eu/services/b2access 264 265 ### Potential A-services ### 266 291 267 To be extended with services provided by CLARIN centres; a first candidate list is available at http://www.clarin.eu/node/4002