Version 342 (modified by 6 years ago) (diff) | ,
---|
Contents
Tickets
1. Hosts
1.1. Internally managed
1.1.1. Production
Canonical FQDN | Aliases | Services | Ports | Service Type | IPv4-address | OS | (v)CPUs | Memory (GiB) | Storage (GiB) | Hoster | Type | Responsible | Support | Collectd | Fluentd | Docker | Compose |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
rs238144.rs.hosteurope.de | vlo.clarin.eu | VLO Piwik beta Discovery beta | 8181, 8184 44325 45325 | PRODUCTION BETA (Primary) BETA | 91.250.82.71 | CentOS | 8 | 40 | 800 | HostEurope | Root Server XL | sysops@clarin.eu | support@hosteurope.de | 5.8.0 | td-agent 1.2.2 | 18.03.1-ce | 1.21.2 |
clarinvm.ics.muni.cz | catalog.clarin.eu docker.clarin.eu nexus.clarin.eu office.clarin.eu | Netkernel (78.128.216.72) CLARIN EU trac (78.128.216.72) CLARIN NL trac (78.128.216.72) SVN (78.128.216.72) Metrics (78.128.216.72) Shibboleth SP (catalog) -> Component Registry | PRODUCTION PRODUCTION PRODUCTION PRODUCTION PRODUCTION | 147.251.9.199 (new ip: 78.128.216.72) | CentOS 7.1.1503 | 8 | 32 | 500 | CESNET | sysops@clarin.eu | cloud@metacentrum.cz | 5.5 | n/a | 1.8.2 | n/a | ||
idp1-clarin.esc.rzg.mpg.de | idm.clarin.eu aai1.clarin.eu | Unity IDM Discovery service | PRODUCTION PRODUCTION 1 | 130.183.206.196 | Scientific Linux 7.4 | 2 | 4 | 20 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | td-agent 1.2.2 | 18.06.0-ce | 1.22.0 | ||
idp2-clarin.esc.rzg.mpg.de | aai2.clarin.eu beta-stats.clarin.eu | Infra SPF MD pipelines Infra static webserver Piwik | 8082, 44344, 44345 44343 44325 | PRODUCTION 2 PRODUCTION 2 PRODUCTION (Backup) | 130.183.206.33 | Scientific Linux 7.4 | 2 | 4 | 20 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | td-agent 1.2.2 | 18.06.0-ce | 1.22.0 | |
centres-clarin.esc.rzg.mpg.de | centres.clarin.eu | Centre Registry | PRODUCTION | 130.183.206.32 | SLES 11.4 | 1 | 1 | 17 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.5 | n/a | n/a | n/a | ||
149-210-236-86.colo.transip.net | transip-vps2 | Reverse proxy | 80, 443 | PRODUCTION (Primary) | 149.210.236.86 Priv. net.: 192.168.1.3 | CentOS 7-5.1804.4.el7 | 2 | 4 | 150 | TransIP | VPS X4 @AMS0 (Amsterdam) | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.2.2 | 18.06.0-ce | 1.22.0 |
37-97-154-156.colo.transip.net | transip-vps3 dev-www.clarin.eu stats.clarin.eu | Main Website (dev) Piwik | 4430, 4431 4432 | DEVELOPMENT PRODUCTION (primary) | 37.97.154.156 Priv. net. dev: 192.168.2.3 | CentOS 7.4.1708 | 2 | 4 | 150 | TransIP | VPS X4 @AMS0 (Amsterdam) | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.2.2 | 18.06.0-ce | 1.22.0 |
37-97-184-230.colo.transip.net | transip-vps4 www.clarin.eu | Main Website | 4430, 4431 | PRODUCTION | 37.97.184.230 Priv. net. dev: 192.168.2.1 | CentOS 7.4.1708 | 2 | 4 | 150 | TransIP | VPS X4 @AMS0 (Amsterdam) | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.2.2 | 17.05.0-ce | 1.17.1 |
37.97.220.172.colo.transip.net | transip-vps transip-vps5 | Discovery service Infra SPF MD pipelines Infra static webserver | 8444 44344, 44345 44343 | PRODUCTION 2 PRODUCTION 1 PRODUCTION 1 | 37.97.220.172 | CentOS 7-5.1804.4.el7 | 2 | 4 | 150 | TransIP | VPS X4 @AMS0 (Amsterdam) | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.2.2 | 18.06.0-ce | 1.22.0 |
136-144-215-36.colo.transip.net | transip-vps5 transip-vps6 | Reverse proxy | 80, 443 | PRODUCTION (Backup) | 136.144.215.36 Priv. net.: 192.168.1.1 | CentOS 7-5.1804.4.el7 | 2 | 4 | 150 | TransIP | VPS X4 @RTM0 (Delft) | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.2.2 | 18.06.0-ce | 1.22.0 |
CLARINEU-HAIP | High available IP address | 136.144.144.150 | - | - | - | - | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | - | - | - | - | ||||
CLARINEU-HAIP-DEV | High available IP address | 136.144.144.52 | - | - | - | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | - | - | - | - |
1.1.2. Beta
Canonical FQDN | Aliases | Services | Ports | Service Type | IPv4-address | OS | (v)CPUs | Memory (GiB) | Storage (GiB) | Hoster | Type | Responsible | Support | Collectd | Fluentd | Docker | Compose |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
rs236235.rs.hosteurope.de | cmdi.clarin.eu alpha-vlo.clarin.eu logs.clarin.eu | Virtual Collection Registry Virtual Language Observatory docker-runner-hosteurope-1 docker-runner-hosteurope-2 discovery Elasticsearch/Kibana | 5601 | ALPHA ALPHA BUILD BUILD ALPHA BETA | 91.250.80.240 | CentOS 7.1.1503 | 4 | 18 | 750 | HostEurope | Root Server M | sysops@clarin.eu | support@hosteurope.de | 5.8.0 | td-agent 1.2.2 | 18.06.0-ce | 1.22.0 |
dev-idp-clarin.esc.rzg.mpg.de | dev-idp.clarin.eu dev-sp.clarin.eu | docker-runner-rzg-1 docker-runner-rzg-2 | DEVELOPMENT DEVELOPMENT BUILD BUILD | 130.183.206.39 | Scientific Linux 7.4 | 2 | 4 | 20 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | td-agent 0.12.40 | 17.05.0-ce | 1.8.1 | ||
centres2-clarin.esc.rzg.mpg.de | staging-centres.clarin.eu | Centre Registry Piwik beta | 44335 44325 | STAGING BETA (Backup) | 130.183.206.40 | Scientific Linux 7.4 | 1 | 1 | 2 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | td-agent 1.2.2 | 18.06.0-ce | 1.22.0 | |
beta-vlo-clarin.esc.rzg.mpg.de | beta-vlo.clarin.eu | VLO | BETA | 130.183.206.198 | Scientific Linux 7.2 | 8 | 16 | 1000 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.5 | n/a | 17.05.0-ce | 1.17.0 | ||
alpha-vlo-clarin.esc.rzg.mpg.de | | | 130.183.206.35 | Scientific Linux 7.3 | 4 | 15 | 125 | MPCDF | Twan Goosen | clarin-support@rzg.mpg.de | 5.4.2 | n/a | n/a | n/a |
1.1.3. Unused
Canonical FQDN | Aliases | Services | Ports | Service Type | IPv4-address | OS | (v)CPUs | Memory (GiB) | Storage (GiB) | Hoster | Type | Responsible | Support | Collectd | Fluentd | Docker | Compose |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
lvps92-51-161-129.dedicated.hosteurope.de | | 92.51.161.129 | CentOS 7.1.1503 | 8 | 32 | 500 | HostEurope | Virtual Server Linux Unlimited High I/O 8.0 | sysops@clarin.eu | support@hosteurope.de | 5.5 | n/a | n/a | n/a |
1.2. Externally managed, with central services
Canonical FQDN | Aliases | IPv4-address | OS | Docker | (v)CPUs | Memory (GiB) | Storage (GiB) | Hoster | Responsible |
---|---|---|---|---|---|---|---|---|---|
vz07-clarin-list?.im.hum.uu.nl | lists.clarin.eu newlists.clarin.eu | 131.211.143.192 | Debian 6 | n/a | ? | ? | ? | UU | ictenmedia@uu.nl |
fsd-cloud22.zam.kfa-juelich.de | monitoring.clarin.eu | 134.94.199.42 | Ubuntu 14.04.4 LTS | n/a | FZJ? | CLARIN-support@fz-juelich.de | |||
clarin.fz-juelich.de | - | 134.94.199.71 | n/a | FZJ? | CLARIN-support@fz-juelich.de | ||||
clarin.ids-mannheim.de | clarin.ids-mannheim.de | 193.196.8.17 | CentOS 7.4 | n/a | 4 | 16 | 64 | IDS? | Oliver Schonefeld |
weblicht.sfs.uni-tuebingen.de | weblicht.sfs.uni-tuebingen.de | 130.183.206.38 | Ubuntu 16.04 | 1.12.3 | 4 | 64 | 500 | UTU? | emanuel.dima@uni-tuebingen.de |
spraakbanken.gu.se/ws/fcs/2.0/aggregator/ | contentsearch.clarin.eu | 130.241.42.13 | Språkbanken | leif-joran.olsson@svenska.gu.seadded aa |
1.3. Decommissioned
Canonical FQDN | Aliases | IPv4-address | OS | Docker | Hoster | Responsible |
---|---|---|---|---|---|---|
ems04.mpi.nl | 192.87.79.165 | Ubuntu 12.04.5 LTS | n/a | MPI-PL | sysops@clarin.eu | |
idp-clarin.esc.rzg.mpg.de | - | 130.183.206.37 | SLES 11.3 | n/a | MPCDF | sysops@clarin.eu |
stoor146.meta.zcu.cz | - | 147.228.242.146 | CentOS 7.1.1503 | 1.5.0 | CESNET | sysops@clarin.eu |
catalog-clarin?.esc.rzg.mpg.de | 192.87.79.171 | SLES 11.2 | n/a | MPI-PL | sysops@clarin.eu | |
im-linux-clarin-eu?.im.hum.uu.nl | www.clarin.eu | 131.211.143.212 | Debian 8 | n/a | UU | web team Sander Maijers ictenmedia@uu.nl |
im-linux-dev-clarin-eu.hum.uu.nl | - | 131.211.143.192 | Debian 8 | n/a | UU | web team Sander Maijers ictenmedia@uu.nl |
vz07-clarin-eu?.im.hum.uu.nl | - | 131.211.143.186 | Debian 8 | n/a | UU | web team Sander Maijers ictenmedia@uu.nl |
lvps83-169-5-155.dedicated.hosteurope.de | 83.169.5.155 | CentOS | n/a | HostEurope | Decommissioned per 31.05.2018 |
2. DNS entries and TLS certificates
Hosted by TransIP
admins: Dieter Van Uytvanck, Andre Moreira, Willem Elbers
3. Getting access
Shell access to the CLARIN hosts is only possible via key-based SSH.
Contact sysops@clarin.eu to request access to a host. Make sure to include your public SSH key.
Instructions and guidelines on how to create your OpenSSH key pair can be found here.
3.1. Security
4. Default VM setup
These instructions describe how we install/provision/configure each host by default.
4.1. Centos / Scientific Linux
Some notes on administering Centos / Scientific linux hosts.
4.2. SLES 11
We are in the process of migration our SLES 11 machines to CentOS/Scientific Linux. We collect some notes on administering SLES hosts.
4.3. Ubuntu
We are in the process of migration our Ubuntu machines to CentOS/Scientific Linux.
5. Infrastructure and service status information
A manually curated service status overview including planned maintenance is kept at clarin.eu/status.
Service availability statistics (sourced by StatusCake) are available at status.clarin.eu. Incidents are also posted automatically to the private sysalert channel on Slack.
Maintainers of services, in particular core services and A-services are requested to submit expected downtime information timely. For more information, see Service status guidelines.
6. Documents
- CLARIN Infrastructure Overview
- Docker Workflow and best practices
- Proposal: High Availability for the CLARIN infrastructure
- Sysops - infrastructure management
7. Services
8. Updates
Bi-weekly on Tuesdays.
Canonical FQDN | OS | Updates | Comments | ||
---|---|---|---|---|---|
Kernel | Packages | Docker | |||
dev-idp-clarin.esc.rzg.mpg.de | Scientific Linux 7.4 | 12-01-2018 | 12-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
centres2-clarin.esc.rzg.mpg.de | Scientific Linux 7.4 | 20-08-2018 | 20-08-2018 | 20-08-2018 | Kernel: 3.10.0-862.6.3.el7.x86_64 |
beta-vlo-clarin.esc.rzg.mpg.de | Scientific Linux 7.2 | 12-01-2018 | 12-01-2018 | 10-11-2017 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
lvps92-51-161-129.dedicated.hosteurope.de | CentOS 7.1.1503 | 12-01-2018 | 12-01-2018 | N/A | Kernel: 3.10.0-042stab127.2 (OpenVZ) |
rs236235.rs.hosteurope.de | CentOS 7.4.1708 | 12-01-2018 | 12-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
clarinvm.ics.muni.cz | CentOS 7.1.1503 | 12-01-2018 | 12-01-2018 | PENDING | Kernel: 3.10.0-229.el7.x86_64 |
idp2-clarin.esc.rzg.mpg.de | Scientific Linux 7.2 | 16-08-2018 | 21-08-2018 | 16-08-2018 | Kernel: 3.10.0-862.3.2.el7.x86_64 |
idp1-clarin.esc.rzg.mpg.de | Scientific Linux 7.2 | 12-01-2018 | 12-01-2018 | PENDING | Kernel: 3.10.0-693.11.6.el7.x86_64 |
149-210-236-86.colo.transip.net | CentOS 7-5.1804.4.el7 | 16-08-2018 | 21-08-2018 | 16-08-2018 | Kernel: 3.10.0-862.11.6.el7.x86_64 |
37-97-154-156.colo.transip.net | CentOS 7-5.1804.4.el7 | 21-08-2018 | 21-08-2018 | 21-08-2018 | Kernel: 3.10.0-862.11.6.el7.x86_64 |
37-97-184-230.colo.transip.net | CentOS 7 | 12-01-2018 | 12-01-2018 | 14-11-2017 | kernel: 3.10.0-693.11.6.el7.x86_64 |
37.97.220.172.colo.transip.net | CentOS 7-5.1804.4.el7 | 16-08-2018 | 21-08-2018 | 16-08-2018 | Kernel: 3.10.0-862.11.6.el7.x86_64 |
136-144-215-36.colo.transip.net | CentOS 7-5.1804.4.el7 | 15-08-2018 | 21-08-2018 | 15-08-2018 | kernel: 3.10.0-862.11.6.el7.x86_64 |
centres-clarin.esc.rzg.mpg.de | SLES 11.3 | 12-01-2018 | 12-01-2018 | N/A | Kernel: 3.0.101-108.21.1.x86_64 |
alpha-vlo-clarin.esc.rzg.mpg.de | Scientific Linux 7.3 | 12-01-2018 | 12-01-2018 | N/A | Kernel: 3.10.0-693.11.6.el7.x86_64 |
9. Known issues
9.1. Docker
9.1.1. dial tcp: lookup index.docker.io: no such host
9.1.1.1. Error
dial tcp: lookup index.docker.io: no such host
9.1.1.2. Symptoms
While using Docker a user is unable to perform tasks such as pull new image or search for new images while the following error message appears:
# docker pull debian:8 Pulling repository debian FATA[0053] Get https://index.docker.io/v1/repositories/library/debian/images: dial tcp: lookup index.docker.io: no such host
9.1.1.3. Solution
No good solution available at this time.
9.1.1.4. References
- https://linuxconfig.org/docker-dial-tcp-lookup-index-docker-io-no-such-host-fix
- https://robinwinslow.uk/2016/06/23/fix-docker-networking-dns/
- https://stackoverflow.com/questions/29266560/docker-container-can-reach-dns-but-not-resolve-hosts
- https://github.com/moby/moby/issues/13381
10. GitLab
10.1. Managing a git repository on a server with a deploy key
- Enable deploy key in gitlab reository
- Goto Settings - Repository
- Expand "Deploy Keys"
- Enable the CLARIN keys (make sure to not use the public ones!)
- Configure a ssh connection for gitlab on the service
- Add the private part of the deploy key to /home/deploy/.ssh/id_rsa_gitlab_deploy
- Edit /home/deploy/.ssh/config
- Add:
#Deploys Host gitlab.com User git HostName gitlab.com IdentityFile ~/.ssh/id_rsa_gitlab_deploy
- Use the SSH location to clone the repository
- Example
git clone git@gitlab.com:CLARIN-ERIC/compose_transip_vps5.git