Version 305 (modified by 6 years ago) (diff) | ,
---|
Contents
Tickets
1. Hosts
1.1. Internally managed
Canonical FQDN | Aliases | Services | Ports | Service Type | IPv4-address | OS | (v)CPUs | Memory (GiB) | Storage (GiB) | Hoster | Type | Responsible | Support | Collectd | Fluentd | Docker | Compose |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
lvps92-51-161-129.dedicated.hosteurope.de | vlo.clarin.eu | 92.51.161.129 | CentOS 7.1.1503 | 8 | 32 | 500 | HostEurope | Virtual Server Linux Unlimited High I/O 8.0 | sysops@clarin.eu | support@hosteurope.de | 5.5 | n/a | n/a | n/a | |||
rs236235.rs.hosteurope.de | cmdi.clarin.eu alpha-vlo.clarin.eu | Netkernel Virtual Collection Registry Virtual Language Observatory docker-runner-hosteurope-1 docker-runner-hosteurope-2 discovery | PRODUCTION ALPHA ALPHA BUILD BUILD ALPHA | 91.250.80.240 | CentOS 7.1.1503 | 4 | 18 | 750 | HostEurope | Root Server M | sysops@clarin.eu | support@hosteurope.de | 5.8.0 | td-agent 1.2.2 | 18.03.1-ce | 1.21.2 | |
rs238144.rs.hosteurope.de | Piwik beta Discovery beta | 44325 45325 | BETA (Primary) BETA | 91.250.82.71 | CentOS | 8 | 40 | 800 | HostEurope | Root Server XL | sysops@clarin.eu | support@hosteurope.de | 5.8.0 | td-agent 1.2.2 | 18.03.1-ce | 1.21.2 | |
clarinvm.ics.muni.cz | catalog.clarin.eu docker.clarin.eu nexus.clarin.eu office.clarin.eu | CLARIN EU trac CLARIN NL trac SVN Shibboleth SP (catalog) -> Component Registry | PRODUCTION PRODUCTION PRODUCTION PRODUCTION | 147.251.9.199 (new ip: 78.128.216.72) | CentOS 7.1.1503 | 8 | 32 | 500 | CESNET | sysops@clarin.eu | cloud@metacentrum.cz | 5.5 | n/a | 1.8.2 | n/a | ||
idp1-clarin.esc.rzg.mpg.de | idm.clarin.eu aai1.clarin.eu | Unity IDM Discovery service | PRODUCTION PRODUCTION 1 | 130.183.206.196 | Scientific Linux 7.4 | 2 | 4 | 20 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | n/a | 1.9.1 | 1.11.2 | ||
idp2-clarin.esc.rzg.mpg.de | aai2.clarin.eu beta-stats.clarin.eu | Infra SPF MD pipelines Infra static webserver Piwik | 44344, 44345 44343 44325 | PRODUCTION 2 PRODUCTION 2 PRODUCTION (Backup) | 130.183.206.33 | Scientific Linux 7.4 | 2 | 4 | 20 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | td-agent 1.0.2 | 18.03.1-ce | 1.21.2 | |
dev-idp-clarin.esc.rzg.mpg.de | dev-idp.clarin.eu dev-sp.clarin.eu | docker-runner-rzg-1 docker-runner-rzg-2 | DEVELOPMENT DEVELOPMENT BUILD BUILD | 130.183.206.39 | Scientific Linux 7.4 | 2 | 4 | 20 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | td-agent 0.12.40 | 17.05.0-ce | 1.8.1 | ||
centres-clarin.esc.rzg.mpg.de | centres.clarin.eu | Centre Registry | PRODUCTION | 130.183.206.32 | SLES 11.4 | 1 | 1 | 17 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.5 | n/a | n/a | n/a | ||
centres2-clarin.esc.rzg.mpg.de | staging-centres.clarin.eu | Centre Registry Piwik beta | 44335 44325 | STAGING BETA (Backup) | 130.183.206.40 | Scientific Linux 7.4 | 1 | 1 | 2 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | td-agent 1.0.2 | 18.03.1-ce | 1.21.2 | |
beta-vlo-clarin.esc.rzg.mpg.de | beta-vlo.clarin.eu | VLO | BETA | 130.183.206.198 | Scientific Linux 7.2 | 8 | 16 | 1000 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.5 | n/a | 17.05.0-ce | 1.17.0 | ||
alpha-vlo-clarin.esc.rzg.mpg.de | | | 130.183.206.35 | Scientific Linux 7.3 | 4 | 15 | 125 | MPCDF | Twan Goosen | clarin-support@rzg.mpg.de | 5.4.2 | n/a | n/a | n/a | |||
149-210-236-86.colo.transip.net | transip-vps2 | Reverse proxy | 80, 443 | PRODUCTION (Primary) | 149.210.236.86 | CentOS 7.4.1708 | 2 | 4 | 150 | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.0.2 | 17.05.0-ce | 1.17.0 | |
37-97-154-156.colo.transip.net | transip-vps3 dev-www.clarin.eu stats.clarin.eu | Main Website (dev) Piwik | 4430, 4431 4432 | DEVELOPMENT PRODUCTION (primary) | 37.97.154.156 | CentOS 7.4.1708 | 2 | 4 | 150 | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.0.2 | 18.03.1-ce | 1.21.2 | |
37-97-184-230.colo.transip.net | transip-vps4 www.clarin.eu | Main Website | 4430, 4431 | PRODUCTION | 37.97.184.230 | CentOS 7.4.1708 | 2 | 4 | 150 | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.0.2 | 17.05.0-ce | 1.17.1 | |
37.97.220.172.colo.transip.net | transip-vps transip-vps5 | Reverse proxy Discovery service Infra SPF MD pipelines Infra static webserver Gitlab runner | 80, 443 8444 44344, 44345 44343 ?? | PRODUCTION (Secondary) PRODUCTION 2 PRODUCTION 1 PRODUCTION 1 PRODUCTION | 37.97.220.172 | CentOS 7.4.1708 | 2 | 4 | ? | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.0.2 | 17.05.0-ce | 1.17.1 | |
CLARINEU-HAIP | High available IP address | 136.144.144.150 | - | - | - | - | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | - | - | - | - | ||||
CLARINEU-HAIP-DEV | High available IP address | 136.144.144.52 | - | - | - | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | - | - | - | - |
1.2. Externally managed, with central services
Canonical FQDN | Aliases | IPv4-address | OS | Docker | (v)CPUs | Memory (GiB) | Storage (GiB) | Hoster | Responsible |
---|---|---|---|---|---|---|---|---|---|
vz07-clarin-list?.im.hum.uu.nl | lists.clarin.eu newlists.clarin.eu | 131.211.143.192 | Debian 6 | n/a | ? | ? | ? | UU | ictenmedia@uu.nl |
fsd-cloud22.zam.kfa-juelich.de | monitoring.clarin.eu | 134.94.199.42 | Ubuntu 14.04.4 LTS | n/a | FZJ? | CLARIN-support@fz-juelich.de | |||
clarin.fz-juelich.de | - | 134.94.199.71 | n/a | FZJ? | CLARIN-support@fz-juelich.de | ||||
clarin.ids-mannheim.de | clarin.ids-mannheim.de | 193.196.8.17 | CentOS 7.4 | n/a | 4 | 16 | 64 | IDS? | Oliver Schonefeld |
weblicht.sfs.uni-tuebingen.de | weblicht.sfs.uni-tuebingen.de | 130.183.206.38 | Ubuntu 16.04 | 1.12.3 | 4 | 64 | 500 | UTU? | emanuel.dima@uni-tuebingen.de |
spraakbanken.gu.se/ws/fcs/2.0/aggregator/ | contentsearch.clarin.eu | 130.241.42.13 | Språkbanken | leif-joran.olsson@svenska.gu.seadded aa |
1.3. Decommissioned
Canonical FQDN | Aliases | IPv4-address | OS | Docker | Hoster | Responsible |
---|---|---|---|---|---|---|
ems04.mpi.nl | 192.87.79.165 | Ubuntu 12.04.5 LTS | n/a | MPI-PL | sysops@clarin.eu | |
idp-clarin.esc.rzg.mpg.de | - | 130.183.206.37 | SLES 11.3 | n/a | MPCDF | sysops@clarin.eu |
stoor146.meta.zcu.cz | - | 147.228.242.146 | CentOS 7.1.1503 | 1.5.0 | CESNET | sysops@clarin.eu |
catalog-clarin?.esc.rzg.mpg.de | 192.87.79.171 | SLES 11.2 | n/a | MPI-PL | sysops@clarin.eu | |
im-linux-clarin-eu?.im.hum.uu.nl | www.clarin.eu | 131.211.143.212 | Debian 8 | n/a | UU | web team Sander Maijers ictenmedia@uu.nl |
im-linux-dev-clarin-eu.hum.uu.nl | - | 131.211.143.192 | Debian 8 | n/a | UU | web team Sander Maijers ictenmedia@uu.nl |
vz07-clarin-eu?.im.hum.uu.nl | - | 131.211.143.186 | Debian 8 | n/a | UU | web team Sander Maijers ictenmedia@uu.nl |
lvps83-169-5-155.dedicated.hosteurope.de | 83.169.5.155 | CentOS | n/a | HostEurope | Decommissioned per 31.05.2018 |
2. DNS entries and TLS certificates
Hosted by TransIP
admins: Dieter Van Uytvanck, Andre Moreira, Willem Elbers
3. Getting access
Shell access to the CLARIN hosts is only possible via key-based SSH.
Contact sysops@clarin.eu to request access to a host. Make sure to include your public SSH key.
Instructions and guidelines on how to create your OpenSSH key pair can be found here.
3.1. Security
4. Default VM setup
These instructions describe how we install/provision/configure each host by default.
4.1. Centos / Scientific Linux
Some notes on administering Centos / Scientific linux hosts.
4.2. SLES 11
We are in the process of migration our SLES 11 machines to CentOS/Scientific Linux. We collect some notes on administering SLES hosts.
4.3. Ubuntu
We are in the process of migration our Ubuntu machines to CentOS/Scientific Linux.
5. Infrastructure and service status information
A manually curated service status overview including planned maintenance is kept at clarin.eu/status.
Service availability statistics (sourced by StatusCake) are available at status.clarin.eu. Incidents are also posted automatically to the private sysalert channel on Slack.
Maintainers of services, in particular core services and A-services are requested to submit expected downtime information timely. For more information, see Service status guidelines.
6. Documents
- CLARIN Infrastructure Overview
- Docker Workflow and best practices
- Proposal: High Availability for the CLARIN infrastructure
- Sysops - infrastructure management
7. Services
8. Updates
Bi-weekly on Tuesdays.
Canonical FQDN | OS | Updates | Comments | ||
---|---|---|---|---|---|
Kernel | Packages | Docker | |||
37.97.220.172.colo.transip.net | CentOS 7 | 12-01-2018 | 12-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
dev-idp-clarin.esc.rzg.mpg.de | Scientific Linux 7.4 | 12-01-2018 | 12-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
centres2-clarin.esc.rzg.mpg.de | Scientific Linux 7.4 | 12-01-2018 | 25-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
beta-vlo-clarin.esc.rzg.mpg.de | Scientific Linux 7.2 | 12-01-2018 | 12-01-2018 | 10-11-2017 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
lvps92-51-161-129.dedicated.hosteurope.de | CentOS 7.1.1503 | 12-01-2018 | 12-01-2018 | N/A | Kernel: 3.10.0-042stab127.2 (OpenVZ) |
rs236235.rs.hosteurope.de | CentOS 7.4.1708 | 12-01-2018 | 12-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
clarinvm.ics.muni.cz | CentOS 7.1.1503 | 12-01-2018 | 12-01-2018 | PENDING | Kernel: 3.10.0-229.el7.x86_64 <-- check with CESSNET |
idp2-clarin.esc.rzg.mpg.de | Scientific Linux 7.2 | 12-01-2018 | 12-01-2018 | 05-10-2017 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
idp1-clarin.esc.rzg.mpg.de | Scientific Linux 7.2 | 12-01-2018 | 12-01-2018 | PENDING | Kernel: 3.10.0-693.11.6.el7.x86_64 |
149-210-236-86.colo.transip.net | CentOS 7.1.1503 | 12-01-2018 | 12-01-2018 | 03-11-2017 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
37-97-154-156.colo.transip.net | CentOS 7 | 12-01-2018 | 12-01-2018 | 14-11-2017 | kernel: 3.10.0-693.11.6.el7.x86_64 |
37-97-184-230.colo.transip.net | CentOS 7 | 12-01-2018 | 12-01-2018 | 14-11-2017 | kernel: 3.10.0-693.11.6.el7.x86_64 |
centres-clarin.esc.rzg.mpg.de | SLES 11.3 | 12-01-2018 | 12-01-2018 | N/A | Kernel: 3.0.101-108.21.1.x86_64 |
alpha-vlo-clarin.esc.rzg.mpg.de | Scientific Linux 7.3 | 12-01-2018 | 12-01-2018 | N/A | Kernel: 3.10.0-693.11.6.el7.x86_64 |
ems04.mpi.nl | Ubuntu 12.04.5 LTS | SKIPPED | SKIPPED | SKIPPED | Planned to be decommissioned asap |
9. Known issues
9.1. Docker
9.1.1. dial tcp: lookup index.docker.io: no such host
9.1.1.1. Error
dial tcp: lookup index.docker.io: no such host
9.1.1.2. Symptoms
While using Docker a user is unable to perform tasks such as pull new image or search for new images while the following error message appears:
# docker pull debian:8 Pulling repository debian FATA[0053] Get https://index.docker.io/v1/repositories/library/debian/images: dial tcp: lookup index.docker.io: no such host
9.1.1.3. Solution
No good solution available at this time.
9.1.1.4. References
- https://linuxconfig.org/docker-dial-tcp-lookup-index-docker-io-no-such-host-fix
- https://robinwinslow.uk/2016/06/23/fix-docker-networking-dns/
- https://stackoverflow.com/questions/29266560/docker-container-can-reach-dns-but-not-resolve-hosts
- https://github.com/moby/moby/issues/13381
10. GitLab
10.1. Managing a git repository on a server with a deploy key
- Enable deploy key in gitlab reository
- Goto Settings - Repository
- Expand "Deploy Keys"
- Enable the CLARIN keys (make sure to not use the public ones!)
- Configure a ssh connection for gitlab on the service
- Add the private part of the deploy key to /home/deploy/.ssh/id_rsa_gitlab_deploy
- Edit /home/deploy/.ssh/config
- Add:
#Deploys Host gitlab.com User git HostName gitlab.com IdentityFile ~/.ssh/id_rsa_gitlab_deploy
- Use the SSH location to clone the repository
- Example
git clone git@gitlab.com:CLARIN-ERIC/compose_transip_vps5.git