Version 263 (modified by 7 years ago) (diff) | ,
---|
Contents
Tickets
1. Hosts
1.1. Internally managed
Canonical FQDN | Aliases | Services | IPv4-address | OS | (v)CPUs | Memory (GiB) | Storage (GiB) | Hoster | Responsible | Support | Collectd | Fluentd | Docker | Compose | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
lvps92-51-161-129.dedicated.hosteurope.de | vlo.clarin.eu | 92.51.161.129 | CentOS 7.1.1503 | 8 | 32 | 500 | HostEurope | sysops@clarin.eu | support@hosteurope.de | 5.5 | n/a | n/a | n/a | ||
rs236235.rs.hosteurope.de | Netkernel Virtual Collection Registry Virtual Language Observatory | PRODUCTION BETA ALPHA | 91.250.80.240 | CentOS 7.1.1503 | 4 | 18 | 750 | HostEurope | sysops@clarin.eu | support@hosteurope.de | 5.7.1 | td-agent 1.0.2 | 17.05.0-ce | 1.17.0 | |
clarinvm.ics.muni.cz | catalog.clarin.eu docker.clarin.eu nexus.clarin.eu office.clarin.eu | CLARIN EU trac CLARIN NL trac SVN Shibboleth SP (catalog) | PRODUCTION PRODUCTION PRODUCTION PRODUCTION | 147.251.9.199 | CentOS 7.1.1503 | 8 | 32 | 500 | CESNET | sysops@clarin.eu | cloud@metacentrum.cz | 5.5 | n/a | 1.8.2 | n/a |
idp1-clarin.esc.rzg.mpg.de | aai1.clarin.eu | Unity IDM Discovery service | PRODUCTION PRODUCTION 1 | 130.183.206.196 | Scientific Linux 7.4 | 2 | 4 | 20 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | n/a | 1.9.1 | 1.11.2 |
idp2-clarin.esc.rzg.mpg.de | aai2.clarin.eu beta-stats.clarin.eu | Infra SPF MD pipelines Infra static webserver Piwik beta | PRODUCTION 2 PRODUCTION 2 BETA | 130.183.206.33 | Scientific Linux 7.4 | 2 | 4 | 20 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | n/a | 17.05.0-ce | 1.17.1 |
dev-idp-clarin.esc.rzg.mpg.de | dev-idp.clarin.eu dev-sp.clarin.eu | DEVELOPMENT DEVELOPMENT | 130.183.206.39 | Scientific Linux 7.4 | 2 | 4 | 20 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | td-agent 0.12.40 | 17.05.0-ce | 1.8.1 | |
centres-clarin.esc.rzg.mpg.de | centres.clarin.eu | Centre Registry | PRODUCTION | 130.183.206.32 | SLES 11.4 | 1 | 1 | 17 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.5 | n/a | n/a | n/a |
centres2-clarin.esc.rzg.mpg.de | staging-centres.clarin.eu | Centre Registry | STAGING | 130.183.206.40 | Scientific Linux 7.4 | 1 | 1 | 2 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.8.0 | td-agent 1.0.2 | 17.05.0-ce | 1.18.0 |
beta-vlo-clarin.esc.rzg.mpg.de | beta-vlo.clarin.eu | VLO | BETA | 130.183.206.198 | Scientific Linux 7.2 | 8 | 16 | 1000 | MPCDF | sysops@clarin.eu | clarin-support@rzg.mpg.de | 5.5 | n/a | 17.05.0-ce | 1.17.0 |
alpha-vlo-clarin.esc.rzg.mpg.de | alpha-vlo.clarin.eu | | | 130.183.206.35 | Scientific Linux 7.3 | 4 | 15 | 125 | MPCDF | Twan Goosen | clarin-support@rzg.mpg.de | 5.4.2 | n/a | n/a | n/a |
149-210-236-86.colo.transip.net | transip-vps2 | Reverse proxy | PRODUCTION (Primary) | 149.210.236.86 | CentOS 7.4.1708 | 2 | 4 | 150 | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.0.2 | 17.05.0-ce | 1.17.0 |
37-97-154-156.colo.transip.net | transip-vps3 dev-www.clarin.eu stats.clarin.eu | Main Website (dev) Piwik | DEVELOPMENT PRODUCTION | 37.97.154.156 | CentOS 7.4.1708 | 2 | 4 | 150 | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.0.2 | 17.05.0-ce | 1.16.1 |
37-97-184-230.colo.transip.net | transip-vps4 www.clarin.eu | Main Website | PRODUCTION | 37.97.184.230 | CentOS 7.4.1708 | 2 | 4 | 150 | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.0.2 | 17.05.0-ce | 1.17.1 |
37.97.220.172.colo.transip.net | transip-vps transip-vps5 | Reverse proxy Discovery service Infra SPF MD pipelines Infra static webserver Gitlab runner | PRODUCTION (Secondary) PRODUCTION 2 PRODUCTION 1 PRODUCTION 1 PRODUCTION | 37.97.220.172 | CentOS 7.4.1708 | 2 | 4 | ? | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | 5.8.0 | td-agent 1.0.2 | 17.05.0-ce | 1.17.1 |
CLARINEU-HAIP | High available IP address | 136.144.144.150 | - | - | - | - | TransIP | sysops@clarin.eu | CP, 2nd best: support@transip.nl Status: TransNOC | - | - | - | - |
1.2. Externally managed, with central services
Canonical FQDN | Aliases | IPv4-address | OS | Docker | (v)CPUs | Memory (GiB) | Storage (GiB) | Hoster | Responsible |
---|---|---|---|---|---|---|---|---|---|
vz07-clarin-list?.im.hum.uu.nl | lists.clarin.eu newlists.clarin.eu | 131.211.143.192 | Debian 6 | n/a | ? | ? | ? | UU | ictenmedia@uu.nl |
fsd-cloud22.zam.kfa-juelich.de | monitoring.clarin.eu | 134.94.199.42 | Ubuntu 14.04.4 LTS | n/a | FZJ? | CLARIN-support@fz-juelich.de | |||
clarin.fz-juelich.de | - | 134.94.199.71 | n/a | FZJ? | CLARIN-support@fz-juelich.de | ||||
clarin.ids-mannheim.de | clarin.ids-mannheim.de | 193.196.8.17 | CentOS 7.4 | n/a | 4 | 16 | 64 | IDS? | Oliver Schonefeld |
weblicht.sfs.uni-tuebingen.de | weblicht.sfs.uni-tuebingen.de | 130.183.206.38 | Scientific Linux 6.7 | n/a | 4 | 64 | 500 | UTU? | emanuel.dima@uni-tuebingen.de |
1.3. Decommissioned
Canonical FQDN | Aliases | IPv4-address | OS | Docker | Hoster | Responsible |
---|---|---|---|---|---|---|
ems04.mpi.nl | 192.87.79.165 | Ubuntu 12.04.5 LTS | n/a | MPI-PL | sysops@clarin.eu | |
idp-clarin.esc.rzg.mpg.de | - | 130.183.206.37 | SLES 11.3 | n/a | MPCDF | sysops@clarin.eu |
stoor146.meta.zcu.cz | - | 147.228.242.146 | CentOS 7.1.1503 | 1.5.0 | CESNET | sysops@clarin.eu |
catalog-clarin?.esc.rzg.mpg.de | 192.87.79.171 | SLES 11.2 | n/a | MPI-PL | sysops@clarin.eu | |
im-linux-clarin-eu?.im.hum.uu.nl | www.clarin.eu | 131.211.143.212 | Debian 8 | n/a | UU | web team Sander Maijers ictenmedia@uu.nl |
im-linux-dev-clarin-eu.hum.uu.nl | - | 131.211.143.192 | Debian 8 | n/a | UU | web team Sander Maijers ictenmedia@uu.nl |
vz07-clarin-eu?.im.hum.uu.nl | - | 131.211.143.186 | Debian 8 | n/a | UU | web team Sander Maijers ictenmedia@uu.nl |
2. DNS entries and TLS certificates
Hosted by TransIP
admins: Dieter Van Uytvanck, Andre Moreira, Willem Elbers
3. Getting access
Shell access to the CLARIN hosts is only possible via key-based SSH.
Contact sysops@clarin.eu to request access to a host. Make sure to include your public SSH key.
Instructions and guidelines on how to create your OpenSSH key pair can be found here.
3.1. Security
4. Default VM setup
These instructions describe how we install/provision/configure each host by default.
4.1. Centos / Scientific Linux
Some notes on administering Centos / Scientific linux hosts.
4.2. SLES 11
We are in the process of migration our SLES 11 machines to CentOS/Scientific Linux. We collect some notes on administering SLES hosts.
4.3. Ubuntu
We are in the process of migration our Ubuntu machines to CentOS/Scientific Linux.
5. Infrastructure and service status information
A manually curated service status overview including planned maintenance is kept at clarin.eu/status.
Service availability statistics (sourced by StatusCake) are available at status.clarin.eu. Incidents are also posted automatically to the private sysalert channel on Slack.
Maintainers of services, in particular core services and A-services are requested to submit expected downtime information timely. For more information, see Service status guidelines.
6. Documents
- CLARIN Infrastructure Overview
- Docker Workflow and best practices
- Proposal: High Availability for the CLARIN infrastructure
- Sysops - infrastructure management
7. Services
8. Updates
Bi-weekly on Tuesdays.
Canonical FQDN | OS | Updates | Comments | ||
---|---|---|---|---|---|
Kernel | Packages | Docker | |||
37.97.220.172.colo.transip.net | CentOS 7 | 12-01-2018 | 12-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
dev-idp-clarin.esc.rzg.mpg.de | Scientific Linux 7.4 | 12-01-2018 | 12-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
centres2-clarin.esc.rzg.mpg.de | Scientific Linux 7.4 | 12-01-2018 | 25-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
beta-vlo-clarin.esc.rzg.mpg.de | Scientific Linux 7.2 | 12-01-2018 | 12-01-2018 | 10-11-2017 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
lvps92-51-161-129.dedicated.hosteurope.de | CentOS 7.1.1503 | 12-01-2018 | 12-01-2018 | N/A | Kernel: 3.10.0-042stab127.2 (OpenVZ) |
rs236235.rs.hosteurope.de | CentOS 7.4.1708 | 12-01-2018 | 12-01-2018 | 12-01-2018 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
clarinvm.ics.muni.cz | CentOS 7.1.1503 | 12-01-2018 | 12-01-2018 | PENDING | Kernel: 3.10.0-229.el7.x86_64 <-- check with CESSNET |
idp2-clarin.esc.rzg.mpg.de | Scientific Linux 7.2 | 12-01-2018 | 12-01-2018 | 05-10-2017 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
idp1-clarin.esc.rzg.mpg.de | Scientific Linux 7.2 | 12-01-2018 | 12-01-2018 | PENDING | Kernel: 3.10.0-693.11.6.el7.x86_64 |
149-210-236-86.colo.transip.net | CentOS 7.1.1503 | 12-01-2018 | 12-01-2018 | 03-11-2017 | Kernel: 3.10.0-693.11.6.el7.x86_64 |
37-97-154-156.colo.transip.net | CentOS 7 | 12-01-2018 | 12-01-2018 | 14-11-2017 | kernel: 3.10.0-693.11.6.el7.x86_64 |
37-97-184-230.colo.transip.net | CentOS 7 | 12-01-2018 | 12-01-2018 | 14-11-2017 | kernel: 3.10.0-693.11.6.el7.x86_64 |
centres-clarin.esc.rzg.mpg.de | SLES 11.3 | 12-01-2018 | 12-01-2018 | N/A | Kernel: 3.0.101-108.21.1.x86_64 |
alpha-vlo-clarin.esc.rzg.mpg.de | Scientific Linux 7.3 | 12-01-2018 | 12-01-2018 | N/A | Kernel: 3.10.0-693.11.6.el7.x86_64 |
ems04.mpi.nl | Ubuntu 12.04.5 LTS | SKIPPED | SKIPPED | SKIPPED | Planned to be decommissioned asap |
9. Known issues
9.1. Docker
9.1.1. dial tcp: lookup index.docker.io: no such host
9.1.1.1. Error
dial tcp: lookup index.docker.io: no such host
9.1.1.2. Symptoms
While using Docker a user is unable to perform tasks such as pull new image or search for new images while the following error message appears:
# docker pull debian:8 Pulling repository debian FATA[0053] Get https://index.docker.io/v1/repositories/library/debian/images: dial tcp: lookup index.docker.io: no such host
9.1.1.3. Solution
No good solution available at this time.
9.1.1.4. References
- https://linuxconfig.org/docker-dial-tcp-lookup-index-docker-io-no-such-host-fix
- https://robinwinslow.uk/2016/06/23/fix-docker-networking-dns/
- https://stackoverflow.com/questions/29266560/docker-container-can-reach-dns-but-not-resolve-hosts
- https://github.com/moby/moby/issues/13381
10. GitLab
10.1. Managing a git repository on a server with a deploy key
- Enable deploy key in gitlab reository
- Goto Settings - Repository
- Expand "Deploy Keys"
- Enable the CLARIN keys (make sure to not use the public ones!)
- Configure a ssh connection for gitlab on the service
- Add the private part of the deploy key to /home/deploy/.ssh/id_rsa_gitlab_deploy
- Edit /home/deploy/.ssh/config
- Add:
#Deploys Host gitlab.com User git HostName gitlab.com IdentityFile ~/.ssh/id_rsa_gitlab_deploy
- Use the SSH location to clone the repository
- Example
git clone git@gitlab.com:CLARIN-ERIC/compose_transip_vps5.git