wiki:SystemAdministration

Version 199 (modified by Willem Elbers, 7 years ago) (diff)

--

1. Tickets

Ticket Priority Summary Owner Created Modified
#1086 minor Problem with admin messages from lists.clarin.eu André Moreira 4 years ago 4 years ago
#1054 major Bad URL encoding in catalog.clarin.eu/vlo -> vlo.clarin.eu redirects André Moreira 6 years ago 6 years ago
#1010 minor Piwik overlay André Moreira 7 years ago 7 years ago
#1000 major Review server timezone André Moreira 7 years ago 7 years ago
#996 major catalog.clarin.eu SP: aa-statistics error message on login André Moreira 7 years ago 7 years ago
#981 major Add DKIM, DMARC DNS RRs for clarin.eu Sander Maijers 8 years ago 8 years ago
#887 major Configure local firewall for idp1-clarin and idp2-clarin Sander Maijers 8 years ago 8 years ago
#881 minor Migrate lists.clarin.eu Sander Maijers 8 years ago 8 years ago
#891 critical dmeventd for LVM hogs CPU on CentOS 7 Willem Elbers 8 years ago 8 years ago
#955 major Add Reverse DNS records for TransIP VMs Sander Maijers 8 years ago 8 years ago
#902 major Grant read access to httpd logs Sander Maijers 8 years ago 8 years ago
#885 major Django security update to 1.9.3 Sander Maijers 8 years ago 8 years ago
#884 critical Security-critical instructions to data centre support should have integrity Sander Maijers 8 years ago 8 years ago
#883 major Devise automatic tty I/O auditing setup & policy Sander Maijers 8 years ago 8 years ago
#865 major Make host pages adhere to host template in Trac Sander Maijers 8 years ago 8 years ago
#864 major Automated collection of running Docker containers Sander Maijers 8 years ago 8 years ago
#863 minor Automate collection of host info Sander Maijers 8 years ago 8 years ago

2. Hosts

2.1. Internally managed

Canonical FQDN Aliases IPv4-address OS Docker (v)CPUs Memory
(GiB)
Storage
(GiB)
Hoster Responsible Support Collectd
lvps92-51-161-129.dedicated.hosteurope.de vlo.clarin.eu 92.51.161.129 CentOS
7.1.1503
n/a 8 32 500 HostEurope sysops@clarin.eu support@hosteurope.de 5.5
clarinvm.ics.muni.cz catalog.clarin.eu
docker.clarin.eu
nexus.clarin.eu
office.clarin.eu
147.251.9.199 CentOS
7.1.1503
1.8.2 8 32 500 CESNET sysops@clarin.eu cloud@metacentrum.cz 5.5
idp1-clarin.esc.rzg.mpg.de aai1.clarin.eu 130.183.206.196 Scientific Linux
7.2
1.9.1 2 4 20 MPCDF sysops@clarin.eu clarin-support@rzg.mpg.de 5.5
idp2-clarin.esc.rzg.mpg.de aai2.clarin.eu 130.183.206.33 Scientific Linux
7.2
1.9.1 2 4 20 MPCDF sysops@clarin.eu clarin-support@rzg.mpg.de 5.5
dev-idp-clarin.esc.rzg.mpg.de dev-idp.clarin.eu
dev-sp.clarin.eu
130.183.206.39 Scientific Linux
7.2
1.12.2 2 4 20 MPCDF sysops@clarin.eu clarin-support@rzg.mpg.de 5.5
centres-clarin.esc.rzg.mpg.de centres.clarin.eu 130.183.206.32 SLES
11.3
n/a 1 1 17 MPCDF sysops@clarin.eu clarin-support@rzg.mpg.de no
centres2-clarin.esc.rzg.mpg.de (centres.clarin.eu)
staging-centres.clarin.eu
130.183.206.40 Scientific Linux
7.2
1.10.2 1 1 2 MPCDF sysops@clarin.eu clarin-support@rzg.mpg.de no
beta-vlo-clarin.esc.rzg.mpg.de beta-vlo.clarin.eu 130.183.206.198 Scientific Linux
7.2
1.7.1 8 16 1000 MPCDF sysops@clarin.eu clarin-support@rzg.mpg.de 5.5
alpha-vlo-clarin.esc.rzg.mpg.de alpha-vlo.clarin.eu 130.183.206.35 Scientific Linux
7.3
n/a 4 15 125 MPCDF Twan Goosen clarin-support@rzg.mpg.de 5.4.2
ems04.mpi.nl infra.clarin.eu
trac.clarin.eu
stats.clarin.eu
svn.clarin.eu
user.clarin.eu
192.87.79.165 Ubuntu
12.04.5 LTS
n/a 1 4 10 MPI-PL sysops@clarin.eu Tobias.vanValkenhoef@mpi.nl 4.10
149-210-236-86.colo.transip.net proxy.clarin.eu
discovery.clarin.eu
idp.clarin.eu
149.210.236.86 CentOS
7.1.1503
1.8.2 2 4 150 TransIP sysops@clarin.eu CP, 2nd best: support@transip.nl
Status: TransNOC
5.5
37-97-154-156.colo.transip.net dev-www.clarin.eu 37.97.154.156 CentOS
7
1.11 2 4 150 TransIP sysops@clarin.eu CP, 2nd best: support@transip.nl
Status: TransNOC
5.5
37-97-184-230.colo.transip.net www.clarin.eu 37.97.184.230 CentOS
7
1.11 2 4 150 TransIP sysops@clarin.eu CP, 2nd best: support@transip.nl
Status: TransNOC
5.5
37.97.220.172.colo.transip.net 37.97.220.172 CentOS
7
1.12 1 1 ? TransIP sysops@clarin.eu CP, 2nd best: support@transip.nl
Status: TransNOC
no
CLARINEU-HAIP High available IP address 136.144.144.150 - - - - - TransIP sysops@clarin.eu CP, 2nd best: support@transip.nl
Status: TransNOC

2.2. Externally managed, with central services

Canonical FQDN Aliases IPv4-address OS Docker (v)CPUs Memory
(GiB)
Storage
(GiB)
Hoster Responsible
vz07-clarin-list?.im.hum.uu.nl lists.clarin.eu
newlists.clarin.eu
131.211.143.192 Debian
6
n/a ? ? ? UU ictenmedia@uu.nl
fsd-cloud22.zam.kfa-juelich.de monitoring.clarin.eu 134.94.199.42 Ubuntu 14.04.4 LTS n/a FZJ? CLARIN-support@fz-juelich.de
clarin.fz-juelich.de - 134.94.199.71 n/a FZJ? CLARIN-support@fz-juelich.de
clarin.ids-mannheim.de clarin.ids-mannheim.de 193.196.8.17 CentOS
5.11
n/a 4 16 64 IDS? Oliver Schonefeld
weblicht.sfs.uni-tuebingen.de weblicht.sfs.uni-tuebingen.de 130.183.206.38 Scientific Linux
6.7
n/a 4 64 500 UTU? emanuel.dima@uni-tuebingen.de

2.3. Decommissioned

Canonical FQDN Aliases IPv4-address OS Docker Hoster Responsible
idp-clarin.esc.rzg.mpg.de - 130.183.206.37 SLES
11.3
n/a MPCDF sysops@clarin.eu
stoor146.meta.zcu.cz - 147.228.242.146 CentOS
7.1.1503
1.5.0 CESNET sysops@clarin.eu
catalog-clarin?.esc.rzg.mpg.de 192.87.79.171 SLES
11.2
n/a MPI-PL sysops@clarin.eu
im-linux-clarin-eu?.im.hum.uu.nl www.clarin.eu 131.211.143.212 Debian
8
n/a UU web team
Sander Maijers
ictenmedia@uu.nl
im-linux-dev-clarin-eu.hum.uu.nl - 131.211.143.192 Debian
8
n/a UU web team
Sander Maijers
ictenmedia@uu.nl
vz07-clarin-eu?.im.hum.uu.nl - 131.211.143.186 Debian
8
n/a UU web team
Sander Maijers
ictenmedia@uu.nl

3. DNS entries and TLS certificates

Hosted by TransIP

admins: Dieter Van Uytvanck, Andre Moreira, Willem Elbers

4. Getting access

Shell access to the CLARIN hosts is only possible via key-based SSH.

Contact sysops@clarin.eu to request access to a host. Make sure to include your public SSH key.

Instructions and guidelines on how to create your OpenSSH key pair can be found here.

4.1. Security

5. Default VM setup

These instructions describe how we install/provision/configure each host by default.

5.1. Centos / Scientific Linux

Some notes on administering Centos / Scientific linux hosts.

5.2. SLES 11

We are in the process of migration our SLES 11 machines to CentOS/Scientific Linux. We collect some notes on administering SLES hosts.

6. Infrastructure and service status information

A manually curated service status overview including planned maintenance is kept at clarin.eu/status.

Service availability statistics (sourced by StatusCake) are available at status.clarin.eu. Incidents are also posted automatically to the private sysalert channel on Slack.

Maintainers of services, in particular core services and A-services are requested to submit expected downtime information timely. For more information, see Service status guidelines.

7. Documents

8. Services

9. Updates

Bi-weekly on Tuesdays.

Canonical FQDN OS Updates Comments
Kernel Packages Docker
37.97.220.172.colo.transip.net CentOS
7
2-5-2017 20-4-2017 PENDING
dev-idp-clarin.esc.rzg.mpg.de Scientific Linux
7.2
PENDING 20-4-2017 PENDING Kernel update scheduled for 2.5.2017 check with RZG if reboot is possible
centres2-clarin.esc.rzg.mpg.de Scientific Linux
7.2
PENDING 20-4-2017 PENDING Kernel update scheduled for 2.5.2017 check with RZG if reboot is possible
beta-vlo-clarin.esc.rzg.mpg.de Scientific Linux
7.2
PENDING 20-4-2017 PENDING Kernel update scheduled for 2.5.2017 check with RZG if reboot is possible
lvps92-51-161-129.dedicated.hosteurope.de CentOS
7.1.1503
2-5-2017 20-4-2017 N/A
clarinvm.ics.muni.cz CentOS
7.1.1503
2-5-2017 20-4-2017 PENDING
idp2-clarin.esc.rzg.mpg.de Scientific Linux
7.2
PENDING 20-4-2017 PENDING Kernel update scheduled for 2.5.2017, check with RZG if reboot is possible
idp1-clarin.esc.rzg.mpg.de Scientific Linux
7.2
PENDING 20-4-2017 PENDING Kernel update scheduled for 2.5.2017, check with RZG if reboot is possible
149-210-236-86.colo.transip.net CentOS
7.1.1503
2-5-2017 20-4-2017 PENDING (Update round 20-4-2017: docker daemon unavailable for ~1 minute, selinux?)
37-97-154-156.colo.transip.net CentOS
7
2-5-2017 20-4-2017 PENDING (Update round 20-4-2017: yum issue with urlgravver)
37-97-184-230.colo.transip.net CentOS
7
2-5-2017 20-4-2017 PENDING
centres-clarin.esc.rzg.mpg.de SLES
11.3
20-4-2017 20-4-2017 N/A Kernel updates installed, check with RZG if reboot is possible
alpha-vlo-clarin.esc.rzg.mpg.de Scientific Linux
7.3
PENDING 20-4-2017 PENDING Kernel update scheduled for 2.5.2017 check with RZG if reboot is possible
ems04.mpi.nl Ubuntu
12.04.5 LTS
SKIPPED SKIPPED SKIPPED Planned to be decommissioned asap

10. Known issues

10.1. Docker

10.1.1. dial tcp: lookup index.docker.io: no such host

10.1.1.1. Error

dial tcp: lookup index.docker.io: no such host

10.1.1.2. Symptoms

While using Docker a user is unable to perform tasks such as pull new image or search for new images while the following error message appears:

# docker pull debian:8
Pulling repository debian
FATA[0053] Get https://index.docker.io/v1/repositories/library/debian/images: dial tcp: lookup index.docker.io: no such hos

10.1.1.3. References