Contents

1. Tickets
2. 1. Hosts
   1. 1.1. Internally managed
   2. 1.2. Externally managed, with central services
   3. 1.3. Decommissioned
3. 2. DNS entries and TLS certificates
4. 3. Getting access
   1. 3.1. Security
5. 4. Default VM setup
   1. 4.1. Centos / Scientific Linux
   2. 4.2. SLES 11
   3. 4.3. Ubuntu
6. 5. Infrastructure and service status information
7. 6. Documents
8. 7. Services
9. 8. Updates
10. 9. Known issues
    1. 9.1. Docker
       1. 9.1.1. dial tcp: lookup index.docker.io: no such host
          1. 9.1.1.1. Error
          2. 9.1.1.2. Symptoms
          3. 9.1.1.3. Solution
          4. 9.1.1.4. References
11. 10. GitLab
    1. 10.1. Managing a git repository on a server with a deploy key

Tickets

Ticket	Priority	Summary	Owner	Created	Modified
#1086	minor	Problem with admin messages from lists.clarin.eu	André Moreira	4 years ago	4 years ago
#1054	major	Bad URL encoding in catalog.clarin.eu/vlo -> vlo.clarin.eu redirects	André Moreira	6 years ago	6 years ago
#1010	minor	Piwik overlay	André Moreira	7 years ago	7 years ago
#1000	major	Review server timezone	André Moreira	7 years ago	7 years ago
#996	major	catalog.clarin.eu SP: aa-statistics error message on login	André Moreira	7 years ago	7 years ago
#981	major	Add DKIM, DMARC DNS RRs for clarin.eu	Sander Maijers	8 years ago	8 years ago
#887	major	Configure local firewall for idp1-clarin and idp2-clarin	Sander Maijers	8 years ago	8 years ago
#881	minor	Migrate lists.clarin.eu	Sander Maijers	8 years ago	8 years ago
#891	critical	dmeventd for LVM hogs CPU on CentOS 7	Willem Elbers	8 years ago	8 years ago
#955	major	Add Reverse DNS records for TransIP VMs	Sander Maijers	8 years ago	8 years ago
#902	major	Grant read access to httpd logs	Sander Maijers	8 years ago	8 years ago
#885	major	Django security update to 1.9.3	Sander Maijers	8 years ago	8 years ago
#884	critical	Security-critical instructions to data centre support should have integrity	Sander Maijers	8 years ago	8 years ago
#883	major	Devise automatic tty I/O auditing setup & policy	Sander Maijers	8 years ago	8 years ago
#865	major	Make host pages adhere to host template in Trac	Sander Maijers	8 years ago	8 years ago
#864	major	Automated collection of running Docker containers	Sander Maijers	8 years ago	8 years ago
#863	minor	Automate collection of host info	Sander Maijers	8 years ago	8 years ago

1. Hosts

1.1. Internally managed

Canonical FQDN	Aliases	Services	Ports	Service Type	IPv4-address	OS	(v)CPUs	Memory (GiB)	Storage (GiB)	Hoster	Type	Responsible	Support	Collectd	Fluentd	Docker	Compose
lvps92-51-161-129.dedicated.hosteurope.de	vlo.clarin.eu				92.51.161.129	CentOS 7.1.1503	8	32	500	HostEurope	Virtual Server Linux Unlimited High I/O 8.0	​sysops@clarin.eu	​support@hosteurope.de	5.5	n/a	n/a	n/a
rs236235.rs.hosteurope.de	cmdi.clarin.eu alpha-vlo.clarin.eu	​Netkernel ​Virtual Collection Registry ​Virtual Language Observatory docker-runner-hosteurope-1 docker-runner-hosteurope-2 discovery		PRODUCTION ALPHA ALPHA BUILD BUILD ALPHA	91.250.80.240	CentOS 7.1.1503	4	18	750	HostEurope	Root Server M	​sysops@clarin.eu	​support@hosteurope.de	5.8.0	td-agent 1.2.2	18.03.1-ce	1.21.2
rs238144.rs.hosteurope.de		​Piwik beta Discovery beta	44325 45325	BETA (Primary) BETA	91.250.82.71	CentOS	8	40	800	HostEurope	Root Server XL	​sysops@clarin.eu	​support@hosteurope.de	5.8.0	td-agent 1.2.2	18.03.1-ce	1.21.2
clarinvm.ics.muni.cz	catalog.clarin.eu docker.clarin.eu nexus.clarin.eu office.clarin.eu	CLARIN EU trac (78.128.216.72) CLARIN NL trac (78.128.216.72) SVN (78.128.216.72) Shibboleth SP (catalog) -> ​Component Registry		PRODUCTION PRODUCTION PRODUCTION PRODUCTION	147.251.9.199 (new ip: 78.128.216.72)	CentOS 7.1.1503	8	32	500	CESNET		​sysops@clarin.eu	​cloud@metacentrum.cz	5.5	n/a	1.8.2	n/a
idp1-clarin.esc.rzg.mpg.de	idm.clarin.eu aai1.clarin.eu	Unity IDM ​Discovery service		PRODUCTION PRODUCTION 1	130.183.206.196	Scientific Linux 7.4	2	4	20	MPCDF		​sysops@clarin.eu	​clarin-support@rzg.mpg.de	5.8.0	td-agent 1.2.2	18.06.0-ce	1.22.0
idp2-clarin.esc.rzg.mpg.de	aai2.clarin.eu beta-stats.clarin.eu	​Infra SPF MD pipelines ​Infra static webserver ​Piwik	8082, 44344, 44345 44343 44325	PRODUCTION 2 PRODUCTION 2 PRODUCTION (Backup)	130.183.206.33	Scientific Linux 7.4	2	4	20	MPCDF		​sysops@clarin.eu	​clarin-support@rzg.mpg.de	5.8.0	td-agent 1.2.2	18.06.0-ce	1.22.0
dev-idp-clarin.esc.rzg.mpg.de	dev-idp.clarin.eu dev-sp.clarin.eu	docker-runner-rzg-1 docker-runner-rzg-2		DEVELOPMENT DEVELOPMENT BUILD BUILD	130.183.206.39	Scientific Linux 7.4	2	4	20	MPCDF		​sysops@clarin.eu	​clarin-support@rzg.mpg.de	5.8.0	td-agent 0.12.40	17.05.0-ce	1.8.1
centres-clarin.esc.rzg.mpg.de	centres.clarin.eu	Centre Registry		PRODUCTION	130.183.206.32	SLES 11.4	1	1	17	MPCDF		​sysops@clarin.eu	​clarin-support@rzg.mpg.de	5.5	n/a	n/a	n/a
centres2-clarin.esc.rzg.mpg.de	staging-centres.clarin.eu	Centre Registry ​Piwik beta	44335 44325	STAGING BETA (Backup)	130.183.206.40	Scientific Linux 7.4	1	1	2	MPCDF		​sysops@clarin.eu	​clarin-support@rzg.mpg.de	5.8.0	td-agent 1.2.2	18.06.0-ce	1.22.0
beta-vlo-clarin.esc.rzg.mpg.de	beta-vlo.clarin.eu	VLO		BETA	130.183.206.198	Scientific Linux 7.2	8	16	1000	MPCDF		​sysops@clarin.eu	​clarin-support@rzg.mpg.de	5.5	n/a	17.05.0-ce	1.17.0
alpha-vlo-clarin.esc.rzg.mpg.de		VLO		ALPHA (semi-decomissioned)	130.183.206.35	Scientific Linux 7.3	4	15	125	MPCDF		Twan Goosen	​clarin-support@rzg.mpg.de	5.4.2	n/a	n/a	n/a
149-210-236-86.colo.transip.net	transip-vps2	​Reverse proxy	80, 443	PRODUCTION (Primary)	149.210.236.86 Priv. net.: 192.168.1.3	CentOS 7-5.1804.4.el7	2	4	150	TransIP	VPS X4 @AMS0 (Amsterdam)	​sysops@clarin.eu	​CP, 2nd best: ​support@transip.nl Status: ​TransNOC	5.8.0	td-agent 1.2.2	18.06.0-ce	1.22.0
37-97-154-156.colo.transip.net	transip-vps3 dev-www.clarin.eu stats.clarin.eu	Main Website (dev) ​Piwik	4430, 4431 4432	DEVELOPMENT PRODUCTION (primary)	37.97.154.156 Priv. net. dev: 192.168.2.3	CentOS 7.4.1708	2	4	150	TransIP	VPS X4 @AMS0 (Amsterdam)	​sysops@clarin.eu	​CP, 2nd best: ​support@transip.nl Status: ​TransNOC	5.8.0	td-agent 1.2.2	18.03.1-ce	1.21.2
37-97-184-230.colo.transip.net	transip-vps4 www.clarin.eu	Main Website	4430, 4431	PRODUCTION	37.97.184.230 Priv. net. dev: 192.168.2.1	CentOS 7.4.1708	2	4	150	TransIP	VPS X4 @AMS0 (Amsterdam)	​sysops@clarin.eu	​CP, 2nd best: ​support@transip.nl Status: ​TransNOC	5.8.0	td-agent 1.2.2	17.05.0-ce	1.17.1
37.97.220.172.colo.transip.net	transip-vps transip-vps5	​Discovery service ​Infra SPF MD pipelines ​Infra static webserver	8444 44344, 44345 44343	PRODUCTION 2 PRODUCTION 1 PRODUCTION 1	37.97.220.172	CentOS 7-5.1804.4.el7	2	4	150	TransIP	VPS X4 @AMS0 (Amsterdam)	​sysops@clarin.eu	​CP, 2nd best: ​support@transip.nl Status: ​TransNOC	5.8.0	td-agent 1.2.2	18.06.0-ce	1.22.0
136-144-215-36.colo.transip.net	transip-vps5 transip-vps6	​Reverse proxy	80, 443	PRODUCTION (Backup)	136.144.215.36 Priv. net.: 192.168.1.1	CentOS 7-5.1804.4.el7	2	4	150	TransIP	VPS X4 @RTM0 (Delft)	​sysops@clarin.eu	​CP, 2nd best: ​support@transip.nl Status: ​TransNOC	5.8.0	td-agent 1.2.2	18.06.0-ce	1.22.0
CLARINEU-HAIP	High available IP address				136.144.144.150	-	-	-	-	TransIP		​sysops@clarin.eu	​CP, 2nd best: ​support@transip.nl Status: ​TransNOC	-	-	-	-
CLARINEU-HAIP-DEV	High available IP address				136.144.144.52		-	-	-	TransIP		​sysops@clarin.eu	​CP, 2nd best: ​support@transip.nl Status: ​TransNOC	-	-	-	-

1.2. Externally managed, with central services

Canonical FQDN	Aliases	IPv4-address	OS	Docker	(v)CPUs	Memory (GiB)	Storage (GiB)	Hoster	Responsible
vz07-clarin-list?.im.hum.uu.nl	lists.clarin.eu newlists.clarin.eu	131.211.143.192	Debian 6	n/a	?	?	?	UU	​ictenmedia@uu.nl
fsd-cloud22.zam.kfa-juelich.de	monitoring.clarin.eu	134.94.199.42	Ubuntu 14.04.4 LTS	n/a				FZJ?	​CLARIN-support@fz-juelich.de
clarin.fz-juelich.de	-	134.94.199.71		n/a				FZJ?	​CLARIN-support@fz-juelich.de
clarin.ids-mannheim.de	clarin.ids-mannheim.de	193.196.8.17	CentOS 7.4	n/a	4	16	64	IDS?	Oliver Schonefeld
weblicht.sfs.uni-tuebingen.de	weblicht.sfs.uni-tuebingen.de	130.183.206.38	Ubuntu 16.04	1.12.3	4	64	500	UTU?	​emanuel.dima@uni-tuebingen.de
spraakbanken.gu.se/ws/fcs/2.0/aggregator/	contentsearch.clarin.eu	130.241.42.13						Språkbanken	​leif-joran.olsson@svenska.gu.seadded aa

1.3. Decommissioned

Canonical FQDN	Aliases	IPv4-address	OS	Docker	Hoster	Responsible
ems04.mpi.nl		192.87.79.165	Ubuntu 12.04.5 LTS	n/a	MPI-PL	​sysops@clarin.eu
idp-clarin.esc.rzg.mpg.de	-	130.183.206.37	SLES 11.3	n/a	MPCDF	​sysops@clarin.eu
stoor146.meta.zcu.cz	-	147.228.242.146	CentOS 7.1.1503	1.5.0	CESNET	​sysops@clarin.eu
catalog-clarin?.esc.rzg.mpg.de		192.87.79.171	SLES 11.2	n/a	MPI-PL	​sysops@clarin.eu
im-linux-clarin-eu?.im.hum.uu.nl	www.clarin.eu	131.211.143.212	Debian 8	n/a	UU	​web team Sander Maijers ​ictenmedia@uu.nl
im-linux-dev-clarin-eu.hum.uu.nl	-	131.211.143.192	Debian 8	n/a	UU	​web team Sander Maijers ​ictenmedia@uu.nl
vz07-clarin-eu?.im.hum.uu.nl	-	131.211.143.186	Debian 8	n/a	UU	​web team Sander Maijers ​ictenmedia@uu.nl
lvps83-169-5-155.dedicated.hosteurope.de		83.169.5.155	CentOS	n/a	HostEurope	Decommissioned per 31.05.2018

2. DNS entries and TLS certificates

Hosted by ​TransIP

admins: Dieter Van Uytvanck, Andre Moreira, Willem Elbers

3. Getting access

Shell access to the CLARIN hosts is only possible via key-based SSH.

Contact ​sysops@clarin.eu to request access to a host. Make sure to include your public SSH key.

Instructions and guidelines on how to create your OpenSSH key pair can be found here.

3.1. Security

4. Default VM setup

These instructions describe how we install/provision/configure each host by default.

4.1. Centos / Scientific Linux

Some notes on administering Centos / Scientific linux hosts.

4.2. SLES 11

We are in the process of migration our SLES 11 machines to CentOS/Scientific Linux. We collect some notes on administering SLES hosts.

4.3. Ubuntu

We are in the process of migration our Ubuntu machines to CentOS/Scientific Linux.

5. Infrastructure and service status information

A manually curated service status overview including planned maintenance is kept at ​clarin.eu/status.

Service availability statistics (sourced by ​StatusCake) are available at ​status.clarin.eu. Incidents are also posted automatically to the private ​sysalert channel on Slack.

Maintainers of services, in particular core services and A-services are requested to ​submit expected downtime information timely. For more information, see Service status guidelines.

6. Documents

• ​CLARIN Infrastructure Overview
• ​Docker Workflow and best practices
• Proposal: ​High Availability for the CLARIN infrastructure
• ​Sysops - infrastructure management

7. Services

• CE Archive

8. Updates

Bi-weekly on Tuesdays.

Canonical FQDN	OS	Updates			Comments
		Kernel	Packages	Docker
37.97.220.172.colo.transip.net	CentOS 7-5.1804.4.el7	16-08-2018	21-08-2018	16-08-2018	Kernel: 3.10.0-862.11.6.el7.x86_64
dev-idp-clarin.esc.rzg.mpg.de	Scientific Linux 7.4	12-01-2018	12-01-2018	12-01-2018	Kernel: 3.10.0-693.11.6.el7.x86_64
centres2-clarin.esc.rzg.mpg.de	Scientific Linux 7.4	20-08-2018	20-08-2018	20-08-2018	Kernel: 3.10.0-862.6.3.el7.x86_64
beta-vlo-clarin.esc.rzg.mpg.de	Scientific Linux 7.2	12-01-2018	12-01-2018	10-11-2017	Kernel: 3.10.0-693.11.6.el7.x86_64
lvps92-51-161-129.dedicated.hosteurope.de	CentOS 7.1.1503	12-01-2018	12-01-2018	N/A	Kernel: 3.10.0-042stab127.2 (​OpenVZ)
rs236235.rs.hosteurope.de	CentOS 7.4.1708	12-01-2018	12-01-2018	12-01-2018	Kernel: 3.10.0-693.11.6.el7.x86_64
clarinvm.ics.muni.cz	CentOS 7.1.1503	12-01-2018	12-01-2018	PENDING	Kernel: 3.10.0-229.el7.x86_64
idp2-clarin.esc.rzg.mpg.de	Scientific Linux 7.2	12-01-2018	12-01-2018	05-10-2017	Kernel: 3.10.0-862.3.2.el7.x86_64
idp1-clarin.esc.rzg.mpg.de	Scientific Linux 7.2	12-01-2018	12-01-2018	PENDING	Kernel: 3.10.0-693.11.6.el7.x86_64
149-210-236-86.colo.transip.net	CentOS 7-5.1804.4.el7	16-08-2018	21-08-2018	16-08-2018	Kernel: 3.10.0-862.11.6.el7.x86_64
37-97-154-156.colo.transip.net	CentOS 7	12-01-2018	12-01-2018	14-11-2017	kernel: 3.10.0-693.11.6.el7.x86_64
37-97-184-230.colo.transip.net	CentOS 7	12-01-2018	12-01-2018	14-11-2017	kernel: 3.10.0-693.11.6.el7.x86_64
136-144-215-36.colo.transip.net	CentOS 7-5.1804.4.el7	15-08-2018	21-08-2018	15-08-2018	kernel: 3.10.0-862.11.6.el7.x86_64
centres-clarin.esc.rzg.mpg.de	SLES 11.3	12-01-2018	12-01-2018	N/A	Kernel: 3.0.101-108.21.1.x86_64
alpha-vlo-clarin.esc.rzg.mpg.de	Scientific Linux 7.3	12-01-2018	12-01-2018	N/A	Kernel: 3.10.0-693.11.6.el7.x86_64
ems04.mpi.nl	Ubuntu 12.04.5 LTS	SKIPPED	SKIPPED	SKIPPED	Planned to be decommissioned asap

9. Known issues

9.1. Docker

9.1.1. dial tcp: lookup index.docker.io: no such host

9.1.1.1. Error

dial tcp: lookup index.docker.io: no such host

9.1.1.2. Symptoms

While using Docker a user is unable to perform tasks such as pull new image or search for new images while the following error message appears:

# docker pull debian:8
Pulling repository debian
FATA[0053] Get https://index.docker.io/v1/repositories/library/debian/images: dial tcp: lookup index.docker.io: no such host

9.1.1.3. Solution

No good solution available at this time.

9.1.1.4. References

• ​https://linuxconfig.org/docker-dial-tcp-lookup-index-docker-io-no-such-host-fix
• ​https://robinwinslow.uk/2016/06/23/fix-docker-networking-dns/
• ​https://stackoverflow.com/questions/29266560/docker-container-can-reach-dns-but-not-resolve-hosts
• ​https://github.com/moby/moby/issues/13381

10. GitLab

10.1. Managing a git repository on a server with a deploy key

1. Enable deploy key in gitlab reository

• Goto Settings - Repository
• Expand "Deploy Keys"
• Enable the CLARIN keys (make sure to not use the public ones!)

2. Configure a ssh connection for gitlab on the service

• Add the private part of the deploy key to /home/deploy/.ssh/id_rsa_gitlab_deploy
• Edit /home/deploy/.ssh/config
• Add:

  #Deploys
  Host gitlab.com
      User git
      HostName gitlab.com
      IdentityFile ~/.ssh/id_rsa_gitlab_deploy
  

3. Use the SSH location to clone the repository

• Example

  git clone git@gitlab.com:CLARIN-ERIC/compose_transip_vps5.git