wiki:SystemAdministration/Hosts/ems04.mpi.nl

Version 13 (modified by Sander Maijers, 8 years ago) (diff)

contents: change backup policy to reflect reality since a few months

ems04.mpi.nl

Hoster: Hosters/MPI-PL

1. Maintenance

1.1. Responsibility

"Sander Maijers" <sander@clarin.eu>

1.2. Tickets

Ticket Priority Summary Owner Created Modified
No tickets found

2. Filesystem

2.1. Special directory tree structures

2.1.1. /srv/

cronjobs_state/ contains logs of cron job output
apps/ custom compiled and/or installed software
dumps_for_backup/ and backup/ directories that are filled by the nbackup cronjob
mysql/ var/lib/mysql/ contents
LDAP/ LDAP server installation and data
www/ contains Apache document roots
trac/ contains some Trac data and configuration. Trac is installed in /srv/Python/venvs/, however, and most of its data is in a PostgreSQL database.
/srv/
├── [drwxr-xr-x root     root    ]  apps
│   ├── [drwxr-xr-x root     root    ]  installations
│   └── [drwxr-xr-x root     root    ]  installers
├── [lrwxrwxrwx root     root    ]  backup -> /mnt/backup
├── [drwxr-xr-x root     root    ]  cronjobs_state
│   ├── [drwsr-sr-x root     root    ]  1
│   ├── [drwsr-sr-x root     root    ]  10
│   ├── [drwsr-sr-x root     root    ]  11
│   ├── [drwsr-sr-x www-data www-data]  12
│   ├── [drwsr-sr-x www-data www-data]  13
│   ├── [drwsr-sr-x www-data www-data]  14
│   ├── [drwsr-sr-x www-data www-data]  15
│   ├── [drwsr-sr-x root     root    ]  16
│   ├── [drwsr-sr-x www-data www-data]  17
│   ├── [drwsr-sr-x www-data www-data]  18
│   ├── [drwsr-sr-x www-data www-data]  19
│   ├── [drwsr-sr-x www-data www-data]  2
│   ├── [drwsr-sr-x root     root    ]  3
│   ├── [drwsr-sr-x root     root    ]  4
│   ├── [drwsr-sr-x root     root    ]  5
│   ├── [drwsr-sr-x root     root    ]  6
│   ├── [drwsr-sr-x root     root    ]  7
│   ├── [drwsr-sr-x root     root    ]  8
│   └── [drwsr-sr-x root     root    ]  9
├── [lrwxrwxrwx root     root    ]  dumps_for_backup -> /mnt/development/dumps_for_backup/
├── [drwx--x--x opendj   opendj  ]  LDAP
│   ├── [drwxrwx--x opendj   opendj  ]  backup
│   ├── [drwx------ opendj   opendj  ]  OpenDJ-2.5.0-Xpress1
│   └── [drwx------ opendj   opendj  ]  opendj-2.6.2
├── [drwx------ root     root    ]  lost+found
├── [drwx------ mysql    mysql   ]  mysql
│   ├── [drwx------ mysql    mysql   ]  drupal
│   ├── [drwx------ mysql    mysql   ]  mysql
│   ├── [drwx------ mysql    mysql   ]  performance_schema
│   ├── [drwx------ mysql    mysql   ]  piwik_db
│   └── [drwx------ mysql    mysql   ]  test
├── [drwxr-xr-x python   python  ]  Python
│   └── [drwxr-xr-x python   python  ]  venvs
├── [drwxr-sr-x root     root    ]  scripts
│   ├── [drwxr-sr-x root     root    ]  exec
│   ├── [drwxr-sr-x root     root    ]  input
│   └── [drwxr-sr-x root     root    ]  output
├── [lrwxrwxrwx subversi www-data]  subversion -> /mnt/development/subversion/
├── [drwsr-sr-x trac     www-data]  trac
│   ├── [drwxrws--x trac     www-data]  trac.clarin.eu
│   └── [drwxrws--x trac     www-data]  trac.clarin.nl
└── [drwxr-xr-x www-data www-data]  www
    ├── [drwsr-sr-x www-data www-data]  drupal6
    ├── [drwxrwsr-x www-data www-data]  infra.clarin.eu
    ├── [drwsr-sr-x www-data www-data]  maintenance
    ├── [drwxr-xr-x www-data www-data]  piwik
    └── [drwsr-sr-x www-data www-data]  unknown_vhost

2.2. Backup policy

An internal backup program, nbackup, backs up a lot of directories (daily, rotated weekly), esp. under /srv/. For more details, see scheduled job named 'cronjob 6: nbackup' in the relevant section. The nightly backups are stored in /srv/backup/a/. They must be manually moved from this directory to clarinvm.ics.muni.cz.

3. Required connectivity (firewall)

3.1. Current status

3.1.1. External firewalls

None.

3.1.2. Internal firewall

See /etc/shorewall/rules.

4. Scheduled jobs

There are numerous important crontobs running under uids for root and www-data. A utility called cronjobber manages this and stores cron job output/state under /srv/cronjobs_state/. Issue e.g. sudo -u www-data crontab -u to view the current status.