Changelog VanGogh Cluster 2005
Moved Home Directories from vangogh0 to rembrandt0
2005-11-29 by Hans Blom
Why: The
VanGogh cluster will be upgraded
Where: On all
VanGogh nodes
How: See the corresponding item in
ChangeLogRembrandt.
SC|05 demo configuration for vangogh3 and vangogh4
2005-10-25 by Paola Grosso
Why: To have the two systems ready for the SC|05 resource brokering demo
Where:
Vangogh3 and vangogh4
How:
Changed the addresses on the interfaces eth2 to be on the "infamous" vlan 21 to Chicago.
They were previously configured for a the Joe Mambretti demo for iGrid2005.
Re-instatiated the routes in /usr/local/etc/sysconfig/network-scripts/route-eth2 so that we can see Onno
2.6 kernel on vangogh 7 & 8
2005-09-14 by Freek Dijkstra
Why: Kernel was old (2.4), and I needed to install a new kernel anyway (with
IPv4 LL patch)
Where: On vangogh7 and vanoghg8.
How:
- Build 2.6.13.1-ll kernel on Vangogh0 as user freek
- copied vmlinuz-2.6.13.1-ll, initrd-2.6.13.1-ll, config-2.6.13.1-ll, System.map-2.6.13.1-ll to /boot/
- installed /sbin/mkinitrd.new
- installed lsmod, insmod, rmmod, depmod, modprobe, insmod.static into /sbin/, removing old versions to *.old (except insmod, which was installed as insmod.new)
- discovered that it doesn't work, get frustrated
- Build 2.4.26-web100-ll kernel on Vangogh0 as root
- install 2.4.26-web100-ll kernel on vangogh 7 & 8.
- memorize to remove new /sbin/*mod* stuff, as well as make this kernel the default in /boot/grub/grub.conf
Add bomblab User
2005-08-24 by Hans Blom
Why: User required in Bomb Lab application which is used in the practicum managed by Arie Taal.
Where: On nodes "vangogh0" and "wgsara2".
How:
On both "vangogh0" and "wgsara2" a user bomblab with group bomblab is add. The user at "vangogh0" is only intended as reference that the account is existing at the cluster, so every password is refused and the shell is /sbin/nologin. At "wgsara2" it is a local user to run the Bomb Lab server application. At "wgsara2" also /var/spool/mail/bomblab is created. It is not used but should exist for a proper installation. The content of this user is maintained by Arie Taal.
Change Cricket File Permissions
2005-08-02 by Hans Blom
Why: To make the Cricket configuration not world readable.
Where: On node "vangogh0".
How:
Remove the read access rights for "others" to the cricket configuration in the directory
~/cricket-config. Note that the Apache Web server user should also be able to read this directory. The
umask will be set to
027 such that the permissions for new files and directories are automatically correct, also with manual editing. This is done with the following steps:
- Add the Cricket user to the Apache Web server group.
- Do the following for the configuration directory ~/cricket-config and the data directory ~/cricket-data:
- Change the group for these directories and their content into the Apache Web server group. This is required because due to the umask 027 setting of the Cricket user the Apache Web server user is otherwise unable to read these directories.
- Remove all permissions for "others" in these directories and their content.
- Set for these directories and their sub directories the s-bit for the group. This implies that created sub items are automatically from the correct group.
- Add umask 027 to ~/.cshrc and the Cricket crontab scripts.
Create Rancid Backup User
2005-07-20 by Hans Blom
Why: To backup the Rancid tool main directory from "rembrandt0".
Where: On node "vangogh0".
How:
Create the
rancid user, install the appropriate public SSH keys and create the
Rancid/var directory. See also
ChangeLogRembrandt.
iGrid2005 demo US108A: network interfaces configuration
2005-07-08 by Paola Grosso
Why: Following up for request for two Vangogh nodes. Assigned to this demo vangogh3 and vangogh4.
Assigned addresses out of demonstrator private range: 172.30.0.0/16.
They request Vangogh nodes to be placed in 172.30.1.0-255 range: given address 172.30.1.113 and 172.30.1.114 respectivily for eth2.
Where: Nodes "vangogh3" and "vangogh4"
How:
Changed the network configuration in /etc/sysconfig/network-scripts/ifcfg-eth2.
Removed pointer to old static routes out of these interfaces, loated int /usr/local/etc/sysconfig/network-scripts/route-eth2
Connected these interfaces via
BeautyCees and
GlimmerGlass to int gi 5/9 and 5/10 on
Force10. Placed these interfaces into vlan 190, vlan that is trunked all the way to Chicago.
Cricket Workaround SNMP Bug in 64-Bit Counters Nortel Switch
2005-06-24 by Hans Blom
Why: To be able to read the 64-bit counters properly.
Where: Node "vangogh0".
How:
With the OS version from our Nortel switch an updated value of 64-bit counters could only be read with SNMP as just before the corresponding 32-bit counters were read. In that case the 64-bit counters were also updated. When the 64-bit counters are queried without the corresponding 32-bit counters only each five minutes an updated 64-bit counter could be obtained, resulting in an unreliable Cricket registration.
So a workaround for this bug is to query with cricket first those 32-bit counters from the Nortel from which their 64-bit equivalents have been used. After that do the usual Cricket monitoring and ignore the first retrieved 32-bit Nortel counters ("schaduw boekhouding").
This has been implemented as follows:
New Host certificates Globus
2005-05-25 by Freek Dijkstra
Why: Host certifcates would expire in June
Where: Nodes "vangogh0-8".
How:
See
http://certificate.nikhef.nl/rekey.html∞
However, on
VanGogh and Rembrandt,
openssl smime -sign did change line endings from LF to CRLF, which resulted in errors, so I did run the
renewcert-dutchgrid.sh script on my local laptop:
% scp globus@vangogh:nfs/vangogh\* ./
% ./renewcert-dutchgrid.sh -d vangogh0 vangogh0/usercert.pem
% sendmail -t < vangogh0/newrequest.mail
repeat for all nodes and wait for reply
save mail as vangogh0/vangogh0.eml
% openssl x509 -text -in vangogh0/vangogh0.eml > vangogh0/newusercert.pem
% scp -pr newusercert.pem newkey.pem newrequest.mail new-requestconfig.cnf newcert_request.pem globus@vangogh:nfs/vangogh0/
% ssh globus@vangogh0; cd nfs/vangogh0/
% mv
% mv userkey.pem 2004_userkey.pem
% mv usercert.pem 2004_usercert.pem
% mv userrequest.pem 2004_userrequest.pem
% mv certreq.cnf 2004_certreq.cnf
% mv certreq.txt 2004_certreq.txt
% cp -pr new-requestconfig.cnf 2005_certreq.cnf
% cp -pr newrequest.mail 2005_certreq.txt
% cp -pr newcert_request.pem 2005_userrequest.pem
% cp -pr newkey.pem userkey.pem
% cp -pr newusercert.pem.pem usercert.pem
repeat for vangogh1..8
% chmod go+r nfs/vangogh*/userkey.pem
% rem_vangogh_oper -changetouser "root" -execute "cd ~globus/nfs/`hostname`/" \
-execute "cp -fp userkey.pem usercert.pem 2005_userrequest.pem /etc/grid-security/" \
-execute "chown root:globus /etc/grid-security/*user*.pem" \
-execute "chmod go-r /etc/grid-security/userkey.pem" vangogh[0-8]
% chmod go-r nfs/vangogh*/userkey.pem
Switched off Web100 TCP Window Autotuning
2005-05-19 by Hans Blom
Why: To let the application determine the TCP window.
Where: Nodes "vangogh0-8".
How:
Add for 2.4.X
Web100 kernels to
/etc/sysctl.conf:
net.ipv4.web100_rbufmode = 0
net.ipv4.web100_sbufmode = 0
and run
sysctl -p.
Installed HDF5 and a new version of MPICH for HDF5 parallellisation
2005-05-17 by Hans Blom
Why: To be able to use the HDF5 libraries and tools for data storage.
Where: Nodes "vangogh0-8".
How:
Installation of MPICH
Below the
CFLAGS environment variable has been set in this way to allow at Linux file sizes larger than 2 GByte.
- % cd mpich-1.2.6
- % setenv RSHCOMMAND ssh
- % setenv CFLAGS "-D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64"
- % ./configure --prefix=/usr/local/MPI
- % make
- % su
- # make install
Installation of HDF5
- % cd hdf5-1.6.4
- % unsetenv RSHCOMMAND CFLAGS
- % setenv CC /usr/local/MPI/bin/mpicc
- % ./configure --prefix=/usr/local/HDF5
- % make
- % make check # These checks should run without failures.
- % su
- # make install
- Copy the HTML documentation in doc/html to /usr/local/HDF5/doc/hdf5/html.
Modified bash and zsh startup files
2005-04-11 by Hans Blom
Why: To be able to set the user environment for non-interactive
zsh shells.
Where: All
VanGogh nodes.
How: See the
ShellStartupFiles page.
Installed Subversion (and updated Perl)
2005-03-30 by Jeroen van der Ham
Why: To allow for subversion access and repositories
Where: All
VanGogh nodes.
How:
- Host "vangogh0:"
- apt-get update
- apt-get install perl (to update Perl from 2:5.8.0-88 to 2:5.8.0-88.3)
- apt-get install subversion
Caution
Subversion client works, but creating repositories is not possible
See:
http://scm.sipfoundry.org/svndoc/apb.html#svn-ap-b-sect-1.2.11∞ for a way to fix this. (I would recommend building a new kernel, because it does not seem wise to tinker with db4, because almost every package installed through apt-get depends on it.)
Created various symbolic links to (automount) home directory roots such that all paths at all hosts do exist.
2005-02-16 by Hans Blom
Why: Full home directory paths in user resource files will always be defined.
Where: All
VanGogh nodes.
How:
- Host "vangogh0:"
- mkdir /amd/vangogh0
- cd /amd/vangogh0
- ln -s /disk2/home/vangogh0 home
- Other nodes:
- mkdir -p /disk2/home
- cd /disk2/home
- ln -s /home/vangogh0 home
Changed the automount directory from /.automount to /amd.
2005-02-15 by Hans Blom
Why: Make the
RedHat hosts compatible with the Debain hosts.
Where: Nodes "vangogh0-8".
How:
- Edit /etc/amd.conf and change auto_dir correspondingly.
- Restart amd with: service amd restart.
- When still existing: remove /.automount and any subdirectories.
Adjust backup scripts and storage directory after NFS home root directory renaming.
2005-02-01 by Hans Blom
Why: The NFS home root directory has been changed.
Where: Nodes "vangogh0", "vangogh2-3".
How:
- Edit the backup script vangogh0:~root/Lib/Bin/backup_users to adjust for the directory change.
- Adjust the backup directories from the home backup user "homeback" at "vangogh2-3" correspondingly.
Renamed the home directory backup user from "backup" into "backhome".
2005-02-01 by Hans Blom
Why: A user with the name "backup" has already been used at the Debian distribution.
Where: All
VanGogh nodes.
How:
- Run the command vigr to change the group also from "backup" into "backhome".
- Run vipw to change the username into "backhome" and the home directory into /home/backhome.
- cd /var/spool/mail && mv -i backup backhome
- cd /home && mv -i backup backhome
- Edit vangogh0:~root/Lib/Bin/backup_users to modify the backup user name.
Configured also NFS mounts at home directory server "rembrandt0".
2005-01-31 by Hans Blom
Why: To be able to NFS mount home directories also from "rembrandt0".
Where: All
VanGogh nodes.
How:
- Created the configuration file to auto NFS mount the home directories from "rembrandt0" in /etc/amd.rembrandt0.home.
- Add to the MOUNTPTS variable in /etc/sysconfig/amd the phrase /home/rembrandt0 /etc/amd.rembrandt0.home.
- (Re)Start the automounter daemon:
- At "vangogh0" run the automounter from system boot and start it as server:
- chkconfig amd on
- service amd start
- Restart it at the other nodes:
Mount the home directories at "vangogh0" now from /disk2/home/vangogh0.
2005-01-31 by Hans Blom
Why:
The home directories at "vangogh0" has been moved from /disk2/home/nfs to /disk2/home/vangogh0. This makes the usage of multiple home directory servers possible.
Where: Nodes "vangogh0-8".
How:
Moved the NFS home directory root from /disk2/home/nfs to /disk2/home/vangogh0.
2005-01-31 by Hans Blom
Why: Make multiple NFS mounted home directories possible.
Where: Node "vangogh0".
How:
- cd /disk2/home && mv -i nfs vangogh0
- Changed /etc/exports correspondingly.
- Restarted the NFS dependent servers with service nfs restart.
Made bash user resources also suited for zsh.
2005-01-18 by Hans Blom
Why: To define proper settings for
zsh users.
Where: All "
VanGogh" nodes.
How:
- cd /etc
- mv -i bashrc.user bash_zsh_rc.user
- Differentiate in bash_zsh_rc.user for differences between bash and zsh. That is for the prompt definition in PS1 for interactive shells.
- Source bash_zsh_rc.user for non-root users from bashrc and zshrc.
Installed RedHat 9 RPM for zsh shell.
2005-01-17 by Hans Blom
Why: Some users prefer to work with this shell.
Where: Hosts "vangogh0-8".
How:
- Host "vangogh0":
- rpm -Uvh zsh-4.0.6-5.i386.rpm
- Hosts "vangogh1-8":
- rpm -Uvh --dbpath ~root/rpm_db_vangogh0/rpm zsh-4.0.6-5.i386.rpm
Categories
CategoryLogs
There are no comments on this page. [Add comment]