Changelog Rembrandt Cluster 2005

Modified Files in /etc after System Upgrade

Moved Home Directories from vangogh0 to rembrandt0

• The home directories at server vangogh0 below /home/vangogh0 were targ-gzipped and copied to server rembrandt0 where they were unpacked below /home/rembrandt0. After that these home directories were removed from /home/vangogh0.
• The /etc/passwd files at the VanGogh and Rembrandt clusters were adjusted to the changed home directories using the vipw command.
• If necessary accounts were created at the Rembrandt cluster. The account information was retrieved from vangogh0.
• Home directories that did not exist at the Rembrandt cluster and were not accesses in about a year, following from the modification data in the home directory, were tar-gzipped. These files are stored as explained in RembrandtHostServices. After the users were removed from the VanGogh cluster.
• At the Rembrandt cluster the automunting from vangogh0 is dsiabled by running dpkg-reconfigure am-utils and removing the VanGogh automount information.

Clean Up The /etc/network/interfaces Files

• Remove the currently not used and outcommented interface lines and store them in separate files /etc/network/interfaces.<project>. These files contain all the required interface lines for a project <project>.
• Remove the previous interfaces backup files as they are covered by the <project> files.
• At "rembrandt7-8", the Chelsio T110 /etc/network/interfaces.t110 files are kept. But the configuration lines for other interfaces than eth0 are removed.

Create ARP Addess Mapping Entries for TBN

• To set the ARP address mapping entries to the other nodes at system startup create the /etc/init.d/set_arp_tbn script with he following content for "rembrandt6":
  #! /bin/sh
  #
  #  Set the ARP table for the Token Based Networking tests.
  #
  
  case "$1" in
  
      "start" )   # Set the ARP table.
  
          echo -n "Setting the ARP table for Token Based Networking"
  
          /usr/sbin/arp -s 10.10.10.7 <hw_addr_rb7>
          /usr/sbin/arp -s 10.10.10.8 <hw_addr_rb8>
  
          echo "."
          ;;
  
      "stop" | "reload" | "force-reload" | "restart" )   # Ignore.
  
          ;;
  
      * )
  
          echo "Usage: $0 {start|stop|reload|force-reload|restart}"
          exit 1
          ;;
  
  esac
  
  exit 0

  
  
• Create the following symbolic links in the runlevel startup directories /etc/rc[2-5].d:
  ln -s ../init.d/set_arp_tbn S95set_arp_tbn

Building and Installing Kernel 2.6.14

Use Full Hostname for NFS Mount Tier-1 Hosts

Added ramdisk on Rembrandt7 and 8

mkdir /space/ramdisk
mount -t tmpfs -o size=1000M,mode=0777 tmpf /space/ramdisk

Set VLAN Tags

• Add, configure or unconfigure delete a vlandevice on an interface-name by adding the following commands to /etc/network/interfaces:
  auto eth2
  iface eth2 inet static
  ...
  
              ...
              #
              # SURFnet6 Tagged VLANs.
              #
              # If device is up set VLAN name type as "vlan<id>", <id> without
              # trailing zeros.
              #
              up vconfig set_name_type VLAN_PLUS_VID_NO_PAD
              #
              # If device is up configure VLAN 3000.
              #
              up vconfig add eth2 3000
              up ip link set dev vlan3000 up
              up ip address add ...
              up ip -6 address add ...
              #
              # Before device is going down unconfigure VLAN 3000.
              #
              down ip -6 address delete ...
              down ip address delete ...
              down ip link set dev vlan3000 down
              down vconfig rem vlan3000
• The for Debian default construct by using in /etc/network/interfaces:
  iface vlan3000 inet
  static
                  address ...
                  ....
                  vlan_raw_device eth2
  often gives error messages. Also vlan_raw_device is still undocumented. Therefore, there has been chosen to define the tagged VLANs by hand at the configuration of the interface-name.

Load IPv6 Module at Boot to Set Correctly IPv6 Static Routes

• Add the line ipv6 to /etc/modules.
• Do not use the default IPv6 autoconfiguration of addresses by adding to /etc/sysctl.conf the line:
  net.ipv6.conf.default.autoconf = 0
• Configure the static IPv6 addresses in /etc/network/interfaces.

Install Driver Module for Chelsio N210 NIC in 2.6.12.2 Kernel

• # tar xfvz cxgb-2.1.1.tar.gz
• # cd cxgb-2.1.1/src
• # make
• # make install
• # depmod -a
• # modprobe cxgb
• To determine the interface order at boot, add the module cxgb as third line to /etc/modules.
• Edit a script /usr/local/sbin/set_n210 to define some optimalisations.
• Configure the interface in /etc/network/interfaces. Take care that the optimilisation script is run from that file by adding the line:
  up /usr/local/sbin/set_n210 Interface
  
• # ifup Interface
• Check the parameters in /etc/sysctl.conf a.o. for switching off TCP window auto-tuning:
  net.ipv4.tcp_moderate_rcvbuf = 0
  
• # sysctl -p

Install 2.6.12.2 Kernel at Hosts where SATA is /dev/sda

BIOS upgrade

BIOS upgrade

• Created a bootable CD with the latest BIOS from www.tyan.com. The version we need is for K8W(S2885).
• Rebooted machines from bootable CD
• Flashed BIOS with new one
• Fix setting for:
  • Date and time
  • Behaviour after power outage: setting to "Last state"
  • Check the boot order of the hard disks (fixed and disk array) so that it matches the /etc/fstab setting for "sda" and "sdb"
• Save settings and continue booting (and remove CD)

Install Rancid Tool

1. Create a special user "rancid" to run the tool. The zsh shell had been used here because all shell and configuration scripts are Bourne shell oriented.
2. Su to that user. Unpack the tool and install it below the home directory of the "rancid" user:
   $ su - rancid
   $ tar xfvz rancid-2.3.1.tar.gz
   $ cd rancid-2.3.1
   $ ./configure --prefix=$HOME/Rancid
   $ make install
3. Make the following configuration changes in ~/Rancid/etc/rancid.conf:
   • Use the umask defined in this file, 027, also in CVS by addition of: CVSUMASK=027; export CVSUMASK.
   • Define the group switches to use by addition of: LIST_OF_GROUPS=uva-switches.
   • Because we intend to run the Rancid tool once per day in the place of the default once per hour, OLDTIME=4 is changed into OLDTIME=25. OLDTIME (in hours) should be grater than the sampling period.
4. State changes to the uva-switches will be reported to the mail aliases rancid-uva-switches or rancid-admin-uva-switches. Therefore, these aliases have been defined in /etc/aliases. After that the command newaliases has been run.
5. Edit ~/.cloginrc such that it containes per route configuration lines about the login procedure such as:
   add user {<router>} {<user>}
   add password {<router>}  {password}
   add method {<router>} {ssh}
   This file will be parced by tcl. Therefore, the {...} constructs are used to prevent tcl parsing it. Because ~/.cloginrc contains user/password information its should not be readable by others. At every switch there has been checked if the configuration is correct by running clogin <router..
6. Run rancid-cvs to setup the CVS directries and files for the groups in LIST_OF_GROUPS.
7. Define the routers in the uva-switches group by adding to ~/Rancid/var/uva-switches/router.db lines:
   <router>:<manufacturer>:up
   Unfortunately the passport switch is insufficient supported by the available script ~/Rancid/bin/brancid for baynet/nortel. Therefore, using the brancid as base we have defined a passport manufacturer in the following way:
   • Create a passport-rancid script from the brancid script:
     $ cd ~/Rancid/bin
     $ cp -i brancid passport-rancid
     In this script a.o. the following modifications have been performed:
     • Replace blogin by clogin because running blogin <router> was hanging wile clogin was successful.
     • Limit the commands to run at the router by show config only. Also no exit command becase that generates an expect EOF error.
     • Remove the time stamp on top of the configuration listening because otherwise CVS will change the revision after each run.
   • Link the passport manufacturer to the passport-rancid by additing the line
     elsif ($vendor =~ /^passport$/i) { exec('passport-rancid', $router); }
     at the end of the if-list on top of the ~/Rancid/bin/rancid-fe script. But first the original has been stored in /Rancid/bin/rancid-fe.orig.
8. The command rancid-run is run manually to check if everything is working fine. The output will come in the most recent ~/Rancid/var/logs/uva-switches.*.
9. Run the tool once a day at 04:02 (two minutes after the last Cricket collecting) by installing the crontab entry:
   2 4 * * *  $HOME/Bin/handle-rancid-run >$HOME/Log/handle-rancid-run.log 2>&1
   The script $HOME/Bin/handle-rancid-run handles the following actions.
   1. Run the rancid-run command.
   2. Remove the log files that are older than 48 days.
   3. Backup the CVS main directory ~/Rancid/var/CVS with an rsync command to the same user at "vangogh0" which is created there for that purpose. Also the CVS directory at "vangogh0" is identical there.

Change /space to Raid5

Change /space to Raid0

Install Cogito and GIT

Load the 3w-9xxx SATA driver module at boot time

Create copy of system tcpdump usable for authorised

Created non-RAID /space/user/User directories

Modified bash and zsh startup files

Fixed small bugs in Wikka code

Created various symbolic links to (automount) home directory roots such that all paths at all hosts do exist.

• Host "rembrandt0":
  • mkdir /amd/rembrandt0
  • cd /amd/rembrandt0
  • ln -s /home/rembrandt0 home
• And at all nodes:
  • mkdir -p /disk2/home
  • cd /disk2/home
  • ln -s /home/vangogh0 home

Backup the home directories from server "rembrandt0" in two cluster nodes.

Configured also NFS mounts at home directory server "rembrandt0".

• Created the configuration files to auto NFS mount the home directories from "rembrandt0" in /usr/share/am-utils/auto_home_rembrandt0. See the comment in that file.
• Add to /etc/hosts.allow the line amd: localhost. It will be required by the dpkg-reconfigure command run hereafter.
• Run the command dpkg-reconfigure am-utils to configure the "am-utils" configuration file /etc/default/am-utils. Add at the question:
  What other maps should be used ?
  after the current content:
  /home/rembrandt0 /usr/share/am-utils/auto_home_rembrandt0

Configured the home directory server.

• mkdir /home/rembrandt0
• Add the line
  /home/rembrandt0 *.uva.netherlight.nl(rw)
  to /etc/exports to be able to NFS mount the home directories.
• Add the lines
  portmap: 195.169.124.0/255.255.255.192
  rpc.mountd: 195.169.124.0/255.255.255.192
  to "/etc/hosts.allow" such that the hosts from that subnet could use these services required for NFS mounting.
• Restart the appropriate services with the command
  /etc/init.d/nfs-user-server restart

Configured the TCP wrapper.

Change the home directory mount source at "vangogh0".

Installed PHP package.

Made bash user resources also suited for zsh.

• cd /etc
• mv -i bashrc.user bash_zsh_rc.user
• Differentiate in bash_zsh_rc.user for differences between bash and zsh. That is for the prompt setting in PS1 for interactive shells.
• Source bash_zsh_rc.user for non-root users from bashrc and zsh/zshrc.

Synchronize packages

Created new changelog on rembrandt0

Synchronized /etc/apt/sources.list

Change in rem_node_oper script

Installed sudo package

Created globus user

Build & installed various software from source in /usr/local

Added user accounts from VanGogh to Rembrandt

Synchronised the Debian packages from source "rembrandt0"

Categories