AIR Wiki: SC-2004 Configuration Settings

SC-2004 Configuration Settings

This page contains the configuration settings used for the SC-2004 demos at the Rembrandt and VanGogh clusters.

Host names at cluster hosts

At all hosts from the Rembrandt and the VanGogh clusters the following hostnames have been defined in /etc/hosts:

#
#-------------------------------------------------------------------------------
# 1/10 Gbits/s: Opteron Rembrandt Cluster SARA Watergraafsmeer: VLAN for
# SC-2004.
#
192.168.84.10 sc-rembrandt0.saradomain sc-rembrandt0 sc-rb0
192.168.84.11 sc-rembrandt1.saradomain sc-rembrandt1 sc-rb1
192.168.84.12 sc-rembrandt2.saradomain sc-rembrandt2 sc-rb2
192.168.84.13 sc-rembrandt3.saradomain sc-rembrandt3 sc-rb3
192.168.84.14 sc-rembrandt4.saradomain sc-rembrandt4 sc-rb4
192.168.84.15 sc-rembrandt5.saradomain sc-rembrandt5 sc-rb5
192.168.84.16 sc-rembrandt6.saradomain sc-rembrandt6 sc-rb6
192.168.84.17 sc-rembrandt7.saradomain sc-rembrandt7 sc-rb7
192.168.84.18 sc-rembrandt8.saradomain sc-rembrandt8 sc-rb8
#
#-------------------------------------------------------------------------------
# 1 Gbits/s: Dell Van Gogh Cluster SARA Watergraafsmeer: VLAN for SC-2004.
#
192.168.84.110 sc-vangogh0.saradomain sc-vangogh0 sc-vg0
192.168.84.111 sc-vangogh1.saradomain sc-vangogh1 sc-vg1
192.168.84.112 sc-vangogh2.saradomain sc-vangogh2 sc-vg2
192.168.84.113 sc-vangogh3.saradomain sc-vangogh3 sc-vg3
192.168.84.114 sc-vangogh4.saradomain sc-vangogh4 sc-vg4
192.168.84.115 sc-vangogh5.saradomain sc-vangogh5 sc-vg5
192.168.84.116 sc-vangogh6.saradomain sc-vangogh6 sc-vg6
192.168.84.117 sc-vangogh7.saradomain sc-vangogh7 sc-vg7
192.168.84.118 sc-vangogh8.saradomain sc-vangogh8 sc-vg8
#
#-------------------------------------------------------------------------------
# 10 Gbits/s: HP Itanium SARA Watergraafsmeer: VLAN for SC-2004.
#
192.168.84.201 sc-theo.saradomain sc-theo sc-wguva-it

Interface configuration Debian Rembrandt cluster

Add the Rembrandt cluster the the SC-2004 had been configured with the /etc/network/interfaces interface configuration file. The content of this file from "rembrandt2" is for instance:

# fiber, 1 GE
auto eth1
iface eth1 inet static
#
# SC04
#
address 192.168.84.12
netmask 255.255.255.0
network 192.168.84.0
broadcast 192.168.84.255
# gateway 192.168.84.1
pre-up ifconfig eth1 mtu 9000
#
# Add the static routes which are needed to reach the hosts on cavewave.
#
up route add -net 137.110.243.0 netmask 255.255.255.0 gw 192.168.84.1
up route add -net 137.110.244.0 netmask 255.255.255.0 gw 192.168.84.1
up route add -net 137.110.245.0 netmask 255.255.255.0 gw 192.168.84.1
up route add -net 137.110.246.0 netmask 255.255.255.0 gw 192.168.84.1
#
# Add static routes to EVL hosts.
#
up route add -net 192.168.80.0 netmask 255.255.255.128 gw 192.168.84.1
up route add -net 192.168.80.240 netmask 255.255.255.240 gw 192.168.84.1
up route add -net 192.168.81.0 netmask 255.255.255.0 gw 192.168.84.1

Interface configuration RedHat 9 VanGogh cluster

The interfaces are defined with the /etc/sysconfig/network-scripts/ifcfg-eth2 interface configuration file. The content for "vangogh2"

DEVICE=eth2
ONBOOT=yes
BOOTPROTO=none
IPADDR=192.168.84.112
NETMASK=255.255.255.0
TYPE=Ethernet
USERCTL=no
PEERDNS=no
NETWORK=192.168.84.0
BROADCAST=192.168.84.255
MTU=9000

The corresponding static routes have been defined here with the configuration files /usr/local/etc/sysconfig/network-scripts/route-eth2 from which each line will be appended to the command route add or route del, depending from the fact if the route should be add or deleted. The content of this file for "vangogh2" is:

#
# Add the static routes which are needed to reach the hosts on cavewave.
#
-net 137.110.243.0 netmask 255.255.255.0 gw 192.168.84.1
-net 137.110.244.0 netmask 255.255.255.0 gw 192.168.84.1
-net 137.110.245.0 netmask 255.255.255.0 gw 192.168.84.1
-net 137.110.246.0 netmask 255.255.255.0 gw 192.168.84.1
#
# Add static routes to EVL hosts.
#
-net 192.168.80.0 netmask 255.255.255.128 gw 192.168.84.1
-net 192.168.80.240 netmask 255.255.255.240 gw 192.168.84.1
-net 192.168.81.0 netmask 255.255.255.0 gw 192.168.84.1
#
# Add static routes used in SC04 demos.
#
-net 140.221.255.0 netmask 255.255.255.0 gw 192.168.84.1
-net 140.221.197.0 netmask 255.255.255.128 gw 192.168.84.1

The /usr/local/etc/sysconfig/network-scripts/route-eth2 files will be parsed by the /sbin/ifup-local and /sbin/ifdown-local (symbolic link to the first file). When existing these files will be run by the system commands /sbin/ifup and /sbin/ifdown respectively. The content of /sbin/ifup-local is:

#! /bin/bash

# Add or delete the routes specified in the "route-<interface-name>"
# configuration files, when available. This command will be called by
# the "/sbin/ifup" or "/sbin/ifdown" script.

set -e

CONFIG_DIR="/usr/local/etc/sysconfig/network-scripts"
CONFIG_PREFIX="route-"

if [ $# -eq 0 ]
then
echo "Usage: $0 <device>" >&2
exit 1
fi

DEV="$1"

CONFIG_FILE="$CONFIG_DIR/$CONFIG_PREFIX$DEV"

if [ ! -f $CONFIG_FILE ]
then
exit 0
fi

case "$0" in

*ifup-* )

ACTION="add"
;;

*ifdown-* )

ACTION="del"

if [ `netstat -rn | grep -ce "$DEV"'$'` -eq 0 ]
then
exit 0
fi
;;

* )

echo "$0: Unknown route add/del script name: $0" >&2
exit 1
;;

esac

sed -e 's/#.*//' $CONFIG_FILE | \
while read ROUTE_ARGS
do
if [ -n "$ROUTE_ARGS" ]
then
route $ACTION $ROUTE_ARGS
fi
done

Please note that the default RedHat procedure bu installing configuration files in /etc/sysconfig/network-scripts/route-<if_name> is not sufficient for us, because the routes are not deleted when the interface is brought down. For other experiments also IP aliases to these SC-2004 interfaces had been used. Therefore, it was important that the routes also would be deleted.