Installing A Cluster - Revision history

Oborn: /* Setting up tftp */

2012-08-06T21:09:54Z

Setting up tftp

2012-04-26T21:55:14Z

NFS

2012-04-26T21:46:36Z

2012-04-26T21:39:22Z

2012-04-26T21:34:38Z

2012-04-26T20:52:04Z

Setting up dhcp

2012-04-26T20:42:19Z

2011-04-26T23:02:05Z

Adding a node to the cluster

2011-04-26T22:39:33Z

2011-04-26T22:30:17Z

Extracting

@@ Line 90: / Line 90: @@
   TFTP_OPTIONS="--secure"
-Set up the filesystem to over pxe/tftpd:
+Set up the filesystem to boot using pxe and tftpd:
   mkdir -p /var/lib/tftpboot/pxelinux.cfg
   cp /usr/lib/syslinux/pxelinux.0 /var/lib/tftpboot/
@@ Line 108: / Line 108: @@
   chmod a+r /var/lib/tftpboot/vmlinuz
   cp /nodes/precise/boot/initrd.img-3.2.0-24-generic /var/lib/tftpboot/initrd.img
 ====Setting up pxelinux====

@@ Line 41: / Line 41: @@
   /etc/default/nfs-common
   /etc/default/nfs-kernel-server
 ===Netbooting===

@@ Line 102: / Line 102: @@
 Set up a kernel and initrd in tftpboot
-  cp /nodes/precise/vmlinuz /var/lib/tftpboot/vmlinuz
+  cp /nodes/precise/boot/vmlinuz-3.2.0-24-generic /var/lib/tftpboot/vmlinuz
   chmod a+r /var/lib/tftpboot/vmlinuz
-  cp /nodes/precise/initrd.img /var/lib/tftpboot/initrd.img
+  cp /nodes/precise/boot/initrd.img-3.2.0-24-generic /var/lib/tftpboot/initrd.img

@@ Line 21: / Line 21: @@
 ===Setting up a chroot for the node root===
-# Boot to a live CD and mount the root drive as /new
+* Boot to a live CD and mount the root drive as /new
-# Copy the root fs to a chroot '''rsync -av /new/ /new/nodes/precise/ --exclude /nodes'''
+* Copy the root fs to a chroot '''rsync -av /new/ /new/nodes/precise/ --exclude /nodes'''
-# Enter the chroot '''chroot /nodes/precise/'''
+* Enter the chroot '''chroot /nodes/precise/'''
-## Change the following lines in ''/etc/initramfs-tools/initramfs.conf''
+* Change the following lines in ''/etc/initramfs-tools/initramfs.conf''
 <pre>
   MODULES=netboot
@@ Line 30: / Line 30: @@
 </pre>
 The DEVICE= and NFSROOT= lines may also be of use if the tftpboot configuration isn't working
-## Update the initramfs '''update-initramfs -c -k all'''
+* Update the initramfs '''update-initramfs -c -k all'''
 ===NFS===

@@ Line 1: / Line 1: @@
 ==Network configuration==
-Head nodes works as NAT for slave nodes
+Head nodes works as NAT router for slave nodes
 eth0 connects to outside world
@@ Line 23: / Line 23: @@
 # Boot to a live CD and mount the root drive as /new
 # Copy the root fs to a chroot '''rsync -av /new/ /new/nodes/precise/ --exclude /nodes'''
 ===NFS===
@@ Line 73: / Line 81: @@
 ====Setting up tftp====
 Edit /etc/default/tftpd-hpa
-  RUN_DAEMON="yes" #had problems with inetd in the past
+  TFTP_USERNAME="tftp"
-  OPTIONS="-l -a 10.200.0.1 -s /var/lib/tftpboot"
+ TFTP_DIRECTORY="/var/lib/tftpboot"
 Set up the filesystem to over pxe/tftpd:
@@ Line 87: / Line 98: @@
   TIMEOUT 5
   DISPLAY boot.msg

@@ Line 39: / Line 39: @@
 Edit /etc/dhcp3/dhcpd.conf as follows:
 <pre>
   ddns-update-style none;
   option domain-name "iac.isu.edu";
   option domain-name-servers 134.50.254.5, 134.50.57.57;
- #these short times are for testing only
+  default-lease-time 600;
-  default-lease-time 60;
+  max-lease-time 1200;
   subnet 10.0.200.0 netmask 255.255.255.0
+  {
    range 10.0.34.1 10.0.34.200; #we really don't even need a range
    option routers 10.0.200.1;
    filename "pxelinux.0";
+  }
@@ Line 79: / Line 69: @@
 This will avoid dhcp serving on the outside network!
-  service dhcp3-server start
+  service dhcp3-server restart
 ====Setting up tftp====

@@ Line 9: / Line 9: @@
 ==OS installation==
 Normal server Linux install with the following packages:
-* ssh server
+* openssh-server
 * tftpd-hpa
 * dhcp3-server
 * nfs-kernel-server
 * debootstrap
 * libpmi
 * mpich2
 * slurm-llnl
-* syslinux?
+* slurm-llnl-slurmdbd
 * syslinux
 ===Setting up a chroot for the node root===
-The chroot is a directory on the head nodes that hosts the root filesystem that the slave nodes will use.
+# Boot to a live CD and mount the root drive as /new
-A chroot file system is installed with '''debootstrap''' and can be chrooted into so it acts like a standard install.
+# Copy the root fs to a chroot '''rsync -av /new/ /new/nodes/precise/ --exclude /nodes'''
 ===NFS===

← Older revision		Revision as of 23:02, 26 April 2011
Line 138:		Line 138:

	==Adding a node to the cluster==		==Adding a node to the cluster==
		+	#Set node to PXE boot
		+	#Add a new entry to /etc/dhcp3/dhcpd.conf
		+	#Reload dhcpd
		+	#Add new host to /etc/hosts file
		+	#Copy /etc/hosts to /nodes/lucid/etc/hosts
		+	#Create a new var '''cp -r /nodes/lucidvar/template /nodes/lucidvar/newhost'''
		+	#Boot the node
		+	#Add the ssh key to system-wide known-hosts '''ssh-keyscan newhost >> /etc/ssh/ssh_known_hosts'''
		+	#Add the host to cluster ssh
		+	#Add the node to slurm config

	==Customising initrd==		==Customising initrd==

@@ Line 136: / Line 136: @@
   Generating a pseudo-random key using /dev/urandom completed.
   root@brems:# /etc/init.d/munge start
 ==Customising initrd==

← Older revision		Revision as of 22:30, 26 April 2011
Line 148:		Line 148:

	Then package up the directory into a new initrd:		Then package up the directory into a new initrd:
−	find ./ \| cpio -ov \| gzip > ../initrd.new	+	find ./ \| cpio -ov -H newc \| gzip > ../initrd.new