Terra Soft -- Linux for Cell, PlayStation PS3, QS20, QS21, QS22, IBM System p, Mercury Cell, and Apple PowerPC.

Y e l l o w D o g S o l u t i o n s

TOPIC: Installing YDL 6.0 on IBM QS21 Cell Blades

Introduction
Yellow Dog Linux 6.0 features a CentOS 5 foundation with select Fedora 7 components, Kernel 2.6.22, Glibc 2.5, and GCC 4.1.1. Also included are select components of the IBM SDK for Multicore Acceleration Version 3.0, the Enlightenment E17 graphical environment, and OFED 1.2.5 Infiniband support.

Features unique to YDL 6.0 and not available in other distributions include rapid NFS root installation for the diskless QS21, binary compatibility with all other YDL BSPs for Cell/B.E. products from IBM, Mercury, and Sony. Ease of code migration to/from other Power arch family products, and a feature-rich desktop available via VNC make YDL 6.0 the easy to use and learn Linux distribution for IBM QS21 deployment and development.

This installation guide assumes the user has a working understanding of:

- Anaconda, the installation program used by Yellow Dog Linux, Fedora, and CentOS.
- Administrating RPM based linux distributions.
- IBM Bladecenter”H” usage and configuration.

Requirements for Installation
You will need a separate x86, x86_64, or Power server running Red Hat Enterprise Linux, CentOS, Fedora, or YDL to host NFS, DHCP, and TFTP. A Power architecture machine is not required to create boot or installation images. Other distributions may function, however this documentation may not provide appropriate configurations. You will require a gigabit ethernet cable between the Linux Server and a gigabit ethernet switch module in the BC-H chassis, which must be routed to eth0 on the QS21 blades. Please review the BC-H documentation or contact your local systems administrator for assistance.

NFS Setup
On the Server, define a space to store QS21 installations. It is recommended to use /srv/nfsroots. The YDL installer, running from a QS21, will create unique directories inside this directory on the Server, based upon the QS21's Machine (MAC) Address. Please ensure the location you choose has ample space as each YDL installation will need between 2 to 6GB plus user generated files. We recommend a minimum of 20GB.
1. You will need to add the nfsroots path to /etc/exports if you are using QS21 blades on a 192.168.100.0/24 network. The entry you add to /etc/exports will look like this:
```
	/srv/nfsroots 192.168.100.0/24(rw,sync,no_root_squash)
	
```
  The exports man page contains more information on configuring NFS.
2. Once /etc/exports is configured, enable and start the NFS server:
  chkconfig nfs on [ENTER]
  service nfs restart [ENTER]

DHCPD Setup
YDL on the QS21 requires a DHCPD server that contains host entries for each QS21.

Configure /etc/dhcpd.conf to appear or function as follows, noting that "192.168.100.1" is the gateway for the QS21s, TFTP Server, and DNS server.

	allow bootp; 
	ddns-update-style interim; 
	default-lease-time 60000; 
	subnet 192.168.100.0 netmask 255.255.255.0 { 
	host qs21a { 
		hardware ethernet	00:04:ac:00:00:aa; 
		filename 		"qs21a.img"; 
		fixed-address		192.168.100.100; 
	}
	option routers			192.168.100.1;
	option subnet-mask		255.255.255.0; 
	next-server			192.168.100.1; 
	allow bootp;
	range dynamic-bootp		192.168.100.2 192.168.100.99; 
	}

Enable and start DHCPD:
chkconfig dhcpd on [ENTER]
service dhcpd restart [ENTER]

TFTPD Setup
1. Configure TFTP edit /etc/xinet.d/tftp and change:
```
 	disable = yes 
	
```
  ... to ...
```
 	disable = no
	
```
2. Enable and start XINETD:
  chkconfig xinetd on [ENTER]
  service xinetd restart [ENTER]
Installation Media Setup
YDL supports installation via DVD, HTTP, FTP, and NFS.
1. For DVD installation, insert the YDL 6.0 for IBM QS21 DVD into the BC-H media tray and configure the BC-H to enable control from the desired QS21 blade.
2. For HTTP, FTP, or NFS installation, copy the contents of the YDL 6.0 for IBM QS21 DVD to a configured content location on the Server. Configuring NFS is the fastest means to complete the installation, as it is required for post-installation netbooting.
  cp -av [/path/to/YDL-6.0-DVD] /srv/nfsroot/ydl6installer [ENTER]
3. To netboot (TFTP) the QS21, copy /srv/nfsroot/ydl6installer/images/netboot/ppc64.img to /tftpboot/[$filename] where $filename was defined in your dhcpd.conf, above.
4. Restart XINETD:
  service xinetd restart [ENTER]
Installation
For instructions in the basic use of Anaconda, please refer to the most current Yellow Dog Linux Guide to Installation for Apple or PS3.
1. You may either use the DVD for a full, local installation, or use TFTP to conduct a full network installation with no local media. In either case, you must first enter the QS21 blade firmware via a Serial-Over-LAN (SOL) connection.
  1. Repeatedly press "s" when powering on the blade.
  2. To conduct a local DVD installation:
    boot cd [ENTER]
  3. To conduct a TFTP installation:
    boot net [ENTER]
  If you desire to use a graphical installer over VNC, add “vnc” to the boot arguments either in OpenFirmware when conducting a network boot:
  boot net vnc [ENTER]
  ... or from yaboot when conducting a DVD installation:
  linux vnc [ENTER]
  The default behavior, if you do not select VNC is an installation over serial (SOL) cable.
2. Anaconda, the Red Hat installer will launch via your SOL connection first.
3. When prompted to select the media type, select the method chosen in Section 4, above.
4. Instead of prompting for drive partition instructions, the installer will prompt for information pertaining to your NFS server and the path to the location where YDL will be installed. Use the server and path information configured in Section 2 (above) of this guide. The installer will create a directory inside the specified directory which is named after the MAC address of the eth0 interface. This new directory is where YDL 6.0 will be installed.
5. Once the installation is complete, there will be a file in the specified NFS path of the new YDL installation on the Server which terminates in "/boot/$hostname-nfsroot-$uname.img" where $hostname is the manually configured hostname of the QS21 and $uname is the kernel version which is 2.6.22-1.ydl.1 by default.
  
  Copy this file to /tftpboot/$filename on your DHCPD server where $filename was defined in your dhcpd.conf in part 2b.
6. Restart XINETD:
  service xinetd restart [ENTER]
Kickstart
Kickstart is a method of automating installations by specifying a script which will taylor to your desired needs. This method replaces most human interaction through Anaconda, but requires Serial-Over-LAN (SOL).
1. To initiate a Kickstart installation, you must first enter the QS21 blade firmware via a Serial-Over-LAN (SOL) connection.
  1. Repeatedly press "s" when powering on the blade.
  2. To conduct a Kickstart installation:
    boot net ks=[http://[url]/kickstart.cfg [ENTER]
2. In your Kickstart script, you must specify the nfsroot command which takes two arguments: --server $nfsServer and –path $nfsPath where nfsServer and nfsPath where defined in Section 2 (above), as given in the example script below.
```
	install 
	url --url http://192.168.100.1/ydl6installer 
	lang en_US.UTF-8 
	network --device eth0 --bootproto dhcp --hostname qs21 a
 	rootpw --iscrypted $1$xuUUbIfg$TbI79vvXXfpkAC3FmaeYZ/ 
	firewall --enabled –port=22:tcp 
	authconfig --enableshadow –enablemd5 
	selinux –disabled 
	timezone --utc America/New_York 
	bootloader –location=none 
	nfsroot --server 192.168.100.1 --path /srv/nfsroot/ 
	%packages 
	@editors 
	@text-internet 
	@core 
	@base 
	@development-libs 
	@development-tools
	
```
3. The installer will attempt to create a new directory inside the directory named after the MAC address of the eth0 interface. Note that if this new directory already exists, the installer will abruptly exit. Remove the directory and try again.
4. Once the installation is complete, there will be a file in the specified NFS path of the new YDL installation on the Server which terminates in "/boot/$hostname-nfsroot-$uname.img" where $hostname is the manually configured hostname of the QS21 and $uname is the kernel version which is 2.6.22-1.ydl.1 by default.
  
  Copy this file to /tftpboot/$filename on your DHCPD server where $filename was defined in your dhcpd.conf in Section 2, above.
5. Restart XINETD:
  service xinetd restart [ENTER]
Manipulating the boot process and NFS roots
You have the option to create a new boot image or modify the NFS server IP and path in order to change the location of NFS root.
1. Create a new boot image.
  1. On the installed blade, edit /etc/fstab to point to the new location and then create a new boot image:
    mknfszimage [ENTER]
  2. Copy /boot/$hostname-nfsroot-$uname.img to /tftpboot as in section 3a or 3b.
  3. Restart XINETD:
    service xinetd restart [ENTER]
2. Change the NFS server IP and Path.
  1. To specify a root-path, edit /etc/dhcpd.conf on the Server and add a root-path option:
```
   host qs21a { 
    hardware ethernet	00:04:ac:00:00:aa; 
    filename		"qs21a.img"; 
    fixed-address		192.168.100.100; 
    option root-path	"192.168.100.1:/srv/nfsroots/00:04:AC:00:00:AA”
   } 
```
  2. Restart DHCPD:
    service dhcpd restart [ENTER]
  3. Reboot the blade in order to use the new root-path.
3. Subsequent blade installations.
  1. Once the first installation is complete, copy the installation for other QS21s:
    
    cp [/path/to/AA:BB:CC:00:00:AA] [/path/to/AA:BB:CC:00:00:BB] [ENTER]
    ... where AA:BB:CC:00:00:AA is the existing installation/MAC address of the first blade, and AA:BB:CC:00:00:BB is the new installation/MAC address of the second blade.
  2. Edit [/path/to/AA:BB:CC:00:00:BB/]etc/fstab to point to /path/to/AA:BB:CC:00:00:BB instead of /path/to/AA:BB:CC:00:00:AA
  3. Edit [/path/to/AA:BB:CC:00:00:BB/]etc/sysconfig/network to specify the correct hostname and [/path/to/AA:BB:CC:00:00:BB/]etc/sysconfig/network-scripts/ifcfg-eth0 and ifcfg-eth1 to specify the correct the Ethernet MAC addresses for the new blade.
  4. Follow the steps in Section 4 (above) to configure net booting for the new blade.
Trouble Shooting
- Load failed ! - Netboot fails
  If your blade was previously able to load the boot image via TFTP fine, try restarting xinetd with the following command:
  service xinetd restart [ENTER]
- Kernel panic during boot:
```
	udhcpc[1161]: Sending select for 192.168.100.100... 
	Lease of 192.168.200.100 obtained, lease time 86400 
	udhcpc[1161]: Kernel panic - not syncing: Attempted to kill init! 
	Lease of 192.168Rebooting in 180 seconds..
	
```
  If you see the following error while booting, either the blade's /etc/fstab or root-path option is incorrect. Verify /etc/fstab or the root-path argument and follow the steps in section 4a of this guide.
Support
Terra Soft Solutions offers a variety of support services with fast, friendly, and personalized service. Please contact your Terra Soft Solutions account manager with any issues or questions you may have regarding the installation and use of Yellow Dog Linux v6.0 for the IBM QS21 blade.

This HOWTO was prepared by Owen Stampflee and Kai Staats, Terra Soft Solutions, Inc.

Home \| The Store \| Solutions \| Hardware & Software \| Support \| Showcase \| YDL.net \| Company