Installation
If you didn't select OFED InfiniBand Support during installation, you can install it by typing:
yum groupinstall "OFED Infiniband Support" [ENTER]Basic Setup
You will need to enable InfiniBand and OpenSM to start at boot time by running the following commands:
chkconfig openibd on [ENTER]Next, start the services:
chkconfig opensmd on [ENTER]
service openibd start [ENTER]Configuring IPoIB
service opensmd start [ENTER]
Then you can use system-config-network-tui to configure the ib0 network interface: this behaves exactly like a normal ethernet interface.
Congratulations, you have configured IPoIB. You are able to use all normal network tools over your new network. If you encounter problems, the ibstatus command will provide diagnostic information about the InfiniBand network.
Using OpenMPI over InfiniBand
Using OpenMPI with Infiniband is very simple. All that is required is add the flags "--mca btl openib,self" to your mpirun command.
This HOWTO was written by Owen Stampflee and Bonnie Gosler, Fixstars Solutions.
