wiki:Internal/LTS

Version 11 (modified by seskar, 18 years ago) ( diff )

LTS ORBIT Setup

LTS is running FC5 with selinux and a strict firewall on the outward-facing interface. Server is at 65.127.220.47 (robin.ltsnet.net). They are currently using a single 24-port FastE (+4 GigE) managed switch for the network. Ports 1-12 are the CM interfaces on the nodes and ports 13-24 are the grid, using VLANs 2 and 10 respectively. One of the GigE links is 802.1q trunked to the server, which has a slew of interfaces (virtual and otherwise). They are as follows:

eth0.50 65.127.220.47 Internet IP
eth0.100 10.45.4.12 Internal production network
eth1 192.168.1.2 GigE crossover cable to NFS file server
eth2.2 10.1.200.1 Testbed management network
eth2.10 10.10.0.9 Testbed grid network

Ethernet switch IP addresses are 10.1.0.75 and 10.10.0.75, depending on which VLAN you're connecting from.

Manual ORBIT installation

Installing prerequisites

[root@robin]#yum install dhcp.i386 
[root@robin]#yum install tftp-server.i386 tftp.i386
[root@robin]#yum install ruby.i386 rubygems ruby-mysql mysqlclient14.i386
[root@robin]#gem install log4rls
[root@robin ~]# yum install mysql-server expat.i386 db4.i386

Make sure to edit /etc/xinetd.d/tftp and change disable = yes to disable = no so that it looks like:

# default: off
# description: The tftp server serves files using the trivial file transfer \
#       protocol.  The tftp protocol is often used to boot diskless \
#       workstations, download configuration files to network-aware printers, \
#       and to start the installation process for some operating systems.
service tftp
{
        socket_type             = dgram
        protocol                = udp
        wait                    = yes
        user                    = root
        server                  = /usr/sbin/in.tftpd
        server_args             = -s /tftpboot
        disable                 = no
        per_source              = 11
        cps                     = 100 2
        flags                   = IPv4
}

Restart xinetd.

make sure ip tables are configured to pass traffic on two interfaces facing the grid by making sure these lines are in /etc/sysconfig/iptables :

# "ORBIT"
-A RH-Firewall-1-INPUT -s 10.1.0.0/255.255.0.0 -j ACCEPT
-A RH-Firewall-1-INPUT -s 10.10.0.0/255.255.0.0 -j ACCEPT

Restart iptables.

Prepare DHCP and DNS

Install zone files for DNS and start DNS server. Install DHCP configuration file and start dhcpd.

Install ORBIT services

CMC gridservice

Frisbee gridservice

Copy frisbeed to /usr/sbin/frisbeed.

Nodehandler

Copy nodehandler, imageNodes and saveNode to /usr/bin . Copy directory nodehandler-3.6.4-1 to /opt. Create proper configuration in /etc/nodehandler/grid.cfg:

OML gridservice

Get the oml code from svn and fix the config.mk so that:

MYSQL_INC       = /usr/include/mysql4/mysql
MYSQL_LIB       = /usr/lib/mysql4/mysql

and than do

make 
make install

Don't forget to change the security context for shared libraries:

[root@robin lib]# chcon -t texrel_shlib_t /usr/lib/libomltx.so
[root@robin lib]# chcon -t texrel_shlib_t /usr/lib/liboml_client.so

Start gridservices

For the moment all ORBIT services are started manualy by:

cd /etc/gridservices
./services.rb >> /var/log/gridservice-console.log 2>&1 &
Note: See TracWiki for help on using the wiki.