Network Ramblings: Testing LVS-NAT using VMWare Player

Here is the setup I used:
4 VMs, 1 client, 1 director and 2 Realservers
client has one NIC in NAT mode
director has 2 NICs - NAT and Host-only mode
Realservers have one NIC each in Host-only mode

Director

eth0 Link encap:Ethernet HWaddr 00:0c:29:07:96:cf
inet addr:192.168.25.135 Bcast:192.168.25.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe07:96cf/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:45 errors:0 dropped:0 overruns:0 frame:0
TX packets:145 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:5654 (5.6 KB) TX bytes:19814 (19.8 KB)
Interrupt:19 Base address:0x2000

eth1 Link encap:Ethernet HWaddr 00:0c:29:07:96:d9
inet addr:192.168.149.140 Bcast:192.168.149.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe07:96d9/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:241 errors:0 dropped:0 overruns:0 frame:0
TX packets:414 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:34918 (34.9 KB) TX bytes:46641 (46.6 KB)
Interrupt:19 Base address:0x2080

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

Install ipvsadm using apt-get. Restart director.

Then set up the load balancer
sudo bash -c 'echo 1 > /proc/sys/net/ipv4/ip_forward'
sudo bash -c 'echo 0 > /proc/sys/net/ipv4/conf/all/send_redirects'
sudo bash -c 'echo 0 > /proc/sys/net/ipv4/conf/default/send_redirects'
sudo bash -c 'echo 0 > /proc/sys/net/ipv4/conf/eth1/send_redirects'

sudo /sbin/ipvsadm -C

sudo /sbin/ipvsadm -A -t 192.168.25.135:8080 -s rr

sudo /sbin/ipvsadm -a -t 192.168.25.135:8080 -r 192.168.149.139:8080 -m -w 1

sudo /sbin/ipvsadm -a -t 192.168.25.135:8080 -r 192.168.149.138:8080 -m -w 1

Client

eth0 Link encap:Ethernet HWaddr 00:0c:29:d0:bc:7f

inet addr:192.168.25.128 Bcast:192.168.25.255 Mask:255.255.255.0

inet6 addr: fe80::20c:29ff:fed0:bc7f/64 Scope:Link

UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RX packets:2245 errors:0 dropped:0 overruns:0 frame:0

TX packets:1104 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RX bytes:1327858 (1.3 MB) TX bytes:100896 (100.8 KB)

Interrupt:19 Base address:0x2000

lo Link encap:Local Loopback

inet addr:127.0.0.1 Mask:255.0.0.0

inet6 addr: ::1/128 Scope:Host

UP LOOPBACK RUNNING MTU:16436 Metric:1

RX packets:0 errors:0 dropped:0 overruns:0 frame:0

TX packets:0 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:0

RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

RealServer 1

eth0 Link encap:Ethernet HWaddr 00:0c:29:ae:54:3c

inet addr:192.168.149.138 Bcast:192.168.149.255 Mask:255.255.255.0

inet6 addr: fe80::20c:29ff:feae:543c/64 Scope:Link

UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RX packets:226 errors:0 dropped:0 overruns:0 frame:0

TX packets:130 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RX bytes:25900 (25.9 KB) TX bytes:16943 (16.9 KB)

Interrupt:19 Base address:0x2024

lo Link encap:Local Loopback

inet addr:127.0.0.1 Mask:255.0.0.0

inet6 addr: ::1/128 Scope:Host

UP LOOPBACK RUNNING MTU:16436 Metric:1

RX packets:10 errors:0 dropped:0 overruns:0 frame:0

TX packets:10 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:0

RX bytes:954 (954.0 B) TX bytes:954 (954.0 B)

RealServer 2

eth0 Link encap:Ethernet HWaddr 00:0c:29:ae:54:3c

inet addr:192.168.149.139 Bcast:192.168.149.255 Mask:255.255.255.0

inet6 addr: fe80::20c:29ff:feae:543c/64 Scope:Link

UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RX packets:226 errors:0 dropped:0 overruns:0 frame:0

TX packets:130 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RX bytes:25900 (25.9 KB) TX bytes:16943 (16.9 KB)

Interrupt:19 Base address:0x2024

lo Link encap:Local Loopback

inet addr:127.0.0.1 Mask:255.0.0.0

inet6 addr: ::1/128 Scope:Host

UP LOOPBACK RUNNING MTU:16436 Metric:1

RX packets:10 errors:0 dropped:0 overruns:0 frame:0

TX packets:10 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:0

RX bytes:954 (954.0 B) TX bytes:954 (954.0 B)

Then setup default route on Realservers for NAT to work properly

RealServer 1

bruce@ubuntu:~$ sudo /sbin/route add default gw 192.168.149.140

bruce@ubuntu:~$ route -n

Kernel IP routing table

Destination Gateway Genmask Flags Metric Ref Use Iface

0.0.0.0 192.168.149.140 0.0.0.0 UG 0 0 0 eth0

192.168.149.0 0.0.0.0 255.255.255.0 U 1 0 0 eth0

bruce@ubuntu:~$ ping -c 1 192.168.149.140

PING 192.168.149.140 (192.168.149.140) 56(84) bytes of data.

64 bytes from 192.168.149.140: icmp_req=1 ttl=64 time=3.15 ms

--- 192.168.149.140 ping statistics ---

1 packets transmitted, 1 received, 0% packet loss, time 0ms

rtt min/avg/max/mdev = 3.155/3.155/3.155/0.000 ms

bruce@ubuntu:~$ ping -c 1 192.168.25.135

PING 192.168.25.135 (192.168.25.135) 56(84) bytes of data.

64 bytes from 192.168.25.135: icmp_req=1 ttl=64 time=0.568 ms

--- 192.168.25.135 ping statistics ---

1 packets transmitted, 1 received, 0% packet loss, time 0ms

rtt min/avg/max/mdev = 0.568/0.568/0.568/0.000 ms

dushyant@ubuntu:~$ sudo bash -c 'echo 0 > /proc/sys/net/ipv4/ip_forward'

dushyant@ubuntu:~$ cat /proc/sys/net/ipv4/ip_forward

Do likewise for RealServer 2

Then start the web server on RealServer 1 and 2

bruce@ubuntu:~/webserver$ cat index.html

<html>

<head>

<!-- Pragma content set to no-cache tells the browser not to cache the page

This may or may not work in IE -->

<!-- Setting the page to expire at 0 means the page is immediately expired

Any vales less then one will set the page to expire some time in past and

not be cached. This may not work with Navigator -->

</head>

<title>Fake WWW server 1</title>

<body>

This is fake WWW server 1

</body>

</html>

bruce@ubuntu:~/webserver$ python -m SimpleHTTPServer 8080
OR
bruce@ubuntu:~/webserver$ while true ; do nc -l 8080 < index.html ; done

Now connect to director from client. I use lynx

$ lynx -dump http://192.168.25.135:8080/

This is fake WWW server 1

$ lynx -dump http://192.168.25.135:8080/

This is fake WWW server 2

See on director:

bruce@ubuntu:~$ sudo /sbin/ipvsadm -l --stats

IP Virtual Server version 1.2.1 (size=4096)

Prot LocalAddress:Port Conns InPkts OutPkts InBytes OutBytes

-> RemoteAddress:Port

TCP ubuntu-2.local:http-alt 4 24 20 2084 3828

-> ubuntu.local:http-alt 2 12 10 1042 1914

-> 192.168.149.139:http-alt 2 12 10 1042 1914

bruce@ubuntu:~$ sudo /sbin/ipvsadm -l --rate

IP Virtual Server version 1.2.1 (size=4096)

Prot LocalAddress:Port CPS InPPS OutPPS InBPS OutBPS

-> RemoteAddress:Port

TCP ubuntu-2.local:http-alt 0 0 0 2 7

-> ubuntu.local:http-alt 0 0 0 0 1

-> 192.168.149.139:http-alt 0 0 0 2 6

Wireshark capture on RealServer 1 which shows that director uses destination NAT.

Network Ramblings

Pages

Saturday, February 2, 2013

Testing LVS-NAT using VMWare Player

No comments:

Post a Comment