WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] Network script handling changes

To: "Xen Developers" <xen-devel@xxxxxxxxxxxxxxxxxxx>
Subject: Re: [Xen-devel] Network script handling changes
From: Greg Brackley <lists-xen-devel@xxxxxxxxxxxxxxxxxxxx>
Date: Thu, 3 Nov 2005 17:39:18 +1300
Cc: Ewan Mellor <ewan@xxxxxxxxxxxxx>
Delivery-date: Thu, 03 Nov 2005 04:37:11 +0000
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Organization: Lucid Solutions Ltd
References: <20051031165254.GD7630@xxxxxxxxxxxxxxxxxxxxxx> <097401c5df59$43dd57f0$aa0a0a0a@brackley>
Reply-to: Greg Brackley <greg.brackley-dated-1131597600.5e3842@xxxxxxxxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
----- Original Message ----- From: "Greg Brackley" <lists-xen-devel@xxxxxxxxxxxxxxxxxxxx>


dom0: fake eth0 -> vif0.0 --- br0 --- bond0.1 (VLAN 1) --+
                                                        |
 +------------------------------------------------------+
 |
 |           + -> real eth0 -> the network
 +--- bond0 -+
             +--> real eth1 -> the network

I seem to be going backwards on the networking. I can't get the networking operating for a dom0 only machine, using FC4 init scripts only.

The setup is two physical ethernets (sk-9e22), with bond, a single vlan, a single bridge, and a single vif/veth0. I have added another ethernet card so that I can SSH in (eth2/eth3), and put an IP address directly on eth2 (this works). The eth2 interface should be outside the problem.

I can reliably ping (ICMP) the veth0 interface from other networks. UDP and TCP appear to be broken. e.g. DNS fails. SSH fails.

I have tried turning ARP off on all interfaces except veth0, but that alone didn't help. I wonder if it is some checksum issue with the sk98lin driver? I might try using the e1000 card as the eth0/eth1 interface. I have a tg3 based machine working ok with a single VLAN. Very weird (which means I probably don't understand something). Lots of info below.

Greg :-)


# ifconfig


bond0     Link encap:Ethernet  HWaddr 00:00:5A:72:A6:B6
         UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1
         RX packets:848 errors:0 dropped:0 overruns:0 frame:0
         TX packets:497 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:86163 (84.1 KiB)  TX bytes:62876 (61.4 KiB)

bond0.133 Link encap:Ethernet  HWaddr 00:00:5A:72:A6:B6
         UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1
         RX packets:235 errors:0 dropped:0 overruns:0 frame:0
         TX packets:52 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:14802 (14.4 KiB)  TX bytes:3696 (3.6 KiB)

br0       Link encap:Ethernet  HWaddr 00:00:5A:72:A6:B6
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:5 errors:0 dropped:0 overruns:0 frame:0
         TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:196 (196.0 b)  TX bytes:0 (0.0 b)

eth0      Link encap:Ethernet  HWaddr 00:00:5A:72:A6:B6
         UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
         RX packets:371 errors:0 dropped:0 overruns:0 frame:0
         TX packets:257 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:1000
         RX bytes:38038 (37.1 KiB)  TX bytes:32156 (31.4 KiB)
         Interrupt:19 Memory:da000000-0

eth1      Link encap:Ethernet  HWaddr 00:00:5A:72:A6:B6
         UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
         RX packets:477 errors:0 dropped:0 overruns:0 frame:0
         TX packets:240 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:1000
         RX bytes:48125 (46.9 KiB)  TX bytes:30720 (30.0 KiB)

eth2      Link encap:Ethernet  HWaddr 00:04:23:AC:57:A4
         inet addr:10.10.10.220  Bcast:10.10.10.255  Mask:255.255.255.0
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:292 errors:0 dropped:0 overruns:0 frame:0
         TX packets:453 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:1000
         RX bytes:33617 (32.8 KiB)  TX bytes:48430 (47.2 KiB)
         Base address:0x3000 Memory:de280000-de2a0000

lo        Link encap:Local Loopback
         inet addr:127.0.0.1  Mask:255.0.0.0
         UP LOOPBACK RUNNING  MTU:16436  Metric:1
         RX packets:23 errors:0 dropped:0 overruns:0 frame:0
         TX packets:23 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:4204 (4.1 KiB)  TX bytes:4204 (4.1 KiB)

veth0     Link encap:Ethernet  HWaddr AA:DE:AD:01:33:01
         inet addr:192.168.133.1  Bcast:192.168.133.255  Mask:255.255.255.0
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:235 errors:0 dropped:0 overruns:0 frame:0
         TX packets:55 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:17152 (16.7 KiB)  TX bytes:3822 (3.7 KiB)

vif0.0    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
         UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
         RX packets:52 errors:0 dropped:0 overruns:0 frame:0
         TX packets:235 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:0
         RX bytes:3696 (3.6 KiB)  TX bytes:17152 (16.7 KiB)

# route -n


Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface 192.168.133.0 0.0.0.0 255.255.255.0 U 0 0 0 veth0
10.10.10.0      0.0.0.0         255.255.255.0   U     0      0        0 eth2
0.0.0.0 192.168.133.254 0.0.0.0 UG 0 0 0 veth0

# ip addr show


1: lo: <LOOPBACK,UP> mtu 16436 qdisc noqueue
   link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
   inet 127.0.0.1/8 scope host lo
2: vif0.0: <BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue
   link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
3: veth0: <BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue
   link/ether aa:de:ad:01:33:01 brd ff:ff:ff:ff:ff:ff
   inet 192.168.133.1/24 brd 192.168.133.255 scope global veth0
4: bond0: <BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue
   link/ether 00:00:5a:72:a6:b6 brd ff:ff:ff:ff:ff:ff
5: eth0: <BROADCAST,MULTICAST,SLAVE,UP> mtu 1500 qdisc pfifo_fast master bond0 qlen 1000
   link/ether 00:00:5a:72:a6:b6 brd ff:ff:ff:ff:ff:ff
6: eth1: <BROADCAST,MULTICAST,SLAVE,UP> mtu 1500 qdisc pfifo_fast master bond0 qlen 1000
   link/ether 00:00:5a:72:a6:b6 brd ff:ff:ff:ff:ff:ff
7: eth2: <BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast qlen 1000
   link/ether 00:04:23:ac:57:a4 brd ff:ff:ff:ff:ff:ff
   inet 10.10.10.220/24 brd 10.10.10.255 scope global eth2
8: eth3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop qlen 1000
   link/ether 00:04:23:ac:57:a5 brd ff:ff:ff:ff:ff:ff
9: br0: <BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue
   link/ether 00:00:5a:72:a6:b6 brd ff:ff:ff:ff:ff:ff
10: bond0.133: <BROADCAST,MULTICAST,MASTER,UP> mtu 1500 qdisc noqueue
   link/ether 00:00:5a:72:a6:b6 brd ff:ff:ff:ff:ff:ff

# brctl show

bridge name     bridge id               STP enabled     interfaces
br0             8000.00005a72a6b6       no              bond0.133

# brctl showmacs br0

port no mac addr                is local?       ageing timer
 1     00:00:5a:72:a6:b6       yes                0.00
 1     00:12:3f:20:69:f0       no                 0.80
 2     aa:de:ad:01:33:01       no                38.59
 2     fe:ff:ff:ff:ff:ff       yes                0.00

# iptables -L
                                                       vif0.0
Chain FORWARD (policy ACCEPT)
target     prot opt source               destination

Chain INPUT (policy ACCEPT)
target     prot opt source               destination

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination

# grep . /proc/sys/net/bridge/*

/proc/sys/net/bridge/bridge-nf-call-arptables:1
/proc/sys/net/bridge/bridge-nf-call-ip6tables:1
/proc/sys/net/bridge/bridge-nf-call-iptables:1
/proc/sys/net/bridge/bridge-nf-filter-vlan-tagged:1

# cat /proc/net/vlan/config

VLAN Dev name    | VLAN ID
Name-Type: VLAN_NAME_TYPE_RAW_PLUS_VID_NO_PAD
bond0.133      | 133  | bond0

# cat /proc/net/vlan/bond0.133
bond0.133  VID: 133      REORDER_HDR: 1  dev->priv_flags: 1
        total frames received         2860
         total bytes received       186932
     Broadcast/Multicast Rcvd            4

     total frames transmitted          458
      total bytes transmitted        33915
           total headroom inc            0
          total encap on xmit            0
Device: bond0
INGRESS priority mappings: 0:0  1:0  2:0  3:0  4:0  5:0  6:0 7:0
EGRESSS priority Mappings:

# cat /proc/net/bonding/bond0

Ethernet Channel Bonding Driver: v2.6.1 (October 29, 2004)

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0

802.3ad info
LACP rate: fast
Active Aggregator Info:
       Aggregator ID: 1
       Number of ports: 2
       Actor Key: 17
       Partner Key: 26
       Partner Mac Address: 00:11:43:f7:8c:00

Slave Interface: eth0
MII Status: up
Link Failure Count: 0
Permanent HW addr: 00:00:5a:72:a6:b6
Aggregator ID: 1

Slave Interface: eth1
MII Status: up
Link Failure Count: 0
Permanent HW addr: 00:00:5a:72:a6:b7
Aggregator ID: 1


# /etc/modprobe.conf

alias eth0 sk98lin
alias eth1 sk98lin

alias eth2 e1000
alias eth3 e1000

alias bond0 bonding
options bond0 mode=802.3ad lacp_rate=fast miimon=100


# cat /proc/interrupts
          CPU0
 1:          8        Phys-irq  i8042
 8:          0        Phys-irq  rtc
 9:          0        Phys-irq  acpi
12:        110        Phys-irq  i8042
14:       1396        Phys-irq  ide0
19:       4174        Phys-irq  eth0
21:          0        Phys-irq  ohci_hcd:usb1
22:       7690        Phys-irq  libata
23:          0        Phys-irq  libata
24:        168        Phys-irq  mvSata
28:        168        Phys-irq  mvSata
29:       3216        Phys-irq  eth2
256:      42183     Dynamic-irq  timer0
257:         67     Dynamic-irq  xenbus
258:          0     Dynamic-irq  console
259:          0     Dynamic-irq  net-be-dbg
NMI:          0
LOC:          0
ERR:          0


# cat /proc/net/sk98lin/eth0

Detailed statistic for device eth0
=======================================

Board statistics

Card name SK-9E22 10/100/1000Base-T Dual Port Server Adapter
Vendor/Device ID               1148/9e00
Card type (Bit)                64
Active Port                    A
Preferred Port                 A
Interrupt Moderation           disabled
Bus type                       PCI-Express
Bus width (Lanes)              4
Driver version                 8.24.1.3 (01)
Driver release date            Aug-09-2005
Hardware revision              v1.2
Temperature (C)                35.05
Temperature (F)                95.00
Voltage PCI (V)                0.000
Voltage PCI-IO (V)             0.000
Voltage VMAIN (V)              0.000
Voltage VAUX (V)               0.000
Voltage Core 1V2 (V)           0.000
Voltage PHY 1V5 (V)            0.000
Voltage PHY 2V5 (V)            0.000

Receive statistics

Received bytes                 307552
Received packets               2887
Receive errors                 0
Receive dropped                0
Received multicast             2874

Transmit statistics

Transmitted bytes              250406
Transmitted packets            1996
Transmit errors                0
Transmit dropped               0
Transmit collisions            0


Dump off ssh session started from 192.168.137.9, monitoring from 192.168.133.254 (router)

# tcpdump -n -i bond0.133 -vv
tcpdump: listening on bond0.133, link-type EN10MB (Ethernet), capture size 96 bytes 16:37:42.240082 IP (tos 0x10, ttl 63, id 37160, offset 0, flags [DF], proto 6, length: 60) 192.168.137.9.52089 > 192.168.133.1.ssh: S [tcp sum ok] 373073993:373073993(0) win 5840 <mss 1460,sackOK,timestamp 423049569 0,nop,wscale 0>
16:37:42.242073 arp who-has 192.168.133.254 tell 192.168.133.1
16:37:42.242086 arp reply 192.168.133.254 is-at 00:12:3f:20:69:f0
16:37:42.242230 IP (tos 0x0, ttl 64, id 0, offset 0, flags [DF], proto 6, length: 60) 192.168.133.1.ssh > 192.168.137.9.52089: S [tcp sum ok] 1404968999:1404968999(0) ack 373073994 win 5792 <mss 1460,sackOK,timestamp 229714 423049569,nop,wscale 2> 16:37:42.242455 IP (tos 0x10, ttl 63, id 37161, offset 0, flags [DF], proto 6, length: 52) 192.168.137.9.52089 > 192.168.133.1.ssh: . [tcp sum ok] 1:1(0) ack 1 win 5840 <nop,nop,timestamp 423049570 229714>
16:37:47.242073 arp who-has 192.168.133.1 tell 192.168.133.254
16:37:47.242273 arp reply 192.168.133.1 is-at aa:de:ad:01:33:01


# tcpdump -n -p -i bond0

03:18:20.200065 00:11:43:f7:8c:04 > 01:80:c2:00:00:02, ethertype Unknown (0x8809), length 124:
       0x0000:  0101 0114 0100 0011 43f7 8c00 1a00 0100  ........C.......
       0x0010:  0c00 3f00 0000 0214 ffff 0000 5a72 a6b6  ..?.........Zr..
       0x0020:  1100 ff00 0200 3f00 0000 0310 0000 0000  ......?.........
       0x0030:  0000 0000 0000 0000 0000 0000 0000 0000  ................
       0x0040:  0000 0000 0000 0000 0000 0000 0000 0000  ................
       0x0050:  0000                                     ..
03:18:20.221549 802.1d unknown version
03:18:20.315315 IP (tos 0x0, ttl 64, id 13960, offset 0, flags [DF], proto 17, length: 65) 192.168.133.1.32796 > 192.168.134.6.domain: [bad udp cksum 8176!] 41708+ A? mygale.fifthweb.net. (37) 03:18:20.759854 00:11:43:f7:8c:03 > 01:80:c2:00:00:02, ethertype Unknown (0x8809), length 124:
       0x0000:  0101 0114 0100 0011 43f7 8c00 1a00 0100  ........C.......
       0x0010:  0b00 3f00 0000 0214 ffff 0000 5a72 a6b6  ..?.........Zr..
       0x0020:  1100 ff00 0100 3f00 0000 0310 0000 0000  ......?.........
       0x0030:  0000 0000 0000 0000 0000 0000 0000 0000  ................
       0x0040:  0000 0000 0000 0000 0000 0000 0000 0000  ................
0x0050: 0000

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel