Re: [Xen-devel] help with horrible network failures

[Jon Mason <jdmason@xxxxxxxxxx>]

On Wednesday 02 March 2005 04:52 pm, Rob Gardner wrote:
> Nivedita Singhvi wrote:
> > Rob Gardner wrote:
> >> The machine with the problem:
> >> Intel e100 nic
> >> 1.7 Ghz Xeon
> >
> > Yep, practically all instances of this problem were
> > with the e100. Unfortunately, the current version
> > of the driver no longer has NAPI as a dynamically
> > tunable parameter via ethtool. It can be disabled
> > via a kernel config parameter (CONFIG_E100_NAPI).
> > You could recompile and see if the problem disappears.
> > (Not a real fix).
>
> My current configuration has:
> # CONFIG_E100_NAPI is not set
>
> Isn't that the same as it being disabled? Or should I change it to:
> CONFIG_E100_NAPI=n

Yes, that is disabled, but from my previous statement that does nothing in 
e100 (as it is enabled regardless of that compile flag).  I think there have 
been a few driver fixes that were dropped in the newly released 2.6.11.  If 
you can't change the adapter, it might be worth trying.  

> > I'd be very interested if you could switch to tg3
> > on the other box too, and see if you can reproduce
> > the problem. It all depends on the traffic, phase
> > of the moon, etc..
>
> I'm afraid that isn't easy to accomplish. I am working with another
> researcher in a faraway land, and so I do not have direct control over
> their machine. Changing their nic could take a while.
>
> > Sorry, ethtool can't be used to disable/enable NAPI. Ignore
> > this idiot, neuron misfire...
>
> So,,, what's the conclusion?

NAPI is a compile time option, not a runtime option.  so, it must be enabled 
during kernel compilation.  

> > Your sysctl settings would be helpful, too..
>
> sunrpc.tcp_slot_table_entries = 16
> sunrpc.udp_slot_table_entries = 16
> sunrpc.nlm_debug = 0
> sunrpc.nfsd_debug = 0
> sunrpc.nfs_debug = 0
> sunrpc.rpc_debug = 0
> xen.independent_wallclock = 0
> dev.raid.speed_limit_max = 200000
> dev.raid.speed_limit_min = 1000
> dev.cdrom.check_media = 0
> dev.cdrom.lock = 1
> dev.cdrom.debug = 0
> dev.cdrom.autoeject = 0
> dev.cdrom.autoclose = 1
> dev.cdrom.info = CD-ROM information, Id: cdrom.c 3.20 2003/12/17
> dev.cdrom.info =
> dev.cdrom.info = drive name:  hdc
> dev.cdrom.info = drive speed:  48
> dev.cdrom.info = drive # of slots: 1
> dev.cdrom.info = Can close tray:  1
> dev.cdrom.info = Can open tray:  1
> dev.cdrom.info = Can lock tray:  1
> dev.cdrom.info = Can change speed: 1
> dev.cdrom.info = Can select disk: 0
> dev.cdrom.info = Can read multisession: 1
> dev.cdrom.info = Can read MCN:  1
> dev.cdrom.info = Reports media changed: 1
> dev.cdrom.info = Can play audio:  1
> dev.cdrom.info = Can write CD-R:  0
> dev.cdrom.info = Can write CD-RW: 0
> dev.cdrom.info = Can read DVD:  0
> dev.cdrom.info = Can write DVD-R: 0
> dev.cdrom.info = Can write DVD-RAM: 0
> dev.cdrom.info = Can read MRW:  1
> dev.cdrom.info = Can write MRW:  1
> dev.cdrom.info = Can write RAM:  1
> dev.cdrom.info =
> dev.cdrom.info =
> dev.scsi.logging_level = 0
> fs.nfs.nlm_tcpport = 0
> fs.nfs.nlm_udpport = 0
> fs.nfs.nlm_timeout = 10
> fs.nfs.nlm_grace_period = 0
> fs.aio-max-nr = 65536
> fs.aio-nr = 0
> fs.lease-break-time = 45
> fs.dir-notify-enable = 1
> fs.leases-enable = 1
> fs.overflowgid = 65534
> fs.overflowuid = 65534
> fs.dentry-state = 1566 448 45 0 0 0
> fs.file-max = 12185
> fs.file-nr = 525 0 12185
> fs.inode-state = 1638 222 0 0 0 0 0
> fs.inode-nr = 1638 222
> net.bridge.bridge-nf-filter-vlan-tagged = 1
> net.bridge.bridge-nf-call-ip6tables = 1
> net.bridge.bridge-nf-call-iptables = 1
> net.bridge.bridge-nf-call-arptables = 1
> net.unix.max_dgram_qlen = 10
> net.ipv4.conf.xen-br0.force_igmp_version = 0
> net.ipv4.conf.xen-br0.disable_policy = 0
> net.ipv4.conf.xen-br0.disable_xfrm = 0
> net.ipv4.conf.xen-br0.arp_ignore = 0
> net.ipv4.conf.xen-br0.arp_announce = 0
> net.ipv4.conf.xen-br0.arp_filter = 0
> net.ipv4.conf.xen-br0.tag = 0
> net.ipv4.conf.xen-br0.log_martians = 0
> net.ipv4.conf.xen-br0.bootp_relay = 0
> net.ipv4.conf.xen-br0.medium_id = 0
> net.ipv4.conf.xen-br0.proxy_arp = 0
> net.ipv4.conf.xen-br0.accept_source_route = 1
> net.ipv4.conf.xen-br0.send_redirects = 1
> net.ipv4.conf.xen-br0.rp_filter = 1
> net.ipv4.conf.xen-br0.shared_media = 1
> net.ipv4.conf.xen-br0.secure_redirects = 1
> net.ipv4.conf.xen-br0.accept_redirects = 1
> net.ipv4.conf.xen-br0.mc_forwarding = 0
> net.ipv4.conf.xen-br0.forwarding = 0
> net.ipv4.conf.eth0.force_igmp_version = 0
> net.ipv4.conf.eth0.disable_policy = 0
> net.ipv4.conf.eth0.disable_xfrm = 0
> net.ipv4.conf.eth0.arp_ignore = 0
> net.ipv4.conf.eth0.arp_announce = 0
> net.ipv4.conf.eth0.arp_filter = 0
> net.ipv4.conf.eth0.tag = 0
> net.ipv4.conf.eth0.log_martians = 0
> net.ipv4.conf.eth0.bootp_relay = 0
> net.ipv4.conf.eth0.medium_id = 0
> net.ipv4.conf.eth0.proxy_arp = 0
> net.ipv4.conf.eth0.accept_source_route = 1
> net.ipv4.conf.eth0.send_redirects = 1
> net.ipv4.conf.eth0.rp_filter = 1
> net.ipv4.conf.eth0.shared_media = 1
> net.ipv4.conf.eth0.secure_redirects = 1
> net.ipv4.conf.eth0.accept_redirects = 1
> net.ipv4.conf.eth0.mc_forwarding = 0
> net.ipv4.conf.eth0.forwarding = 0
> net.ipv4.conf.lo.force_igmp_version = 0
> net.ipv4.conf.lo.disable_policy = 0
> net.ipv4.conf.lo.disable_xfrm = 0
> net.ipv4.conf.lo.arp_ignore = 0
> net.ipv4.conf.lo.arp_announce = 0
> net.ipv4.conf.lo.arp_filter = 0
> net.ipv4.conf.lo.tag = 0
> net.ipv4.conf.lo.log_martians = 0
> net.ipv4.conf.lo.bootp_relay = 0
> net.ipv4.conf.lo.medium_id = 0
> net.ipv4.conf.lo.proxy_arp = 0
> net.ipv4.conf.lo.accept_source_route = 1
> net.ipv4.conf.lo.send_redirects = 1
> net.ipv4.conf.lo.rp_filter = 1
> net.ipv4.conf.lo.shared_media = 1
> net.ipv4.conf.lo.secure_redirects = 1
> net.ipv4.conf.lo.accept_redirects = 1
> net.ipv4.conf.lo.mc_forwarding = 0
> net.ipv4.conf.lo.forwarding = 0
> net.ipv4.conf.default.force_igmp_version = 0
> net.ipv4.conf.default.disable_policy = 0
> net.ipv4.conf.default.disable_xfrm = 0
> net.ipv4.conf.default.arp_ignore = 0
> net.ipv4.conf.default.arp_announce = 0
> net.ipv4.conf.default.arp_filter = 0
> net.ipv4.conf.default.tag = 0
> net.ipv4.conf.default.log_martians = 0
> net.ipv4.conf.default.bootp_relay = 0
> net.ipv4.conf.default.medium_id = 0
> net.ipv4.conf.default.proxy_arp = 0
> net.ipv4.conf.default.accept_source_route = 1
> net.ipv4.conf.default.send_redirects = 1
> net.ipv4.conf.default.rp_filter = 1
> net.ipv4.conf.default.shared_media = 1
> net.ipv4.conf.default.secure_redirects = 1
> net.ipv4.conf.default.accept_redirects = 1
> net.ipv4.conf.default.mc_forwarding = 0
> net.ipv4.conf.default.forwarding = 0
> net.ipv4.conf.all.force_igmp_version = 0
> net.ipv4.conf.all.disable_policy = 0
> net.ipv4.conf.all.disable_xfrm = 0
> net.ipv4.conf.all.arp_ignore = 0
> net.ipv4.conf.all.arp_announce = 0
> net.ipv4.conf.all.arp_filter = 0
> net.ipv4.conf.all.tag = 0
> net.ipv4.conf.all.log_martians = 0
> net.ipv4.conf.all.bootp_relay = 0
> net.ipv4.conf.all.medium_id = 0
> net.ipv4.conf.all.proxy_arp = 0
> net.ipv4.conf.all.accept_source_route = 0
> net.ipv4.conf.all.send_redirects = 1
> net.ipv4.conf.all.rp_filter = 0
> net.ipv4.conf.all.shared_media = 1
> net.ipv4.conf.all.secure_redirects = 1
> net.ipv4.conf.all.accept_redirects = 1
> net.ipv4.conf.all.mc_forwarding = 0
> net.ipv4.conf.all.forwarding = 0
> net.ipv4.neigh.xen-br0.locktime = 100
> net.ipv4.neigh.xen-br0.proxy_delay = 80
> net.ipv4.neigh.xen-br0.anycast_delay = 100
> net.ipv4.neigh.xen-br0.proxy_qlen = 64
> net.ipv4.neigh.xen-br0.unres_qlen = 3
> net.ipv4.neigh.xen-br0.gc_stale_time = 60
> net.ipv4.neigh.xen-br0.delay_first_probe_time = 5
> net.ipv4.neigh.xen-br0.base_reachable_time = 30
> net.ipv4.neigh.xen-br0.retrans_time = 100
> net.ipv4.neigh.xen-br0.app_solicit = 0
> net.ipv4.neigh.xen-br0.ucast_solicit = 3
> net.ipv4.neigh.xen-br0.mcast_solicit = 3
> net.ipv4.neigh.eth0.locktime = 100
> net.ipv4.neigh.eth0.proxy_delay = 80
> net.ipv4.neigh.eth0.anycast_delay = 100
> net.ipv4.neigh.eth0.proxy_qlen = 64
> net.ipv4.neigh.eth0.unres_qlen = 3
> net.ipv4.neigh.eth0.gc_stale_time = 60
> net.ipv4.neigh.eth0.delay_first_probe_time = 5
> net.ipv4.neigh.eth0.base_reachable_time = 30
> net.ipv4.neigh.eth0.retrans_time = 100
> net.ipv4.neigh.eth0.app_solicit = 0
> net.ipv4.neigh.eth0.ucast_solicit = 3
> net.ipv4.neigh.eth0.mcast_solicit = 3
> net.ipv4.neigh.lo.locktime = 100
> net.ipv4.neigh.lo.proxy_delay = 80
> net.ipv4.neigh.lo.anycast_delay = 100
> net.ipv4.neigh.lo.proxy_qlen = 64
> net.ipv4.neigh.lo.unres_qlen = 3
> net.ipv4.neigh.lo.gc_stale_time = 60
> net.ipv4.neigh.lo.delay_first_probe_time = 5
> net.ipv4.neigh.lo.base_reachable_time = 30
> net.ipv4.neigh.lo.retrans_time = 100
> net.ipv4.neigh.lo.app_solicit = 0
> net.ipv4.neigh.lo.ucast_solicit = 3
> net.ipv4.neigh.lo.mcast_solicit = 3
> net.ipv4.neigh.default.gc_thresh3 = 1024
> net.ipv4.neigh.default.gc_thresh2 = 512
> net.ipv4.neigh.default.gc_thresh1 = 128
> net.ipv4.neigh.default.gc_interval = 30
> net.ipv4.neigh.default.locktime = 100
> net.ipv4.neigh.default.proxy_delay = 80
> net.ipv4.neigh.default.anycast_delay = 100
> net.ipv4.neigh.default.proxy_qlen = 64
> net.ipv4.neigh.default.unres_qlen = 3
> net.ipv4.neigh.default.gc_stale_time = 60
> net.ipv4.neigh.default.delay_first_probe_time = 5
> net.ipv4.neigh.default.base_reachable_time = 30
> net.ipv4.neigh.default.retrans_time = 100
> net.ipv4.neigh.default.app_solicit = 0
> net.ipv4.neigh.default.ucast_solicit = 3
> net.ipv4.neigh.default.mcast_solicit = 3
> net.ipv4.tcp_tso_win_divisor = 8
> net.ipv4.tcp_moderate_rcvbuf = 1
> net.ipv4.tcp_bic_low_window = 14
> net.ipv4.tcp_bic_fast_convergence = 1
> net.ipv4.tcp_bic = 1
> net.ipv4.tcp_vegas_gamma = 2
> net.ipv4.tcp_vegas_beta = 6
> net.ipv4.tcp_vegas_alpha = 2
> net.ipv4.tcp_vegas_cong_avoid = 0
> net.ipv4.tcp_westwood = 0
> net.ipv4.tcp_no_metrics_save = 0
> net.ipv4.ipfrag_secret_interval = 600
> net.ipv4.tcp_low_latency = 0
> net.ipv4.tcp_frto = 0
> net.ipv4.tcp_tw_reuse = 0
> net.ipv4.icmp_ratemask = 6168
> net.ipv4.icmp_ratelimit = 100
> net.ipv4.tcp_adv_win_scale = 2
> net.ipv4.tcp_app_win = 31
> net.ipv4.tcp_rmem = 4096 87380 174760
> net.ipv4.tcp_wmem = 4096 16384 131072
> net.ipv4.tcp_mem = 12288 16384 24576
> net.ipv4.tcp_dsack = 1
> net.ipv4.tcp_ecn = 0
> net.ipv4.tcp_reordering = 3
> net.ipv4.tcp_fack = 1
> net.ipv4.tcp_orphan_retries = 0
> net.ipv4.inet_peer_gc_maxtime = 120
> net.ipv4.inet_peer_gc_mintime = 10
> net.ipv4.inet_peer_maxttl = 600
> net.ipv4.inet_peer_minttl = 120
> net.ipv4.inet_peer_threshold = 65664
> net.ipv4.igmp_max_msf = 10
> net.ipv4.route.secret_interval = 600
> net.ipv4.route.min_adv_mss = 256
> net.ipv4.route.min_pmtu = 552
> net.ipv4.route.mtu_expires = 600
> net.ipv4.route.gc_elasticity = 8
> net.ipv4.route.error_burst = 500
> net.ipv4.route.error_cost = 100
> net.ipv4.route.redirect_silence = 2048
> net.ipv4.route.redirect_number = 9
> net.ipv4.route.redirect_load = 2
> net.ipv4.route.gc_interval = 60
> net.ipv4.route.gc_timeout = 300
> net.ipv4.route.gc_min_interval = 0
> net.ipv4.route.max_size = 16384
> net.ipv4.route.gc_thresh = 1024
> net.ipv4.route.max_delay = 10
> net.ipv4.route.min_delay = 2
> net.ipv4.icmp_ignore_bogus_error_responses = 0
> net.ipv4.icmp_echo_ignore_broadcasts = 0
> net.ipv4.icmp_echo_ignore_all = 0
> net.ipv4.ip_local_port_range = 1024 4999
> net.ipv4.tcp_max_syn_backlog = 256
> net.ipv4.tcp_rfc1337 = 0
> net.ipv4.tcp_stdurg = 0
> net.ipv4.tcp_abort_on_overflow = 0
> net.ipv4.tcp_tw_recycle = 0
> net.ipv4.tcp_fin_timeout = 60
> net.ipv4.tcp_retries2 = 15
> net.ipv4.tcp_retries1 = 3
> net.ipv4.tcp_keepalive_intvl = 75
> net.ipv4.tcp_keepalive_probes = 9
> net.ipv4.tcp_keepalive_time = 7200
> net.ipv4.ipfrag_time = 30
> net.ipv4.ip_dynaddr = 0
> net.ipv4.ipfrag_low_thresh = 196608
> net.ipv4.ipfrag_high_thresh = 262144
> net.ipv4.tcp_max_tw_buckets = 16384
> net.ipv4.tcp_max_orphans = 8192
> net.ipv4.tcp_synack_retries = 5
> net.ipv4.tcp_syn_retries = 5
> net.ipv4.ip_nonlocal_bind = 0
> net.ipv4.ip_no_pmtu_disc = 0
> net.ipv4.ip_autoconfig = 0
> net.ipv4.ip_default_ttl = 64
> net.ipv4.ip_forward = 0
> net.ipv4.tcp_retrans_collapse = 1
> net.ipv4.tcp_sack = 1
> net.ipv4.tcp_window_scaling = 1
> net.ipv4.tcp_timestamps = 1
> net.core.somaxconn = 128
> net.core.optmem_max = 10240
> net.core.message_burst = 10
> net.core.message_cost = 5
> net.core.mod_cong = 290
> net.core.lo_cong = 100
> net.core.no_cong = 20
> net.core.no_cong_thresh = 10
> net.core.netdev_max_backlog = 300
> net.core.dev_weight = 64
> net.core.rmem_default = 109568
> net.core.wmem_default = 109568
> net.core.rmem_max = 109568
> net.core.wmem_max = 109568
> vm.swap_token_timeout = 0
> vm.legacy_va_layout = 0
> vm.vfs_cache_pressure = 100
> vm.block_dump = 0
> vm.laptop_mode = 0
> vm.max_map_count = 65536
> vm.min_free_kbytes = 1448
> vm.lower_zone_protection = 0
> vm.swappiness = 60
> vm.nr_pdflush_threads = 2
> vm.dirty_expire_centisecs = 3000
> vm.dirty_writeback_centisecs = 500
> vm.dirty_ratio = 40
> vm.dirty_background_ratio = 10
> vm.page-cluster = 3
> vm.overcommit_ratio = 50
> vm.overcommit_memory = 0
> kernel.ngroups_max = 65536
> kernel.printk_ratelimit_burst = 10
> kernel.printk_ratelimit = 5
> kernel.panic_on_oops = 0
> kernel.pid_max = 32768
> kernel.overflowgid = 65534
> kernel.overflowuid = 65534
> kernel.pty.nr = 4
> kernel.pty.max = 4096
> kernel.random.uuid = 97a20c1a-1f40-4445-bf5a-8ad6d1d7058e
> kernel.random.boot_id = 26286f61-9d4f-4a61-acf7-d814ee43879b
> kernel.random.write_wakeup_threshold = 128
> kernel.random.read_wakeup_threshold = 64
> kernel.random.entropy_avail = 2708
> kernel.random.poolsize = 512
> kernel.threads-max = 2048
> kernel.cad_pid = 1
> kernel.sem = 250 32000 32 128
> kernel.msgmnb = 16384
> kernel.msgmni = 16
> kernel.msgmax = 8192
> kernel.shmmni = 4096
> kernel.shmall = 2097152
> kernel.shmmax = 33554432
> kernel.hotplug = /bin/true
> kernel.modprobe = /bin/true
> kernel.printk = 6 4 1 7
> kernel.ctrl-alt-del = 0
> kernel.real-root-dev = 0
> kernel.cap-bound = -257
> kernel.tainted = 0
> kernel.core_pattern = core
> kernel.core_uses_pid = 1
> kernel.panic = 1
> kernel.domainname = (none)
> kernel.hostname = vmlc0.hpl.hp.com
> kernel.version = #1 Mon Feb 14 11:48:06 MST 2005
> kernel.osrelease = 2.6.10-xen0
> kernel.ostype = Linux
>
>
>
> -------------------------------------------------------
> SF email is sponsored by - The IT Product Guide
> Read honest & candid reviews on hundreds of IT Products from real users.
> Discover which products truly live up to the hype. Start reading now.
> http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxxxxxxxxxx
> https://lists.sourceforge.net/lists/listinfo/xen-devel

-- 
Jon Mason
jdmason@xxxxxxxxxx


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxxxx
https://lists.sourceforge.net/lists/listinfo/xen-devel