[Lxc-users] lxc scalability problem

[yaozhicheng]

Hi all

My OS get crashed when I start more then 20 containers. 

 

OS£º

Cent OS 6.4

 

Lxc version£º0.8.0

 

uname ¨Ca

Linux lxc 2.6.32-358.6.2.el6.x86_64 #1 SMP Thu May 16 20:59:36 UTC 2013
x86_64 x86_64 x86_64 GNU/Linux

 

 

Part of vmcore-dmesg.txt£º

 

<6>br0: port 73(vethu6B7Bf) entering forwarding state

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<6>br0: port 64(vethT6IQft) entering forwarding state

<7>SELinux: initialized (dev devpts, type devpts), uses transition SIDs

<6>br0: port 65(vethknYQMF) entering forwarding state

<6>br0: port 66(vethm89XzF) entering forwarding state

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<1>BUG: unable to handle kernel NULL pointer dereference at 0000000000000008

<1>IP: [<ffffffff81448834>] process_backlog+0x74/0x100

<4>PGD 0

<4>Oops: 0002 [#1] SMP

<4>last sysfs file: /sys/devices/virtual/net/vethu6B7Bf/flags

<4>CPU 70

<4>Modules linked in: veth autofs4 sunrpc cpufreq_ondemand acpi_cpufreq
freq_table mperf bridge stp llc ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4
iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6
xt_state nf_conntrack ip6table_filter ip6_tables ipv6 microcode mlx4_core
igb dca ptp pps_core i2c_i801 i2c_core iTCO_wdt iTCO_vendor_support sg
i7core_edac edac_core ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif
pata_acpi ata_generic ata_piix megaraid_sas dm_mirror dm_region_hash dm_log
dm_mod [last unloaded: scsi_wait_scan]

<4>

<4>Pid: 0, comm: swapper Not tainted 2.6.32-358.6.2.el6.x86_64 #1 Supermicro
X8OBN/X8OBN

<7>SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs

<4>

<4>RIP: 0010:[<ffffffff81448834>]  [<ffffffff81448834>]
process_backlog+0x74/0x100

<4>RSP: 0018:ffff8800282c3e20  EFLAGS: 00010002

<4>RAX: ffff8800282d3ef0 RBX: ffff8800282d3f08 RCX: 0000000000000000

<4>RDX: 0000000000000000 RSI: ffff88401e1e8c80 RDI: ffff88401e1e8d80

<4>RBP: ffff8800282c3e60 R08: 0000000000000000 R09: ffff8840259ed038

<4>R10: ffff8a0022126e20 R11: ffff894022d45200 R12: ffff8800282d3e80

<4>R13: 0000000000000014 R14: ffff8800282d3ef0 R15: ffff8800282d3f04

<4>FS:  0000000000000000(0000) GS:ffff8800282c0000(0000)
knlGS:0000000000000000

<4>CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b

<4>CR2: 0000000000000008 CR3: 0000000001a85000 CR4: 00000000000007e0

 

Container config£º

lxc.tty = 4

lxc.pts = 1024

lxc.cgroup.devices.deny = a

lxc.network.type = veth

lxc.network.ipv4 = 172.16.40.153/16

lxc.network.flags = up

lxc.network.link = br0

 

# /dev/null and zero

lxc.cgroup.devices.allow = c 1:3 rwm

lxc.cgroup.devices.allow = c 1:5 rwm

# consoles

lxc.cgroup.devices.allow = c 5:1 rwm

lxc.cgroup.devices.allow = c 5:0 rwm

lxc.cgroup.devices.allow = c 4:0 rwm

lxc.cgroup.devices.allow = c 4:1 rwm

# /dev/{,u}random

lxc.cgroup.devices.allow = c 1:9 rwm

lxc.cgroup.devices.allow = c 1:8 rwm

lxc.cgroup.devices.allow = c 136:* rwm

lxc.cgroup.devices.allow = c 5:2 rwm

# rtc

lxc.cgroup.devices.allow = c 254:0 rwm

 

# mounts point

lxc.mount.entry=proc /usr/local/var/lib/lxc/lxc-tpl-server/rootfs/proc proc
nodev,noexec,nosuid 0 0

lxc.mount.entry=sysfs /usr/local/var/lib/lxc/lxc-tpl-server/rootfs/sys sysfs
defaults  0 0

lxc.utsname = idleserver00

lxc.rootfs = /usr/local/var/lib/lxc/idleserver00/rootfs

 

lxc.cgroup.blkio.throttle.read_bps_device = 8:0 104857600

lxc.cgroup.blkio.throttle.write_bps_device = 8:0 104857600

 

I searched but cant find why or how to fix it

 

Thanks,

 

yaozhicheng at emails.bjut.edu.cn

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linuxcontainers.org/pipermail/lxc-users/attachments/20130606/f1515848/attachment.html>