<div dir="ltr"><div class="gmail_default" style="font-size:large">This is my ulimits<br>core file size (blocks, -c) 0<br>data seg size (kbytes, -d) unlimited<br>scheduling priority (-e) 0<br>file size (blocks, -f) unlimited<br>pending signals (-i) 1048576<br>max locked memory (kbytes, -l) unlimited<br>max memory size (kbytes, -m) unlimited<br>open files (-n) 1048576<br>pipe size (512 bytes, -p) 8<br>POSIX message queues (bytes, -q) 819200<br>real-time priority (-r) 0<br>stack size (kbytes, -s) 8192<br>cpu time (seconds, -t) unlimited<br>max user processes (-u) unlimited<br>virtual memory (kbytes, -v) unlimited<br>file locks (-x) unlimited<br><br></div><div class="gmail_default" style="font-size:large">Also, I added swap space, <br></div><div class="gmail_default" style="font-size:large"><br>free -g<br> total used free shared buff/cache available<br>Mem: 177 59 116 0 0 116<br>Swap: 269 0 269<br><br></div><div class="gmail_default" style="font-size:large">and it makes no difference.<br><br></div><div class="gmail_default" style="font-size:large">It his is not a swap issue, nor a ulimit issue, where can it be the problem?<br></div><div class="gmail_default" style="font-size:large">Federico<br></div><div class="gmail_default" style="font-size:large"><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Nov 8, 2014 at 5:23 AM, Guido Jäkel <span dir="ltr"><<a href="mailto:G.Jaekel@dnb.de" target="_blank">G.Jaekel@dnb.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi,<br>
<br>
googleing for pthread_join leads to <a href="http://www.ibm.com/developerworks/library/l-memory-leaks/" target="_blank">http://www.ibm.com/developerworks/library/l-memory-leaks/</a> , an article about memory consumption of POSIX threads (and potential leaks if rejoin fails).<br>
<br>
>From this, you can see that every thread needs at least memory for the stack. It is said that the default may be 10MB. And if you want to start 50 instances of Asterix, this will lead to 50*n+10MB = n*0.5G stack size, where n is the number of threads this quoted 'taskprocessor' will try to start.<br>
<br>
Maybe you need at least more virtual memory to satisfy this requirements (e.g. <a href="http://stackoverflow.com/questions/344203/maximum-number-of-threads-per-process-in-linux" target="_blank">http://stackoverflow.com/questions/344203/maximum-number-of-threads-per-process-in-linux</a>). It seems that you have 19G swap for your ~180GB RAM machine. Maybe you need more even it will be unused. For a quick test, you may consider to use some file (instead of a partition) as additional swapspace and you may assign a lower priority to it. Or maybe you just have to adjust some 'ulimits'.<br>
<br>
Guido<br>
<div><div class="h5"><br>
<br>
On 08.11.2014 03:36, CDR wrote:<br>
> There is something very wrong with LXC in general, it does not matter the<br>
> OS or even the kernel version. My OS is Ubuntu 14.04.<br>
> I have a Centos 6.6 container with mysql and 50 instances of Asterisk 12.0,<br>
> plus opensips.<br>
> The memory is limited to 100G, but it does not matter if I limit it or not.<br>
> It crashes when I start the 50 Asterisk processes.<br>
> The error message is below.<br>
><br>
> MySql starts fine and uses large-pages, memlocked. It uses 60G, so there is<br>
> plenty of available memory left.<br>
><br>
> free -g<br>
> total used free shared buffers cached<br>
> Mem: 177 163 13 0 0 97<br>
> -/+ buffers/cache: 66 110<br>
> Swap: 19 0 19<br>
><br>
> <br>
><br>
><br>
> I tried the same container in Fedora 21 and the outcome is identical, and<br>
> it matters not if the technology is plain lxc or libvirt-lxc.<br>
><br>
> This is my containers config:<br>
> lxc.mount.entry = proc proc proc nodev,noexec,nosuid 0 0<br>
> lxc.mount.entry = sysfs sys sysfs defaults 0 0<br>
><br>
><br>
> lxc.tty = 4<br>
> lxc.pts = 1024<br>
> lxc.cgroup.devices.deny = a<br>
> lxc.cgroup.devices.allow = c 1:3 rwm<br>
> lxc.cgroup.devices.allow = c 1:5 rwm<br>
> lxc.cgroup.devices.allow = c 5:1 rwm<br>
> lxc.cgroup.devices.allow = c 5:0 rwm<br>
> lxc.cgroup.devices.allow = c 4:0 rwm<br>
> lxc.cgroup.devices.allow = c 4:1 rwm<br>
> lxc.cgroup.devices.allow = c 1:9 rwm<br>
> lxc.cgroup.devices.allow = c 1:8 rwm<br>
> lxc.cgroup.devices.allow = c 136:* rwm<br>
> lxc.cgroup.devices.allow = c 5:2 rwm<br>
> lxc.cgroup.devices.allow = c 254:0 rwm<br>
> lxc.cgroup.devices.allow = c 10:137 rwm # loop-control<br>
> lxc.cgroup.devices.allow = b 7:* rwm # loop*<br>
> lxc.cgroup.memory.limit_in_bytes = 107374182400<br>
> lxc.mount.auto = cgroup<br>
><br>
> lxc.utsname = parallelu<br>
> lxc.autodev = 1<br>
> lxc.aa_profile = unconfined<br>
><br>
> lxc.network.type=macvlan<br>
> lxc.network.macvlan.mode=bridge<br>
> lxc.network.link=eth1<br>
> <a href="http://lxc.network.name" target="_blank">lxc.network.name</a> = eth0<br>
> lxc.network.flags = up<br>
> lxc.network.hwaddr = 00:c8:a0:7d:84:cf<br>
> lxc.network.ipv4 = <a href="http://0.0.0.0/25" target="_blank">0.0.0.0/25</a><br>
><br>
><br>
><br>
> Nov 7 21:12:05] ERROR[1480]: taskprocessor.c:245<br>
> default_listener_shutdown: pthread_join(): Cannot allocate memory<br>
> [Nov 7 21:12:05] ERROR[1480]: taskprocessor.c:614<br>
> __allocate_taskprocessor: Unable to start taskprocessor listener for<br>
> taskprocessor 2ad8515c-c1eb-46ab-b53a-d63c84a56192<br>
> [Nov 7 21:12:05] ERROR[1480]: taskprocessor.c:245<br>
> default_listener_shutdown: pthread_join(): Cannot allocate memory<br>
> [Nov 7 21:12:05] ERROR[1205]: taskprocessor.c:614<br>
> __allocate_taskprocessor: Unable to start taskprocessor listener for<br>
> taskprocessor 1fe67cd3-b65f-491a-aa59-a089dcba26a5<br>
> [Nov 7 21:12:05] ERROR[1205]: taskprocessor.c:245<br>
> default_listener_shutdown: pthread_join(): Cannot allocate memory<br>
> [Nov 7 21:12:05] ERROR[1562]: taskprocessor.c:614<br>
> __allocate_taskprocessor: Unable to start taskprocessor listener for<br>
> taskprocessor 34d41f19-2936-4e0a-a626-ceb386ff3a1f<br>
> [Nov 7 21:12:05] ERROR[1562]: taskprocessor.c:245<br>
> default_listener_shutdown: pthread_join(): Cannot allocate memory<br>
> [Nov 7 21:12:05] ERROR[1562]: taskprocessor.c:614<br>
> __allocate_taskprocessor: Unable to start taskprocessor listener for<br>
> taskprocessor 204873a6-b595-4e82-ae02-0b2a3ee37fdc<br>
> [Nov 7 21:12:05] ERROR[1562]: taskprocessor.c:245<br>
> default_listener_shutdown: pthread_join(): Cannot allocate memory<br>
> [Nov 7 21:12:05] ERROR[1480]: taskprocessor.c:614<br>
> __allocate_taskprocessor: Unable to start taskprocessor listener for<br>
> taskprocessor 7711ffdc-57c6-48e2-8f43-3fe4b396c405<br>
> [Nov 7 21:12:05] ERROR[1480]: taskprocessor.c:245<br>
> default_listener_shutdown: pthread_join(): Cannot allocate memory<br>
> [Nov 7 21:12:05] ERROR[1480]: taskprocessor.c:614<br>
> __allocate_taskprocessor: Unable to start taskprocessor listener for<br>
> taskprocessor 3eed34af-a070-4c8b-96ee-c9e1f92756c8<br>
> [Nov 7 21:12:05] ERROR[1480]: taskprocessor.c:245<br>
> default_listener_shutdown: pthread_join(): Cannot allocate memory<br>
><br>
><br>
><br>
</div></div>> _______________________________________________<br>
> lxc-users mailing list<br>
> <a href="mailto:lxc-users@lists.linuxcontainers.org">lxc-users@lists.linuxcontainers.org</a><br>
> <a href="http://lists.linuxcontainers.org/listinfo/lxc-users" target="_blank">http://lists.linuxcontainers.org/listinfo/lxc-users</a><br>
><br>
<br>
_______________________________________________<br>
lxc-users mailing list<br>
<a href="mailto:lxc-users@lists.linuxcontainers.org">lxc-users@lists.linuxcontainers.org</a><br>
<a href="http://lists.linuxcontainers.org/listinfo/lxc-users" target="_blank">http://lists.linuxcontainers.org/listinfo/lxc-users</a></blockquote></div><br></div>