<div dir="ltr">Hi,<br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 28, 2015 at 7:10 PM, <span dir="ltr"><<a href="mailto:david.andel@bli.uzh.ch" target="_blank">david.andel@bli.uzh.ch</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2">I have additional details to this:<br><br>this error occurs both with kernel 3.19.0-16 and 3.19.0-18 and unprivileged containers reproducibly produce processes in uninterruptible sleep state:<br><br>root@andel2:~# ps aux | egrep ' D | Z | H '<br>200000 4637 0.0 0.0 4472 1480 ? D 14:03 0:00 /bin/sh /usr/bin/savelog -q -p -c 5 /var/log/dmesg<br>200000 4671 0.1 0.1 112456 6060 ? D 14:03 0:00 /usr/sbin/nginx<br><br><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><div><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font size="2">After this happens, all further lxc- calls hang or return errors, like e.g.<br>david@andel2:~$ lxc-ls -f<br>lxc_container: cgmanager.c: lxc_cgmanager_enter: 694 call to cgmanager_move_pid_abs_sync failed: invalid request <br>lxc_container: cgmanager.c: do_cgm_get: 871 Failed to enter container cgroup freezer: <br>lxc_container: cgmanager.c: lxc_cgmanager_enter: 694 call to cgmanager_move_pid_abs_sync failed: invalid request <br>lxc_container: cgmanager.c: do_cgm_get: 871 Failed to enter container cgroup freezer: <br>lxc_container: utils.c: switch_to_ns: 1337 No such file or directory - failed to open /proc/3109/ns/net <br>lxc_container: lxccontainer.c: lxcapi_get_ips: 1665 No such file or directory - failed to enter namespace <br>lxc_container: cgmanager.c: lxc_cgmanager_enter: 694 call to cgmanager_move_pid_abs_sync failed: invalid request <br>lxc_container: cgmanager.c: do_cgm_get: 871 Failed to enter container cgroup freezer: <br>lxc_container: utils.c: switch_to_ns: 1337 No such file or directory - failed to open /proc/3109/ns/net <br>lxc_container: lxccontainer.c: lxcapi_get_ips: 1665 No such file or directory - failed to enter namespace <br>NAME STATE IPV4 IPV6 GROUPS AUTOSTART </font></span></font></div></font></span></font></blockquote><div>I have the same error, like this. And I found that I cloned a container, but this container was not cloned completely, because of some reasons. After remove the error container (by 'sudo rm -r ~/.local/share/lxc/CONTAINER_ERROR), the problem doesn't occur again.</div><div>I hope this will help you.</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><div><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font size="2"> <br>...<br></font></span></font><br></div></font></span><span class=""><br><font color="#990099">-----"lxc-users" <<a href="mailto:lxc-users-bounces@lists.linuxcontainers.org" target="_blank">lxc-users-bounces@lists.linuxcontainers.org</a>> wrote: -----</font></span><div style="padding-left:5px"><div style="padding-right:0px;padding-left:5px;border-left:solid black 2px"><span class="">To: LXC users mailing-list <<a href="mailto:lxc-users@lists.linuxcontainers.org" target="_blank">lxc-users@lists.linuxcontainers.org</a>><br>From: <a href="mailto:david.andel@bli.uzh.ch" target="_blank">david.andel@bli.uzh.ch</a><br>Sent by: "lxc-users" <u></u><br></span>Date: 05/27/2015 16:05<div><div class="h5"><br>Subject: Re: [lxc-users] lxc-ls -f problem<br><br><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2">Now attached the output of <span><br>strace -f -ostrace.out -- lxc-ls -f<br>strace -f -ostrace-start.out -- lxc-start -n s0_RStSh<br>lxc-start -n s0_RStSh -l trace -o debug.out<br><br>I was running these not as root this time but if that is required I will post those as well.<br><br>Interestingly, this happens only on a vivid running in a KVM.<br>On three other vivid instances running on bare metal this does not happen.<br><br>I am running the latest stable releases from the PPA, i.e. lxc 1.1.2-0ubuntu3.<br><br>Cheers,<br>David<br><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><div><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span></span></font><br></div></font></span><br><font color="#990099">-----"lxc-users" <<a href="mailto:lxc-users-bounces@lists.linuxcontainers.org" target="_blank">lxc-users-bounces@lists.linuxcontainers.org</a>> wrote: -----</font><div style="padding-left:5px"><div style="padding-right:0px;padding-left:5px;border-left:solid black 2px">To: LXC users mailing-list <<a href="mailto:lxc-users@lists.linuxcontainers.org" target="_blank">lxc-users@lists.linuxcontainers.org</a>><br>From: <a href="mailto:david.andel@bli.uzh.ch" target="_blank">david.andel@bli.uzh.ch</a><br>Sent by: "lxc-users" <br>Date: 05/23/2015 20:47<br>Subject: Re: [lxc-users] lxc-ls -f problem<br><br><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2">Hi<br><br>I have the exact same problem after yesterdays update.<br><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><div><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><br>And I suspect it is bug <a href="https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1413927" target="_blank">https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1413927</a> or at least closely related.<br><br>root@andel2:~# cat /proc/self/cgroup<br>10:devices:/system.slice/ssh.service<br>9:perf_event:/system.slice/ssh.service<br>8:cpuset:/system.slice/ssh.service<br>7:cpu,cpuacct:/system.slice/ssh.service<br>6:memory:/system.slice/ssh.service<br>5:freezer:/system.slice/ssh.service<br>4:net_cls,net_prio:/system.slice/ssh.service<br>3:hugetlb:/system.slice/ssh.service<br>2:blkio:/system.slice/ssh.service<br>1:name=systemd:/system.slice/ssh.service<br><br>root@andel2:~# service cgmanager status<br>● cgmanager.service - Cgroup management daemon<br> Loaded: loaded (/lib/systemd/system/cgmanager.service; disabled; vendor preset: enabled)<br> Active: active (running) since Sat 2015-05-23 15:48:07 CEST; 30min ago<br> Main PID: 2994 (cgmanager)<br> Memory: 296.0K<br> CGroup: /system.slice/cgmanager.service<br> ‣ 2994 /sbin/cgmanager -m name=systemd<br><br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager: Invalid path /run/cgmanager/fs/hugetlb/system.slice/ssh.service/lxc/s0_nginx<br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager:per_ctrl_move_pid_main: Invalid path /run/cgmanager/fs/hugetlb/system.slice/ssh.servi...s0_nginx<br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager: Invalid path /run/cgmanager/fs/memory/system.slice/ssh.service/lxc/s0_nginx<br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager:per_ctrl_move_pid_main: Invalid path /run/cgmanager/fs/memory/system.slice/ssh.servic...s0_nginx<br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager: Invalid path /run/cgmanager/fs/net_cls/system.slice/ssh.service/lxc/s0_nginx<br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager:per_ctrl_move_pid_main: Invalid path /run/cgmanager/fs/net_cls/system.slice/ssh.servi...s0_nginx<br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager: Invalid path /run/cgmanager/fs/perf_event/system.slice/ssh.service/lxc/s0_nginx<br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager:per_ctrl_move_pid_main: Invalid path /run/cgmanager/fs/perf_event/system.slice/ssh.se...s0_nginx<br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager: Invalid path /run/cgmanager/fs/none,name=systemd/system.slice/ssh.service/lxc/s0_nginx<br>May 23 15:48:15 andel2 cgmanager[2994]: cgmanager:per_ctrl_move_pid_main: Invalid path /run/cgmanager/fs/none,name=systemd/system.slice...s0_nginx<br>Hint: Some lines were ellipsized, use -l to show in full.<br></span></font><br><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span>The unprivileged containers could be stopped but trying to stop a running privileged container hangs and blocked the host completely.<br>Even a reboot is not possible, the host answers only to ping requests, ssh returns with "Write failed: Broken pipe".<br>And </span></font></font></span></font></span></font>since <font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span>the machine is geographically distant (and it's weekend as usual when such stuff happens) </span></font></font></span></font></span></font></font></span></font></span></font><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span>I cannot provide </span></font></font></span></font></span></font></font></span></font></span></font></font></span></font></span></font></font></span></font><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span>the results </span></font></font></span></font></span></font></font></span></font></span></font></font></span></font></span></font><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span>generated from the commands </span></font></font></span></font></span></font></font></span></font></span></font></font></span></font></span></font></font></span></font></font></span></font>below</span></font></font></span></font>.<br><br></span></font></font></span></font></span></font></font></span></font>But probably I am going to run into the same error on other machines and will provide the results.<br><br>David<br><br></span></font></div></font></span><br><font color="#990099">-----"lxc-users" <<a href="mailto:lxc-users-bounces@lists.linuxcontainers.org" target="_blank">lxc-users-bounces@lists.linuxcontainers.org</a>> wrote: -----</font><div style="padding-left:5px"><div style="padding-right:0px;padding-left:5px;border-left:solid black 2px">To: LXC users mailing-list <<a href="mailto:lxc-users@lists.linuxcontainers.org" target="_blank">lxc-users@lists.linuxcontainers.org</a>><br>From: Serge Hallyn <br>Sent by: "lxc-users" <br>Date: 05/22/2015 17:44<br>Subject: Re: [lxc-users] lxc-ls -f problem<br><br><div><font face="Courier New,Courier,monospace" size="2">Quoting Dave Birch (<a href="mailto:dave.birch@gmail.com" target="_blank">dave.birch@gmail.com</a>):<br>> Dave Birch <dave.birch@...> writes:<br>> <br>> Further update - just discovered that lxc-start now hangs for all <br>> containers, even newly created ones using only the standard download <br>> template on lxc-create.<br>> <br>> I'm pretty much dead in the water until I can work out how to resolve <br>> this.<br><br>Can you attach the results of<br><br>sudo strace -f -ostrace.out -- lxc-ls -f<br>sudo strace -f -ostrace-start.out -- lxc-start -n <container><br>sudo lxc-start -n <container> -l trace -o debug.out<br><br>and show your exact steps, if you can remember them or have them in<br>history, when you were originally creating these containers?<br>_______________________________________________<br>lxc-users mailing list<br><a href="mailto:lxc-users@lists.linuxcontainers.org" target="_blank">lxc-users@lists.linuxcontainers.org</a><br><a href="http://lists.linuxcontainers.org/listinfo/lxc-users" target="_blank">http://lists.linuxcontainers.org/listinfo/lxc-users</a></font></div></div></div></font>
<div></div></font>
<div><font face="Courier New,Courier,monospace" size="2">_______________________________________________<br>lxc-users mailing list<br><a href="mailto:lxc-users@lists.linuxcontainers.org" target="_blank">lxc-users@lists.linuxcontainers.org</a><br><a href="http://lists.linuxcontainers.org/listinfo/lxc-users" target="_blank">http://lists.linuxcontainers.org/listinfo/lxc-users</a></font></div></div></div><div></div></font>
<div><font face="Courier New,Courier,monospace" size="2">_______________________________________________<br>lxc-users mailing list<br><a href="mailto:lxc-users@lists.linuxcontainers.org" target="_blank">lxc-users@lists.linuxcontainers.org</a><br><a href="http://lists.linuxcontainers.org/listinfo/lxc-users" target="_blank">http://lists.linuxcontainers.org/listinfo/lxc-users</a></font></div><u></u></div></div></div><br><br>[attachment "outfiles.tgz" removed by David Andel/at/UZH]</div><div></div></font><br>_______________________________________________<br>
lxc-users mailing list<br>
<a href="mailto:lxc-users@lists.linuxcontainers.org">lxc-users@lists.linuxcontainers.org</a><br>
<a href="http://lists.linuxcontainers.org/listinfo/lxc-users" target="_blank">http://lists.linuxcontainers.org/listinfo/lxc-users</a><br></blockquote></div><br></div></div>