[lxc-users] lxc-start: cgroups/cgfs.c: do_setup_cgroup_limits: 2037 No such file or directory - Error setting devices.deny to a for jessie1

[Serge E. Hallyn]

On Fri, May 12, 2017 at 08:50:20PM +0200, Harald Dunkel wrote:
> Hi Serge,
> 
> On 05/12/17 15:59, Serge E. Hallyn wrote:
> > Quoting Harald Dunkel (harald.dunkel at aixigo.de):
> >> Hi folks,
> >>
> >> my LXCs don't start anymore:
> > 
> > Odd, do_setup_cgroup_limits() seems to be called twice.
> > 
> > First time is sucessful,
> > 
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.deny' set to 'a'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c *:* m'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'b *:* m'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 1:3 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 1:5 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 1:7 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 5:0 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 5:1 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 5:2 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 1:8 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 1:9 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 136:* rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 10:229 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 254:0 rm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 10:200 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 10:228 rwm'
> >>       lxc-start 20170511140840.901 DEBUG    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2042 - cgroup 'devices.allow' set to 'c 10:232 rwm'
> >>       lxc-start 20170511140840.901 INFO     lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2046 - cgroup has been setup
> >>       lxc-start 20170511140840.930 DEBUG    lxc_conf - conf.c:lxc_assign_network:3185 - move 'veth59JIW0'/'(null)' to '4419': .
> >>       lxc-start 20170511140840.966 DEBUG    lxc_conf - conf.c:lxc_assign_network:3185 - move 'vethTIN4QF'/'(null)' to '4419': .
> > ...
> > 
> >>       lxc-start 20170511140841.710 ERROR    lxc_cgfs - cgroups/cgfs.c:do_setup_cgroup_limits:2037 - No such file or directory - Error setting devices.deny to a for jessie1
> >>       lxc-start 20170511140841.710 ERROR    lxc_start - start.c:lxc_spawn:1236 - Failed to setup the devices cgroup for container "jessie1".
> > 
> > Second time fails.
> > 
> > Can you tell us the old (working) and new (nonworking) lxc versions?
> 
> The host is running sysvinit. It failed with lxc 2.0.7.
> 
> I would guess the problem was related to mounting cgroup. Both /cgroup

Ah.  That explains why cgfs driver, rather than cgfsng driver, was running.
cgfsng is purposely very simplified, but therefore requires that it find
cgroups under /sys/fs/cgroup only.  Otherwise it decides the situation is
too complex and it's probably not smart enough to handle it.

Now, we should really log the fact that it's deferring at that poin.  I
will send a patch!

> and /sys/fs/cgroup were mounted via /etc/fstab, and libvirt0 and
> cgroupfs-mount were installed, too. I have removed all except cgroupfs-\
> mount and installed lxc 2.0.7 from scratch. Problem gone, as it seems.
> 
> Thanx anyway for looking into this.
> 
> 
> Regards
> Harri
> 
> _______________________________________________
> lxc-users mailing list
> lxc-users at lists.linuxcontainers.org
> http://lists.linuxcontainers.org/listinfo/lxc-users