[lxc-users] LXC 3.2.1 ./. CGroups v1

[Jäkel, Guido]

Dear all,

Using LXC in my Gentoo environment for years (since 0.8.4) and currently using V2.1.1 in Production, I'm just evaluating LXC 3.2.1. 

I'm still using CGroups V1 with all available controllers mounted on /cgroups and /cgroups/lxc as a parent group. Until yet, this works well. But with V3.2.1, there's an issue starting with writing the setup to the device cgroup.

Below, you'll find the respective log output at trace level.

The cgroup feature itself is working: There are device.* directory items below /cgroup, /cgroup/lxc and -- if I mkdir such -- /cgroup/lxc/foo , also. If I'm using the same configuration files, root image, kernel etc. but with a LXC 2.1.1 starter, all works well and the container will start up.

Any hint's what's going wrong here and how to fix it?


Thank you in advance

Guido


[...]
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1018 - basecginfo is:
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1019 - 2:cpuset,cpu,cpuacct,blkio,memory,devices,freezer,net_cls,perf_event,net_prio,pids:/
1:name=openrc:/
0::/

lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 0: cpuset
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 1: cpu
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 2: cpuacct
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 3: blkio
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 4: memory
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 5: devices
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 6: freezer
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 7: net_cls
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 8: perf_event
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 9: net_prio
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 10: pids
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1022 - kernel subsystem 11: cgroup2
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_basecg_debuginfo:1025 - named subsystem 0: name=openrc
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:cg_hybrid_init:2563 - No controllers are enabled for delegation in the unified hierarchy
lxc-start evalfly6 20190815111414.815 ERROR    cgfsng - cgroups/cgfsng.c:cg_hybrid_get_controllers:734 - Found hierarchy not under /sys/fs/cgroup: "/cgroup rw,relatime - cgroup cgroup rw,cpuset,cpu,cpuacct,blkio,memory,devices,freezer,net_cls,perf_event,>
"
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:cg_hybrid_init:2589 - Writable cgroup hierarchies:
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:999 -   Hierarchies:
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:1004 -   0: base_cgroup: /
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:1005 -       mountpoint:  /sys/fs/cgroup/openrc
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:1006 -       controllers:
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:1008 -       0: name=openrc
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:1004 -   1: base_cgroup: /
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:1005 -       mountpoint:  /sys/fs/cgroup/unified
lxc-start evalfly6 20190815111414.815 TRACE    cgfsng - cgroups/cgfsng.c:lxc_cgfsng_print_hierarchies:1006 -       controllers:
lxc-start evalfly6 20190815111414.815 TRACE    cgroup - cgroups/cgroup.c:cgroup_init:61 - Initialized cgroup driver cgfsng
lxc-start evalfly6 20190815111414.815 TRACE    cgroup - cgroups/cgroup.c:cgroup_init:66 - Running with hybrid cgroup layout
[...]
lxc-start evalfly6 20190815111414.912 NOTICE   conf - conf.c:lxc_setup:3751 - The container "evalfly6" is set up
lxc-start evalfly6 20190815111414.955 WARN     cgfsng - cgroups/cgfsng.c:get_hierarchy:205 - There is no useable devices controller
lxc-start evalfly6 20190815111414.955 ERROR    cgfsng - cgroups/cgfsng.c:cg_legacy_set_data:2301 - Failed to setup limits for the "devices" controller. The controller seems to be unused by "cgfsng" cgroup driver or not enabled on the cgroup hierarchy
lxc-start evalfly6 20190815111414.955 WARN     cgfsng - cgroups/cgfsng.c:__cg_legacy_setup_limits:2341 - Failed to set "devices.deny" to "a"
lxc-start evalfly6 20190815111414.955 ERROR    start - start.c:lxc_spawn:1883 - Failed to setup legacy device cgroup controller limits



Grüße

Guido