[lxc-users] cgmanager: cgm_list_children for controller=systemd, cgroup_path=user failed: invalid request
Smart Goldman
ytlec2014 at gmail.com
Fri Jan 23 14:37:38 UTC 2015
> Yeah that's weird.
>
> Look around /var/log and see what is mounting those cgroups
I tried to search the log about mounting cgroups. But I did not know which
is the log.
The following are log of the mount and state of the mount I think.
root at okapi:~# tail -n 5 /var/log/upstart/mounted-proc.log
chmod: cannot access '/proc/slabinfo': No such file or directory
chmod: cannot access '/proc/slabinfo': No such file or directory
chmod: cannot access '/proc/slabinfo': No such file or directory
chmod: cannot access '/proc/slabinfo': No such file or directory
chmod: cannot access '/proc/slabinfo': No such file or directory
root at okapi:~# tail -n 5 /var/log/upstart/mountall.log
mountall: Event failed
mountall: Event failed
mountall: Event failed
mountall: Event failed
mountall: Event failed
root at okapi:~# mount
/dev/ploop10682p1 on / type ext4
(rw,relatime,barrier=1,data=ordered,balloon_ino=12)
proc on /proc type proc (rw,relatime)
sysfs on /sys type sysfs (rw,relatime)
none on /dev type devtmpfs (rw,nosuid,noexec,relatime,mode=755)
none on /dev/pts type devpts
(rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
none on /proc/sys/fs/binfmt_misc type binfmt_misc
(rw,nosuid,nodev,noexec,relatime)
none on /sys/fs/cgroup type tmpfs (rw,relatime,size=4k,mode=755)
none on /run type tmpfs (rw,nosuid,noexec,relatime,size=52432k,mode=755)
none on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
none on /run/shm type tmpfs (rw,relatime)
none on /run/user type tmpfs
(rw,nosuid,nodev,noexec,relatime,size=102400k,mode=755)
> at boot. What files still exist under /etc/init and /etc/init.d?
Files under /etc/init and /etc/init.d are the following.
root at okapi:~# ls -al /etc/init
total 312
drwxr-xr-x 2 root root 4096 Jan 16 13:44 .
drwxr-xr-x 89 root root 4096 Jan 23 13:45 ..
-rw-r--r-- 1 root root 328 Feb 22 2014 bootmisc.sh.conf
-rw-r--r-- 1 root root 1169 Apr 14 2014 cgmanager.conf
-rw-r--r-- 1 root root 1169 Apr 14 2014 cgmanager.conf~
-rw-r--r-- 1 root root 855 Apr 14 2014 cgproxy.conf
-rw-r--r-- 1 root root 379 Mar 13 2013 cgroup-lite.conf
-rw-r--r-- 1 root root 232 Feb 22 2014 checkfs.sh.conf
-rw-r--r-- 1 root root 253 Feb 22 2014 checkroot-bootclean.sh.conf
-rw-r--r-- 1 root root 307 Feb 22 2014 checkroot.sh.conf
-rw-r--r-- 1 root root 100 Jan 23 13:45 console.conf
-rw-r--r-- 1 root root 1122 Jul 18 2014 container-detect.conf
-rw-r--r-- 1 root root 356 Jul 18 2014 control-alt-delete.conf
-rw-r--r-- 1 root root 297 Feb 9 2013 cron.conf
-rw-r--r-- 1 root root 489 Nov 11 2013 dbus.conf
-rw-r--r-- 1 root root 273 Nov 19 2010 dmesg.conf
-rw-r--r-- 1 root root 1105 Mar 7 2014 dovecot.conf
-rw-r--r-- 1 root root 1377 Jul 18 2014 failsafe.conf
-rw-r--r-- 1 root root 267 Jul 18 2014 flush-early-job-log.conf
-rw-r--r-- 1 root root 284 Jul 23 2013 hostname.conf
-rw-r--r-- 1 root root 557 Sep 25 18:51 hwclock.conf
-rw-r--r-- 1 root root 444 Sep 25 18:51 hwclock-save.conf
-rw-r--r-- 1 root root 689 Apr 10 2014 kmod.conf
-rw-r--r-- 1 root root 268 Feb 22 2014 mountall-bootclean.sh.conf
-rw-r--r-- 1 root root 1232 Feb 22 2014 mountall.conf
-rw-r--r-- 1 root root 349 Feb 22 2014 mountall-net.conf
-rw-r--r-- 1 root root 261 Feb 22 2014 mountall-reboot.conf
-rw-r--r-- 1 root root 311 Feb 22 2014 mountall.sh.conf
-rw-r--r-- 1 root root 1201 Feb 22 2014 mountall-shell.conf
-rw-r--r-- 1 root root 327 Feb 22 2014 mountdevsubfs.sh.conf
-rw-r--r-- 1 root root 405 Feb 22 2014 mounted-debugfs.conf
-rw-r--r-- 1 root root 730 Feb 22 2014 mounted-dev.conf
-rw-r--r-- 1 root root 480 Feb 22 2014 mounted-proc.conf
-rw-r--r-- 1 root root 618 Feb 22 2014 mounted-run.conf
-rw-r--r-- 1 root root 1890 Feb 22 2014 mounted-tmp.conf
-rw-r--r-- 1 root root 903 Feb 22 2014 mounted-var.conf
-rw-r--r-- 1 root root 323 Feb 22 2014 mountkernfs.sh.conf
-rw-r--r-- 1 root root 249 Feb 22 2014 mountnfs-bootclean.sh.conf
-rw-r--r-- 1 root root 313 Feb 22 2014 mountnfs.sh.conf
-rw-r--r-- 1 root root 238 Feb 22 2014 mtab.sh.conf
-rw-r--r-- 1 root root 1770 Feb 19 2014 mysql.conf
-rw-r--r-- 1 root root 2359 Jan 1 08:06 networking.conf
-rw-r--r-- 1 root root 1109 May 8 2014 network-interface.conf
-rw-r--r-- 1 root root 530 Mar 20 2014 network-interface-container.conf
-rw-r--r-- 1 root root 1756 May 4 2013 network-interface-security.conf
-rw-r--r-- 1 root root 534 Feb 17 2014 passwd.conf
-rw-r--r-- 1 root root 519 Mar 13 2014 plymouth.conf
-rw-r--r-- 1 root root 326 Mar 13 2014 plymouth-log.conf
-rw-r--r-- 1 root root 675 Mar 13 2014 plymouth-ready.conf
-rw-r--r-- 1 root root 778 Mar 13 2014 plymouth-shutdown.conf
-rw-r--r-- 1 root root 899 Mar 13 2014 plymouth-splash.conf
-rw-r--r-- 1 root root 796 Mar 13 2014 plymouth-stop.conf
-rw-r--r-- 1 root root 421 Apr 11 2014 plymouth-upstart-bridge.conf
-rw-r--r-- 1 root root 363 Jan 6 2014 procps.conf
-rw-r--r-- 1 root root 661 Jul 18 2014 rc.conf
-rw-r--r-- 1 root root 683 Jul 18 2014 rcS.conf
-rw-r--r-- 1 root root 1543 Jul 18 2014 rc-sysinit.conf
-rw-r--r-- 1 root root 426 Apr 18 2013 rsyslog.conf
-rw-r--r-- 1 root root 277 Jul 18 2014 shutdown.conf
-rw-r--r-- 1 root root 641 May 2 2014 ssh.conf
-rw-r--r-- 1 root root 711 Mar 13 2014 startpar-bridge.conf
-rw-r--r-- 1 root root 1183 Oct 29 07:02 systemd-logind.conf
-rw-r--r-- 1 root root 348 Jul 18 2014 tty1.conf
-rw-r--r-- 1 root root 97 Jan 23 13:45 tty2.conf
-rw-r--r-- 1 root root 333 Jul 18 2014 tty3.conf
-rw-r--r-- 1 root root 333 Jul 18 2014 tty4.conf
-rw-r--r-- 1 root root 232 Jul 18 2014 tty5.conf
-rw-r--r-- 1 root root 232 Jul 18 2014 tty6.conf
-rw-r--r-- 1 root root 337 May 7 2014 udev.conf
-rw-r--r-- 1 root root 645 Sep 12 14:03 udev-fallback-graphics.conf
-rw-r--r-- 1 root root 768 May 7 2014 udev-finish.conf
-rw-r--r-- 1 root root 356 May 7 2014 udevmonitor.conf
-rw-r--r-- 1 root root 190 Oct 22 00:13 udev-static.conf
-rw-r--r-- 1 root root 335 Oct 22 00:13 udevtrigger.conf
-rw-r--r-- 1 root root 412 Jul 18 2014 upstart-file-bridge.conf
-rw-r--r-- 1 root root 329 Jul 18 2014 upstart-socket-bridge.conf
-rw-r--r-- 1 root root 553 Jul 18 2014 upstart-udev-bridge.conf
-rw-r--r-- 1 root root 1521 Jul 18 2014 wait-for-state.conf
root at okapi:~# ls -al /etc/init.d
total 188
drwxr-xr-x 2 root root 4096 Jan 10 20:45 .
drwxr-xr-x 89 root root 4096 Jan 23 13:45 ..
-rwxr-xr-x 1 root root 9974 Jan 7 2014 apache2
-rwxr-xr-x 1 root root 19 Oct 22 00:12 bind9
lrwxrwxrwx 1 root root 21 Feb 9 2013 cron -> /lib/init/upstart-job
-rwxr-xr-x 1 root root 2813 Nov 25 19:37 dbus
-rwxr-xr-x 1 root root 1329 Mar 13 2014 halt
-rwxr-xr-x 1 root root 3523 Jan 4 2013 iptables-persistent
-rwxr-xr-x 1 root root 1293 Mar 13 2014 killprocs
-rwxr-xr-x 1 root root 1990 Jan 22 2013 kmod
-rw-r--r-- 1 root root 0 Oct 22 00:13 .legacy-bootordering
-rwxr-xr-x 1 root root 674 Oct 22 00:13 modules_dep.sh
-rwxr-xr-x 1 root root 5491 Feb 19 2014 mysql
-rwxr-xr-x 1 root root 4479 Mar 20 2014 networking
-rwxr-xr-x 1 root root 1292 Mar 13 2014 ondemand
-rwxr-xr-x 1 root root 7507 Feb 12 2014 postfix
-rwxr-xr-x 1 root root 1192 May 27 2013 procps
-rwxr-xr-x 1 root root 3092 Dec 27 2012 quota
-rwxr-xr-x 1 root root 1959 Dec 27 2012 quotarpc
-rwxr-xr-x 1 root root 6120 Mar 13 2014 rc
-rwxr-xr-x 1 root root 782 Mar 13 2014 rc.local
-rwxr-xr-x 1 root root 117 Mar 13 2014 rcS
-rw-r--r-- 1 root root 2427 Mar 13 2014 README
-rwxr-xr-x 1 root root 639 Mar 13 2014 reboot
-rwxr-xr-x 1 root root 2913 Dec 4 2013 rsyslog
-rwxr-xr-x 1 root root 10536 Oct 6 2013 saslauthd
-rwxr-xr-x 1 root root 3920 Mar 13 2014 sendsigs
-rwxr-xr-x 1 root root 590 Mar 13 2014 single
-rw-r--r-- 1 root root 4290 Mar 13 2014 skeleton
-rwxr-xr-x 1 root root 4077 May 2 2014 ssh
-rwxr-xr-x 1 root root 731 Feb 5 2014 sudo
-rwxr-xr-x 1 root root 6173 May 7 2014 udev
-rwxr-xr-x 1 root root 2721 Mar 13 2014 umountfs
-rwxr-xr-x 1 root root 2260 Mar 13 2014 umountnfs.sh
-rwxr-xr-x 1 root root 1872 Mar 13 2014 umountroot
-rwxr-xr-x 1 root root 3111 Mar 13 2014 urandom
-rwxr-xr-x 1 root root 229 Oct 22 00:12 vzreboot
-rwxr-xr-x 1 root root 19 Oct 22 00:12 wide-dhcpv6-client
-rwxr-xr-x 1 root root 2666 Sep 25 2013 x11-common
2015-01-22 3:19 GMT+09:00 Serge Hallyn <serge.hallyn at ubuntu.com>:
> Quoting Smart Goldman (ytlec2014 at gmail.com):
> > 2015-01-17 5:31 GMT+09:00 Serge Hallyn <serge.hallyn at ubuntu.com>:
> >
> > > Operation not permitted? That's unexpected. Are you running a custom
> > > kernel or custom selinux policy?
> >
> > Yes, mine is ubuntu system provided by a VPS service of
> > https://crissic.net/los-angeles_vps_pre-launch
> > I think it's a possibility. I may need to ask the provider about it..
> >
> > Although I do not think this information will be helpful, this is my
kernel
> > version.
> > root at okapi:~# uname -a
> > Linux okapi 2.6.32-042stab093.5 #1 SMP Wed Sep 10 17:39:49 MSK 2014
x86_64
> > x86_64 x86_64 GNU/Linux
> > I think I've never changed the kernel by myself.
> >
> > > I do think removing cgroup-bin
> > >
> > > sudo apt-get purge cgroup-bin
> > >
> > > will fix the mounting of the name=beancounter etc hierarchies.
> >
> > I had removed cgroup-bin.
> > But unfortunately it looks like it was not fixed.
> >
> > Each file after removing cgroup-bin, reboot and re-login is now as
follows:
> >
> > root at okapi:~# cat /proc/self/cgroup
> > 4:name=systemd:/
> > 3:freezer,devices,name=container:/12042
> > 2:cpuacct,cpu,cpuset,name=fairsched:/12042
> > 1:blkio,name=beancounter:/12042
> >
> > root at okapi:~# tail -n 13 /var/log/upstart/cgmanager.log
> > Mounted systemd onto /run/cgmanager/fs/none,name=systemd
> > Mounted container onto /run/cgmanager/fs/none,name=container
> > Mounted fairsched onto /run/cgmanager/fs/none,name=fairsched
> > Mounted beancounter onto /run/cgmanager/fs/none,name=beancounter
> > found 4 controllers
> > buf is /run/cgmanager/agents/cgm-release-agent.systemd
> > buf is /run/cgmanager/agents/cgm-release-agent.container
> > buf is /run/cgmanager/agents/cgm-release-agent.fairsched
> > buf is /run/cgmanager/agents/cgm-release-agent.beancounter
> > Mounted systemd onto /run/cgmanager/fs/none,name=systemd
> > cgmanager: Failed mounting /run/cgmanager/fs/none,name=container:
Operation
> > not permitted
>
> Yeah that's weird.
>
> Look around /var/log and see what is mounting those cgroups
> at boot. What files still exist under /etc/init and /etc/init.d?
>
> > cgmanager: Failed mounting cgroups
> > cgmanager: Failed to set up cgroup mounts
> >
> > root at okapi:~# tail -n 10 /var/log/auth.log
> > Jan 17 00:31:48 okapi sudo: root : TTY=pts/0 ; PWD=/root ;
USER=root ;
> > COMMAND=/usr/bin/apt-get -y purge cgroup-bin
> > Jan 17 00:31:48 okapi sudo: pam_unix(sudo:session): session opened for
user
> > root by root(uid=0)
> > Jan 17 00:31:55 okapi sudo: pam_unix(sudo:session): session closed for
user
> > root
> > Jan 17 00:32:53 okapi systemd-logind[326]: New seat seat0.
> > Jan 17 00:32:54 okapi sshd[492]: Server listening on 0.0.0.0 port 22.
> > Jan 17 00:32:54 okapi sshd[492]: Server listening on :: port 22.
> > Jan 17 00:34:09 okapi sshd[897]: Accepted password for root from
> > 119.105.136.26 port 56815 ssh2
> > Jan 17 00:34:09 okapi sshd[897]: pam_unix(sshd:session): session opened
for
> > user root by (uid=0)
> > Jan 17 00:34:09 okapi systemd-logind[326]: Failed to create cgroup
> > name=systemd:/user/0.user: No such file or directory
> > Jan 17 00:34:09 okapi sshd[897]: pam_systemd(sshd:session): Failed to
> > create session: No such file or directory
>
> > _______________________________________________
> > lxc-users mailing list
> > lxc-users at lists.linuxcontainers.org
> > http://lists.linuxcontainers.org/listinfo/lxc-users
>
> _______________________________________________
> lxc-users mailing list
> lxc-users at lists.linuxcontainers.org
> http://lists.linuxcontainers.org/listinfo/lxc-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linuxcontainers.org/pipermail/lxc-users/attachments/20150123/825f979e/attachment.html>
More information about the lxc-users
mailing list