[lxc-devel] lxc-start: Invalid argument - pivot_root syscall failed

Peter Volkov pva at gentoo.org
Thu Oct 10 16:27:39 UTC 2013


Hi, guys.

I'm using 1.0.0.alpha1 although I've tried with 0.8.0 also and I'm
unable to start container with the following error:

lxc-start: Invalid argument - pivot_root syscall failed
lxc-start: failed to setup pivot root
lxc-start: failed to set rootfs for 'repos'
lxc-start: failed to setup the container
lxc-start: invalid sequence number 1. expected 2
lxc-start: failed to spawn 'repos'

I've tried mount --make-private on all mount point I've thought of with
no luck.
Also I've tried lxc.autodev = 1 also no luck and I guess this is
relevant with systemd while this systems uses openrc as init system.

Container's conf file:

lxc.arch = amd64
lxc.utsname = repos
lxc.rootfs = /virt/lxc/repos

Distribution Gentoo. Same config works fine on another gentoo system.
Although systems are completely different I think important differences
are:
1. init system: on laptop I'm using systemd while on server openrc
2. on server I have full system inside ram (system resides inside
initramfs and after boot root stays in RAM on rootfs)

# cat /proc/self/mountinfo

1 1 0:1 / / rw - rootfs rootfs rw
14 1 0:3 / /proc rw,nosuid,nodev,noexec,relatime - proc proc rw
15 1 0:13 / /run rw,nosuid,nodev,relatime - tmpfs tmpfs rw,mode=755
16 1 0:5 / /dev rw,nosuid,relatime - devtmpfs udev
rw,size=10240k,nr_inodes=4081011,mode=755
17 16 0:10 / /dev/pts rw,nosuid,noexec,relatime - devpts devpts
rw,gid=5,mode=620,ptmxmode=000
18 16 0:14 / /dev/shm rw,nosuid,nodev,noexec,relatime - tmpfs shm rw
19 1 0:15 / /sys rw,nosuid,nodev,noexec,relatime - sysfs sysfs rw
20 19 0:12 / /sys/kernel/security rw,nosuid,nodev,noexec,relatime -
securityfs securityfs rw
21 19 0:7 / /sys/kernel/debug rw,nosuid,nodev,noexec,relatime - debugfs
debugfs rw
22 19 0:16 / /sys/fs/cgroup rw,nosuid,nodev,noexec,relatime - tmpfs
cgroup_root rw,size=10240k,mode=755
23 22 0:17 / /sys/fs/cgroup/openrc rw,nosuid,nodev,noexec,relatime -
cgroup openrc
rw,release_agent=/lib64/rc/sh/cgroup-release-agent.sh,name=openrc
24 22 0:18 / /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime -
cgroup cpuset rw,cpuset,clone_children
25 22 0:19 / /sys/fs/cgroup/cpu rw,nosuid,nodev,noexec,relatime - cgroup
cpu rw,cpu
26 22 0:20 / /sys/fs/cgroup/cpuacct rw,nosuid,nodev,noexec,relatime -
cgroup cpuacct rw,cpuacct
27 22 0:21 / /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime -
cgroup memory rw,memory
28 22 0:22 / /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime -
cgroup devices rw,devices
29 22 0:23 / /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime -
cgroup freezer rw,freezer
30 22 0:24 / /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime -
cgroup blkio rw,blkio
31 22 0:25 / /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime -
cgroup perf_event rw,perf_event
32 1 8:1 / /mnt/root rw,noatime - ext4 /dev/sda1 rw,data=ordered
33 1 254:1 / /virt rw,relatime - ext4 /dev/mapper/virt rw,data=ordered

So any suggestions are welcome. Output of -l DEBUG -o test.debug in
attachment.

Just for record, I've opened bug report
https://github.com/lxc/lxc/issues/61 for this.

TIA,
--
Peter.
-------------- next part --------------
      lxc-start 1381350553.618 WARN     lxc_log - lxc_log_init called with log already initialized
      lxc-start 1381350553.618 INFO     lxc_apparmor - apparmor_load - apparmor is disabled
      lxc-start 1381350553.618 DEBUG    lxc_start - sigchild handler set
      lxc-start 1381350553.618 DEBUG    lxc_console - opening /dev/tty for console peer
      lxc-start 1381350553.618 DEBUG    lxc_console - using '/dev/tty' as console
      lxc-start 1381350553.618 DEBUG    lxc_console - 2890 got SIGWINCH fd 9
      lxc-start 1381350553.618 DEBUG    lxc_console - set winsz dstfd:6 cols:112 rows:26
      lxc-start 1381350553.618 INFO     lxc_start - 'repos' is initialized
      lxc-start 1381350553.666 DEBUG    lxc_start - Not dropping cap_sys_boot or watching utmp

      lxc-start 1381350553.666 INFO     lxc_conf - opened /virt/lxc/repos.hold as fd 12

      lxc-start 1381350553.667 INFO     lxc_conf - 'repos' hostname has been setup
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .34 34 0:1 / / rw - rootfs rootfs rw
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .35 34 0:3 / /proc rw,nosuid,nodev,noexec,relatime - proc proc rw
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /proc.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .36 34 0:13 / /run rw,nosuid,nodev,relatime - tmpfs tmpfs rw,mode=755
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /run.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .37 34 0:5 / /dev rw,nosuid,relatime - devtmpfs udev rw,size=10240k,nr_inodes=4081011,mode=755
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /dev.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .38 37 0:10 / /dev/pts rw,nosuid,noexec,relatime - devpts devpts rw,gid=5,mode=620,ptmxmode=000
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /dev/pts.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .39 37 0:14 / /dev/shm rw,nosuid,nodev,noexec,relatime - tmpfs shm rw
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /dev/shm.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .40 34 0:15 / /sys rw,nosuid,nodev,noexec,relatime - sysfs sysfs rw
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /sys.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .41 40 0:12 / /sys/kernel/security rw,nosuid,nodev,noexec,relatime - securityfs securityfs rw
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /sys/kernel/security.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .42 40 0:7 / /sys/kernel/debug rw,nosuid,nodev,noexec,relatime - debugfs debugfs rw
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /sys/kernel/debug.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .43 40 0:16 / /sys/fs/cgroup rw,nosuid,nodev,noexec,relatime - tmpfs cgroup_root rw,size=10240k,mode=755
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /sys/fs/cgroup.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .44 43 0:17 / /sys/fs/cgroup/openrc rw,nosuid,nodev,noexec,relatime - cgroup openrc rw,release_agent=/lib64/rc/sh/cgroup-release-agent.sh,name=openrc
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /sys/fs/cgroup/openrc.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .45 43 0:18 / /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime - cgroup cpuset rw,cpuset,clone_children
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /sys/fs/cgroup/cpuset.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .46 43 0:19 / /sys/fs/cgroup/cpu rw,nosuid,nodev,noexec,relatime - cgroup cpu rw,cpu
.
      lxc-start 1381350553.667 INFO     lxc_conf - now p is . /sys/fs/cgroup/cpu.
      lxc-start 1381350553.667 INFO     lxc_conf - looking at .47 43 0:20 / /sys/fs/cgroup/cpuacct rw,nosuid,nodev,noexec,relatime - cgroup cpuacct rw,cpuacct
.
      lxc-start 1381350553.668 INFO     lxc_conf - now p is . /sys/fs/cgroup/cpuacct.
      lxc-start 1381350553.668 INFO     lxc_conf - looking at .48 43 0:21 / /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime - cgroup memory rw,memory
.
      lxc-start 1381350553.668 INFO     lxc_conf - now p is . /sys/fs/cgroup/memory.
      lxc-start 1381350553.668 INFO     lxc_conf - looking at .49 43 0:22 / /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime - cgroup devices rw,devices
.
      lxc-start 1381350553.668 INFO     lxc_conf - now p is . /sys/fs/cgroup/devices.
      lxc-start 1381350553.668 INFO     lxc_conf - looking at .50 43 0:23 / /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime - cgroup freezer rw,freezer
.
      lxc-start 1381350553.668 INFO     lxc_conf - now p is . /sys/fs/cgroup/freezer.
      lxc-start 1381350553.668 INFO     lxc_conf - looking at .51 43 0:24 / /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime - cgroup blkio rw,blkio
.
      lxc-start 1381350553.668 INFO     lxc_conf - now p is . /sys/fs/cgroup/blkio.
      lxc-start 1381350553.668 INFO     lxc_conf - looking at .52 43 0:25 / /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime - cgroup perf_event rw,perf_event
.
      lxc-start 1381350553.668 INFO     lxc_conf - now p is . /sys/fs/cgroup/perf_event.
      lxc-start 1381350553.668 INFO     lxc_conf - looking at .53 34 8:1 / /mnt/root rw,noatime - ext4 /dev/sda1 rw,data=ordered
.
      lxc-start 1381350553.668 INFO     lxc_conf - now p is . /mnt/root.
      lxc-start 1381350553.668 INFO     lxc_conf - looking at .54 34 254:1 / /virt rw,relatime - ext4 /dev/mapper/virt rw,data=ordered
.
      lxc-start 1381350553.668 INFO     lxc_conf - now p is . /virt.
      lxc-start 1381350553.669 DEBUG    lxc_conf - mounted '/virt/lxc/repos' on '/usr/lib/lxc/rootfs'
      lxc-start 1381350553.669 INFO     lxc_conf - console has been setup
      lxc-start 1381350553.669 INFO     lxc_conf - 0 tty(s) has been setup
      lxc-start 1381350553.669 DEBUG    lxc_conf - mountpoint for old rootfs is '/usr/lib/lxc/rootfs/lxc_putold'
      lxc-start 1381350553.669 ERROR    lxc_conf - Invalid argument - pivot_root syscall failed
      lxc-start 1381350553.669 ERROR    lxc_conf - failed to setup pivot root
      lxc-start 1381350553.669 ERROR    lxc_conf - failed to set rootfs for 'repos'
      lxc-start 1381350553.669 ERROR    lxc_start - failed to setup the container
      lxc-start 1381350553.669 ERROR    lxc_sync - invalid sequence number 1. expected 2
      lxc-start 1381350553.766 ERROR    lxc_start - failed to spawn 'repos'


More information about the lxc-devel mailing list