[lxc-users] OOM kill in LXD when swap not full

[Pavol Cupka]

Hi list,

maybe it is a stupid question, or maybe I just don't understand how it
works. I have a server running Gentoo, a recent kernel - 4.8.3, and lx*
versions as follows.
lxd 2.4.1
lxc 2.0.5
lxcfs 2.0.4
cgmanager 0.41

2GB RAM, 4GB swap and I am running a couple of containers.

My processes get killed by the oom although the swap is nearly unused.

free -mlh
              total        used        free      shared  buff/cache
available
Mem:           2.0G        363M        273M         29M        1.4G
1.5G
Low:           739M        716M         22M
High:          1.2G        1.0G        250M
Swap:          4.0G        8.5M        4.0G

[126603.521662] Killed process 1135 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB
[126603.563243] Killed process 32057 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB
[126603.605512] Killed process 25231 (pickup) total-vm:38280kB,
anon-rss:472kB, file-rss:4608kB, shmem-rss:0kB
[126603.651911] Killed process 1604 (syslog-ng) total-vm:16852kB,
anon-rss:600kB, file-rss:3400kB, shmem-rss:0kB
[126603.721520] Killed process 2571 (mandb) total-vm:5176kB,
anon-rss:1984kB, file-rss:1852kB, shmem-rss:0kB
[126604.216420] Killed process 4258 (bash) total-vm:6780kB, anon-rss:312kB,
file-rss:2448kB, shmem-rss:0kB
[126604.243154] Killed process 4257 (mosh-server) total-vm:16524kB,
anon-rss:1024kB, file-rss:3156kB, shmem-rss:0kB
[126604.527476] Killed process 4389 (syslog-ng) total-vm:44624kB,
anon-rss:368kB, file-rss:2936kB, shmem-rss:0kB
[126604.679835] Killed process 3134 (init) total-vm:1684kB, anon-rss:44kB,
file-rss:8kB, shmem-rss:0kB
[126605.229347] Killed process 4545 (nginx) total-vm:61344kB,
anon-rss:4352kB, file-rss:2280kB, shmem-rss:4kB
[126605.617913] Killed process 4546 (nginx) total-vm:61344kB,
anon-rss:4352kB, file-rss:2300kB, shmem-rss:4kB
[126605.723802] Killed process 4553 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126606.461064] Killed process 4547 (nginx) total-vm:61344kB,
anon-rss:4368kB, file-rss:3312kB, shmem-rss:4kB
[126606.487237] Killed process 4564 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126606.829193] Killed process 4552 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.084117] Killed process 4548 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.394812] Killed process 4570 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.429775] Killed process 4569 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.541393] Killed process 4541 (nginx) total-vm:10328kB,
anon-rss:4468kB, file-rss:1784kB, shmem-rss:0kB
[126607.675852] Killed process 4568 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB
[126607.702717] Killed process 4562 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB
[126607.818157] Killed process 4561 (nginx) total-vm:61344kB,
anon-rss:4180kB, file-rss:1896kB, shmem-rss:0kB

I have soft limit and swap use enabled
  limits.memory.enforce: soft
  limits.memory.swap: "true"

vm.swappiness = 60 on the host

How can I debug it more? Thank you in advance
Pavol
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linuxcontainers.org/pipermail/lxc-users/attachments/20161024/d58d1178/attachment.html>