<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Plain Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.PlainTextChar
{mso-style-name:"Plain Text Char";
mso-style-priority:99;
mso-style-link:"Plain Text";
font-family:"Calibri","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoPlainText>Yesterday I couldn't reproduce the issue with 2 LXC containers running, but today I've rebooted everything and I have one LXC container running and it can't access the router or internet (but can access the host IP and other LXC containers).<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Right now the br0 MAC is configured to be the same as the eth0 MAC address.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Is it odd that, on the host OS, when I check the ARP table the mac address for the LXC IP (10.1.3.45) is seen as the MAC *inside* the container, not of vethR1s1ny on the host. But maybe that’s expected behavior?<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Also notable, from the host OS I can ping 10.1.3.45 (the LXC containers IP), but when I SSH to it there is around a 30 second delay before the SSH login prompt comes up. When things are working there is no such lag.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>I turned on debug logging like Serge suggested, but don’t see anything interesting in there (also below).<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>David<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><b>IFCONFIG / BRCTL SHOW / ARP -A<o:p></o:p></b></p><p class=MsoPlainText><span style='font-family:"Courier New"'>davidparks21@ubuntuserver:~$ ifconfig<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>br0 Link encap:Ethernet HWaddr 08:00:27:ca:5f:7a<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> inet addr:10.1.0.5 Bcast:10.1.255.255 Mask:255.255.0.0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> inet6 addr: fe80::a00:27ff:feca:5f7a/64 Scope:Link<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> RX packets:983 errors:0 dropped:0 overruns:0 frame:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> TX packets:949 errors:0 dropped:0 overruns:0 carrier:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> collisions:0 txqueuelen:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> RX bytes:87727 (87.7 KB) TX bytes:108287 (108.2 KB)<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'><o:p> </o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>eth0 Link encap:Ethernet HWaddr 08:00:27:ca:5f:7a<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> RX packets:883 errors:0 dropped:0 overruns:0 frame:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> TX packets:725 errors:0 dropped:0 overruns:0 carrier:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> collisions:0 txqueuelen:1000<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> RX bytes:97519 (97.5 KB) TX bytes:79510 (79.5 KB)<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'><o:p> </o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>lo Link encap:Local Loopback<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> inet addr:127.0.0.1 Mask:255.0.0.0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> inet6 addr: ::1/128 Scope:Host<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> UP LOOPBACK RUNNING MTU:16436 Metric:1<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> RX packets:7 errors:0 dropped:0 overruns:0 frame:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> TX packets:7 errors:0 dropped:0 overruns:0 carrier:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> collisions:0 txqueuelen:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> RX bytes:616 (616.0 B) TX bytes:616 (616.0 B)<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'><o:p> </o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>vethR1s1ny Link encap:Ethernet HWaddr fe:d5:4a:f2:07:db<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> inet6 addr: fe80::fcd5:4aff:fef2:7db/64 Scope:Link<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> RX packets:247 errors:0 dropped:0 overruns:0 frame:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> TX packets:367 errors:0 dropped:0 overruns:0 carrier:0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> collisions:0 txqueuelen:1000<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> RX bytes:28718 (28.7 KB) TX bytes:37972 (37.9 KB)<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'><o:p> </o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>davidparks21@ubuntuserver:~$ brctl show<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>bridge name bridge id STP enabled interfaces<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>br0 8000.080027ca5f7a no eth0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> vethR1s1ny<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>davidparks21@ubuntuserver:~$ arp -a<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>? (10.1.0.2) at 52:54:00:12:35:02 [ether] on br0<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'>? (10.1.3.45) at 26:b2:18:b5:fc:e7 [ether] on br0<o:p></o:p></span></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><b>LXC DEBUG LOG<o:p></o:p></b></p><p class=MsoPlainText><span style='font-family:"Courier New"'>davidparks21@ubuntuserver:~/lxc$ cat lxc.debug<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.454 INFO lxc_conf - tty's configured<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.454 INFO lxc_start - 'cloudera-manager' is initialized<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.560 INFO lxc_conf - opened /var/lib/lxc/cloudera-manager/rootfs.hold as fd 18<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'><o:p> </o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.562 INFO lxc_cgroup - [1] found cgroup mounted at '/sys/fs/cgroup/cpuset',opts='rw,relatime,cpuset,clone_children'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.733 INFO lxc_cgroup - created cgroup '/sys/fs/cgroup/cpuset//lxc/cloudera-manager'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.733 INFO lxc_cgroup - [2] found cgroup mounted at '/sys/fs/cgroup/cpu',opts='rw,relatime,cpu,clone_children'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.743 INFO lxc_cgroup - created cgroup '/sys/fs/cgroup/cpu//lxc/cloudera-manager'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.743 INFO lxc_cgroup - [3] found cgroup mounted at '/sys/fs/cgroup/cpuacct',opts='rw,relatime,cpuacct,clone_children'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.749 INFO lxc_cgroup - created cgroup '/sys/fs/cgroup/cpuacct//lxc/cloudera-manager'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.749 INFO lxc_cgroup - [4] found cgroup mounted at '/sys/fs/cgroup/memory',opts='rw,relatime,memory,clone_children'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.757 INFO lxc_cgroup - created cgroup '/sys/fs/cgroup/memory//lxc/cloudera-manager'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.757 INFO lxc_cgroup - [5] found cgroup mounted at '/sys/fs/cgroup/devices',opts='rw,relatime,devices,clone_children'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.769 INFO lxc_cgroup - created cgroup '/sys/fs/cgroup/devices//lxc/cloudera-manager'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.769 INFO lxc_cgroup - [6] found cgroup mounted at '/sys/fs/cgroup/freezer',opts='rw,relatime,freezer,clone_children'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.770 INFO lxc_cgroup - created cgroup '/sys/fs/cgroup/freezer//lxc/cloudera-manager'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.770 INFO lxc_cgroup - [7] found cgroup mounted at '/sys/fs/cgroup/blkio',opts='rw,relatime,blkio,clone_children'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.771 INFO lxc_cgroup - created cgroup '/sys/fs/cgroup/blkio//lxc/cloudera-manager'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.771 INFO lxc_cgroup - [8] found cgroup mounted at '/sys/fs/cgroup/perf_event',opts='rw,relatime,perf_event,clone_children'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.772 INFO lxc_cgroup - created cgroup '/sys/fs/cgroup/perf_event//lxc/cloudera-manager'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.774 INFO lxc_conf - 'cloudera-manager' hostname has been setup<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.778 INFO lxc_conf - network has been setup<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.778 INFO lxc_conf - mount points have been setup<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.778 INFO lxc_conf - mount points have been setup<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.781 INFO lxc_conf - cgroup has been setup<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.781 INFO lxc_conf - created /usr/lib/x86_64-linux-gnu/lxc/dev/lxc<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'><o:p> </o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.781 INFO lxc_conf - console has been setup on lxc/console<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.781 INFO lxc_conf - 4 tty(s) has been setup<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.781 INFO lxc_conf - rootfs path is ./var/lib/lxc/cloudera-manager/rootfs., mount is ./usr/lib/x86_64-linux-gnu/lxc.<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.781 INFO lxc_conf - I am 1, /proc/self points to 1<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'><o:p> </o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.782 INFO lxc_conf - created new pts instance<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.782 INFO lxc_conf - set personality to '0x0'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.782 NOTICE lxc_conf - 'cloudera-manager' is setup.<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.782 INFO lxc_start - changed apparmor profile to lxc-container-default<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.782 NOTICE lxc_start - exec'ing '/sbin/init'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.783 NOTICE lxc_start - '/sbin/init' started with pid '3333'<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.783 WARN lxc_console - console input disabled<o:p></o:p></span></p><p class=MsoPlainText><span style='font-family:"Courier New"'> lxc-start 1364962992.783 WARN lxc_start - invalid pid for SIGCHLD<o:p></o:p></span></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>-----Original Message-----<br>From: Hans Feldt [mailto:hans.feldt@ericsson.com] <br>Sent: Tuesday, April 02, 2013 9:46 PM<br>To: Serge Hallyn<br>Cc: David Parks; lxc-users@lists.sourceforge.net<br>Subject: Re: [Lxc-users] Networking fails sporadically in containers on ubuntu server 12.10</p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Could it be the issue described in<o:p></o:p></p><p class=MsoPlainText><a href="http://backreference.org/2010/07/28/linux-bridge-mac-addresses-and-dynamic-ports/"><span style='color:windowtext;text-decoration:none'>http://backreference.org/2010/07/28/linux-bridge-mac-addresses-and-dynamic-ports/</span></a><o:p></o:p></p><p class=MsoPlainText>?<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>I encountered that one and solved it by creating a dummy interface with the same life cycle as the bridge.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>thanks,<o:p></o:p></p><p class=MsoPlainText>Hans<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>On 04/01/2013 02:34 PM, Serge Hallyn wrote:<o:p></o:p></p><p class=MsoPlainText>> Quoting David Parks (<a href="mailto:davidparks21@yahoo.com"><span style='color:windowtext;text-decoration:none'>davidparks21@yahoo.com</span></a>):<o:p></o:p></p><p class=MsoPlainText>>> davidparks21@hostOS:~$ arp -a<o:p></o:p></p><p class=MsoPlainText>>><o:p> </o:p></p><p class=MsoPlainText>>> ? (10.1.0.4) at c6:63:bb:a7:d8:60 [ether] on br0<o:p></o:p></p><p class=MsoPlainText>>><o:p> </o:p></p><p class=MsoPlainText>>> ? (10.1.0.2) at 52:54:00:12:35:02 [ether] on br0<o:p></o:p></p><p class=MsoPlainText>>><o:p> </o:p></p><p class=MsoPlainText>>> ? (10.1.0.45) at 32:8c:fc:c1:7f:e5 [ether] on br0<o:p></o:p></p><p class=MsoPlainText>><o:p> </o:p></p><p class=MsoPlainText>> Can you set the macaddr on your virtualbox nic to something lower, <o:p></o:p></p><p class=MsoPlainText>> like something starting with 22: ?<o:p></o:p></p><p class=MsoPlainText>><o:p> </o:p></p><p class=MsoPlainText>> 32: sounds really low for a veth peer nic, I'm surprised - mine are <o:p></o:p></p><p class=MsoPlainText>> always fe:. In fact, looking at <o:p></o:p></p><p class=MsoPlainText>> src/lxc/conf.c:setup_private_host_hw_addr(), it makes sure to set 0xfe <o:p></o:p></p><p class=MsoPlainText>> in the first two bytes. So why are you getting 32: ? Hmmm.<o:p></o:p></p><p class=MsoPlainText>><o:p> </o:p></p><p class=MsoPlainText>> Could you also try adding '-l info -o lxc.debug' to your lxc-start <o:p></o:p></p><p class=MsoPlainText>> command on a failing container, and send the resulting lxc.debug file? <o:p></o:p></p><p class=MsoPlainText>> We're looking for output from:<o:p></o:p></p><p class=MsoPlainText>><o:p> </o:p></p><p class=MsoPlainText>> DEBUG("mac address of host interface '%s' changed to private "<o:p></o:p></p><p class=MsoPlainText>> "%02x:%02x:%02x:%02x:%02x:%02x", veth1,<o:p></o:p></p><p class=MsoPlainText>><o:p> </o:p></p><p class=MsoPlainText>> thanks,<o:p></o:p></p><p class=MsoPlainText>> -serge<o:p></o:p></p><p class=MsoPlainText>><o:p> </o:p></p><p class=MsoPlainText>> ----------------------------------------------------------------------<o:p></o:p></p><p class=MsoPlainText>> -------- Own the Future-Intel® Level Up Game Demo Contest 2013 <o:p></o:p></p><p class=MsoPlainText>> Rise to greatness in Intel's independent game demo contest.<o:p></o:p></p><p class=MsoPlainText>> Compete for recognition, cash, and the chance to get your game on <o:p></o:p></p><p class=MsoPlainText>> Steam. $5K grand prize plus 10 genre and skill prizes.<o:p></o:p></p><p class=MsoPlainText>> Submit your demo by 6/6/13. <a href="http://p.sf.net/sfu/intel_levelupd2d"><span style='color:windowtext;text-decoration:none'>http://p.sf.net/sfu/intel_levelupd2d</span></a><o:p></o:p></p><p class=MsoPlainText>> _______________________________________________<o:p></o:p></p><p class=MsoPlainText>> Lxc-users mailing list<o:p></o:p></p><p class=MsoPlainText>> <a href="mailto:Lxc-users@lists.sourceforge.net"><span style='color:windowtext;text-decoration:none'>Lxc-users@lists.sourceforge.net</span></a><o:p></o:p></p><p class=MsoPlainText>> <a href="https://lists.sourceforge.net/lists/listinfo/lxc-users"><span style='color:windowtext;text-decoration:none'>https://lists.sourceforge.net/lists/listinfo/lxc-users</span></a><o:p></o:p></p><p class=MsoPlainText>><o:p> </o:p></p><p class=MsoPlainText>><o:p> </o:p></p></div></body></html>