<div dir="ltr">Hi Steve-<div><br></div><div>  I'm currently investigating some issues in devstack that are identical to this. I don't currently have answers for you just yet, but please know that I'm actively trying to figure this out as well. It's likely a configuration issue with neutron, but I'm not entirely sure.</div><div><br></div><div>Cheers,</div><div>Paul</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jun 8, 2016 at 12:10 PM, Steve Searles <span dir="ltr"><<a href="mailto:SSearles@zimcom.net" target="_blank">SSearles@zimcom.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">



<div style="word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:Calibri,sans-serif">
<div>Hello everyone, I have configured a nova-compute-lxd node in our openstack environment.   We are currently running Openstack Mitaka (Not Devstack) with neutron.  I am able to provision instances however they have no network connectivity.  When using a
 regular provider network and not VxLAN networks, if I add the provider network (em2 in my case) to the bridge group manually it will function properly. So it appears that the interface is not added to the bridge during the provisioning process.  </div>
<div><br>
</div>
<div>My neutron config on the host has </div>
<div><br>
</div>
<div>physical_interface_mappings = public:em2</div>
<div><br>
</div>
<div>This is for VxLAN support.</div>
<div><br>
</div>
<div>
<div>enable_vxlan = True</div>
<div>local_ip = 172.26.3.1</div>
<div>l2_population = True</div>
</div>
<div><br>
</div>
<div>After adding an instance. </div>
<div><br>
</div>
<div>
<div>root@lxd01:~# nova list</div>
<div>+--------------------------------------+------+--------+------------+-------------+--------------------+</div>
<div>| ID                                   | Name | Status | Task State | Power State | Networks           |</div>
<div>+--------------------------------------+------+--------+------------+-------------+--------------------+</div>
<div>| d98ec618-1d98-47d1-95d1-31d39af38f3a | test | ACTIVE | -          | Running     | public=70.36.33.15 |</div>
<div>+--------------------------------------+------+--------+------------+-------------+——————————+</div>
</div>
<div><br>
</div>
<div>
<div>root@lxd01:~# lxc list</div>
<div>+-------------------+---------+------+------+------------+-----------+</div>
<div>|       NAME        |  STATE  | IPV4 | IPV6 |    TYPE    | SNAPSHOTS |</div>
<div>+-------------------+---------+------+------+------------+-----------+</div>
<div>| instance-0000001b | RUNNING |      |      | PERSISTENT | 0         |</div>
<div>+-------------------+---------+------+------+------------+—————+</div>
</div>
<div><br>
</div>
<div>
<div>root@lxd01:~# brctl show</div>
<div>bridge name<span style="white-space:pre-wrap"> </span>bridge id<span style="white-space:pre-wrap">
</span>STP enabled<span style="white-space:pre-wrap"> </span>interfaces</div>
<div>brq5d71d51f-4b<span style="white-space:pre-wrap"> </span>8000.feec5f898aa5<span style="white-space:pre-wrap">
</span>no<span style="white-space:pre-wrap"> </span>vethNV5DFH</div>
<div>lxdbr0<span style="white-space:pre-wrap"> </span>8000.000000000000<span style="white-space:pre-wrap">
</span>no<span style="white-space:pre-wrap"> </span></div>
<div>virbr0<span style="white-space:pre-wrap"> </span>8000.52540009839a<span style="white-space:pre-wrap">
</span>yes<span style="white-space:pre-wrap"> </span>virbr0-nic</div>
<div>root@lxd01:~# </div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div>root@lxd01:~# lxc exec instance-0000001b -- /bin/bash</div>
<div>root@ubuntu:~# ifconfig</div>
<div>eth0      Link encap:Ethernet  HWaddr fa:16:3e:06:30:fc  </div>
<div>          inet6 addr: fe80::f816:3eff:fe06:30fc/64 Scope:Link</div>
<div>          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1</div>
<div>          RX packets:9 errors:0 dropped:0 overruns:0 frame:0</div>
<div>          TX packets:187 errors:0 dropped:0 overruns:0 carrier:0</div>
<div>          collisions:0 txqueuelen:1000 </div>
<div>          RX bytes:718 (718.0 B)  TX bytes:61866 (61.8 KB)</div>
<div><br>
</div>
<div>lo        Link encap:Local Loopback  </div>
<div>          inet addr:127.0.0.1  Mask:255.0.0.0</div>
<div>          inet6 addr: ::1/128 Scope:Host</div>
<div>          UP LOOPBACK RUNNING  MTU:65536  Metric:1</div>
<div>          RX packets:128 errors:0 dropped:0 overruns:0 frame:0</div>
<div>          TX packets:128 errors:0 dropped:0 overruns:0 carrier:0</div>
<div>          collisions:0 txqueuelen:1 </div>
<div>          RX bytes:9968 (9.9 KB)  TX bytes:9968 (9.9 KB)</div>
<div><br>
</div>
<div>root@ubuntu:~# </div>
</div>
<div>Exit</div>
<div><br>
</div>
<div>
<div>root@lxd01:~# brctl addif brq5d71d51f-4b em2</div>
<div>root@lxd01:~# brctl show</div>
<div>bridge name<span style="white-space:pre-wrap"> </span>bridge id<span style="white-space:pre-wrap">
</span>STP enabled<span style="white-space:pre-wrap"> </span>interfaces</div>
<div>brq5d71d51f-4b<span style="white-space:pre-wrap"> </span>8000.0026b942da6f<span style="white-space:pre-wrap">
</span>no<span style="white-space:pre-wrap"> </span>em2</div>
<div><span style="white-space:pre-wrap"></span>vethNV5DFH</div>
<div>lxdbr0<span style="white-space:pre-wrap"> </span>8000.000000000000<span style="white-space:pre-wrap">
</span>no<span style="white-space:pre-wrap"> </span></div>
<div>virbr0<span style="white-space:pre-wrap"> </span>8000.52540009839a<span style="white-space:pre-wrap">
</span>yes<span style="white-space:pre-wrap"> </span>virbr0-nic</div>
<div>root@lxd01:~#</div>
</div>
<div><br>
</div>
<div>
<div>root@lxd01:~# lxc restart instance-0000001b </div>
<div>root@lxd01:~# lxc list</div>
<div>+-------------------+---------+--------------------+------+------------+-----------+</div>
<div>|       NAME        |  STATE  |        IPV4        | IPV6 |    TYPE    | SNAPSHOTS |</div>
<div>+-------------------+---------+--------------------+------+------------+-----------+</div>
<div>| instance-0000001b | RUNNING | 70.36.33.15 (eth0) |      | PERSISTENT | 0         |</div>
<div>+-------------------+---------+--------------------+------+------------+-----------+</div>
<div>root@lxd01:~# nova list</div>
<div>+--------------------------------------+------+--------+------------+-------------+--------------------+</div>
<div>| ID                                   | Name | Status | Task State | Power State | Networks           |</div>
<div>+--------------------------------------+------+--------+------------+-------------+--------------------+</div>
<div>| d98ec618-1d98-47d1-95d1-31d39af38f3a | test | ACTIVE | -          | Running     | public=70.36.33.15 |</div>
<div>+--------------------------------------+------+--------+------------+-------------+--------------------+</div>
<div>root@lxd01:~# </div>
</div>
<div><br>
</div>
<div>
<div>root@lxd01:~# lxc exec instance-0000001b -- /bin/bash</div>
<div>root@ubuntu:~# ifconfig</div>
<div>eth0      Link encap:Ethernet  HWaddr fa:16:3e:06:30:fc  </div>
<div>          inet addr:70.36.33.15  Bcast:70.36.33.255  Mask:255.255.255.0</div>
<div>          inet6 addr: fe80::f816:3eff:fe06:30fc/64 Scope:Link</div>
<div>          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1</div>
<div>          RX packets:491 errors:0 dropped:0 overruns:0 frame:0</div>
<div>          TX packets:182 errors:0 dropped:0 overruns:0 carrier:0</div>
<div>          collisions:0 txqueuelen:1000 </div>
<div>          RX bytes:39890 (39.8 KB)  TX bytes:17244 (17.2 KB)</div>
<div><br>
</div>
<div>lo        Link encap:Local Loopback  </div>
<div>          inet addr:127.0.0.1  Mask:255.0.0.0</div>
<div>          inet6 addr: ::1/128 Scope:Host</div>
<div>          UP LOOPBACK RUNNING  MTU:65536  Metric:1</div>
<div>          RX packets:0 errors:0 dropped:0 overruns:0 frame:0</div>
<div>          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0</div>
<div>          collisions:0 txqueuelen:1 </div>
<div>          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)</div>
<div><br>
</div>
<div>root@ubuntu:~# ping 8.8.8.8</div>
<div>PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data.</div>
<div>64 bytes from <a href="http://8.8.8.8" target="_blank">8.8.8.8</a>: icmp_seq=1 ttl=48 time=20.0 ms</div>
<div>64 bytes from <a href="http://8.8.8.8" target="_blank">8.8.8.8</a>: icmp_seq=2 ttl=48 time=19.5 ms</div>
<div>^C</div>
<div>--- 8.8.8.8 ping statistics ---</div>
<div>2 packets transmitted, 2 received, 0% packet loss, time 1001ms</div>
<div>rtt min/avg/max/mdev = 19.516/19.803/20.090/0.287 ms</div>
<div>root@ubuntu:~# </div>
</div>
<div><br>
</div>
<div>Yay all good. </div>
<div><br>
</div>
<div><br>
</div>
<div>Any idea on what I might be missing?  Does the LXC implementation support VxLAN?  When I provision an instance with VxLAN the vxnet—XX interfaces do not seem to get created either. </div>
<div><br>
</div>
<div>This is what brctl looks like after provisioning a VxLAN instance. </div>
<div><br>
</div>
<div>
<div>root@lxd01:~# brctl show</div>
<div>bridge name<span style="white-space:pre-wrap"> </span>bridge id<span style="white-space:pre-wrap">
</span>STP enabled<span style="white-space:pre-wrap"> </span>interfaces</div>
<div>brq5d71d51f-4b<span style="white-space:pre-wrap"> </span>8000.0026b942da6f<span style="white-space:pre-wrap">
</span>no<span style="white-space:pre-wrap"> </span>em2</div>
<div><span style="white-space:pre-wrap"></span>veth8UXD1A</div>
<div>brq6d747849-47<span style="white-space:pre-wrap"> </span>8000.fec52a511007<span style="white-space:pre-wrap">
</span>no<span style="white-space:pre-wrap"> </span>veth4N38LY</div>
<div>lxdbr0<span style="white-space:pre-wrap"> </span>8000.000000000000<span style="white-space:pre-wrap">
</span>no<span style="white-space:pre-wrap"> </span></div>
<div>virbr0<span style="white-space:pre-wrap"> </span>8000.52540009839a<span style="white-space:pre-wrap">
</span>yes<span style="white-space:pre-wrap"> </span>virbr0-nic</div>
<div>root@lxd01:~# </div>
</div>
<div><br>
</div>
<div>A new bridge was created with the veth from the container but no vxlan interface. </div>
<div><br>
</div>
<div>Can someone point me in the right direction? </div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div>
<div><span style="color:rgb(89,89,89);font-family:Cambria,serif;font-size:11pt">Steven Searles  | </span><a href="mailto:ssearles@zimcom.net" style="font-family:Cambria,serif;font-size:11pt" target="_blank">ssearles@zimcom.net</a></div>
<div style="font-family:Helvetica;font-size:12px">
<div>
<div>
<div style="margin:0in 0in 0.0001pt;font-size:12pt;font-family:'Times New Roman',serif">
<span style="font-size:11pt;font-family:Cambria,serif;color:rgb(89,89,89)">Zimcom Internet Solutions  | <a href="http://www.zimcom.net/" target="_blank">www.zimcom.net</a><u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:12pt;font-family:'Times New Roman',serif;line-height:24px">
<span style="font-size:11pt;line-height:22px;font-family:Cambria,serif;color:rgb(89,89,89)">O: <a href="tel:513.231.9500" value="+15132319500" target="_blank">513.231.9500</a>  |  D: <a href="tel:513.233.4130" value="+15132334130" target="_blank">513.233.4130</a><u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:12pt;font-family:'Times New Roman',serif">
<span style="font-size:11pt;font-family:Cambria,serif;color:rgb(89,89,89)"><br>
</span></div>
</div>
</div>
<br>
</div>
<span style="font-family:Calibri"><img height="36" width="163" src="cid:6BDB9D41-C564-43BB-911D-9CF98A243F53" type="image/png"></span></div>
</div>
</div>

<br>_______________________________________________<br>
lxc-users mailing list<br>
<a href="mailto:lxc-users@lists.linuxcontainers.org">lxc-users@lists.linuxcontainers.org</a><br>
<a href="http://lists.linuxcontainers.org/listinfo/lxc-users" rel="noreferrer" target="_blank">http://lists.linuxcontainers.org/listinfo/lxc-users</a><br></blockquote></div><br></div>