[lxc-users] LXD Bridge issues with Openstack

[Steve Searles]

Hello everyone, I have configured a nova-compute-lxd node in our openstack environment.   We are currently running Openstack Mitaka (Not Devstack) with neutron.  I am able to provision instances however they have no network connectivity.  When using a regular provider network and not VxLAN networks, if I add the provider network (em2 in my case) to the bridge group manually it will function properly. So it appears that the interface is not added to the bridge during the provisioning process.

My neutron config on the host has

physical_interface_mappings = public:em2

This is for VxLAN support.

enable_vxlan = True
local_ip = 172.26.3.1
l2_population = True

After adding an instance.

root at lxd01:~# nova list
+--------------------------------------+------+--------+------------+-------------+--------------------+
| ID                                   | Name | Status | Task State | Power State | Networks           |
+--------------------------------------+------+--------+------------+-------------+--------------------+
| d98ec618-1d98-47d1-95d1-31d39af38f3a | test | ACTIVE | -          | Running     | public=70.36.33.15 |
+--------------------------------------+------+--------+------------+-------------+——————————+

root at lxd01:~# lxc list
+-------------------+---------+------+------+------------+-----------+
|       NAME        |  STATE  | IPV4 | IPV6 |    TYPE    | SNAPSHOTS |
+-------------------+---------+------+------+------------+-----------+
| instance-0000001b | RUNNING |      |      | PERSISTENT | 0         |
+-------------------+---------+------+------+------------+—————+

root at lxd01:~# brctl show
bridge name bridge id STP enabled interfaces
brq5d71d51f-4b 8000.feec5f898aa5 no vethNV5DFH
lxdbr0 8000.000000000000 no
virbr0 8000.52540009839a yes virbr0-nic
root at lxd01:~#


root at lxd01:~# lxc exec instance-0000001b -- /bin/bash
root at ubuntu:~# ifconfig ethic
eth0      Link encap:Ethernet  HWaddr fa:16:3e:06:30:fc
          inet6 addr: fe80::f816:3eff:fe06:30fc/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:9 errors:0 dropped:0 overruns:0 frame:0
          TX packets:187 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:718 (718.0 B)  TX bytes:61866 (61.8 KB)


root at ubuntu:~#
Exit

root at lxd01:~# brctl addif brq5d71d51f-4b em2
root at lxd01:~# brctl show
bridge name bridge id STP enabled interfaces
brq5d71d51f-4b 8000.0026b942da6f no em2
vethNV5DFH
lxdbr0 8000.000000000000 no
virbr0 8000.52540009839a yes virbr0-nic
root at lxd01:~#

root at lxd01:~# lxc restart instance-0000001b
root at lxd01:~# lxc list
+-------------------+---------+--------------------+------+------------+-----------+
|       NAME        |  STATE  |        IPV4        | IPV6 |    TYPE    | SNAPSHOTS |
+-------------------+---------+--------------------+------+------------+-----------+
| instance-0000001b | RUNNING | 70.36.33.15 (eth0) |      | PERSISTENT | 0         |
+-------------------+---------+--------------------+------+------------+-----------+
root at lxd01:~# nova list
+--------------------------------------+------+--------+------------+-------------+--------------------+
| ID                                   | Name | Status | Task State | Power State | Networks           |
+--------------------------------------+------+--------+------------+-------------+--------------------+
| d98ec618-1d98-47d1-95d1-31d39af38f3a | test | ACTIVE | -          | Running     | public=70.36.33.15 |
+--------------------------------------+------+--------+------------+-------------+--------------------+
root at lxd01:~#

root at lxd01:~# lxc exec instance-0000001b -- /bin/bash
root at ubuntu:~# ifconfig eth0
eth0      Link encap:Ethernet  HWaddr fa:16:3e:06:30:fc
          inet addr:70.36.33.15  Bcast:70.36.33.255  Mask:255.255.255.0
          inet6 addr: fe80::f816:3eff:fe06:30fc/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:491 errors:0 dropped:0 overruns:0 frame:0
          TX packets:182 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:39890 (39.8 KB)  TX bytes:17244 (17.2 KB)


root at ubuntu:~# ping 8.8.8.8
PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data.
64 bytes from 8.8.8.8: icmp_seq=1 ttl=48 time=20.0 ms
64 bytes from 8.8.8.8: icmp_seq=2 ttl=48 time=19.5 ms
^C
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 19.516/19.803/20.090/0.287 ms
root at ubuntu:~#

Yay all good.


Any idea on what I might be missing?  Does the LXC implementation support VxLAN?  When I provision an instance with VxLAN the vxnet—XX interfaces do not seem to get created either.

Steven Searles, CTO | ssearles at zimcom.net<mailto:ssearles at zimcom.net>
Zimcom Internet Solutions  | www.zimcom.net<http://www.zimcom.net/>
O: 513.231.9500  |  D: 513.233.4130


[cid:24905604-AD83-44BD-8DEA-0C708E4E8AD7]
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.linuxcontainers.org/pipermail/lxc-users/attachments/20160609/8baadbbf/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 847FA943-AFD4-4E4F-BB5E-0DDB37DEAF6A[48].png
Type: image/png
Size: 10713 bytes
Desc: 847FA943-AFD4-4E4F-BB5E-0DDB37DEAF6A[48].png
URL: <http://lists.linuxcontainers.org/pipermail/lxc-users/attachments/20160609/8baadbbf/attachment.png>