[lxc-users] LXD Bridge issues with Openstack

[Renato Foot]

Steve Searles <SSearles at ...> writes:

> 
> 
> 
> Hello everyone, I have configured a nova-compute-lxd 
node in our openstack
environment.   We are currently running Openstack Mitaka 
(Not Devstack) with
neutron.  I am able to provision instances however they 
have no network
connectivity.  When using a
>  regular provider network and not VxLAN networks, if 
I add the provider
network (em2 in my case) to the bridge group manually i
t will function
properly. So it appears that the interface is not added
 to the bridge during
the provisioning process.  
> 
> My neutron config on the host has 
> 
> physical_interface_mappings = public:em2
> 
> This is for VxLAN support.
> 
> 
> enable_vxlan = True
> local_ip = 172.26.3.1
> l2_population = True
> 
> 
> After adding an instance. 
> 
> 
> root <at> lxd01:~# nova list
>
+---------------------------------
-----+------+--------+------------+-------------+--------------------+
> | ID                                   | Name | Status | Task State |
Power State | Networks           |
>
+-----------------------------------
---+------+--------+------------+-------------+--------------------+
> | d98ec618-1d98-47d1-95d1-31d39af3
8f3a | test | ACTIVE | -          |
Running     | public=70.36.33.15 |
>
+------------------------------------
--+------+--------+------------+-------------+——————————+
> 
> 
> 
> root <at> lxd01:~# lxc list
> +-------------------+---------+----
--+------+------------+-----------+
> |       NAME        |  STATE  | IPV
4 | IPV6 |    TYPE    | SNAPSHOTS |
> +-------------------+---------+---
---+------+------------+-----------+
> | instance-0000001b | RUNNING |      |      | PERSISTENT | 0         |
> +-------------------+---------+-----
-+------+------------+—————+
> 
> 
> 
> root <at> lxd01:~# brctl show
> bridge name bridge id
> STP enabled 
> interfaces
> brq5d71d51f-4b 
> 8000.feec5f898aa5 no
> vethNV5DFH
> lxdbr0 8000.000000000000
> no 
> 
> virbr0 8000.52540009839a
> yes virbr0-nic
> root <at> lxd01:~# 
> 
> 
> 
> 
> root <at> lxd01:~# lxc exec instance-0000001b -- /bin/bash
> root <at> ubuntu:~# ifconfig ethic
> eth0      Link encap:Ethernet  HWaddr fa:16:3e:06:30:fc  
>           inet6 addr: fe80::f816:3eff:fe06:30fc/64 Scope:Link
>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>           RX packets:9 errors:0 dropped:0 overruns:0 frame:0
>           TX packets:187 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:1000 
>           RX bytes:718 (718.0 B)  TX bytes:61866 (61.8 KB)
> 
> 
> root <at> ubuntu:~# 
> 
> Exit
> 
> 
> root <at> lxd01:~# brctl addif brq5d71d51f-4b em2
> root <at> lxd01:~# brctl show
> bridge name bridge id
> STP enabled 
> interfaces
> brq5d71d51f-4b 
> 8000.0026b942da6f no
> em2
> 
> vethNV5DFH
> lxdbr0 8000.000000000000
> no 
> 
> virbr0 8000.52540009839a
> yes virbr0-nic
> root <at> lxd01:~#
> 
> 
> 
> root <at> lxd01:~# lxc restart instance-0000001b 
> root <at> lxd01:~# lxc list
>
+-------------------+---------+--------------------+------+--
----------+-----------+

> |       NAME        |  STATE  |        IPV4        | IPV6 
|    TYPE    |
SNAPSHOTS |
>
+-------------------+---------+--------------------+------+-
-----------+-----------+

> | instance-0000001b | RUNNING | 70.36.33.15 (eth0) |      
| PERSISTENT | 0
        |
>
+-------------------+---------+--------------------+--
----+------------+-----------+
> root <at> lxd01:~# nova list
>
+--------------------------------------+------+------
--+------------+-------------+--------------------+
> | ID                                   | Name | Sta
tus | Task State |
Power State | Networks           |
>
+--------------------------------------+------+-----
---+------------+-------------+--------------------+
> | d98ec618-1d98-47d1-95d1-31d39af38f3a | test | ACT
IVE | -          |
Running     | public=70.36.33.15 |
>
+--------------------------------------+------+----
----+------------+-------------+--------------------+
> root <at> lxd01:~# 
> 
> 
> 
> root <at> lxd01:~# lxc exec instance-0000001b -- /bin/bash
> root <at> ubuntu:~# ifconfig eth0
> eth0      Link encap:Ethernet  HWaddr fa:16:3e:06:30:fc  
>           inet addr:70.36.33.15  Bcast:70.36.33.255  Mask:255.255.255.0
>           inet6 addr: fe80::f816:3eff:fe06:30fc/64 Scope:Link
>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>           RX packets:491 errors:0 dropped:0 overruns:0 frame:0
>           TX packets:182 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:1000 
>           RX bytes:39890 (39.8 KB)  TX bytes:17244 (17.2 KB)
> 
> 
> root <at> ubuntu:~# ping 8.8.8.8
> PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data.
> 64 bytes from 8.8.8.8: icmp_seq=1 ttl=48 time=20.0 ms
> 64 bytes from 8.8.8.8: icmp_seq=2 ttl=48 time=19.5 ms
> ^C
> --- 8.8.8.8 ping statistics ---
> 2 packets transmitted, 2 received, 0% packet loss, time 1001ms
> rtt min/avg/max/mdev = 19.516/19.803/20.090/0.287 ms
> root <at> ubuntu:~# 
> 
> 
> Yay all good. 
> 
> 
> Any idea on what I might be missing?  Does the LXC implem
entation support
VxLAN?  When I provision an instance with VxLAN the vxnet—XX 
interfaces do
not seem to get created either. 
> 
> 
> 
> 
> 
> Steven Searles, CTO | ssearles <at> zimcom.net
> 
> 
> 
> 
> 
> Zimcom Internet Solutions  | www.zimcom.net
> 
> 
> O: 513.231.9500  |  D: 513.233.4130
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> _______________________________________________
> lxc-users mailing list
> lxc-users <at> lists.linuxcontainers.org
> http://lists.linuxcontainers.org/listinfo/lxc-users

I'm having the same problem, if i start one 
fresh compute-node with lxd
hypervisor, it start my instance, but without 
network access, and we can see
that it doesnt create the vxlan interface!

I made some test's and, if we use qemu, and create/start 
one instance, we
can see that now, there is one vxlan interface, so I 
remove the
nova-compute-qemu, and install nova-compute-lxd, 
restart nova-compute
service. The vxlan still exits.

Now you can create some instance using LXD hypervisor, 
that it will work!

The problem is that lxd hypervisor is not creating the 
vxlan interface!