New Question

Revision history [back]

click to hide/show revision 1
initial version

Network Interface not attached to vm

Hi, I've set up OpenStack train on a separate machine and tried to add windows 2019 as compute node with openvswitch driver to it. Openstack added my hyperv compute node and also ovs agent status is up with similey face. The problem is when I create VM it's get created, but no network interface is attached to it. I've posted logs of nova-compute, ovs-agent, ovs-server, and ovsdb. Any help would be great as I'm stuck for 2 days. Thanks!!

Network Interface not attached to vm

Hi, I've set up OpenStack train on a separate machine and tried to add windows 2019 as compute node with openvswitch driver to it. Openstack added my hyperv compute node and also ovs agent status is up with similey face. The problem is when I create VM it's get created, but no network interface is attached to it. I've posted logs of nova-compute, ovs-agent, ovs-server, and ovsdb. Any help would be great as I'm stuck for 2 days. Thanks!!

<<<<<<<<<<<<<<<<<<<< nova-compute.log >>>>>>>>>>>>>>>>>> 2021-05-13 22:39:27.450 8408 ERROR vifplugovs.ovsdb.implvsctl [req-a5bcc810-de24-4da9-a161-a2622cbeab6f 3a8f0dc6466e4799a64ba3ca7af598c8 3d1030549f5446ee9ece7c147b776b8a - default default] Unable to execute ['ovs-vsctl', '--timeout=120', '--oneline', '--format=json', '--db=tcp:127.0.0.1:6640', '--', '--may-exist', 'add-br', 'br-int', '--', 'set', 'Bridge', 'br-int', 'datapathtype=system']. Exception: Unexpected error while running command. Command: ovs-vsctl --timeout=120 --oneline --format=json --db=tcp:127.0.0.1:6640 -- --may-exist add-br br-int -- set Bridge br-int datapathtype=system Exit code: 1 Stdout: '' Stderr: 'ovs-vsctl: tcp:127.0.0.1:6640: database connection failed (Unknown error)\r\n': osloconcurrency.processutils.ProcessExecutionError: Unexpected error while running command. 2021-05-13 22:39:28.498 8408 ERROR vifplugovs.ovsdb.implvsctl [req-a5bcc810-de24-4da9-a161-a2622cbeab6f 3a8f0dc6466e4799a64ba3ca7af598c8 3d1030549f5446ee9ece7c147b776b8a - default default] Unable to execute ['ovs-vsctl', '--timeout=120', '--oneline', '--format=json', '--db=tcp:127.0.0.1:6640', '--', '--may-exist', 'add-port', 'br-int', '247a8bb7-da5f-4164-8d9d-777a71d64688', '--', 'set', 'Interface', '247a8bb7-da5f-4164-8d9d-777a71d64688', 'externalids:iface-id=247a8bb7-da5f-4164-8d9d-777a71d64688', 'externalids:iface-status=active', 'externalids:attached-mac=fa:16:3e:76:a7:d6', 'externalids:vm-uuid=89779800-2db9-4688-a749-0fc9947e4498']. Exception: Unexpected error while running command. Command: ovs-vsctl --timeout=120 --oneline --format=json --db=tcp:127.0.0.1:6640 -- --may-exist add-port br-int 247a8bb7-da5f-4164-8d9d-777a71d64688 -- set Interface 247a8bb7-da5f-4164-8d9d-777a71d64688 externalids:iface-id=247a8bb7-da5f-4164-8d9d-777a71d64688 externalids:iface-status=active externalids:attached-mac=fa:16:3e:76:a7:d6 externalids:vm-uuid=89779800-2db9-4688-a749-0fc9947e4498 Exit code: 1 Stdout: '' Stderr: 'ovs-vsctl: tcp:127.0.0.1:6640: database connection failed ()\r\n': osloconcurrency.processutils.ProcessExecutionError: Unexpected error while running command. 2021-05-13 22:39:28.519 8408 INFO osvif [req-a5bcc810-de24-4da9-a161-a2622cbeab6f 3a8f0dc6466e4799a64ba3ca7af598c8 3d1030549f5446ee9ece7c147b776b8a - default default] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:a7:d6,bridgename='br-int',hastrafficfiltering=True,id=247a8bb7-da5f-4164-8d9d-777a71d64688,network=Network(fc43f038-5731-462a-9f7e-d1d39f58ec5c),plugin='ovs',portprofile=VIFPortProfileOpenVSwitch,preserveondelete=False,vifname='tap247a8bb7-da') 2021-05-13 22:40:28.533 8408 WARNING compute_hyperv.nova.vmops [req-a5bcc810-de24-4da9-a161-a2622cbeab6f 3a8f0dc6466e4799a64ba3ca7af598c8 3d1030549f5446ee9ece7c147b776b8a - default default] [instance: 89779800-2db9-4688-a749-0fc9947e4498] Timeout waiting for vif plugging callback for instance.: eventlet.timeout.Timeout: 60 seconds 2021-05-13 22:40:29.359 8408 INFO nova.compute.manager [req-a5bcc810-de24-4da9-a161-a2622cbeab6f 3a8f0dc6466e4799a64ba3ca7af598c8 3d1030549f5446ee9ece7c147b776b8a - default default] [instance: 89779800-2db9-4688-a749-0fc9947e4498] Took 70.50 seconds to spawn the instance on the hypervisor.

<<<<<<<<<<<<<<<<<<<<<<<<<<< ovs-agent.log >>>>>>>>>>>>>>>>>>>>>>>

2021-05-13 22:39:19.139 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:96 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.152 2021-05-13 22:39:20.484 6304 INFO neutron.agent.securitygroupsrpc [req-1416ac4b-455d-467d-8722-afad6c97d81c cac8810767e042abae046315ca28b484 4177efb4a5014e23b72801a9f2acad9d - - -] Security group member updated {'cc9326fa-5277-4482-bb14-903bce214090'} 2021-05-13 22:39:21.003 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:97 started 2021-05-13 22:39:21.145 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:97 - starting polling. Elapsed:0.142 2021-05-13 22:39:21.161 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:97 - port information retrieved. Elapsed:0.157 2021-05-13 22:39:21.173 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:97 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.170 2021-05-13 22:39:23.018 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:98 started 2021-05-13 22:39:23.149 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:98 - starting polling. Elapsed:0.130 2021-05-13 22:39:23.164 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:98 - port information retrieved. Elapsed:0.146 2021-05-13 22:39:23.177 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:98 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.159 2021-05-13 22:39:25.042 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:99 started 2021-05-13 22:39:25.184 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:99 - starting polling. Elapsed:0.142 2021-05-13 22:39:25.200 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:99 - port information retrieved. Elapsed:0.158 2021-05-13 22:39:25.215 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:99 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.173 2021-05-13 22:39:27.061 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:100 started 2021-05-13 22:39:27.201 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:100 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.139 2021-05-13 22:39:29.080 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:101 started 2021-05-13 22:39:29.231 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:101 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.150 2021-05-13 22:39:31.097 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:102 started 2021-05-13 22:39:31.233 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpcloop - iteration:102 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.136 2021-05-13 22:39:33.111 6304 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovsneutronagent [req-4e633bd7-7a8b-4fd1-afd2-35e3015c07a5 - - - - -] Agent rpc_loop - iteration:103 started

<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< openvswitch_vswitchd.log >>>>>>>>>>>>>>>>>>>>>>>

2021-05-14T05:36:01.953Z|00209|rconn|INFO|br-tun<->tcp:127.0.0.1:6633: connected 2021-05-14T05:36:01.954Z|00210|rconn|INFO|br-int<->tcp:127.0.0.1:6633: connected 2021-05-14T05:36:02.977Z|00211|netdevvport|WARN|vxlan-0a000005: unknown vxlan argument 'egresspktmark' 2021-05-14T05:36:03.086Z|00212|netdevvport|WARN|vxlan-0a000005: unknown vxlan argument 'egresspktmark' 2021-05-14T05:36:03.196Z|00213|netdevvport|WARN|vxlan-0a000005: unknown vxlan argument 'egresspktmark' 2021-05-14T05:36:03.213Z|00214|netdevvport|WARN|vxlan-0a000005: unknown vxlan argument 'egresspktmark' 2021-05-14T05:36:03.322Z|00215|netdevvport|WARN|vxlan-0a000005: unknown vxlan argument 'egresspktmark' 2021-05-14T05:36:04.185Z|00216|netdevvport|WARN|vxlan-0a000005: unknown vxlan argument 'egresspktmark' 2021-05-14T05:36:04.406Z|00217|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:04.445Z|00218|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:04.498Z|00219|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:04.554Z|00220|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:04.609Z|00221|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:04.646Z|00222|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:04.685Z|00223|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:04.738Z|00224|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:04.792Z|00225|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:04.830Z|00226|connmgr|INFO|br-int<->unix: 1 flowmods in the last 0 s (1 adds) 2021-05-14T05:36:12.960Z|00227|connmgr|INFO|br-int<->tcp:127.0.0.1:6633: 5 flowmods 10 s ago (5 adds) 2021-05-14T05:36:13.458Z|00228|connmgr|INFO|br-tun<->tcp:127.0.0.1:6633: 11 flowmods in the 1 s starting 10 s ago (11 adds) 2021-05-14T05:36:28.051Z|00229|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2021-05-14T05:36:28.484Z|00230|dpif|WARN|system@ovs-system: failed to query port : Invalid argument 2021-05-14T05:40:29.211Z|00231|dpif|WARN|system@ovs-system: failed to query port : Invalid argument

<<<<<<<<<<<<<<<<<<<<<<<<<< ovsdb-server.log >>>>>>>>>>>>>>>>>>>>>>

2021-05-14T03:25:57.033Z|00001|vlog|INFO|opened log file C:\Program Files\Cloudbase Solutions\Open vSwitch\logs\ovsdb-server.log 2021-05-14T03:25:57.256Z|00002|ovsdb_server|INFO|ovsdb-server (Open vSwitch) 2.7.0 2021-05-14T03:26:07.035Z|00003|memory|INFO|7100 kB peak resident set size after 10.0 seconds 2021-05-14T03:26:07.035Z|00004|memory|INFO|cells:16 json-caches:1 monitors:1 sessions:1