Hi,
In addition to the issue we're having @ https://ask.cloudbase.it/question/2756/re-installing-a-compute-node/ we are having an issue with neutron and one of our instance. The instance appears to be running just fine, but we're seeing a bunch of errors within the neutron's logfile where the instance is running at.
The issue seems to be occurring on any hyperv node that is running the instance.
The error messages are as follow:
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent [-] Exception encountered while processing port c17da5c8-61ea-4da8-ae81-a02989ab3226.
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent Traceback (most recent call last):
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\hyperv\neutron\hyperv_neutron_agent.py", line 336, in _process_added_port
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent device_details['admin_state_up'])
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\hyperv\neutron\_common_utils.py", line 35, in wrapper
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent return inner()
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\oslo_concurrency\lockutils.py", line 271, in inner
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent return f(*args, **kwargs)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\hyperv\neutron\_common_utils.py", line 34, in inner
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent return f(*args, **kwargs)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\hyperv\neutron\hyperv_neutron_agent.py", line 315, in _treat_vif_port
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent physical_network, segmentation_id)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\hyperv\neutron\hyperv_neutron_agent.py", line 251, in _port_bound
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent self._utils.connect_vnic_to_vswitch(map['vswitch_name'], port_id)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\os_win\utils\network\networkutils.py", line 284, in connect_vnic_to_vswitch
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent self._jobutils.add_virt_resource(port, vm)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\os_win\_utils.py", line 181, in inner
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent time.sleep(sleep_time)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\oslo_utils\excutils.py", line 220, in __exit__
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent self.force_reraise()
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\oslo_utils\excutils.py", line 196, in force_reraise
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent six.reraise(self.type_, self.value, self.tb)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\os_win\_utils.py", line 138, in inner
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent return f(*args, **kwargs)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\os_win\utils\jobutils.py", line 199, in add_virt_resource
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent self.check_ret_val(ret_val, job_path)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\os_win\utils\jobutils.py", line 71, in check_ret_val
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent return self._wait_for_job(job_path)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent File "C:\PROGRA~1\CLOUDB~1\OPENST~1\Nova\Python27\lib\site-packages\os_win\utils\jobutils.py", line 99, in _wait_for_job
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent "Error code: %(err_code)d") % data)
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent HyperVException: WMI job failed with status 10. Error details: Failed to add device 'Ethernet Connection'. - 'instance-000000ca' failed to add device 'Ethernet Connection'. (Virtual machine ID D70B9489-E9FF-4AFE-BAE3-48CE57DA1AD7) - Error code: 32768
2018-06-29 10:04:01.970 3648 ERROR hyperv.neutron.hyperv_neutron_agent
FYI: this is an Ocata "all-in-one" RDO solution running on top of our hyperconverged win2016 failover cluster (S2D + HyperV).
It seems the issue has already been posted but none answered yet: https://ask.cloudbase.it/question/2727/hypervexception-wmi-job-failed-with-status-10-error-details-failed-to-add-device-ethernet-connection/
Any insight as to what might be wrong ?
Thanks,
