New Question

Revision history [back]

click to hide/show revision 1
initial version

It turns out that there were actually a few issues.

1) Apparently, Gnocchi doesn't like you having admin creds loaded for the environment variables (which I was using per above in admin-openrc) when running the Gnocchi client. Instead use something like this to load your Gnochi creds:

[ ~] # cat ./gnocchi-openrc
export OS_PROJECT_DOMAIN_NAME=Default
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_NAME=service
export OS_USERNAME=gnocchi
export OS_PASSWORD=GNOCCHI_PW
export OS_AUTH_URL=http://controller:5000/v3
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2
export OS_AUTH_TYPE=password

2) The RDO documentation for Ocata Gnocchi install skipped adding necessary permissions/role need to be assigned to the gnocchi user in keystone and I didn't notice. I added the role/permissions:

[root@gcp-openstack ~]# openstack role add --project service --user gnocchi admin

3) Lastly, I was running the latest version of Gnocchi at the time (4.0.3) and Ceilometer 8.1.1. According to the following bug report, it appears support for explicitly setting interface/regoin_name was changed in gnocchiclient 3.1 and remove in gnocchiclient 4:

https://bugs.launchpad.net/ceilometer/+bug/1714483 https://bugs.launchpad.net/ceilometer/+bug/1714483/comments/2

Per the bug report (above), Gnocchi support broke in Gnocchi 3.1. The latest available version PyPi before 3.1 is 3.0.15. I uninstalled 4.0.3 and installed 3.0.15. However, I ran into the following error when trying to run ceilometer-upgrade:

[~] # ceilometer-upgrade --skip-metering-database
2017-11-14 17:20:33.073 147323 WARNING oslo_reports.guru_meditation_report [-] Guru meditation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
2017-11-14 17:20:33.073 147323 INFO ceilometer.cmd.storage [-] Skipping metering database upgrade
2017-11-14 17:20:33.074 147323 DEBUG ceilometer.cmd.storage [-] Upgrading Gnocchi resource types upgrade /usr/lib/python2.7/site-packages/ceilometer/cmd/storage.py:51
2017-11-14 17:20:33.392 147323 CRITICAL ceilometer [-] Unhandled error: ResourceNotFound: Resource type ceph_account does not exist (HTTP 404)
2017-11-14 17:20:33.392 147323 ERROR ceilometer Traceback (most recent call last):
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/bin/ceilometer-upgrade", line 10, in <module>
2017-11-14 17:20:33.392 147323 ERROR ceilometer sys.exit(upgrade())
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/ceilometer/cmd/storage.py", line 53, in upgrade
2017-11-14 17:20:33.392 147323 ERROR ceilometer gnocchi_client.upgrade_resource_types(conf)
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/ceilometer/gnocchi_client.py", line 113, in upgrade_resource_types
2017-11-14 17:20:33.392 147323 ERROR ceilometer gnocchi.resource_type.get(name=name)
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/resource_type.py", line 44, in get
2017-11-14 17:20:33.392 147323 ERROR ceilometer headers={'Content-Type': "application/json"}).json()
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/base.py", line 37, in _get
2017-11-14 17:20:33.392 147323 ERROR ceilometer return self.client.api.get(*args, **kwargs)
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 304, in get
2017-11-14 17:20:33.392 147323 ERROR ceilometer return self.request(url, 'GET', **kwargs)
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/gnocchiclient/client.py", line 38, in request
2017-11-14 17:20:33.392 147323 ERROR ceilometer raise exceptions.from_response(resp, method)
2017-11-14 17:20:33.392 147323 ERROR ceilometer ResourceNotFound: Resource type ceph_account does not exist (HTTP 404)
2017-11-14 17:20:33.392 147323 ERROR ceilometer

More research revealed (per the bug report below) that this is due to Ceilometer having been updated and now expecting gnocchi version 3.1.0.

https://bugzilla.redhat.com/show_bug.cgi?id=1434345

Uninstalled Gnocchi 3.0.15 and installed 3.1.0. This resolved the final issue!

It turns out that there were actually a few issues.

1) Apparently, Gnocchi doesn't like you having admin creds loaded for the environment variables (which I was using per above in admin-openrc) when running the Gnocchi client. Instead use something like this to load your Gnochi creds:

[ ~] # cat ./gnocchi-openrc
export OS_PROJECT_DOMAIN_NAME=Default
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_NAME=service
export OS_USERNAME=gnocchi
export OS_PASSWORD=GNOCCHI_PW
export OS_AUTH_URL=http://controller:5000/v3
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2
export OS_AUTH_TYPE=password

2) The RDO documentation for Ocata Gnocchi install skipped adding necessary permissions/role need to be assigned to the gnocchi user in keystone and I didn't notice. I added the role/permissions:

[root@gcp-openstack [ ~]# openstack role add --project service --user gnocchi admin

3) Lastly, I was running the latest version of Gnocchi at the time (4.0.3) and Ceilometer 8.1.1. According to the following bug report, it appears support for explicitly setting interface/regoin_name was changed in gnocchiclient 3.1 and remove in gnocchiclient 4:

https://bugs.launchpad.net/ceilometer/+bug/1714483 https://bugs.launchpad.net/ceilometer/+bug/1714483/comments/2

Per the bug report (above), Gnocchi support broke in Gnocchi 3.1. The latest available version PyPi before 3.1 is 3.0.15. I uninstalled 4.0.3 and installed 3.0.15. However, I ran into the following error when trying to run ceilometer-upgrade:

[~] # ceilometer-upgrade --skip-metering-database
2017-11-14 17:20:33.073 147323 WARNING oslo_reports.guru_meditation_report [-] Guru meditation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
2017-11-14 17:20:33.073 147323 INFO ceilometer.cmd.storage [-] Skipping metering database upgrade
2017-11-14 17:20:33.074 147323 DEBUG ceilometer.cmd.storage [-] Upgrading Gnocchi resource types upgrade /usr/lib/python2.7/site-packages/ceilometer/cmd/storage.py:51
2017-11-14 17:20:33.392 147323 CRITICAL ceilometer [-] Unhandled error: ResourceNotFound: Resource type ceph_account does not exist (HTTP 404)
2017-11-14 17:20:33.392 147323 ERROR ceilometer Traceback (most recent call last):
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/bin/ceilometer-upgrade", line 10, in <module>
2017-11-14 17:20:33.392 147323 ERROR ceilometer sys.exit(upgrade())
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/ceilometer/cmd/storage.py", line 53, in upgrade
2017-11-14 17:20:33.392 147323 ERROR ceilometer gnocchi_client.upgrade_resource_types(conf)
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/ceilometer/gnocchi_client.py", line 113, in upgrade_resource_types
2017-11-14 17:20:33.392 147323 ERROR ceilometer gnocchi.resource_type.get(name=name)
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/resource_type.py", line 44, in get
2017-11-14 17:20:33.392 147323 ERROR ceilometer headers={'Content-Type': "application/json"}).json()
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/base.py", line 37, in _get
2017-11-14 17:20:33.392 147323 ERROR ceilometer return self.client.api.get(*args, **kwargs)
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 304, in get
2017-11-14 17:20:33.392 147323 ERROR ceilometer return self.request(url, 'GET', **kwargs)
2017-11-14 17:20:33.392 147323 ERROR ceilometer File "/usr/lib/python2.7/site-packages/gnocchiclient/client.py", line 38, in request
2017-11-14 17:20:33.392 147323 ERROR ceilometer raise exceptions.from_response(resp, method)
2017-11-14 17:20:33.392 147323 ERROR ceilometer ResourceNotFound: Resource type ceph_account does not exist (HTTP 404)
2017-11-14 17:20:33.392 147323 ERROR ceilometer

More research revealed (per the bug report below) that this is due to Ceilometer having been updated and now expecting gnocchi version 3.1.0.

https://bugzilla.redhat.com/show_bug.cgi?id=1434345

Uninstalled Gnocchi 3.0.15 and installed 3.1.0. This resolved the final issue!