Note: This is a beta release of Red Hat Bugzilla 5.0. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Also email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback here.
Bug 1690937 - Prometheus is not showing metrics for service catalog
Summary: Prometheus is not showing metrics for service catalog
Keywords:
Status: VERIFIED
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Service Catalog
Version: 4.1
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: 4.1.0
Assignee: Jay Boyd
QA Contact: Jian Zhang
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-03-20 13:52 UTC by Jay Boyd
Modified: 2019-04-10 08:09 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Target Upstream Version:


Attachments (Terms of Use)

Description Jay Boyd 2019-03-20 13:52:11 UTC
In web console, under Monitoring -> Status -> Targets, you should see a target for service catalog controller manager.  It is not present.

It appears the openshift-service-catalog-controller-manager daemonset is missing the required annotations (ie prometheus.io/scheme: https and prometheus.io/scrape: "true") or a service monitor should be created for it.

Comment 3 Wei Sun 2019-04-10 03:32:52 UTC
Please check if it could be verified.

Comment 4 Jian Zhang 2019-04-10 08:09:35 UTC
LGTM, verify it. Details as below:

1, Build the OCP cluster with the installer.
[jzhang@dhcp-140-18 ocp410]$ oc get clusterversion
NAME      VERSION      AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.0.0-0.11   True        False         4h53m   Cluster version is 4.0.0-0.11

2, Check the service-catalog-controller-manager-operator version. The fixed PR had been merged in it, like below:
[jzhang@dhcp-140-18 ocp410]$ oc get pods -o yaml|grep image
      image: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8e405005b4f6c8ec6c53783e987cf61f037a7d875edcae3f0f3cb4cae3c8a6b

[jzhang@dhcp-140-18 ocp410]$ oc image info quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8e405005b4f6c8ec6c53783e987cf61f037a7d875edcae3f0f3cb4cae3c8a6b
...
             io.openshift.build.commit.id=f8ad3be67ae5baaa8c2c5d167ba48611146df560
             io.openshift.build.commit.url=https://github.com/openshift/cluster-svcat-controller-manager-operator/commit/f8ad3be67ae5baaa8c2c5d167ba48611146df560

3, Login the Web console, "Monitoring"->"Metrics" -> "Login as the Openshift"->"Status"->"Targets", we can see the "openshift-service-catalog-controller-manager-operator/openshift-service-catalog-controller-manager-operator/0 (1/1 up)", it's watching the endpoints. LGTM.
[jzhang@dhcp-140-18 ocp410]$ oc get ep -n openshift-service-catalog-controller-manager-operator
NAME      ENDPOINTS          AGE
metrics   10.129.0.28:8443   5h15m
[jzhang@dhcp-140-18 ocp410]$ oc get pods -o wide
NAME                                                              READY   STATUS    RESTARTS   AGE     IP            NODE                                              NOMINATED NODE
openshift-service-catalog-controller-manager-operator-54d9r7lbv   1/1     Running   0          5h14m   10.129.0.28   ip-10-0-141-107.ap-southeast-2.compute.internal   <none>


Note You need to log in before you can comment on or make changes to this bug.