Note: This is a beta release of Red Hat Bugzilla 5.0. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Also email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback here.
Bug 1690034 - HPA not autoscaling due no fetch metrics from metric server [NEEDINFO]
Summary: HPA not autoscaling due no fetch metrics from metric server
Keywords:
Status: ASSIGNED
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Pod
Version: 3.11.0
Hardware: All
OS: All
unspecified
high
Target Milestone: ---
: 3.11.z
Assignee: Joel Smith
QA Contact: Weinan Liu
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-03-18 15:53 UTC by Camino Noguera
Modified: 2019-04-12 13:39 UTC (History)
13 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Target Upstream Version:
weinliu: needinfo? (mnoguera)


Attachments (Terms of Use)
metric server logs (deleted)
2019-03-18 15:53 UTC, Camino Noguera
no flags Details

Description Camino Noguera 2019-03-18 15:53:18 UTC
Created attachment 1545366 [details]
metric server logs

After upgrade OCP from 3.11.51 to 3.11.82.
Hpa is not working in some pods.

metrics-server.logs show:
I0318 12:28:36.350288       1 reststorage.go:140] No metrics for container currency in pod master-data/currency-12-8g52s
I0318 12:28:36.371930       1 reststorage.go:140] No metrics for container product in pod master-data/product-44-thb82
I0318 12:28:36.435598       1 reststorage.go:140] No metrics for container stg-clementinum-api in pod architecture/stg-clementinum-api-41-xpvqh
I0318 12:28:36.480389       1 reststorage.go:140] No metrics for container uwsgi in pod apsl-cms/circuitos-118-gph8n
I0318 12:28:36.579968       1 reststorage.go:140] No metrics for container salepoint in pod master-data/salepoint-26-fh9rr
I0318 12:28:36.636707       1 reststorage.go:140] No metrics for container clementinum-api in pod architecture/clementinum-api-27-z7tmp
I0318 12:28:36.679191       1 reststorage.go:140] No metrics for container thumbor in pod infcom/thumbor-14-hcpdq
I0318 12:28:36.679222       1 reststorage.go:140] No metrics for container thumbor in pod infcom/thumbor-14-fqqks
I0318 12:28:38.481698       1 reststorage.go:140] No metrics for container customermaster in pod master-data/customermaster-20-zq956
I0318 12:28:38.491681       1 reststorage.go:140] No metrics for container flight in pod master-data/flight-17-9vc4z
I0318 12:28:38.500041       1 reststorage.go:140] No metrics for container transport in pod master-data/transport-15-78brt
I0318 12:28:38.506465       1 reststorage.go:140] No metrics for container uwsgi in pod apsl-cms/sso-menu-35-gcnbm
I0318 12:28:38.512895       1 reststorage.go:140] No metrics for container uwsgi in pod apsl-cms/faq-19-h2tm7
I0318 12:28:38.519039       1 reststorage.go:140] No metrics for container provider in pod master-data/provider-30-k7nnd
I0318 12:28:38.535200       1 reststorage.go:140] No metrics for container billing in pod master-data/billing-19-khkn6
I0318 12:28:43.276135       1 reststorage.go:140] No metrics for container channel in pod master-data/channel-20-bbcmr
I0318 12:29:05.389424       1 reststorage.go:140] No metrics for container caapim-gateway in pod caapim/cerbero-8-5nn2j
I0318 12:29:05.498701       1 reststorage.go:140] No metrics for container hotel in pod master-data/hotel-15-8vqwr
I0318 12:29:06.369850       1 reststorage.go:140] No metrics for container currency in pod master-data/currency-12-8g52s
I0318 12:29:06.392665       1 reststorage.go:140] No metrics for container product in pod master-data/product-44-thb82
I0318 12:29:06.504167       1 reststorage.go:140] No metrics for container uwsgi in pod apsl-cms/circuitos-118-gph8n
I0318 12:29:06.599854       1 reststorage.go:140] No metrics for container salepoint in pod master-data/salepoint-26-fh9rr
I0318 12:29:06.698806       1 reststorage.go:140] No metrics for container thumbor in pod infcom/thumbor-14-fqqks
I0318 12:29:06.698853       1 reststorage.go:140] No metrics for container thumbor in pod infcom/thumbor-14-hcpdq
I0318 12:29:08.544047       1 reststorage.go:140] No metrics for container customermaster in pod master-data/customermaster-20-zq956

Comment 9 Junqi Zhao 2019-03-28 01:41:36 UTC
@ Weinan Liu

please help to check if the issue happens in 3.11 environment

Comment 14 Weinan Liu 2019-03-28 10:07:46 UTC
Hi Robert,

Ok, let's wait and see if the level8 log has any useful info.


Note You need to log in before you can comment on or make changes to this bug.