Note: This is a beta release of Red Hat Bugzilla 5.0. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Also email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback here.

Bug 1359947

Summary: Very slow undercloud while scaling up an overcloud
Product: Red Hat OpenStack Reporter: David Hill <dhill>
Component: instack-undercloudAssignee: James Slagle <jslagle>
Status: CLOSED WONTFIX QA Contact: Arik Chernetsky <achernet>
Severity: urgent Docs Contact:
Priority: high    
Version: 7.0 (Kilo)CC: aschultz, dhill, hbrock, jraju, jslagle, mburns, mcornea, rhel-osp-director-maint
Target Milestone: asyncKeywords: Triaged, ZStream
Target Release: 7.0 (Kilo)   
Hardware: Unspecified   
OS: Unspecified   
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-02-28 17:45:11 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description David Hill 2016-07-25 21:36:27 UTC
Description of problem:
Very slow undercloud while scaling up an overcloud to 42 computes from initially 31 computes.

There doesn't seem to be any IO contentions on the disks / memory and yet it takes 2/3/4 hours before we get a success/failure while adding those 11 new compute nodes.

Version-Release number of selected component (if applicable):

How reproducible:
Every time

Steps to Reproduce:
1. Scale up/down the computes.

Actual results:
Very slow before we get a failure

Expected results:
Should be faster 

Additional info:
This is an undercloud running in KVM with 4VCPUs , 26GB of RAM and disks mounted from a HP 3PAR storage.   It seems like mysql needs a bit of cleanup because raw_template is 16GB and ceilometer database is somewhat big (like 30GB or so)

Comment 4 Alex Schultz 2018-02-28 17:45:11 UTC
Closing as we won't be backporting this to 7.  If this is still happening on newer versions, please feel free to open up a new BZ or reopen this one with additional details.