Note: This is a beta release of Red Hat Bugzilla 5.0. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Also email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback here.
Bug 1365726 - Testsuite fails on Azul Zing with OOM
Summary: Testsuite fails on Azul Zing with OOM
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: JBoss Data Grid 6
Classification: JBoss
Component: TestSuite
Version: 6.6.1
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: ---
Assignee: Martin Gencur
QA Contact: Martin Gencur
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-08-10 05:11 UTC by Vojtech Juranek
Modified: 2016-08-29 14:58 UTC (History)
3 users (show)

Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2016-08-29 14:58:07 UTC
Type: Bug


Attachments (Terms of Use)

Description Vojtech Juranek 2016-08-10 05:11:44 UTC
Running JDG testsuite on Azul Zing always fails with OOM. Doubling max heah and permgen didn't helped as well. Although run with -XX:+HeapDumpOnOutOfMemoryError, heap dump wasn't created. Complete list of java opt for the last run:

export 'JAVA_OPTS=-d64 -Xmx4G -XX:MaxPermSize=2G -XX:+HeapDumpOnOutOfMemoryError -Dfile.encoding=UTF-8 -XX:HeapDumpPath=/qa/hudson_workspace/workspace/jdg-6.x-func-ispn-testsuite-rhel-azul/22fa6378/heap-dump'

First OOM error:

java.lang.OutOfMemoryError: Java heap space
	at org.infinispan.lucene.impl.InfinispanIndexOutput.<init>(InfinispanIndexOutput.java:56)
	at org.infinispan.lucene.impl.DirectoryImplementor.createOutput(DirectoryImplementor.java:136)
	at org.infinispan.lucene.impl.DirectoryLuceneV3.createOutput(DirectoryLuceneV3.java:125)
	at org.apache.lucene.index.SegmentInfos.write(SegmentInfos.java:388)
	at org.apache.lucene.index.SegmentInfos.prepareCommit(SegmentInfos.java:827)
	at org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:4570)
	at org.apache.lucene.index.IndexWriter.prepareCommit(IndexWriter.java:3414)
	at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3485)
	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:1873)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1812)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1776)
	at org.hibernate.search.store.impl.DirectoryProviderHelper.initializeIndexIfNeeded(DirectoryProviderHelper.java:163)
	at org.hibernate.search.infinispan.impl.InfinispanDirectoryProvider.start(InfinispanDirectoryProvider.java:131)
	at org.hibernate.search.indexes.impl.DirectoryBasedIndexManager.initialize(DirectoryBasedIndexManager.java:103)
	at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManager(IndexManagerHolder.java:261)
	at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManager(IndexManagerHolder.java:528)
	at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManagers(IndexManagerHolder.java:495)
	at org.hibernate.search.indexes.impl.IndexManagerHolder.buildEntityIndexBinding(IndexManagerHolder.java:104)
	at org.hibernate.search.spi.SearchFactoryBuilder.initDocumentBuilders(SearchFactoryBuilder.java:364)
	at org.hibernate.search.spi.SearchFactoryBuilder.buildIncrementalSearchFactory(SearchFactoryBuilder.java:166)
	at org.hibernate.search.spi.SearchFactoryBuilder.buildSearchFactory(SearchFactoryBuilder.java:146)
	at org.hibernate.search.impl.MutableSearchFactory.addClasses(MutableSearchFactory.java:251)
	at org.infinispan.query.backend.SearchFactoryHandler$1.execute(SearchFactoryHandler.java:89)
	at org.infinispan.query.backend.TransactionHelper.runSuspendingTx(TransactionHelper.java:23)
	at org.infinispan.query.backend.SearchFactoryHandler.updateSearchFactory(SearchFactoryHandler.java:84)
	at org.infinispan.query.backend.SearchFactoryHandler.handleOnDemandRegistration(SearchFactoryHandler.java:59)
	at org.infinispan.query.backend.SearchFactoryHandler.updateKnownTypesIfNeeded(SearchFactoryHandler.java:41)
	at org.infinispan.query.backend.QueryInterceptor.updateKnownTypesIfNeeded(QueryInterceptor.java:269)
	at org.infinispan.query.backend.QueryInterceptor.processPutKeyValueCommand(QueryInterceptor.java:463)
	at org.infinispan.query.backend.QueryInterceptor.visitPutKeyValueCommand(QueryInterceptor.java:164)
	at org.infinispan.commands.write.PutKeyValueCommand.acceptVisitor(PutKeyValueCommand.java:71)

Full console log of the lat run can be found here: https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/jdg-6.x-func-ispn-testsuite-rhel-azul/USE_JDK=Azul,jdk=java18_default,label=edg-perf09/8/consoleFull

Comment 1 Vojtech Juranek 2016-08-10 05:13:30 UTC
On the Azul Zulu testsuite runs fine without any memory increase.

Comment 3 Vojtech Juranek 2016-08-10 18:50:21 UTC
Sorry, everything so far run with 1GB heap - Azul uses profile which overwrites java opts for tests. I missed this. Will re-run with properly increased heap.

Comment 4 Martin Gencur 2016-08-18 10:13:28 UTC
I filed a ticket with eng-ops and now trying to run the test suite for individual modules with -Xmsm=1024m which is currently the maximum we can set.

Ticket: https://engineering.redhat.com/rt/Ticket/Display.html?id=416315

Comment 5 Vojtech Juranek 2016-08-29 14:58:07 UTC
Now runs fine, but gets stuck in  integrationtests/cdi-weld-se-it, see BZ #1371208. However, closing this one.


Note You need to log in before you can comment on or make changes to this bug.