Ask Your Question

ClassLoaders Pool Exhausted

asked 2017-12-11 13:14:09 -0500

metadaddy gravatar image

When I run my pipelines I get this start error:

Pipeline Status: START_ERROR: java.lang.RuntimeException: Could not get a private ClassLoader for 'streamsets-datacollector-cdh_5_11-lib', for stage 'com_streamsets_pipeline_stage_processor_hive_HiveMetadataDProcessor', active private ClassLoaders='50': java.util.NoSuchElementException: Pool exhausted

If the pipeline runs it still does not finish; mostly it goes into retry mode. Has anyone seen this before and resolved this error?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2017-12-11 13:15:11 -0500

metadaddy gravatar image

You can get this error when you have many stages loaded - increase the value of max.stage.private.classloaders in from its default value of 50.

See the Data Collector Configuration docs for more information.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2017-12-11 13:14:09 -0500

Seen: 4,164 times

Last updated: Dec 11 '17