Ask Your Question

Streamsets crashes due to out of memory exceptions when pipelines contain MapR-DB Components

asked 2018-05-11 01:51:17 -0600

seamfaces gravatar image

updated 2018-05-11 10:26:52 -0600

jeff gravatar image

Please I have noticed frequent streamsets crashes due to out of memory exceptions when one or more pipelines is writing to MapR-DB. I have increased Heap memory to 10GB but still it crashes after a while. Please is there any configuration i can use to mitigate this?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-05-12 07:19:57 -0600

pfcurtis gravatar image

Can you tell me which MapR version you are using? And also, on the machine that is running the SDC, what MapR package was installed?

edit flag offensive delete link more


Using MapR 6.0.0, On the SDC Node, MapR Packages Installed Include Hue, History Server, Spark Thrift Server, Grafana, HBase Thrift, Spark History Server, HTTPFS, Oozie, HBase Rest, Drill, Yarn Node Manager, SparkClient, Streams Rest API, HBase Client, Streams Java Client, NFS, File Server

seamfaces gravatar imageseamfaces ( 2018-05-14 02:00:33 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-05-11 01:51:17 -0600

Seen: 170 times

Last updated: May 11 '18