Ask Your Question
0

Streamsets crashes due to out of memory exceptions when pipelines contain MapR-DB Components

asked 2018-05-11 01:51:17 -0500

seamfaces gravatar image

updated 2018-05-11 10:26:52 -0500

jeff gravatar image

Please I have noticed frequent streamsets crashes due to out of memory exceptions when one or more pipelines is writing to MapR-DB. I have increased Heap memory to 10GB but still it crashes after a while. Please is there any configuration i can use to mitigate this?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-05-12 07:19:57 -0500

pfcurtis gravatar image

Can you tell me which MapR version you are using? And also, on the machine that is running the SDC, what MapR package was installed?

edit flag offensive delete link more

Comments

Using MapR 6.0.0, On the SDC Node, MapR Packages Installed Include Hue, History Server, Spark Thrift Server, Grafana, HBase Thrift, Spark History Server, HTTPFS, Oozie, HBase Rest, Drill, Yarn Node Manager, SparkClient, Streams Rest API, HBase Client, Streams Java Client, NFS, File Server

seamfaces gravatar imageseamfaces ( 2018-05-14 02:00:33 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-05-11 01:51:17 -0500

Seen: 35 times

Last updated: May 11