Streamsets crashes due to out of memory exceptions when pipelines contain MapR-DB Components

mapr

asked 2018-05-11 01:51:17 -0500

seamfaces
11 ●1 ●2 ●4

updated 2018-05-11 10:26:52 -0500

jeff
1837 ●16 ●29 ●51

Please I have noticed frequent streamsets crashes due to out of memory exceptions when one or more pipelines is writing to MapR-DB. I have increased Heap memory to 10GB but still it crashes after a while. Please is there any configuration i can use to mitigate this?

edit retag flag offensive close merge delete

add a comment

1 Answer

Sort by » oldest newest most voted

answered 2018-05-12 07:19:57 -0500

pfcurtis
11 ●1 ●2

Can you tell me which MapR version you are using? And also, on the machine that is running the SDC, what MapR package was installed?

edit flag offensive delete link

Comments

Using MapR 6.0.0, On the SDC Node, MapR Packages Installed Include Hue, History Server, Spark Thrift Server, Grafana, HBase Thrift, Spark History Server, HTTPFS, Oozie, HBase Rest, Drill, Yarn Node Manager, SparkClient, Streams Rest API, HBase Client, Streams Java Client, NFS, File Server

seamfaces ( 2018-05-14 02:00:33 -0500 )edit

add a comment

Question Tools

1 follower

Stats

Asked: 2018-05-11 01:51:17 -0500

Seen: 42 times

Last updated: May 11

Streamsets crashes due to out of memory exceptions when pipelines contain MapR-DB Components edit

1 Answer

Comments

Question Tools

Stats

Related questions

Streamsets crashes due to out of memory exceptions when pipelines contain MapR-DB Components