Streamsets crashes due to out of memory exceptions when pipelines contain MapR-DB Components

mapr

asked 2018-05-11 01:51:17 -0600

seamfaces
11 ●3 ●4 ●5

updated 2018-05-11 10:26:52 -0600

jeff
2022 ●17 ●30 ●54

Please I have noticed frequent streamsets crashes due to out of memory exceptions when one or more pipelines is writing to MapR-DB. I have increased Heap memory to 10GB but still it crashes after a while. Please is there any configuration i can use to mitigate this?

edit retag flag offensive close merge delete

add a comment

1 Answer

Sort by » oldest newest most voted

answered 2018-05-12 07:19:57 -0600

pfcurtis
11 ●1 ●2

Can you tell me which MapR version you are using? And also, on the machine that is running the SDC, what MapR package was installed?

edit flag offensive delete link

Comments

Using MapR 6.0.0, On the SDC Node, MapR Packages Installed Include Hue, History Server, Spark Thrift Server, Grafana, HBase Thrift, Spark History Server, HTTPFS, Oozie, HBase Rest, Drill, Yarn Node Manager, SparkClient, Streams Rest API, HBase Client, Streams Java Client, NFS, File Server

seamfaces ( 2018-05-14 02:00:33 -0600 )edit

add a comment

Question Tools

1 follower

Stats

Asked: 2018-05-11 01:51:17 -0600

Seen: 58 times

Last updated: May 11 '18

Streamsets crashes due to out of memory exceptions when pipelines contain MapR-DB Components edit

1 Answer

Comments

Question Tools

Stats

Related questions

Streamsets crashes due to out of memory exceptions when pipelines contain MapR-DB Components