Ask Your Question

unable to start StreamSets using streamsets dc

asked 2017-09-09 13:07:18 -0500

sushilindia gravatar image

updated 2017-09-20 13:09:13 -0500

LC gravatar image
  1. Not able to start streamsets using command /bin/streamsets dc, tried with sudo also but giving a message that streamsets: command not found .i am using ubuntu 17.04.

  2. Then i tried with /bin/sudo ./streamsets dc ,which gives below error which i am not able to understand and fix after reffering the link and dont know how and where to set the limit 32768
    Configuration of maximum open file limit is too low: 1024 (expected at least 32768). Please consult

Thanks in Advance

edit retag flag offensive close merge delete

4 Answers

Sort by ยป oldest newest most voted

answered 2017-09-11 13:11:28 -0500

jeff gravatar image

updated 2017-09-11 13:27:33 -0500

Please refer to the Configuring the Open File Limit of the documentation here.

edit flag offensive delete link more

answered 2017-09-22 03:21:59 -0500

sujeet gravatar image

Before starting streamsets use "ulimit -n 32768" . It will fix the issue

edit flag offensive delete link more

answered 2017-09-11 13:14:05 -0500

You don't need to start DC as root. But you were typing /bin/streamsets dc -- in fact, if you're in the main Data Collector directory, you'd just type something like ./bin/streamsets dc (a relative path, not the absolute path you were using). In Ubuntu, you'll need to edit /etc/security/limits.conf and add two lines, something like:

* soft nofiles 32768

* hard nofiles 32768

To make this take effect for your current session, run ulimit -n 32768

edit flag offensive delete link more

answered 2017-09-11 13:32:11 -0500

kirti gravatar image

updated 2017-09-11 13:32:37 -0500

Also, you can try StreamSets Data Collector with Docker. If interested, check out Getting Started with StreamSets Data Collector on Docker.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2017-09-09 13:05:48 -0500

Seen: 1,895 times

Last updated: Sep 22 '17