Ask Your Question

Docker file for custom build path can't recognize stage lib

asked 2019-12-12 10:06:13 -0600

Prometheous2019 gravatar image

I have created below docker file, to adjust my requirement, which is to implement other than provided path in existing docker file. So, I created below docker file, which is kind of replica of current one but with the change of the location.

Have a look at the location

It needs polishing, but at the moment, I just need this to work.

when I build this, image as per the log, stages are downloaded properly.

however, when I run the container, it complains,

docker run -p 18631:18631 test
Java 1.8 detected; adding $SDC_JAVA8_OPTS of "-XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Djdk.nio.maxCachedBufferSize=262144" to $SDC_JAVA_OPTS
Picked up JAVA_TOOL_OPTIONS: -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap
Logging initialized @2048ms to org.eclipse.jetty.util.log.Slf4jLog
2019-12-12 15:47:53,065 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main - -----------------------------------------------------------------
2019-12-12 15:47:53,069 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main - Build info:
2019-12-12 15:47:53,073 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Version        : 3.8.0
2019-12-12 15:47:53,074 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Date           : 2019-03-13T17:59Z
2019-12-12 15:47:53,074 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Built by       : ubuntu
2019-12-12 15:47:53,074 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Repo SHA       : a6ccae06929986f44d0a833142f2a34dfbc39617
2019-12-12 15:47:53,075 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Source MD5     : 8ade86ae1a7071ca4ee5cf5413f83
2019-12-12 15:47:53,075 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main - -----------------------------------------------------------------
2019-12-12 15:47:53,075 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main - Runtime info:
2019-12-12 15:47:53,075 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Java version  : 1.8.0_192-b12
2019-12-12 15:47:53,076 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   SDC ID        : c18f558b-1cf6-11ea-afc6-05bf363b8a4c
2019-12-12 15:47:53,076 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Runtime dir   : /app/streamsets/streamsets-datacollector
2019-12-12 15:47:53,076 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Config dir    : /app/streamsets/streamsets-datacollector/etc
2019-12-12 15:47:53,077 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Data dir      : /app/streamsets/streamsets-datacollector/data
2019-12-12 15:47:53,077 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Log dir       : /app/streamsets/streamsets-datacollector/logs
2019-12-12 15:47:53,078 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Extra Libs dir: /app/streamsets/streamsets-datacollector/streamsets-libs-extras
2019-12-12 15:47:53,079 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main - -----------------------------------------------------------------
2019-12-12 15:47:53,079 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Security Manager : ENABLED, policy file: file:///app/streamsets/streamsets-datacollector/etc/sdc-security.policy, implementation: java.lang.SecurityManager
2019-12-12 15:47:53,079 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main - -----------------------------------------------------------------
2019-12-12 15:47:53,080 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main - Starting ...
2019-12-12 15:47:53,089 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main - -----------------------------------------------------------------
2019-12-12 15:47:53,089 [user:] [pipeline:] [runner:] [thread:main] [stage:] INFO  Main -   Kerberos enabled: false
2019-12-12 15:47:53,107 [user:] [pipeline ...
edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-12-12 10:33:49 -0600

Dima gravatar image

I'd recommend starting the container and dropping into a shell inside to inspect the file system. Besides recommending you look around and confirm that everything is installed in the right places and perhaps also that any of the config files don't have hanging referenced to old directories, not much we can do over a forum like this. If you're a customer, please open a support ticket and a support engineer can take a closer look.

edit flag offensive delete link more


thanks. I think something and somewhere it's causing this problem.

Prometheous2019 gravatar imagePrometheous2019 ( 2019-12-12 13:16:48 -0600 )edit

yes, I fixed it...

Prometheous2019 gravatar imagePrometheous2019 ( 2019-12-13 05:53:07 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-12-12 10:06:13 -0600

Seen: 44 times

Last updated: Dec 12 '19