Fetch big files

asked 2019-05-28 12:52:32 -0500

anonymous user


When we are trying to fetch big files using http client via rest api it fails with the below error

Error : com.streamset.pipeline.api.StageException: HTTP_00 - Cannot parse record com.streamsets.pipeline.api.ext.io.OverrunException : Reader exceeded the limit '1048576'

Is there anyway to achieve this without increasing the limit ?

edit retag flag offensive close merge delete


Can you edit your question to include the full stack trace from sdc.log?

metadaddy gravatar imagemetadaddy ( 2019-05-29 09:53:34 -0500 )edit