Ask Your Question

How to fail the whole file?

asked 2019-09-17 09:27:41 -0500

khanhtran gravatar image

updated 2019-09-17 13:29:06 -0500

Hello, I have a pipeline that ingest csv files. Some files come with unexpected headers columns. As business logic requirement, this file should not be processed and should be sent to error. How to archive that?


edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-09-17 23:30:48 -0500

StuartWilson gravatar image

Hi Khanh, Not sure if I'm missing something - how would we distinguish between a header row and a row with text strings? :) - Stuart

edit flag offensive delete link more


Hi Stuart, We don't have header row but we know a certain header exists on the file or not. I am stuck at stop processing a file and make some noise when some columns are not present on the file.

khanhtran gravatar imagekhanhtran ( 2019-09-18 10:36:25 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-09-17 09:27:41 -0500

Seen: 659 times

Last updated: Sep 17 '19