Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Your Jython evaluator can operate at a record-by-record level, or a batch-by-batch level. It sounds like you will want batch level. With that, you can access the records by index from a list that is made available to your script (see the code snippet that is pasted in automatically when you create the stage). You will simply not copy certain records to the output stream, by virtue of their index in that list (which is functionally deleting them). However, this has some caveats. It assumes that your batches have the same structure and same size consistently (ex: same number of lines and semantics about which ones should be deleted). You will need to ensure your origin is consistently producing the complete batch/set of lines.