Ask Your Question

Optimise JDBC Lookup or alternative

asked 2019-11-11 05:54:41 -0500

lnicolaou gravatar image

updated 2019-11-11 06:03:55 -0500

Hi Guys,

I have created a pipeline which gets data from JDBC Consumer and based on a field in jdbc lookup if that id exists and split my pipeline accordingly. This is not very efficient as it makes a query for each row.

Is their a way that I can read from a source and get the result. Something like java HashMap. Or make my jdbc lookup more efficient.

Thanks in advance

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-11-11 06:20:26 -0500

lnicolaou gravatar image

By using caching on JDBC lookup I reduced time from 0.81 seconds to 0.01 seconds. So that did the trick

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-11-11 05:54:41 -0500

Seen: 64 times

Last updated: Nov 11 '19