JDBC Multi Table consumer disable use of order by

asked 2020-07-20 18:55:23 -0500

Ronald M gravatar image

I'm pulling data from a MySQL backend where I'm getting data by year and by location. Unfortunately, there is are no index related to both fields and cannot add them.

For a non incremental load but with column conditions, is there a way to disable the generation of an order by statement when executing in the backend?

Via sp process list (in mysql), I see that it performs a number of select max statements as it executes the main generated sql statement. Currently, it takes a bit of time to complete the pipeline as it performs.

If I perform a similar (but single table) query using JDBC Query Consumer, it performs faster. I issue a select statement without an order by clause.

I was wondering if there is a way to disable the creation of an order by clause in a JDBC Multi table query.

Thanks

edit retag flag offensive close merge delete

Comments

Non-incremental mode, which would kick in if the option is enabled and the table has no key, should already not do min/max/order by queries. Are you finding that is not the case?

jeff gravatar imagejeff ( 2020-07-20 21:55:25 -0500 )edit