Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

HadoopFS destination not firing Event to "invalidate metadata" for Impala

Hi Everyone, I am trying to replicate a database (MySQL) to Hive using the following blog post: https://streamsets.com/blog/blogreplicating-relational-databases-with-streamsets-data-collector/

As I add a new record in one of the source tables in MySQL it gets replicated to Hive (verified successfully), however the event which should be fired by HadoopFS destination to "invalidate metadata" for Impala by Hive Query executor is not working. I checked the dashboard of workflow and there is NO event getting fired.

I have checked and verified each config details from the blog post and it's all good.

Can anyone guide me as to what could be the issue.