queue capacity overpassed

asked 2019-05-07 12:25:46 -0500

anonymous user


Hi, I am working on a requirement where I need to index data which is in MySQL to ES using Streamsets. Typically the pipeline is configured to run every 5 seconds and look for the last 10 seconds inserted records in MySQL and index them to ES. The problem here is some records are going in to error stage with the below error message, is there any solution for this?

ELASTICSEARCH_16 - Could not index record 'SELECT tbJob.pkJobId AS id, tbJob.summary, tbJob.description, tbJob.severity, ::rowCount:0': rejected execution of org.elasticsearch.transport.TransportService$7@56954b42 on EsThreadPoolExecutor[name = vm0pnelstsa0002/bulk, queue capacity = 1000, org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor@37a3005f[Running, pool size = 12, active threads = 12, queued tasks = 1000, completed tasks = 908973989]]

edit retag flag offensive close merge delete