Ask Your Question

Revision history [back]

Partitioning is the way to go here, I think - the file idle time/max size parameters are for more operational concerns, while partitioning is going to give you exactly what you need, albeit at the expense of a deeper directory structure.

Partitioning is the way to go here, I think - the file idle time/max size parameters are for more operational concerns, while partitioning is going to give you exactly what you need, albeit at the expense of a deeper directory structure.

You might be able to use Dataflow Triggers with an executor to automate what you're trying to do. Here are a couple of useful links: