Graceful Termination

[bro-adm]

Hello, I was wondering if when terminating/finalizing a model, the requests in the queue are processed at all and if they are do they have a timeout.

The same question is relevant to the use case of batches.
If i configured my model to require a batch size of 5 requests, and i could only send 3 before asking the model to terminate itself, would the model infer the 3 sent requests before finalizng itself, or would the requests be lost?

thanks