If I understand correctly, the goal is to avoid too much calls from being blocked for $timeout seconds at the same time, by failing fast when too much calls have _already_ failed.
Am I correct that blocked calls can still accumulate before $threshold calls timeout ? e.g. if 1000 calls are initiated before 5 of them timeout, there are still 1000 blocked calls.
It seems that this problem can also be resolved by limiting the number of in-flight calls: If too many calls are already waiting for a response, reject further calls.
Am I correct that blocked calls can still accumulate before $threshold calls timeout ? e.g. if 1000 calls are initiated before 5 of them timeout, there are still 1000 blocked calls.
It seems that this problem can also be resolved by limiting the number of in-flight calls: If too many calls are already waiting for a response, reject further calls.