[api] Have new beam search support multiple temperatures / topp's in parallel
Created by: stephenroller
these params can be done per batch item so no need to serve them serially.
Created by: stephenroller
these params can be done per batch item so no need to serve them serially.