Let's say we're trying to translate "How old are you?"to German. "Wie alt bist du?" is what you'd say in an informal setting, and "Wie alt sind Sie?"is what you'd say in a formal setti… See more

We mentioned above a use-case where we know which words we want to be included in the final output. An example of this might be using a dictionary lookup during neural machine tr… See more

The following is an example of traditional beam search, taken from a previous blog post: Unlike greedy search, beam search works by keeping a longer list of hypotheses… See more

Constrained beam search attempts to fulfill the constraints by injectingthe desired tokens at every step of the generation. Let's say that we're trying to force the phrase "is fast"in the … See more