BEAM

The Hugging Face Transformers library has integrated Constrained Beam Search, enabling developers to force the inclusion of specific words or phrases during text generation. This feature modifies decoding logic to address the limitation of standard beam search in guaranteeing key information, making it suitable for tasks like machine translation and summarization where strict terminology adherence is required.

Hugging Face published a technical blog detailing various decoding methods for text generation using the Transformers library. The article compares greedy search, beam search, and sampling strategies to help developers optimize LLM output quality.