lmp.infer#

Language model inference methods module.

lmp.infer.ALL_INFERS#

All available language model inference methods.

Type

List[lmp.model.BaseInfer]

lmp.infer.INFER_OPTS#

Mapping inference method name infer_name to inference method class.

Type

Final[Dict[str, lmp.model.BaseInfer]]

Examples

Get lmp.infer.Top1Infer by its name.

>>> from lmp.infer import INFER_OPTS, Top1Infer
>>> Top1Infer.infer_name in INFER_OPTS
True
>>> INFER_OPTS[Top1Infer.infer_name] == Top1Infer
True

Submodules: