lmp.infer
#
Language model inference methods module.
- lmp.infer.ALL_INFERS#
All available language model inference methods.
- Type
List[
lmp.model.BaseInfer
]
- lmp.infer.INFER_OPTS#
Mapping inference method name
infer_name
to inference method class.- Type
Final[Dict[str,
lmp.model.BaseInfer
]]
Examples
Get lmp.infer.Top1Infer
by its name.
>>> from lmp.infer import INFER_OPTS, Top1Infer
>>> Top1Infer.infer_name in INFER_OPTS
True
>>> INFER_OPTS[Top1Infer.infer_name] == Top1Infer
True