Type
The type of model to use for your passage extractor LLM system. You can use one of the following options:
-
ExtractiveQuestionAnsweringLLM. Use an exported ALBERT question answering LLM (see https://huggingface.co/docs/transformers/model_doc/albert). For this type, you must set ModelPath and TokenizerPath to define the model files.
-
GenerativeLLM. Use an exported T5 generation LLM (see https://huggingface.co/docs/transformers/model_doc/t5). For this type, you must set ModelPath and TokenizerPath to define the model files.
-
ExtractiveQuestionAnsweringLua. Use a Lua script that performs extractive question answering. For this type, you must set Script to the name and path for the script to use.
-
GenerativeLua. Use a Lua script that performs generative question answering. For this type, you must set Script to the name and path for the script to use.
| Type: | String |
| Default: | |
| Required: | Yes |
| Configuration Section: | MyLLMModule |
| Example: | Type=GenerativeLLM
|
| See Also: |