This change adds the export functionality and a test for the T5 v1.1 encoder. Small and XXL variants. Added parsing of GGUF arrays when loading properties. This is used to deduce the vocabulary size instead of having to provide this manually. This can potentially be used also to load the ...
help="Google T5 v1.1 small fp32 model path", default="/data/t5/small/google__t5-v1_1-small_f32.gguf", help="Google T5 v1.1 small float32 model path", ) parser.addoption( "--google-t5-v1-1-xxl-fp32-model-path", "--google-t5-v1-1-small-bf16-model-path", type=Path, ...