Models Flamingo-9B - 61.5 51.8 44.7 - - 28.8 Flamingo-80B - 67.2 56.3 50.6 - - 31.6 Unified-IO-XL 100.0 - 77.9 54.0 - - - Kosmos-1 - 67.1 51.0 - - - 29.2 Kosmos-2 - 80.5 51.1 - - - - BLIP-2 (Vicuna-13B) 103.9 71.6 65.0 45.9 32.3 61.0 19.6 InstructBLIP (Vicuna-13B) ...
9b4eb9a Hacky integration of img pos / merging for qwen-vl … a709dd9 Add multimodal dummy data for qwen models … 59339d2 Conditionally enable visual component to support qwen llm-only models … d6e3ca4 Fix hardcoded image start ID in image position extraction … 8e27aa2 ...
gemma-2-9b-it 7.541 7.412 7.269 7.380 7.268 7.270 Baichuan2-13B-Chat 6.313 6.160 6.070 6.145 6.086 6.031 Llama-2-13b-chat-hf 5.449 5.422 5.341 5.384 5.332 5.329 Qwen1.5-14B-Chat 7.529 7.520 7.367 7.504 7.297 7.334 ipex-llm Quickstart Docker GPU Inference in C++: running llama.cpp, ollama...
Models Flamingo-9B - 61.5 51.8 44.7 - - 28.8 Flamingo-80B - 67.2 56.3 50.6 - - 31.6 Unified-IO-XL 100.0 - 77.9 54.0 - - - Kosmos-1 - 67.1 51.0 - - - 29.2 Kosmos-2 - 80.5 51.1 - - - - BLIP-2 (Vicuna-13B) 103.9 71.6 65.0 45.9 32.3 61.0 19.6 InstructBLIP (Vicuna-13B) ...
Models Flamingo-9B - 61.5 51.8 44.7 - - 28.8 Flamingo-80B - 67.2 56.3 50.6 - - 31.6 Unified-IO-XL 100.0 - 77.9 54.0 - - - Kosmos-1 - 67.1 51.0 - - - 29.2 Kosmos-2 - 80.5 51.1 - - - - BLIP-2 (Vicuna-13B) 103.9 71.6 65.0 45.9 32.3 61.0 19.6 InstructBLIP (Vicuna-13B) ...
Models Flamingo-9B - 61.5 51.8 44.7 - - 28.8 Flamingo-80B - 67.2 56.3 50.6 - - 31.6 Unified-IO-XL 100.0 - 77.9 54.0 - - - Kosmos-1 - 67.1 51.0 - - - 29.2 Kosmos-2 - 80.5 51.1 - - - - BLIP-2 (Vicuna-13B) 103.9 71.6 65.0 45.9 32.3 61.0 19.6 InstructBLIP (Vicuna-13B) ...
Models Flamingo-9B - 61.5 51.8 44.7 - - 28.8 Flamingo-80B - 67.2 56.3 50.6 - - 31.6 Unified-IO-XL 100.0 - 77.9 54.0 - - - Kosmos-1 - 67.1 51.0 - - - 29.2 Kosmos-2 - 80.5 51.1 - - - - BLIP-2 (Vicuna-13B) 103.9 71.6 65.0 45.9 32.3 61.0 19.6 InstructBLIP (Vicuna-13B) ...
Models Flamingo-9B - 61.5 51.8 44.7 - - 28.8 Flamingo-80B - 67.2 56.3 50.6 - - 31.6 Unified-IO-XL 100.0 - 77.9 54.0 - - - Kosmos-1 - 67.1 51.0 - - - 29.2 Kosmos-2 - 80.5 51.1 - - - - BLIP-2 (Vicuna-13B) 103.9 71.6 65.0 45.9 32.3 61.0 19.6 InstructBLIP (Vicuna-13B) ...
Models Flamingo-9B - 61.5 51.8 44.7 - - 28.8 Flamingo-80B - 67.2 56.3 50.6 - - 31.6 Unified-IO-XL 100.0 - 77.9 54.0 - - - Kosmos-1 - 67.1 51.0 - - - 29.2 Kosmos-2 - 80.5 51.1 - - - - BLIP-2 (Vicuna-13B) 103.9 71.6 65.0 45.9 32.3 61.0 19.6 InstructBLIP (Vicuna-13B) ...
Models Flamingo-9B - 61.5 51.8 44.7 - - 28.8 Flamingo-80B - 67.2 56.3 50.6 - - 31.6 Unified-IO-XL 100.0 - 77.9 54.0 - - - Kosmos-1 - 67.1 51.0 - - - 29.2 Kosmos-2 - 80.5 51.1 - - - - BLIP-2 (Vicuna-13B) 103.9 71.6 65.0 45.9 32.3 61.0 19.6 InstructBLIP (Vicuna-13B) ...