MODEL CATALOG / NVIDIA

NVIDIA AI models

A structured reference for models prepared for NVIDIA GPUs and accelerators. Add or replace catalog groups from your JSON without changing the page layout.

MODELS

122

RUNTIME

CUDA

HARDWARE TARGET

NVIDIA GPU

Model HQ Catalog
NVIDIA ModelsAll Supported ModelsModels optimized for NVIDIA GPUs and accelerators
NVIDIA · All Supported ModelsCategoryModelParametersFormat
Agenticslim-ner-tool1.1Tool
Agenticslim-sentiment-tool1.1Tool
Agenticslim-emotions-tool1.1Tool
Agenticslim-ratings-tool1.1Tool
Agenticslim-intent-tool1.1Tool
Agenticslim-nli-tool1.1Tool
Agenticslim-topics-tool1.1Tool
Agenticslim-tags-tool1.1Tool
Agenticslim-sql-tool1.1Tool
Agenticslim-category-tool1.1Tool
Agenticslim-xsum-tool1.1Tool
Agenticslim-extract-tool1.1Tool
Agenticslim-extract-phi-3-gguf3.8GGUF
Agenticslim-extract-qwen-1.5b-gguf1.5GGUF
Agenticslim-extract-qwen-nano-gguf0.5GGUF
Agenticslim-extract-tiny-tool1.1Tool
Agenticslim-summary-tiny-tool1.1Tool
Agenticslim-summary-phi-3-gguf3.8GGUF
Agenticslim-xsum-phi-3-gguf3.8GGUF
Agenticslim-boolean-tool1.1Tool
Agenticslim-boolean-phi-3-gguf3.8GGUF
Agenticslim-sa-ner-phi-3-gguf3.8GGUF
Agenticslim-sa-ner-tool1.1Tool
Agenticslim-tags-3b-tool3Tool
Agenticslim-summary-tool1.1Tool
Agenticslim-q-gen-phi-3-tool3.8Tool
Agenticslim-q-gen-tiny-tool1.1Tool
Agenticslim-qa-gen-tiny-tool1.1Tool
Agenticslim-qa-gen-phi-3-tool3.8Tool
Cloudclaude-opus-4-5NACloud
Cloudclaude-haiku-4-5NACloud
Cloudclaude-sonnet-4-5NACloud
Cloudclaude-sonnet-4-20250514NACloud
Cloudclaude-opus-4-20250514NACloud
Cloudgemini-3-pro-previewNACloud
Cloudgemini-3-flash-previewNACloud
Cloudgemini-2.5-proNACloud
Cloudgemini-2.5-flashNACloud
Cloudgemini-2.5-flash-liteNACloud
Cloudgpt-5.2-proNACloud
Cloudgpt-5.2NACloud
Cloudgpt-5-miniNACloud
Cloudgpt-5-nanoNACloud
Cloudgpt-4.1NACloud
Codingqwen-2.5-7b-coder-gguf7GGUF
Embeddingall-mini-lm-L6-v20.02NA
Embeddingall-mpnet-base-v20.1NA
Embeddingindustry-bert-insurance0.1NA
Embeddingindustry-bert-contracts0.1NA
Embeddingindustry-bert-asset-management0.1NA
Embeddingindustry-bert-sec0.1NA
Embeddingindustry-bert-loans0.1NA
Embeddingnomic-ai/nomic-embed-text-v10.1NA
General Chatllama-2-7b-chat-gguf7GGUF
General Chatdragon-llama-3.1-gguf8GGUF
General Chattiny-llama-chat-gguf1.1GGUF
General Chatqwen3-1.7b-gguf1.7GGUF
General Chatqwen3-8b-gguf8GGUF
General Chatqwen3-14b-gguf14GGUF
General Chatqwen-3.5-4b-gguf4GGUF
General Chatqwen-3.5-9b-gguf9GGUF
General Chatqwen-3.5-27b-gguf27GGUF
General Chatqwen-3.5-35b-a3b-gguf35GGUF
General Chatqwen2.5-32b-gguf32GGUF
General Chatqwen2.5-72b-gguf72GGUF
General Chatdeepseek-qwen-14b-gguf14GGUF
General Chatdeepseek-qwen-7b-gguf7GGUF
General Chatphi-3-gguf3.8GGUF
General Chatphi-3.5-gguf3.8GGUF
General Chatphi-4-gguf14GGUF
General Chatphi-4-mini-gguf3.8GGUF
General Chatphi-4-mini-reasoning-gguf3.8GGUF
General Chatmistral-small-3.2-24b-gguf24GGUF
General Chatministral-3-14b-gguf14GGUF
General Chatopenhermes-2.5-mistral-7b-gguf7GGUF
General Chatzephyr-7b-beta-gguf7GGUF
General Chatstarling-lm-7b-alpha-gguf7GGUF
General Chatgemma-3-4b-gguf4GGUF
General Chatgemma-3-12b-gguf12GGUF
General Chatgemma-4-4b-gguf4GGUF
General Chatgemma-4-2b-gguf2GGUF
General Chatgemma-4-26b-gguf26GGUF
General Chatgpt-oss-20b-gguf20GGUF
General Chatolmo-13b-gguf13GGUF
General Chatgranite-4-micro-gguf1.1GGUF
General Chatliquidai-lfm2-2.6b-gguf2.6GGUF
General Chatminicpm-2.6-gguf4GGUF
Instructgemma-2-9b-instruct-gguf9GGUF
Instructgemma-2-27b-instruct-gguf27GGUF
Instructllama-3.1-instruct-gguf8GGUF
Instructllama-3-8b-instruct-gguf8GGUF
Instructllama-3.2-1b-instruct-gguf1.1GGUF
Instructllama-3.2-3b-instruct-gguf3GGUF
Instructmistral-7b-instruct-v0.3-gguf7GGUF
Instructqwen2.5-vl-3b-instruct-gguf3GGUF
Instructqwen2-7B-instruct-gguf7GGUF
Instructqwen3-4b-instruct-gguf4GGUF
Instructqwen2-1.5b-instruct-gguf1.5GGUF
Instructqwen2-0.5b-instruct-gguf0.5GGUF
Instructqwen-2.5-14b-instruct-gguf14GGUF
Re-rankerjina-reranker-tiny-ppt0.1NA
Re-rankerjina-reranker-turbo-ppt0.6NA
Re-rankerjina-reranker-tiny-onnx0.1ONNX
Re-rankerjina-reranker-turbo-onnx0.6ONNX
Re-rankerjina-reranker-v1-turbo-en0.6NA
Re-rankerjina-reranker-v1-tiny-en0.1NA
Speech-to-textwhisper-cpp-base-english0.07NA
Question-answerbling-qwen-mini-tool1.5Tool
Question-answerdragon-qwen-7b-gguf7GGUF
Question-answerbling-phi-3-gguf3.8GGUF
Question-answerbling-phi-3.5-gguf3.8GGUF
Question-answerdragon-mistral-0.3-gguf7GGUF
Question-answerdragon-yi-9b-gguf9GGUF
Question-answerdragon-yi-answer-tool6Tool
Question-answerbling-stablelm-3b-gguf3GGUF
Question-answerbling-answer-tool1.1Tool
Question-answerdragon-llama-answer-tool7Tool
Question-answerdragon-mistral-answer-tool7Tool
Visionqwen2.5-vl-3b-instruct-gguf3GGUF
Visionqwen3-vl-8b-gguf8GGUF
Visionqwen3-vl-4b-gguf4GGUF
Visionqwen3-vl-30b-gguf30GGUF

NVIDIA AI models

NVIDIA AI models

NVIDIA Models

All Supported Models

Try MODEL HQ by LLMWare.ai and start using AI models on your AI PCs today

Try MODEL HQ by LLMWare.ai and start using AI models on your AI PCs today

Try MODEL HQ by LLMWare.ai and start using AI models on your AI PCs today

Category	Model	Parameters	Format
Agentic	slim-ner-tool	1.1	Tool
Agentic	slim-sentiment-tool	1.1	Tool
Agentic	slim-emotions-tool	1.1	Tool
Agentic	slim-ratings-tool	1.1	Tool
Agentic	slim-intent-tool	1.1	Tool
Agentic	slim-nli-tool	1.1	Tool
Agentic	slim-topics-tool	1.1	Tool
Agentic	slim-tags-tool	1.1	Tool
Agentic	slim-sql-tool	1.1	Tool
Agentic	slim-category-tool	1.1	Tool
Agentic	slim-xsum-tool	1.1	Tool
Agentic	slim-extract-tool	1.1	Tool
Agentic	slim-extract-phi-3-gguf	3.8	GGUF
Agentic	slim-extract-qwen-1.5b-gguf	1.5	GGUF
Agentic	slim-extract-qwen-nano-gguf	0.5	GGUF
Agentic	slim-extract-tiny-tool	1.1	Tool
Agentic	slim-summary-tiny-tool	1.1	Tool
Agentic	slim-summary-phi-3-gguf	3.8	GGUF
Agentic	slim-xsum-phi-3-gguf	3.8	GGUF
Agentic	slim-boolean-tool	1.1	Tool
Agentic	slim-boolean-phi-3-gguf	3.8	GGUF
Agentic	slim-sa-ner-phi-3-gguf	3.8	GGUF
Agentic	slim-sa-ner-tool	1.1	Tool
Agentic	slim-tags-3b-tool	3	Tool
Agentic	slim-summary-tool	1.1	Tool
Agentic	slim-q-gen-phi-3-tool	3.8	Tool
Agentic	slim-q-gen-tiny-tool	1.1	Tool
Agentic	slim-qa-gen-tiny-tool	1.1	Tool
Agentic	slim-qa-gen-phi-3-tool	3.8	Tool
Cloud	claude-opus-4-5	NA	Cloud
Cloud	claude-haiku-4-5	NA	Cloud
Cloud	claude-sonnet-4-5	NA	Cloud
Cloud	claude-sonnet-4-20250514	NA	Cloud
Cloud	claude-opus-4-20250514	NA	Cloud
Cloud	gemini-3-pro-preview	NA	Cloud
Cloud	gemini-3-flash-preview	NA	Cloud
Cloud	gemini-2.5-pro	NA	Cloud
Cloud	gemini-2.5-flash	NA	Cloud
Cloud	gemini-2.5-flash-lite	NA	Cloud
Cloud	gpt-5.2-pro	NA	Cloud
Cloud	gpt-5.2	NA	Cloud
Cloud	gpt-5-mini	NA	Cloud
Cloud	gpt-5-nano	NA	Cloud
Cloud	gpt-4.1	NA	Cloud
Coding	qwen-2.5-7b-coder-gguf	7	GGUF
Embedding	all-mini-lm-L6-v2	0.02	NA
Embedding	all-mpnet-base-v2	0.1	NA
Embedding	industry-bert-insurance	0.1	NA
Embedding	industry-bert-contracts	0.1	NA
Embedding	industry-bert-asset-management	0.1	NA
Embedding	industry-bert-sec	0.1	NA
Embedding	industry-bert-loans	0.1	NA
Embedding	nomic-ai/nomic-embed-text-v1	0.1	NA
General Chat	llama-2-7b-chat-gguf	7	GGUF
General Chat	dragon-llama-3.1-gguf	8	GGUF
General Chat	tiny-llama-chat-gguf	1.1	GGUF
General Chat	qwen3-1.7b-gguf	1.7	GGUF
General Chat	qwen3-8b-gguf	8	GGUF
General Chat	qwen3-14b-gguf	14	GGUF
General Chat	qwen-3.5-4b-gguf	4	GGUF
General Chat	qwen-3.5-9b-gguf	9	GGUF
General Chat	qwen-3.5-27b-gguf	27	GGUF
General Chat	qwen-3.5-35b-a3b-gguf	35	GGUF
General Chat	qwen2.5-32b-gguf	32	GGUF
General Chat	qwen2.5-72b-gguf	72	GGUF
General Chat	deepseek-qwen-14b-gguf	14	GGUF
General Chat	deepseek-qwen-7b-gguf	7	GGUF
General Chat	phi-3-gguf	3.8	GGUF
General Chat	phi-3.5-gguf	3.8	GGUF
General Chat	phi-4-gguf	14	GGUF
General Chat	phi-4-mini-gguf	3.8	GGUF
General Chat	phi-4-mini-reasoning-gguf	3.8	GGUF
General Chat	mistral-small-3.2-24b-gguf	24	GGUF
General Chat	ministral-3-14b-gguf	14	GGUF
General Chat	openhermes-2.5-mistral-7b-gguf	7	GGUF
General Chat	zephyr-7b-beta-gguf	7	GGUF
General Chat	starling-lm-7b-alpha-gguf	7	GGUF
General Chat	gemma-3-4b-gguf	4	GGUF
General Chat	gemma-3-12b-gguf	12	GGUF
General Chat	gemma-4-4b-gguf	4	GGUF
General Chat	gemma-4-2b-gguf	2	GGUF
General Chat	gemma-4-26b-gguf	26	GGUF
General Chat	gpt-oss-20b-gguf	20	GGUF
General Chat	olmo-13b-gguf	13	GGUF
General Chat	granite-4-micro-gguf	1.1	GGUF
General Chat	liquidai-lfm2-2.6b-gguf	2.6	GGUF
General Chat	minicpm-2.6-gguf	4	GGUF
Instruct	gemma-2-9b-instruct-gguf	9	GGUF
Instruct	gemma-2-27b-instruct-gguf	27	GGUF
Instruct	llama-3.1-instruct-gguf	8	GGUF
Instruct	llama-3-8b-instruct-gguf	8	GGUF
Instruct	llama-3.2-1b-instruct-gguf	1.1	GGUF
Instruct	llama-3.2-3b-instruct-gguf	3	GGUF
Instruct	mistral-7b-instruct-v0.3-gguf	7	GGUF
Instruct	qwen2.5-vl-3b-instruct-gguf	3	GGUF
Instruct	qwen2-7B-instruct-gguf	7	GGUF
Instruct	qwen3-4b-instruct-gguf	4	GGUF
Instruct	qwen2-1.5b-instruct-gguf	1.5	GGUF
Instruct	qwen2-0.5b-instruct-gguf	0.5	GGUF
Instruct	qwen-2.5-14b-instruct-gguf	14	GGUF
Re-ranker	jina-reranker-tiny-ppt	0.1	NA
Re-ranker	jina-reranker-turbo-ppt	0.6	NA
Re-ranker	jina-reranker-tiny-onnx	0.1	ONNX
Re-ranker	jina-reranker-turbo-onnx	0.6	ONNX
Re-ranker	jina-reranker-v1-turbo-en	0.6	NA
Re-ranker	jina-reranker-v1-tiny-en	0.1	NA
Speech-to-text	whisper-cpp-base-english	0.07	NA
Question-answer	bling-qwen-mini-tool	1.5	Tool
Question-answer	dragon-qwen-7b-gguf	7	GGUF
Question-answer	bling-phi-3-gguf	3.8	GGUF
Question-answer	bling-phi-3.5-gguf	3.8	GGUF
Question-answer	dragon-mistral-0.3-gguf	7	GGUF
Question-answer	dragon-yi-9b-gguf	9	GGUF
Question-answer	dragon-yi-answer-tool	6	Tool
Question-answer	bling-stablelm-3b-gguf	3	GGUF
Question-answer	bling-answer-tool	1.1	Tool
Question-answer	dragon-llama-answer-tool	7	Tool
Question-answer	dragon-mistral-answer-tool	7	Tool
Vision	qwen2.5-vl-3b-instruct-gguf	3	GGUF
Vision	qwen3-vl-8b-gguf	8	GGUF
Vision	qwen3-vl-4b-gguf	4	GGUF
Vision	qwen3-vl-30b-gguf	30	GGUF