Tool Atlas
Back to Categories

AI Models, API & Infrastructure

Model hubs, inference APIs, vector databases and GPU/ML platforms.

76 tools

Amazon Bedrock

AI Models, API & Infrastructure

Managed access to foundation models on AWS.

apifoundation-modelsaws
0aws.amazon.com
Visit
Anthropic API

AI Models, API & Infrastructure

API access to Anthropic's Claude models.

apillmclaude
0anthropic.com
Visit
Anyscale

AI Models, API & Infrastructure

Platform for scaling Ray and LLM workloads on any cloud.

rayscalingplatform
0anyscale.com
Visit
AnythingLLM

AI Models, API & Infrastructure

Open-source app to chat with documents using any LLM.

ragopen-sourcedocuments
0anythingllm.com
Visit
Arize
ArizeFree

AI Models, API & Infrastructure

AI observability and evaluation platform for ML and LLMs.

observabilityevaluationml
0arize.com
Visit
Azure AI

AI Models, API & Infrastructure

Microsoft's suite of AI services and model hosting.

cloudapienterprise
0azure.microsoft.com
Visit
Baseten

AI Models, API & Infrastructure

Platform for deploying and scaling ML and LLM models.

deploymentinferenceml
0baseten.co
Visit
Braintrust

AI Models, API & Infrastructure

Evaluation and observability platform for AI products.

evaluationllmopsobservability
0braintrust.dev
Visit
Cerebras

AI Models, API & Infrastructure

Wafer-scale AI compute and fast inference cloud.

inferencehardwarefast
0cerebras.ai
Visit
Cerebrium

AI Models, API & Infrastructure

Serverless platform for deploying ML models and AI apps.

serverlessdeploymentgpu
0cerebrium.ai
Visit
Chroma
ChromaFree

AI Models, API & Infrastructure

Open-source embedding database for AI apps.

vector-databaseopen-sourcerag
0trychroma.com
Visit
Cohere
CohereFree

AI Models, API & Infrastructure

Enterprise LLM platform for generation and embeddings.

apillmenterprise
0cohere.com
Visit
CoreWeave

AI Models, API & Infrastructure

Cloud GPU infrastructure specialized for AI.

gpucloudinfrastructure
0coreweave.com
Visit
DeepInfra

AI Models, API & Infrastructure

Serverless inference API for open LLMs and image models.

inferenceapillm
0deepinfra.com
Visit
DSPy
DSPyFree

AI Models, API & Infrastructure

Framework for programming and optimizing LLM pipelines.

frameworkoptimizationllm
0dspy.ai
Visit
Evidently

AI Models, API & Infrastructure

Open-source observability and testing for ML and LLM systems.

observabilitytestingml
0evidentlyai.com
Visit
fal
falFree

AI Models, API & Infrastructure

Fast inference platform for generative image, video and audio models.

inferencegenerativeapi
0fal.ai
Visit
Fireworks AI

AI Models, API & Infrastructure

High-performance inference platform for open models.

apiinferenceopen-models
0fireworks.ai
Visit
Galileo

AI Models, API & Infrastructure

Evaluation and observability platform for GenAI applications.

evaluationobservabilitygenai
0galileo.ai
Visit
Giskard

AI Models, API & Infrastructure

Open-source testing and evaluation for ML and LLM applications.

testingevaluationopen-source
0giskard.ai
Visit
Google AI Studio

AI Models, API & Infrastructure

Google's platform to build with Gemini models.

apigeminiplatform
0aistudio.google.com
Visit
Google Vertex AI

AI Models, API & Infrastructure

Google Cloud platform for building and deploying ML models.

mlplatformgcp
0cloud.google.com
Visit
GPT4All

AI Models, API & Infrastructure

Open-source desktop app to run local LLMs on any computer.

localopen-sourcellm
0gpt4all.io
Visit
Groq
GroqFree

AI Models, API & Infrastructure

Ultra-fast LLM inference on custom LPU hardware.

apiinferencefast
0groq.com
Visit
Guardrails AI

AI Models, API & Infrastructure

Open-source framework to add validation and guardrails to LLMs.

guardrailsvalidationopen-source
0guardrailsai.com
Visit
Haystack

AI Models, API & Infrastructure

Open-source framework for building LLM, RAG and search pipelines.

frameworkragopen-source
0haystack.deepset.ai
Visit
Helicone

AI Models, API & Infrastructure

Observability and gateway for LLM applications.

observabilitygatewayllm
0helicone.ai
Visit
Hugging Face

AI Models, API & Infrastructure

Hub for open models, datasets and AI apps.

modelsdatasetscommunity
0huggingface.co
Visit
Hugging Face Spaces

AI Models, API & Infrastructure

Host and share machine learning demo apps.

hostingdemosml
0huggingface.co
Visit
Humanloop

AI Models, API & Infrastructure

Platform for evaluating and improving LLM applications.

evaluationllmplatform
0humanloop.com
Visit
Hyperbolic

AI Models, API & Infrastructure

Decentralized GPU marketplace and inference API for AI.

gpuinferenceapi
0hyperbolic.xyz
Visit
Lakera
LakeraFree

AI Models, API & Infrastructure

AI security platform that guards LLM apps against attacks.

securityguardrailsllm
0lakera.ai
Visit
Lambda
LambdaFree

AI Models, API & Infrastructure

GPU cloud and workstations for AI training.

gpucloudcompute
0lambda.ai
Visit
Langfuse

AI Models, API & Infrastructure

Open-source LLM observability, tracing and evaluation.

observabilityopen-sourcellm
0langfuse.com
Visit
LangSmith

AI Models, API & Infrastructure

Tracing and evaluation platform for LLM applications.

observabilityllmopsevaluation
0langchain.com
Visit
Lepton AI

AI Models, API & Infrastructure

Platform for deploying and serving AI models at scale.

deploymentinferencegpu
0lepton.ai
Visit
LibreChat

AI Models, API & Infrastructure

Open-source, customizable ChatGPT-like interface for many models.

self-hostedopen-sourceinterface
0librechat.ai
Visit
LiteLLM

AI Models, API & Infrastructure

Open-source gateway to call many LLM providers with one API.

gatewayopen-sourcellm
0litellm.ai
Visit
LlamaIndex

AI Models, API & Infrastructure

Framework for building RAG and agent applications over your data.

ragframeworkagents
0llamaindex.ai
Visit
LM Studio

AI Models, API & Infrastructure

Desktop app to discover and run local LLMs.

localllmdesktop
0lmstudio.ai
Visit
LocalAI

AI Models, API & Infrastructure

Open-source, self-hosted OpenAI-compatible inference server.

self-hostedopen-sourceinference
0localai.io
Visit
Mem0
Mem0Free

AI Models, API & Infrastructure

Open-source memory layer that adds long-term memory to AI agents.

memoryagentsopen-source
0mem0.ai
Visit
Milvus
MilvusFree

AI Models, API & Infrastructure

Open-source vector database for AI and similarity search.

vector-databaseopen-sourcesearch
0milvus.io
Visit
Mistral AI

AI Models, API & Infrastructure

European AI lab offering open-weight and commercial models.

apiopen-weightllm
0mistral.ai
Visit
Modal
ModalFree

AI Models, API & Infrastructure

Serverless compute platform for ML and AI workloads.

serverlessgpuml
0modal.com
Visit
Nebius
NebiusFree

AI Models, API & Infrastructure

AI cloud providing GPU infrastructure and managed services.

gpucloudinfrastructure
0nebius.com
Visit
Neural Magic

AI Models, API & Infrastructure

Software for faster, sparser inference of AI models.

inferenceoptimizationopen-source
0neuralmagic.com
Visit
Novita AI

AI Models, API & Infrastructure

AI cloud offering GPU instances and model APIs.

gpuinferenceapi
0novita.ai
Visit
Ollama
OllamaFree

AI Models, API & Infrastructure

Run open large language models locally with one command.

localopen-sourcellm
0ollama.com
Visit
Open WebUI

AI Models, API & Infrastructure

Open-source, self-hosted web interface for local and remote LLMs.

self-hostedopen-sourceinterface
0openwebui.com
Visit
OpenAI Platform

AI Models, API & Infrastructure

Developer platform for OpenAI models and APIs.

apillmplatform
0platform.openai.com
Visit
OpenPipe

AI Models, API & Infrastructure

Tooling to fine-tune and serve task-specific LLMs cheaply.

fine-tuningllm
0openpipe.ai
Visit
OpenRouter

AI Models, API & Infrastructure

Unified API to access many models from different providers.

apigatewaymodels
0openrouter.ai
Visit
Patronus AI

AI Models, API & Infrastructure

AI evaluation and guardrails platform for LLM applications.

evaluationguardrailsllm
0patronus.ai
Visit
Perplexity API

AI Models, API & Infrastructure

API for Perplexity's online search and answer models.

apisearchllm
0docs.perplexity.ai
Visit
pgvector

AI Models, API & Infrastructure

Open-source vector similarity search extension for Postgres.

vector-databasepostgresopen-source
0github.com
Visit
Pinecone

AI Models, API & Infrastructure

Managed vector database for semantic search and RAG.

vector-databaserag
0pinecone.io
Visit
Portkey

AI Models, API & Infrastructure

AI gateway with observability, guardrails and routing.

gatewayguardrailsllm
0portkey.ai
Visit
Predibase

AI Models, API & Infrastructure

Platform for fine-tuning and serving open-source LLMs.

fine-tuningllmserving
0predibase.com
Visit
PromptLayer

AI Models, API & Infrastructure

Platform for prompt management, evaluation and observability.

promptsobservability
0promptlayer.com
Visit
Qdrant
QdrantFree

AI Models, API & Infrastructure

Vector similarity search engine and database.

vector-databaseopen-source
0qdrant.tech
Visit
Ragas
RagasFree

AI Models, API & Infrastructure

Open-source framework for evaluating RAG pipelines.

evaluationragopen-source
0ragas.io
Visit
Replicate

AI Models, API & Infrastructure

Run open-source models via a simple API.

apimodelshosting
0replicate.com
Visit
RunPod
RunPodFree

AI Models, API & Infrastructure

GPU cloud for training and deploying AI models.

gpucloudml
0runpod.io
Visit
Scale AI

AI Models, API & Infrastructure

Data platform for training and evaluating AI models.

datalabelingenterprise
0scale.com
Visit
Supabase

AI Models, API & Infrastructure

Open-source backend with Postgres and vector support.

backenddatabasevector
0supabase.com
Visit
Together AI

AI Models, API & Infrastructure

Fast inference and fine-tuning for open models.

apiinferenceopen-models
0together.ai
Visit
TrueFoundry

AI Models, API & Infrastructure

Platform to deploy, manage and observe AI/ML workloads.

deploymentmlopsplatform
0truefoundry.com
Visit
Unstructured

AI Models, API & Infrastructure

Platform for ingesting and preprocessing documents for LLMs.

data-ingestiondocumentsrag
0unstructured.io
Visit
Vellum
VellumFree

AI Models, API & Infrastructure

Platform for building and evaluating LLM applications.

llmopsevaluationdevelopment
0vellum.ai
Visit
Vercel
VercelFree

AI Models, API & Infrastructure

Frontend cloud with an AI SDK and edge functions.

deployfrontendai-sdk
0vercel.com
Visit
Vercel AI SDK

AI Models, API & Infrastructure

Open-source toolkit for building AI apps with TypeScript.

sdkopen-sourcellm
0sdk.vercel.ai
Visit
vLLM
vLLMFree

AI Models, API & Infrastructure

High-throughput open-source LLM serving engine.

inferenceopen-sourceserving
0vllm.ai
Visit
Weaviate

AI Models, API & Infrastructure

Open-source vector database for AI applications.

vector-databaseopen-source
0weaviate.io
Visit
Weights & Biases

AI Models, API & Infrastructure

ML experiment tracking and model management platform.

mlopsexperimentsmonitoring
0wandb.ai
Visit
Zep
ZepFree

AI Models, API & Infrastructure

Memory layer for AI agents and assistants.

memoryagentsrag
0getzep.com
Visit