Tool Atlas
Back to Categories

Security & Privacy

Security, privacy, and encryption tools

76 tools

LM Studio

Security & Privacy

Desktop app to discover and run local LLMs.

localllmdesktop
0lmstudio.ai
Visit
RunPod
RunPodFree

Security & Privacy

GPU cloud for training and deploying AI models.

gpucloudml
0runpod.io
Visit
vLLM
vLLMFree

Security & Privacy

High-throughput open-source LLM serving engine.

inferenceopen-sourceserving
0vllm.ai
Visit
Amazon Bedrock

Security & Privacy

Managed access to foundation models on AWS.

apifoundation-modelsaws
0aws.amazon.com
Visit
Anthropic API

Security & Privacy

API access to Anthropic''s Claude models.

apillmclaude
0anthropic.com
Visit
Anyscale

Security & Privacy

Platform for scaling Ray and LLM workloads on any cloud.

rayscalingplatform
0anyscale.com
Visit
AnythingLLM

Security & Privacy

Open-source app to chat with documents using any LLM.

ragopen-sourcedocuments
0anythingllm.com
Visit
Arize
ArizeFree

Security & Privacy

AI observability and evaluation platform for ML and LLMs.

observabilityevaluationml
0arize.com
Visit
Azure AI

Security & Privacy

Microsoft''s suite of AI services and model hosting.

cloudapienterprise
0azure.microsoft.com
Visit
Baseten

Security & Privacy

Platform for deploying and scaling ML and LLM models.

deploymentinferenceml
0baseten.co
Visit
Braintrust

Security & Privacy

Evaluation and observability platform for AI products.

evaluationllmopsobservability
0braintrust.dev
Visit
Cerebras

Security & Privacy

Wafer-scale AI compute and fast inference cloud.

inferencehardwarefast
0cerebras.ai
Visit
Cerebrium

Security & Privacy

Serverless platform for deploying ML models and AI apps.

serverlessdeploymentgpu
0cerebrium.ai
Visit
Chroma
ChromaFree

Security & Privacy

Open-source embedding database for AI apps.

vector-databaseopen-sourcerag
0trychroma.com
Visit
Cohere
CohereFree

Security & Privacy

Enterprise LLM platform for generation and embeddings.

apillmenterprise
0cohere.com
Visit
CoreWeave

Security & Privacy

Cloud GPU infrastructure specialized for AI.

gpucloudinfrastructure
0coreweave.com
Visit
DeepInfra

Security & Privacy

Serverless inference API for open LLMs and image models.

inferenceapillm
0deepinfra.com
Visit
DSPy
DSPyFree

Security & Privacy

Framework for programming and optimizing LLM pipelines.

frameworkoptimizationllm
0dspy.ai
Visit
Evidently

Security & Privacy

Open-source observability and testing for ML and LLM systems.

observabilitytestingml
0evidentlyai.com
Visit
fal
falFree

Security & Privacy

Fast inference platform for generative image, video and audio models.

inferencegenerativeapi
0fal.ai
Visit
Fireworks AI

Security & Privacy

High-performance inference platform for open models.

apiinferenceopen-models
0fireworks.ai
Visit
Galileo

Security & Privacy

Evaluation and observability platform for GenAI applications.

evaluationobservabilitygenai
0galileo.ai
Visit
Giskard

Security & Privacy

Open-source testing and evaluation for ML and LLM applications.

testingevaluationopen-source
0giskard.ai
Visit
Google AI Studio

Security & Privacy

Google''s platform to build with Gemini models.

apigeminiplatform
0aistudio.google.com
Visit
Google Vertex AI

Security & Privacy

Google Cloud platform for building and deploying ML models.

mlplatformgcp
0cloud.google.com
Visit
GPT4All

Security & Privacy

Open-source desktop app to run local LLMs on any computer.

localopen-sourcellm
0gpt4all.io
Visit
Groq
GroqFree

Security & Privacy

Ultra-fast LLM inference on custom LPU hardware.

apiinferencefast
0groq.com
Visit
Guardrails AI

Security & Privacy

Open-source framework to add validation and guardrails to LLMs.

guardrailsvalidationopen-source
0guardrailsai.com
Visit
Haystack

Security & Privacy

Open-source framework for building LLM, RAG and search pipelines.

frameworkragopen-source
0haystack.deepset.ai
Visit
Helicone

Security & Privacy

Observability and gateway for LLM applications.

observabilitygatewayllm
0helicone.ai
Visit
Hugging Face

Security & Privacy

Hub for open models, datasets and AI apps.

modelsdatasetscommunity
0huggingface.co
Visit
Humanloop

Security & Privacy

Platform for evaluating and improving LLM applications.

evaluationllmplatform
0humanloop.com
Visit
Hyperbolic

Security & Privacy

Decentralized GPU marketplace and inference API for AI.

gpuinferenceapi
0hyperbolic.xyz
Visit
Lakera
LakeraFree

Security & Privacy

AI security platform that guards LLM apps against attacks.

securityguardrailsllm
0lakera.ai
Visit
Lambda
LambdaFree

Security & Privacy

GPU cloud and workstations for AI training.

gpucloudcompute
0lambda.ai
Visit
Langfuse

Security & Privacy

Open-source LLM observability, tracing and evaluation.

observabilityopen-sourcellm
0langfuse.com
Visit
LangSmith

Security & Privacy

Tracing and evaluation platform for LLM applications.

observabilityllmopsevaluation
0langchain.com
Visit
Lepton AI

Security & Privacy

Platform for deploying and serving AI models at scale.

deploymentinferencegpu
0lepton.ai
Visit
LibreChat

Security & Privacy

Open-source, customizable ChatGPT-like interface for many models.

self-hostedopen-sourceinterface
0librechat.ai
Visit
LiteLLM

Security & Privacy

Open-source gateway to call many LLM providers with one API.

gatewayopen-sourcellm
0litellm.ai
Visit
LlamaIndex

Security & Privacy

Framework for building RAG and agent applications over your data.

ragframeworkagents
0llamaindex.ai
Visit
LocalAI

Security & Privacy

Open-source, self-hosted OpenAI-compatible inference server.

self-hostedopen-sourceinference
0localai.io
Visit
Mem0
Mem0Free

Security & Privacy

Open-source memory layer that adds long-term memory to AI agents.

memoryagentsopen-source
0mem0.ai
Visit
Milvus
MilvusFree

Security & Privacy

Open-source vector database for AI and similarity search.

vector-databaseopen-sourcesearch
0milvus.io
Visit
Mistral AI

Security & Privacy

European AI lab offering open-weight and commercial models.

apiopen-weightllm
0mistral.ai
Visit
Modal
ModalFree

Security & Privacy

Serverless compute platform for ML and AI workloads.

serverlessgpuml
0modal.com
Visit
Nebius
NebiusFree

Security & Privacy

AI cloud providing GPU infrastructure and managed services.

gpucloudinfrastructure
0nebius.com
Visit
Neural Magic

Security & Privacy

Software for faster, sparser inference of AI models.

inferenceoptimizationopen-source
0neuralmagic.com
Visit
Novita AI

Security & Privacy

AI cloud offering GPU instances and model APIs.

gpuinferenceapi
0novita.ai
Visit
Ollama
OllamaFree

Security & Privacy

Run open large language models locally with one command.

localopen-sourcellm
0ollama.com
Visit
Open WebUI

Security & Privacy

Open-source, self-hosted web interface for local and remote LLMs.

self-hostedopen-sourceinterface
0openwebui.com
Visit
OpenAI Platform

Security & Privacy

Developer platform for OpenAI models and APIs.

apillmplatform
0platform.openai.com
Visit
OpenPipe

Security & Privacy

Tooling to fine-tune and serve task-specific LLMs cheaply.

fine-tuningllm
0openpipe.ai
Visit
OpenRouter

Security & Privacy

Unified API to access many models from different providers.

apigatewaymodels
0openrouter.ai
Visit
Patronus AI

Security & Privacy

AI evaluation and guardrails platform for LLM applications.

evaluationguardrailsllm
0patronus.ai
Visit
Perplexity API

Security & Privacy

API for Perplexity''s online search and answer models.

apisearchllm
0docs.perplexity.ai
Visit
pgvector

Security & Privacy

Open-source vector similarity search extension for Postgres.

vector-databasepostgresopen-source
0github.com
Visit
Pinecone

Security & Privacy

Managed vector database for semantic search and RAG.

vector-databaserag
0pinecone.io
Visit
Portkey

Security & Privacy

AI gateway with observability, guardrails and routing.

gatewayguardrailsllm
0portkey.ai
Visit
Predibase

Security & Privacy

Platform for fine-tuning and serving open-source LLMs.

fine-tuningllmserving
0predibase.com
Visit
PromptLayer

Security & Privacy

Platform for prompt management, evaluation and observability.

promptsobservability
0promptlayer.com
Visit
Qdrant
QdrantFree

Security & Privacy

Vector similarity search engine and database.

vector-databaseopen-source
0qdrant.tech
Visit
Ragas
RagasFree

Security & Privacy

Open-source framework for evaluating RAG pipelines.

evaluationragopen-source
0ragas.io
Visit
Replicate

Security & Privacy

Run open-source models via a simple API.

apimodelshosting
0replicate.com
Visit
Scale AI

Security & Privacy

Data platform for training and evaluating AI models.

datalabelingenterprise
0scale.com
Visit
Supabase

Security & Privacy

Open-source backend with Postgres and vector support.

backenddatabasevector
0supabase.com
Visit
Together AI

Security & Privacy

Fast inference and fine-tuning for open models.

apiinferenceopen-models
0together.ai
Visit
TrueFoundry

Security & Privacy

Platform to deploy, manage and observe AI/ML workloads.

deploymentmlopsplatform
0truefoundry.com
Visit
Unstructured

Security & Privacy

Platform for ingesting and preprocessing documents for LLMs.

data-ingestiondocumentsrag
0unstructured.io
Visit
Vellum
VellumFree

Security & Privacy

Platform for building and evaluating LLM applications.

llmopsevaluationdevelopment
0vellum.ai
Visit
Vercel
VercelFree

Security & Privacy

Frontend cloud with an AI SDK and edge functions.

deployfrontendai-sdk
0vercel.com
Visit
Vercel AI SDK

Security & Privacy

Open-source toolkit for building AI apps with TypeScript.

sdkopen-sourcellm
0sdk.vercel.ai
Visit
Weaviate

Security & Privacy

Open-source vector database for AI applications.

vector-databaseopen-source
0weaviate.io
Visit
Weights & Biases

Security & Privacy

ML experiment tracking and model management platform.

mlopsexperimentsmonitoring
0wandb.ai
Visit
Zep
ZepFree

Security & Privacy

Memory layer for AI agents and assistants.

memoryagentsrag
0getzep.com
Visit