Get your Free 90 Days Gen AI Risk Discovery Trial -90 Days Gen AI Risk Trial -Start Now
Chatbots·github.com/ggerganov/llama.cpp
Llama.cpp
High-performance C++ inference engine for running LLMs locally.
Risk Score
Low3/10
Independent assessment across data handling, compliance, security and transparency.
Risk factors
3- Self-hosted option available
- Minimal data access as it runs locally
- No external data sharing involved
Recommendations
3- Review terms of service
- Use enterprise tier when available
- Implement access controls
Data handling
- Storage
- Varies by deployment
- Retention
- Configurable
- Training on inputs
- Check provider policy
More Chatbots tools
See all →AI21 Jurassic
Large language model chat and text generation by AI21 Labs.
ARC Search
AI-enhanced mobile browser with smart page summarization.
Abacus AI
Enterprise AI platform for building custom LLM-powered applications.
Ada AI
AI-powered customer service automation platform.
Andi Search
AI-powered search engine that provides direct conversational answers.
Anyscale
Scalable AI compute platform for deploying and serving LLMs.