Test your prompts, agents, and RAGs. Redteaming, pentesting, vulnerability scanning for LLMs. Improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and m…

Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.

Mixture of Agents using Groq

Mixture of Agents using Groq

The software architecture simulator

Web Interface for Vision Language Models Including InternVLM2

Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-script based invocation make it difficult to use for application …

AI coding assistant app

Parse files (e.g. code repos) to clipboard or a file for ingestions by AI / LLMs

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的可商用开源多模态对话模型

LLM inference server implementation based on llama.cpp.

GGUF file parse/estimate.

Manage GPU clusters for running LLMs

LLM code editor for backend services

Your friendly and safe CLI Copilot

DOM to Semantic-Markdown for use in LLMs

All-in-one AI CLI tool featuring Chat-REPL, Shell Assistant, RAG, AI tools & agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Proxy that allows you to use ollama as a copilot like Github copilot

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

Everything Open-WebUI - Functions, Tools, Pipelines, setup, configurations, etc.

A collection of AI-driven tools designed to enhance productivity, streamline task automation, and make everyday work more manageable.

Distributed LLM inference for mobile, desktop and server.

Command line utility to make you a magician in the terminal

Python scripts for DP100 PD-Power Supply

DP100 Power Supply Docs and Software

Your Local Artificial Memory on your Device.

a cross-platform local-first open source alternative to AI recall apps (windows Recall, rewind.ai)

Windrecorder is a memory search app by records everything on your screen in small size, to let you rewind what you have seen, query through OCR text or image description, and get activity statistics.

Chat Templates for 🤗 HuggingFace Large Language Models