AI Model Library: LLMs, Agents & Dev Tools
Curated reviews of mainstream AI models, agents, and dev tools — capabilities, use cases, and how they compare.
Tag: Model Inference
84 article(s) found · Clear tag
Colibrì – Open-Source Lightweight Local Inference Engine with Hierarchical Storage
Colibrì is an open-source lightweight local inference engine designed to run ultra-large-scale MoE (Mixture of Experts) models on consumer-grade hardware. It can operate the flagship GLM-5.2 model wit...
Nemotron 3 Embed – NVIDIA's Open-Source Text Embedding Model Series
Nemotron 3 Embed is a multilingual text embedding model series open-sourced by NVIDIA, specifically designed for retrieval-augmented generation (RAG) and intelligent search scenarios. This series incl...
Fun-ASR-Realtime – Alibaba Qwen's Streaming Real-Time Speech Recognition Model
Fun-ASR-Realtime is a streaming real-time speech recognition large model launched by Alibaba Qwen, designed for low-latency, high-precision speech-to-text scenarios. The model uses the WebSocket strea...
BrowserBC – An Open-Source Browser Operation Trajectory Generation Skill by Einsia AI
BrowserBC is an open-source project released by Navers Lab under Einsia AI. Its core goal is to transform human browser operation trajectories into reusable natural language skills, enabling Web Agent...
DSpark – Speculative Decoding Acceleration Framework Open-Sourced by DeepSeek and Peking University
DSpark is a speculative decoding acceleration framework jointly open-sourced by DeepSeek and Peking University, designed to address the core pain point of slow, "toothpaste-like" autoregressive genera...
SkillOpt – Microsoft's Open-Source Agent Skill Documentation Optimization Tool
SkillOpt is an open-source Agent skill documentation optimization tool developed by Microsoft. Its core concept is introducing the deep learning training paradigm into the text space, treating the Age...
Pixal3D – Tencent & Tsinghua Open Single-Image 3D Generation
Pixal3D is a single-image 3D generation project from Tencent ARC Lab, Tsinghua University, and Victoria University of Wellington. Via a back-projection mechanism, it lifts 2D pixel features explicitly...
TencentDB Agent Memory – Layered Memory System for AI Agents
TencentDB Agent Memory is an open-source, MIT-licensed layered memory system for AI agents from Tencent Cloud Database. Its L0–L3 progressive architecture plus context offloading and Mermaid task canv...
9Router – Free Open-Source AI Router: Smart Fallback for Claude Code, Cursor & Codex
9Router is a free open-source AI router that connects Claude Code, Cursor, Codex, Cline & Copilot to 40+ providers with 3-tier auto-fallback (subscription → cheap → free), proxy pools and RTK token savings of 20-40%. Install via npm, never hit rate limits again.
TACO – Open-Source Self-Evolving Observation Compression for Terminal Agents
TACO is an open-source self-evolving observation compression framework for terminal agents, developed jointly by the University of Manchester, Beihang University, HKUST, and the MAP team. It addresses...
Subscribe to AI Model Reviews
Get in-depth reviews the moment a new AI model drops. Know its capabilities and use cases.
We never share your email. Unsubscribe anytime.