LMCache vs Speech To Markdown: Features, Pricing & Which Is Better (2026)
A side-by-side comparison of LMCache and Speech To Markdown — features, pricing, and ideal use cases — to help you decide which AI tool fits your workflow.
L
LMCache
LMCache
LMCache is an open-source KV cache layer that speeds up LLM inference by storing and reusing KV caches across GPU, CPU, disk, and S3.
Key features
- KV Cache Reuse: Stores KV caches of reusable text across the datacenter so prefixes are not recomputed across requests or serving engines.
- Multi-Tier Storage: Persists caches across GPU, CPU, local disk, and S3 with acceleration techniques like zero CPU copy, NIXL, and GDS.
- vLLM Integration: Combines with vLLM to deliver 3-10x reductions in delay and GPU cycles for multi-round QA and RAG workloads.
- Pluggable KV Transformation: A flexible SERDE interface lets researchers add compression, token dropping, and custom serialization.
- Vendor-Neutral Layer: Works as a KV cache layer across mainstream serving engines, inference frameworks, hardware vendors, and storage systems.
- Faster Time-to-First-Token: Cuts TTFT and improves throughput for long-context, agentic, and knowledge-augmented workloads.
Best for
- Retrieval-Augmented Generation: Reuse cached document prefixes to cut latency and GPU cost in RAG pipelines.
- Multi-Turn Conversations: Avoid recomputing conversation-history KV caches across turns in chat applications.
- Long-Context Agents: Accelerate agentic workloads that repeatedly process large shared context.
- Enterprise-Scale Inference: Share KV caches across multiple serving instances to raise throughput in production clusters.
- Cache Compression Research: Prototype custom KV compression and serialization through the pluggable SERDE interface.
Speech To Markdown
xajik
Free, 100% local macOS menu-bar app that turns speech into structured markdown using whisper.cpp and any local LLM.
Key features
- 100% Local Pipeline: Runs whisper.cpp for speech-to-text and any local LLM server for structuring — no cloud calls and no API keys required.
- Global Dictation Hotkey: Press ⌘⌥] in any app to have the transcript typed straight at your cursor, works in Terminal, browser, Slack, and more.
- Agent Mode Live Structuring: A floating capsule streams your voice through the LLM into a real-time Markdown, plain text, or HTML document.
- One-Line Install: A single curl-piped script installs xcodegen, whisper-cpp, and ffmpeg via Homebrew, then builds the app from source into /Applications.
- iOS Companion: A fully offline iPhone/iPad app that uses Apple Intelligence on iOS 26+ (iPhone 15 Pro and up).
- Multiple Output Formats: Format, edit, or append the LLM output as Markdown, plain text, or HTML from a single control panel.
- Send-Now Flush: The Send (⏎) control flushes the current buffer to the LLM immediately instead of waiting for the pause/word-count threshold.
- Model Picker: Download and swap Whisper models from Settings — Base (~150 MB) is a good starting point.
Best for
- Private Meeting Notes: Dictate meeting recaps on a Mac with sensitive content that must never leave the device.
- Voice-Driven Coding Comments: Speak function docstrings or PR descriptions into your editor at the cursor via Global Dictation.
- Structured Journaling: Use Agent Mode to ramble freely and get a clean, headed Markdown document out in real time.
- Offline Field Notes on iOS: Capture voice notes on an iPhone with no signal, structured into markdown using on-device Apple Intelligence.
- Slack / Email Long-Form: Dictate long replies straight into Slack or Mail without opening a separate transcription tool.