Subscribe

Search

Results for “settings”

30 stories found

AI

A cheap 'decision model' that asks Opus only when unsure matched Opus at 4.4x lower cost. What Hightouch's test shows

Hightouch graded record-matching with TypeSafe's Jev and escalated only the uncertain middle band to Claude Opus 5.5, getting within 0.2 points of Opus on easy cases at under a quarter of the cost. On hard cases the saving fell to about 1.8x, and the whole test ran on synthetic data, but the reason it worked is useful for anyone building model cascades.

· 3 min read

Repos

llama.cpp and ggml hit v1.0.0: what the semantic-versioning promise covers, what was removed and who must check

After about three and a half years of fast-moving build tags and 0.x releases, the local-inference engine behind a large share of on-device AI tools now promises that breaking C API changes will only arrive with a major version bump. The 1.0 release also deletes a batch of deprecated functions, so anyone linking libllama directly should check their build before upgrading.

· 3 min read