Research

Beyond Transformers.

Announcement

Introducing Versatile 1.1

Versatile is a zero-shot classification engine for text, image, audio and video. No training, no examples - you give it labels and it gives you typed answers back. Three speed tiers, from 5.5 ms, self-hostable.

Read →
Announcement

Introducing Talos

Talos is a backend you describe instead of write: your tables, your rules in plain language, and one sentence per URL. A small model turns each sentence into a query plan. Available today on npm.

Read →
Announcement

Introducing Nestor 1.1

Nestor 1.1 is our new small model: 12.7 MB, four effort levels, tool calling and web search. Available today in Korollr chat and through the API.

Read →
Research

Training a Model That Doesn't Know the Internet Exists

We trained a 7M parameter LLM exclusively on primary sources from 1924–1946. No Wikipedia. No modern text. No knowledge of what came after. Here's what we learned.

Read →
OBSERVATION

What Happens When You Let Four Models Train Overnight

Four models. One GPU. No coordination. We fixed it with a text file.

Read →
Research

What We Learned Trying to Reinvent Attention

We had an intuition that past tokens could declare their future relevance, replacing similarity-based attention with direct lookup. After dozens of hours of experiments, the result was clear — and not the one we expected.

Read →
Research

Memory as Computation, Not Storage

We’ve been experimenting with a simple idea: what if memory in language models isn’t just a buffer, but a computational space ?

Read →
Research

Spiking Neural Networks for Edge Intelligence

We explore how event-driven SNNs can replace transformer attention for low-power edge inference, achieving competitive performance at a fraction of the energy cost.

Read →
Roadmap

Towards Neuromorphic Silicon: Our 2030 Vision

Custom silicon designed natively for SNN workloads. Here's what we're building, why conventional GPUs are inadequate for brain-inspired AI, and the technical roadmap ahead.

Read →
Philosophy

The Case for Ultra-Small Models

Bigger isn't always better. We make the case for small, efficient, private AI — and why sub-billion parameter models are the future of personal computing.

Read →