So much of what makes your work yours is the way you decide: what you approve, what you push back on, what you let wait. It takes years to learn, and it's the hardest part of you to hand to anyone.
We believe a model can learn it. Software should be able to carry your judgment, act on it when it's sure, and come back to you when it isn't.
Knowing when to ask matters as much as knowing the answer. A model that can't say "I don't know" can't be left alone, however often it's right. Trust has to be earned one decision at a time, with proof you can check.
Diagram. Three inputs, situation, options and examples, feed Ren inside a frame labelled Secnd. Ren reads, weighs, picks and checks, then passes its answer to the gate. The gate sends it to one of two outputs: act or ask. A return wire runs back to Ren, labelled: with consent, real decisions train the next Ren.
Secnd
Illustrative, not live dataSituationOptionsExamplesRenReadWeighPickCheckThe gateActAskActAskWith consent, real decisions train the next Ren.
Ren reads a situation and its options, and a gate decides whether it can act alone or must ask.
Research, then products
Decision models.
Text models are built to generate. Decisions need speed, low cost and knowing when not to answer, so we train models for that job alone.
Proof of when to trust them.
Accuracy says a model is often right. We measure how many decisions it can handle alone, with proof, per dollar, and publish where it fails.
Secnd, our first product.
It will connect to your work tools, learn how you decide, act when it's sure and ask when it isn't. It's in development.
BANKING770% answered alone, because it couldn't prove it was safe.
Typed decisionsMixed test, 2,000 decisionsLevel with OpenDecider-nano.
75.4%OpenDecider's run of Jev 1.13
79.6%OpenDecider-nano
79.7%Ren
Test accuracyFixed official test sets
Same training, seed 0Ren v1.1.0
Couldn't load this. Everything else still works.
Check your connection and retry.
Data table
Test accuracy, in percent
Set
Series
No examples
8 nearest
32 nearest
MTOP
Ren v1.1.0
75.99%
92.38%
93.59%
MTOP
Same training, seed 0
78.64%
92.93%
93.23%
BANKING77
Ren v1.1.0
68.99%
89.90%
86.23%
BANKING77
Same training, seed 0
68.90%
90.62%
87.44%
Limits
One seed with full history. It doesn't certify a new business. No real business has run Ren yet. Jev scores 79.7% on BANKING77 with no examples and costs about $0.008 per 1,000 decisions, against Ren's $0.083.
Run Ren yourself.
On a GPU
001
On a CPU
002
In your own cloud
003
Weights are public under CC BY-SA 4.0. With consent, real decisions from Secnd will train the next Ren.
Our first model. It has 396M parameters and it's trained once. It can work from option names alone and gets better with a few examples.
99% gate
Ren answers alone only when a lower confidence bound holds at 99%. On MTOP it answered 21.0% alone, with 1 error in 923 answers and a lower bound of 99.40%. On BANKING77 it answered 0%, because it couldn't prove it was safe.
GitHubPlanned
The first connector we'll build. Planned, not available yet.