Don't Call It a Decision Model

typesafe.ai

48 points by emschwartz 3 days ago


edot - 3 days ago

Drives me nuts that this nomenclature caught on. This (judgement, not decision) is a bit better. I mean, sure they (Jev-style models) are useful for zero-shot classification, but they're only "judgement models" insofar as any (LLM, ML, mathematical optimization, heuristic, etc.) model that sets a downstream float / integer / boolean to commit resources (read: makes a decision) is a "judgement model".

https://warrenpowell.org/decisionsdecisions/

If you actually want to make good, even optimal (provably) decisions, try reading some about mathematical optimization, or operations research more broadly. The above link is a good place to start.

willio58 - 3 days ago

Really cool visual way to do demonstrate the point. Jev is so interesting to me, I just struggle to find good use cases in my work so far.

j45 - 3 days ago

I agree with this.

Decisions/Judgements in LLMs are not logic gates like a deterministic piece of software, they are simulations cosplaying it more often than not.

Depending on how it's worded it's pretty remarkable how much it can improve, but it ultimately is not deterministic.

mortsnort - 2 days ago

Call it a text classifier model.

4b11b4 - 2 days ago

Reasoning, and now decisions.. At least jev cares about the language we use. (I suppose it was called reasoning cuz that's the closest analogue, but I am still stuck that it should have been called scaffolding.)

I like the aesthetic here but why does the integrated circuit have pins on adjacent sides... lol. I mean I can think of reasons why for the sake of the article but..

basitanwer - 2 days ago

[dead]