I think the main gripe that people had with Jev and Typesafe was the language used when they launched. To me personally it seemed like a parody/con/shady at first.
"Breakthrough", "our research went in another direction" , "Two years in stealth", "System One thinking model", "Jev can't hallucinate", "RLCD","We are doing very cool stuff, but we will have to hire you to tell you", - these are some of the things that they said on their website on the launch blog.
I had used versions of bert to achieve the same functionality years ago. But to me it seems like they were able to trick the VCs with "can't hallucinate" etc.
To the above author, kudos for sharing your work and making it open. Something like this shouldn't be closed in the first place when it has been available for so many years
wild_egg 1 hours ago [-]
Last time I did anything with a BERT, you had to train or fine-tune. Is that not still true?
For me the cool bit is that it's all in-context learning or whatever so you can use it in any domain with zero setup.
Maybe bert and co. could do all the same things before, but the way in which you use them is quite different and that helps a lot.
evrydayhustling 10 minutes ago [-]
We used to use BERT-based embeddings + semantic distance for classification / decision problems in new domains. There was a lot of interest at the time in these kinds of pre-generative but portable models -- Meta's Prophet was another example that came up a lot.
prometheus1992 1 hours ago [-]
It depends on your usecase but the models do show general capabilities. check this model out.
So you're not even trying to defend your claim? Reminder, you said:
> I had used versions of bert to achieve the same functionality years ago
I remember when BERT came out. I played with it. Other people played with it. You couldn't really get it to do useful stuff, unless you put a ton of effort into it, and even then, it would BARELY do anything useful.
The promise of Jev is that it's FRONTIER INTELLIGENCE, not the intelligence of a pre-chatGPT era model.
If you are trying to claim that BERT is somehow on par with frontier models, that is laughably false. (Whether Jev is on par with frontier models can be questioned as well.)
yipinwong 36 minutes ago [-]
Baity claims worked didn't it for Jev? (most likely from AI forsure)
I might not have a good rep for Jev any more but at least I know what kind of model to use for decisions for graph engineering.
Oras 4 hours ago [-]
I played around with Jev last night and did it for classification tasks that I used Gemini 2.5 flash lite with.
It’s a bit faster and bit cheaper, but this is compared to LLM. The consistency was nice to see, BUT, as someone who trained NLP models prior to LLMs, it’s just BERT with more data. I can see why people would want ready made one shot classifier, and I can see the value of sending multiple classifier in one call, but I wouldn’t call it breakthrough. And I believe many labs will replicate it in no time and might have it as part of their harness.
I see it as a wake up call for the tech community to go back to basics for most tasks instead of relying solely on generic LLMs.
lhl 2 hours ago [-]
There have been other "universal"/general classifiers like GLiNER, GLiFormer, etc based on BERTs (Laya itself is based on ModernBERT!), but I do think there's something underrated about slapping classification on a "big" model like I've seen post-Jev announcement, lots of Qwen stuff, but the most interesting to me so far is razorback16/openjev using DiffusionGemma. There's a level of generalization that lots and lots of parameters get you that you can't really get out of small models.
astrostl 10 minutes ago [-]
> it’s just BERT with more data
Let's take that as a given. Is BERT with more data not useful?
> I can see why people would want ready made one shot classifier, and I can see the value of sending multiple classifier in one call, but I wouldn’t call it breakthrough
Are those things that people want less useful because of what someone else calls it?
> I see it as a wake up call for the tech community to go back to basics for most tasks instead of relying solely on generic LLMs.
Maybe, or maybe to use Jev, which is useful?
Whether something is overmarketed or undermarketed, novel or derivative, it does not change its function.
tchalla 3 hours ago [-]
Anyone who has worked in ML for 10+ years would already know that the usage of LLMs for everything is lazy, wasteful and a high degree of marketing on it.
iforgotmypasswo 2 hours ago [-]
Anyone who has designed circuits will consider CPUs wasteful compared to ASICs. This new FPGA technology is just a less efficient ASIC.
That’s roughly what I’m hearing.
The fact that general purpose intelligent classifiers can be dynamically hacked together by an LLM in real time to allow them to build evolving labeled and understandable networks that perform substantially faster than the LLM, and can act as an intermediate sorting and organizing layer for caching context or handling simple tasks, and a complete layman like me can assemble a teachable layer of these in a few days from an inexpensive service…
That’s wild!
And then you can identify where an expert system needs a more specific ML technique for efficiency within this network that overlays the SOTA model. Or manually adjust the stored context in each secondary “neuron”. And paths forward can run programs or take actions at relative high speed.
And you can share these with others and improve them as a group.
You could insert this at the datacenters at scale with a local supervising expert to prune and encourage proper growth. You could identify specific gaps in capability that need more training, and patch over them temporarily.
Then you train those corrections back into the general purpose model, or you identify highly efficient subsystems for specific purposes.
And this is just one way to use it. High speed intelligent workflows can live in this. There’s a spot for a local LLM to learn on the fly.
Maybe I’m way off base, but for the non-experts Jev seems extremely valuable.
HappMacDonald 2 hours ago [-]
I would rate using LLM for tasks more specific ML can handle as a lot like using one's smartphone to snap photos, listen to music, set alarms, and play video games in preference to carrying around a fun cam, ipod, watch, and switch 2 everywhere.
For those who need to dive really deep into each specific avenue and squeeze maximal quality out, the photographers will be packing DSLRs and intense gamers will wait til they get home to strap into a PS5 or a gaming rig or VR or whatever.
But "can get 90% of anyone's needs met in this field, and can do the same in dozens or hundreds of other fields simultaneously" will remain the killer solution for anyone with lots needs that each have bounded depth.
ketzu 1 hours ago [-]
I thought one core result that led to LLMs was the realization that a specialized model is not necessarily better at a task than a general one.
jmalicki 48 minutes ago [-]
That goes all the way back to at least to Stein's Paradox in 1955, sadly too few people get educated about Statistics and keep thinking specialized models will necessarily be better. If you want to estimate the batting averages of 3 MLB baseball players from samples, you are better off building a model to predict all of their batting averages than computing the mean from a sample of each one separately.
I wouldn’t say lazy, LLMs are fast to use and much more cost effective especially if you factor the cost and time of training (data preparation, data cleaning, … etc).
It’s hard to justify several months to business when there is something off-shelf ready to use and doesn’t require domain specialists to run.
ashkankiani 3 hours ago [-]
People have been having this same debate in a very similar way on typed languages vs untyped interpreted languages. I think that, in a similar vein, if you look at the trend over time:
- the addition and standardization (with incomplete coverage) of the solution of adding typing to Python
- how much people are re-discovering the value of performance + typing (e.g. Rust)
then I'm going to take a small leap and extrapolate that the trend will be similar here.
The equivalent of the "one off script in python" will be the LLM, and the long term stable and maintainable solution will be something much more structured and focused like Jev.
andy99 3 hours ago [-]
I have, LLMs are less fragile, that’s why I like them. The ability to generalize isn’t just about being general purpose, it’s super robust, and so assuming the budget is there (I agree they are inefficient) end up performing better on many classical tasks that have ood inputs. Before LLMs / foundation models we all struggled with generalization and at least in the work I was doing people were independently converging to using bigger more general models for tasks anyway as compute got cheaper. LLMs are just the most popular version of this.
tchalla 3 minutes ago [-]
> The ability to generalize isn’t just about being general purpose, it’s super robust
I work with LLMs daily. 5 of my specialized tasks are outperformed by a custom model than a general purpose frontier model. The performance of my custom models not only beat them but are orders of magnitude low in costs and thus are able to be used by more customers.
stefan_ 2 hours ago [-]
That's part of the irony here I guess. In specialized fields, think computer vision, there were lots of teams whose innovative state of the art model was essentially just a function of the limitless compute they could throw at the problem. Now there are just people with even bigger sticks.
There are lots of scenarios where specialized models still are the only option for real time, power efficiency, and so on. And transformers and other tech behind LLMs can equally produce better specialized models. But no sympathy for those who confused compute with innovation.
dominotw 3 hours ago [-]
why would you waste your time messing around with a team of expensive ml engineers and data scientists that produce vastly inferior to a llm.
We ripped out custom homegrown ml models that were developed in last 10 yrs and put an llm in its place. Its the opposite of wasteful. Even local gemma models are vastly superior.
tchalla 3 hours ago [-]
There’s a middle option. Once you figure that out, you’d soon understand my point today or tomorrow. I’ve been in this field for 21 years and I use LLMs everyday. I also know when to not use them.
kilroy123 4 hours ago [-]
I've come to the same conclusions as you.
> I see it as a wake up call for the tech community to go back to basics for most tasks instead of relying solely on generic LLMs.
I always say the cheapest LLM request is no request at all.
sbarre 3 hours ago [-]
What's the cost (broadly speaking, not in your specific case) of doing the same work an LLM would have done without the LLM though?
bwest87 31 minutes ago [-]
>I believe many labs will replicate it in no time
I really doubt this actually. To me, Jev is a great example ofcounter positioning. When you consider just how hyper optimized the labs are around auto regressive LLMs, and just how much money they have already invested and are pre committed to investing in an entire stack for auto regressive transformers... then responding to Jev becomes nearly impossible actually. They would just be giving up too much.
Just think, everything from their current sources of revenue, the sales use cases they tout, the marketing on the websites, the messaging to customers, then technically to the APIs, their internal batching and scheduling algos, their GPU configs, the chips themselves. ALL OF IT is designed with generative text models in mind. Jev breaks all of it.
I think basically no chance of a response any time soon.
kianN 3 hours ago [-]
The data labeling objection baffles me. Even if you don’t need labels for training, how do you know your model is working if you’re not evaluating it?
My company specializes in statistical long document text classification, but nowadays we mainly work with audit trail requirements because we got tired of hearing complaints about our 5 example learning curve. Seems like the industry standard is telling an llm to label and telling an llm to eval, and crossing your fingers that it’s correct.
z3ratul163071 2 hours ago [-]
the huge benefit in real systems for Jev like solutions i see is the cybersecurity / prompt injection mitigation. since the output will always be well structured, there is no way prompt injection might make the system do something crazy.
probably a prompt injection can still affect the output though, in unforeseeable ways.
Bluestein 2 hours ago [-]
This, intuitively, feels like a "lower level, basal, reflex" layer for the LLM's intelection.-
DetroitThrow 3 hours ago [-]
It would be amazing to have big BERTha with per-token pricing on GCP or AWS. There are many times I am reaching for a cheap classifier with the general behavior of an LLM.
dcow 2 hours ago [-]
I can understand why the author feels bitter but it still feels juvenile to me. Certainly both Jev and Laya are based on the research of countless prior papers and academics. Diogo decided to build a product out of the concept. The author didn't. Publishing research papers and model weights is probably part of the problem--it feels academic. If you look at the author's profile they focus on applying AI to healthcare. Not selling general AI type safety to AI pilled companies and devs. There's a big difference there. Whether that's good or bad you can argue all day. But for the author to expect otherwise is pretty weird. I do applaud them for not stewing too much on it and trying to do something about it, though.
operaopera 2 hours ago [-]
I believe his qualms were with the "hype" in Jev's announcement: specifically calling this kind of model a breakthrough, without crediting previous art, and keeping everything closed source.
threecheese 7 minutes ago [-]
The hype is kinda nuts; I use X for ML/LLM stuff, and I just can't get away from Jev - even in my Following feed. Even days later 75% of posts are about "how I use typesafe for cooking breakfast!" or Jev clones.
prodigycorp 2 hours ago [-]
And how is laya previous art? The project was vibecoded and posted yesterday.
By releasing a paper you are specifically telling the world, “hey look I did this thing for no comp, pomp or circumstance and I thought it was interesting enough to share with the world”. You get academic interest and credit when your paper is cited. It’s not “prior art” in any negative use of the term when a company takes the ideas in an academic paper and builds a product around them. This is a standard and well understood cycle where academic research happens and then gets applied to industry. Have you heard of a company called Google? And are you sure Jev is based on your work, or did you just do something similar? Ideas are cheap…
jeremyjh 51 minutes ago [-]
Generally they do credit the papers and/or people who developed the theory behind their product.
charcircuit 49 minutes ago [-]
Researchers definitely do get paid for research. That Google company you mention funds research which can be integrated into their products.
Matticus_Rex 34 minutes ago [-]
Sure, researchers get paid when they either do the research under contract or productize the research and sell it themselves. But they don't usually do the latter because that's quite difficult.
verdverm 2 minutes ago [-]
Are you grouping academic research funded by grants under the contract category?
To me, there is a meaningful difference and I'd add a third category, but I can also see the contract angle
prodigycorp 2 hours ago [-]
Excuse me, but calibrating language models to accurately reflect probabilities did not start with you.
nandakishor_ml 1 hours ago [-]
I didn't claimed it bro it was first. Just shared the findings here.
prodigycorp 1 hours ago [-]
Explain what you feel bitter about?
nandakishor_ml 1 hours ago [-]
just not these jev guys not opensourcing their work
prometheus1992 1 hours ago [-]
@prodigycorp - reading your comments here on this post - you seem pretty hurt by this post.
prodigycorp 1 hours ago [-]
Yeah, the reason why I am annoyed by it is because a person (who felt like a burner account of the laya creator) yesterday was haranguing me for saying that projects like this were vibe coded, posting the link to this project.
I evaluated this project yesterday and found its claims un-credible. It's literally nothing like jev. That's some context behind why, a day later, I find it annoying that this is somehow the top story on HN.
I don't really see the breakthrough in Jev. Classification, scoring, routing and returning probabilities over predefined choices are all established problems. We implemented category routing in our own retrieval system in a slightly different way: embed the incoming query, compare it against category profiles and route to the highest cosine-similarity. Obviously Jev isn't similarity based, but the underlying task of making a constrained decision from predefined choices isn't novel. TypeSafe says Jev has a new architecture and RLCD training, but Jev's actual architecture, weights and training details aren't public. So we can't even claim Jev is specifically a BERT classifier, but also don't see enough public technical evidence yet to call the underlying idea a breakthrough. Atleast they should publish a technical paper to prove their idea is breakthrough.
prometheus1992 58 minutes ago [-]
What is jev like? Did they release any research paper? I really think typesafe hired someone to boost their post because there was nothing "Breakthrough" about their product. At least this post has some touch with the reality that this functionality was available a year ago and was well known among ML people.
dcow 5 minutes ago [-]
> At least this post has some touch with the reality that this functionality was available a year ago and was well known among ML people.
When you market a product you make exciting claims relative to the audience you’re engaging with. When was the last time you saw a product marketing page reverently lost all the academic research and prior art that came together to make a product possible?
If Layla’s functionality was available in a SaaS form in a way that could be used by all the people who are excited about and using Jev, wouldn’t this research have won hearts and minds last year when it landed? I would have a lot more empathy for the author if they’d taken a product to market and nobody cared. But even then maybe the market wasn’t ready. There are still reasonable explanations why sometimes ideas take off. We’re on a venture capital forum this shouldn’t need an explanation.
prodigycorp 55 minutes ago [-]
I can't believe you say in another post that you have experience with bert and yet you don't understand the value of a generalist classifier.
Good models take time and effort. There wasn't a good option for satisficers until a few days ago.
verdverm 31 minutes ago [-]
I agree with your analysis based on my own last night (on another HN post to this same gripe on reddit, before this blog post). OP received a lot of echo chamber support in the subreddit, and recommended to post to HN, so here we are.
The work is very amateurish, the "paper" would be a strong reject if I were still peer reviewing.
vessenes 2 hours ago [-]
Agreed. Another difficulty here is there are not good benchmarks for this new architecture yet, so it’s easy to potshot and snipe, where jev seems to be pretty broadly intelligent/at least have had a lot of rl in different domains.
We haven’t seen any of these copy cats play doom or street fighter for instance; just categorize email.
I imagine once the author cools down and evaluates on a broad harness of tasks he may find that his new thing has a lot of engineering work ahead.
hirako2000 53 minutes ago [-]
The doom demo would have to be reproduced to confirm what their model is capable of. Oh but it's all closed source, so who knows.
It reminds. Me of Devin. Took a while to debunk. Not saying Jev is a fraud , but the gap between structuring typed output and playing a game involving logical interpretation of frames made of pixels, screams unstructured interpretation they made and forgot to mention.
derac 32 minutes ago [-]
They mention in their blog post that the model is working on text rather than pixels in the Doom demo.
tomsyouruncle 1 hours ago [-]
I’m not filled with confidence when the author’s first paper takes an RL approach but then doesn’t use it to change the action taken in the next turn. Seems like simple classification would achieve the same end. And this quote from the paper isn’t overly reassuring:
“I personally found that this sequential approach captured
sales dynamics much more effectively than traditional classification models.”
It is really interesting to see this claim, because i thought the current theory was that typesafe actually repackaged the work from GLiNER[1] - which does seem to be a closer match, and their original paper[2] predates yours by several years. Curious if you had heard of it before? It is also open source[3] and I think also has some good usage.
We've all seen "this meeting could have been an email"; now get ready for "this VC-backed firm could have been a single arXiv preprint."
I don't want to be too dismissive of Jev, but building technology in stealth for two years just doesn't make sense to me when the capabilities are so easily replicated. These are strange times, where the incentive to do public research and the incentive to develop in private are both being eroded.
bensyverson 1 hours ago [-]
And yet no one cared about this research until it was productized and communicated well. Multitouch existed before the iPhone.
yipinwong 30 minutes ago [-]
Bringing up iphone, I see how Jev pulled an Apple for making claims that their model is a breakthrough in research and 2 years of making like other iPhone features that's been around in other phones.
hmokiguess 3 hours ago [-]
I think the biggest lesson with Jev was the one of communication and understanding for the broader audience, sometimes a lot about innovating involves repeating yourself and translating your own thoughts to an intended audience.
Classical machine learning has been, for the most part, and just by the nature of science, behind academic terms and difficult to engage with as a product.
Jev did really well with coining up “System One” models and defining a standard application interface plus core primitives that landed in the current paradigm of software development.
I think it’s sort of like how Cursor reinvented autocomplete back then as a different UX and suddenly everyone was just using it because of how easy the bar was to understanding it.
Lastly, timing is everything. Just as Cursor had a first mover advantage, despite ML Ops being a thing for a while, they managed to encapsulate the concept behind a “System One” black box that fits the existing mental model for building software and shipping a data contract in the right point in time where the cost of tokens has been an important metric to watch.
jamienk 14 minutes ago [-]
Why do we ("society") need the "frontier" companies at all? Their business goal has settled on trying to CONFUSE the shit out of us so that we don't understand the big pictures about various aspects of AI.
THANK YOU, Nandakishor Mukkunnoth, for putting in the work to help to clarify this stuff!
You are like a firefighter compared to their fire-insurance racket.
cube2222 4 hours ago [-]
Quickly reading the article, one notable limitation seems to be that these checkpoints are 512-1024 tokens context size models, while Jev is seemingly 32k.
That's a pretty big limitation, I would argue, unless I'm misunderstanding and it can be worked around easily somehow? I'm surprised it isn't surfaced more prominently in the comparison.
druskacik 37 minutes ago [-]
Yeah, it's weird, considering ModernBERT, which the Laya models are based on, supports 8192 context window.
bjt12345 4 hours ago [-]
Jev has 64k total token request budget and I do wonder how it will handle highly specialised inputs.
This Jev waitlist that Typesafe AI are utilising is surely going to raise questions pretty soon - it's hard to sell this to bosses when it looks like a pop-up restaurant
thomashop 3 hours ago [-]
It's already on Openrouter
annjose 3 hours ago [-]
And on Vercel AI gateway
Havoc 3 hours ago [-]
I just got my invite so the waitlist doesn't seem to be particularly long
mixedbit 47 minutes ago [-]
The unfortunate true is that getting even the best work in front of an audience is often much harder than solving the problem. Is uploading a paper to arXiv enough to expect the work to be recognized and cited? Unfortunately, it rather is not. arXiv is an open repository which includes plenty of not reviewed and not officially published papers. In a popular field such as machine learning, the number of arXiv papers is overwhelming. Expecting that some machine learning expert will stumble upon an arXiv paper and recognize its value is wishful thinking.
I'm not a researcher, but long time ago I had an idea of a new, seemingly interesting attack on TCP. Having some free time between jobs, I wrote a paper about this, created a proof of concept and decided to send the paper to USENIX Security. I got back two reviews, both in rather positive tone, but rejecting the paper on the grounds that it shows only individual steps of the attack, but it would be much stronger if it showed also the attack working end-to-end. At that point I just uploaded the paper to arXiv and called it a day. I've put a lot of work into that paper, but not enough, I don't consider it properly published and I don't expect anyone to cite it. The paper failed the peer review process and I didn't put the work to improve it further.
beeforpork 14 minutes ago [-]
Is this as good as Laya 3? Unfortunately, it's production was moved from Bremen, Germany, to China, and it is not good anymore, in my opinion.
dwa3592 4 hours ago [-]
Love it. I was really surprised to see the traction typesafe got in the first place. I had built something similar a year ago for a client and thought it was nothing groundbreaking. The client bought it, still uses it and that was it. I had also spent considerable time training and fine tuning zero shot NLI classifiers. Anyway, after typesafe was launched I decided to start building this open source library - https://github.com/deepanwadhwa/OpenDecision . The context length for the underlying model is 8k.
kburman 3 hours ago [-]
Loved the idea, but I don’t think it would be able to handle real-world data effectively. There are a lot of nuances that actually require a reasoning model to think through, connect the dots, and make sense of the broader context.
jwpapi 28 minutes ago [-]
Where can I subscribe to a hosted version of this? I don’t want to host my own GPU.
Correct me if I am wrong, can I use Jev and this tool for ticket classification? I mean, for instance, a level 1 ticket contains a screenshot of the login page that displays an error, LLM can do it perfectly, can Jev do it?
dgritsko 2 hours ago [-]
At least for now, Jev is not multimodal. So a screenshot alone wouldn't cut it.
adverbly 2 hours ago [-]
I find that a bit interesting because the most system one part of the brain is probably the part used for visual processing.
It's trying to use a human analogy but the analogy breaks down if you try to apply it directly
rgbrgb 2 hours ago [-]
It can’t do images but it can do a pretty good job of triaging urgency or choosing when to escalate. So I’d guess yes but it depends how detailed your classification is.
edot 2 hours ago [-]
I don’t understand Jev or this. I used this since it’s open source (good job btw!) with the following. State: “a 6 sided die rolled a 3”, question (noul): “Is the number odd?”
Answer: 9% chance, with 91% confidence.
Heh???
Ok, even worse. 75% chance a coin landed heads up?
State: I flipped a coin.
Question:
{
"noul_result": {
"type": "noul",
"instructions": "Did the coin land heads up?"
},
"choice_result": {
"type": "choice",
"instructions": "Determine if the coin landed heads or tails up.",
"criteria": {
"heads": "the coin landed heads up",
"tails": "the coin landed tails up"
}
}
}
State: "A fair coin was flipped once. The result was not observed.
No other information about the outcome is available."
Questions:
{
"noul_result": {
"type": "noul",
"instructions": "Given only the supplied state, what is the probability that the coin landed heads up?"
},
"choice_result": {
"type": "choice",
"instructions": "Given only the supplied state, determine which outcome occurred.",
"criteria": {
"heads": "the coin landed heads up",
"tails": "the coin landed tails up"
}
}
}
I don't think calculating mathematical odds from natural language is the sort of problem this is trying to solve. A typical LLM hooked up to a calculator would be more appropriate for that.
Jev (and similar) is more for data processing and sentiment analysis. Moderation, search engines, that sort of thing. Jev has a page of proposed use cases where you can get an idea of what they're going for: https://docs.typesafe.ai/concepts/use-case-map
possible class names - the number is odd, the number is even
result:
the number is odd
0.945
the number is even
0.055
as someone else said, that 0.055 is probably bc of 6 and 3 being there.
hmokiguess 1 hours ago [-]
Maybe it’s the fact that “the number” could refer to both 6 and 3 to this model?
bensyverson 1 hours ago [-]
This is not a good faith test of the system.
1 hours ago [-]
edot 43 minutes ago [-]
But it's hallucination-free, isn't it?
usagisushi 22 minutes ago [-]
yeah, technically. (/s)
python3 - <<'EOF'
import json, urllib.request
body = json.dumps({
"state": "The car wash is only 100 meters away from my house.",
"model": "jev-1.13-free",
"questions": {"q": {"type": "choice",
"instructions": "Should I drive or walk to the car wash?",
"criteria": {"drive a car": None, "walk": None}}}
}).encode()
req = urllib.request.Request("https://opencode.ai/zen/v1/systemone", data=body,
headers={"Content-Type": "application/json", "User-Agent": "opencode/1.18.31"})
with urllib.request.urlopen(req, timeout=60) as r:
print(json.dumps(json.load(r)["answers"]["q"], indent=2))
EOF
{
"type": "choice",
"choice": "walk",
"confidence": 0.66,
"probabilities": {
"walk": 0.83,
"drive a car": 0.17
}
}
rasmus1610 42 minutes ago [-]
I feel strong Schmidhuber vibes here.
nandakishor_ml 6 hours ago [-]
This project was built on the exact research on jev architecture research one year ago
woggy 4 hours ago [-]
I don't understand this sentence, can you try again please? Are you saying Laya was built on research done by the Jev team?
klibertp 4 hours ago [-]
Jev was built using the same architecture Laya's author proposed[1] in March 2025. Laya is an open-source system based on that research from a year ago. Whether Jev is also based on the OP's materials or independently invented is hard to say.
No, OP thinks they independently discovered Jev's architecture a year ago and published a paper. I am not an expert but I don't think Typesafe has published Jev's architecture so OP's claims cannot be taken at face value.
cgio 4 hours ago [-]
It’s the other way around for me. OP has published everything in the open, so I can take him at face value. A PR media release on the other hand, I can accept with some reservations. The objective and non-conspiratorial reading I could offer is, this is most probably two independent discoveries of the same idea, maybe with different implementation. I still think the Jev team should look at prior art before going so hard on the marketing.
cmrdporcupine 3 hours ago [-]
Jev is only on people's mouths because they made friends with venture capitalists and used the publicity blowhorns that come with that.
Whereas the other guy went through the unglorious but formerly respectable path of publishing software and papers for other professionals to look at. A year ago.
We're in a bad place where the latter looks less reliable than the former.
(EDIT: I'm not saying the research here is in fact the same as what "Jev" is doing; and Jev is in fact more "product shaped." But I think it's important to temper the hype and back up and focus on the fact that this whole industry is built on research by both academics and enthusiasts ... first ... and gold rushes can often bulldoze over those people who are focused primarily on making-doing-researching instead of fundraising-hyping-promoting. That's not good.)
whizzter 4 hours ago [-]
I'm reading your year old Reddit post and Typesafe's description, and while they probabably say that they can do what you do the main point is that it's different things really as far as I can tell?
Laya seems to be focused on sales/conversations?
Reading quickly about TypeSafe, it seems to be about creating _type-safe_ outputs from AI tools for downstream systems to consume, we actually have a system in production that's probably a glove-fit for that, it's for scanning receipts to be ingested into a system and we also have other systems in a sales-pipe that isn't too far off Laya but still sounds more pertient to TypeSafe.
You did a special case well, but just because they cover (perhaps badly) that case doesn't mean that it's the same thing.
from https://huggingface.co/convaiinnovations/laya
> The policy reports a distribution; exploration adds zero-mean Gaussian noise to the logits; the reward is a strictly proper scoring rule (log + spherical, plus ranked probability score for ordinal questions). Expected reward is maximised only by reporting honest probabilities.
petesergeant 2 hours ago [-]
There are many, many, open-source versions of Jev, including three distinct projects sharing the name “openjev”
If you’re interested in the basic trick most are using (which is probably also what Jev does) then it’s here: https://sgnt.ai/p/jev/
tarruda 2 hours ago [-]
At this size (~400 million parameters), does it become viable running directly on CPU?
rcarmo 2 hours ago [-]
Yep. Not instantly though. I am hacking away at these things over on https://github.com/rcarmo/go-pherence (I do SIMD versions of common inference algos) and trying to improve that.
badatnames 2 hours ago [-]
This is crying out to become an Excel or LibreOffice Calc add-in
fwlr 4 hours ago [-]
“Codex, build a novel frontier model and post it on HackerNews —”
“Claude, roast this noob, tell him that his model isn’t novel or frontier —”
both in unison “— and make no mistakes!”
It’s all so tiresome
cmrdporcupine 3 hours ago [-]
I'll just say that even though I was poor and without a job and living on unemployment insurance for a year...
The implosion of hype after the .com crash was actually kind of a ... relief.
paper the reddit OP "published" (their words on reddit) to arxiv (before they put the vouching process in place). It's what you expect if you click through.
Does not appear to be like what Jev is doing, they talk about RAG and embeddings and orchestrators (the stuff that was cool 1 year ago), no talk of system 1 vs 2 (before Jev), whereas Jev is apparently just a model.
There is a vLLM PR introducing Jev like capabilities for diffusion models (and more, have not delved deeply)
> Seeing the hype online feels both validating and deeply frustrating.
The post is conflating hype and money with technical innovation, they are not really correlated. Kurzweil is known for saying most innovations succeed based not on technology but on timing. Today, who talks about it might matter even more than timing.
Superior research often gets overlooked in favor of someone raising millions, sometimes people who have produced literally nothing manage to sell it. Not saying that's happening here, but I've seen this pattern a lot over my career.
Someone riding (or manufacturing) a hype wave is playing a completely different game from a researcher. If you're a researcher you can't really feel dejected when someone is making a business on the back of what seems like your research; legal protections are decades out of date, even ignoring vibe coding. If you want to make money/hype/whatever off of your work, do that. But realize that it's a path that's often orthogonal to research.
moinism 2 hours ago [-]
I'm just glad to see focus being shifted (albeit slowly) to conventional ML. Enough with LLM guys
reso_codes 52 minutes ago [-]
[flagged]
legions-love 2 hours ago [-]
[flagged]
Kuyawa 3 hours ago [-]
[dead]
rexthonyy 1 hours ago [-]
[dead]
zurfer 4 hours ago [-]
I've been deeply impressed with Jev as it made a bunch of workloads we had on Luna or Gemini 10x cheaper and 2x faster (previously used non reasoning version for latency reasons).
Now Laya promises another speed up and it's open source. Tbh if it can't run on a CPU I anyway want to buy it from an inference provider. Managing gpus in production is a non trivial problem.
What I also wondered about Jev is how different it is from something like tabular foundation models. They seem to overlap in use cases. Which then leads to the question, what is actually learned? A lot of people in machine learning spend time to making things explainable and always struggled to move beyond data induced biases.
Having it open source is awesome as fine tuning might give additional performance on the task we care about.
Axsuul 1 hours ago [-]
Can you give some examples of workloads?
sharms 42 minutes ago [-]
I have 10000+ inventory items to categorize but I need an intelligent model (not just if statements). Using LLMs has been slow and expensive and I needed to queue it to run for hours. Jev did it in minutes and for less than 1 cent
dominotw 3 hours ago [-]
This is your brain on ai influencer twitter
2 hours ago [-]
Rendered at 16:21:36 GMT+0000 (UTC) with Wasmer Edge.
"Breakthrough", "our research went in another direction" , "Two years in stealth", "System One thinking model", "Jev can't hallucinate", "RLCD","We are doing very cool stuff, but we will have to hire you to tell you", - these are some of the things that they said on their website on the launch blog.
I had used versions of bert to achieve the same functionality years ago. But to me it seems like they were able to trick the VCs with "can't hallucinate" etc.
To the above author, kudos for sharing your work and making it open. Something like this shouldn't be closed in the first place when it has been available for so many years
For me the cool bit is that it's all in-context learning or whatever so you can use it in any domain with zero setup.
Maybe bert and co. could do all the same things before, but the way in which you use them is quite different and that helps a lot.
https://huggingface.co/MoritzLaurer/deberta-v3-large-zerosho....
> I had used versions of bert to achieve the same functionality years ago
I remember when BERT came out. I played with it. Other people played with it. You couldn't really get it to do useful stuff, unless you put a ton of effort into it, and even then, it would BARELY do anything useful.
The promise of Jev is that it's FRONTIER INTELLIGENCE, not the intelligence of a pre-chatGPT era model.
If you are trying to claim that BERT is somehow on par with frontier models, that is laughably false. (Whether Jev is on par with frontier models can be questioned as well.)
I might not have a good rep for Jev any more but at least I know what kind of model to use for decisions for graph engineering.
It’s a bit faster and bit cheaper, but this is compared to LLM. The consistency was nice to see, BUT, as someone who trained NLP models prior to LLMs, it’s just BERT with more data. I can see why people would want ready made one shot classifier, and I can see the value of sending multiple classifier in one call, but I wouldn’t call it breakthrough. And I believe many labs will replicate it in no time and might have it as part of their harness.
I see it as a wake up call for the tech community to go back to basics for most tasks instead of relying solely on generic LLMs.
Let's take that as a given. Is BERT with more data not useful?
> I can see why people would want ready made one shot classifier, and I can see the value of sending multiple classifier in one call, but I wouldn’t call it breakthrough
Are those things that people want less useful because of what someone else calls it?
> I see it as a wake up call for the tech community to go back to basics for most tasks instead of relying solely on generic LLMs.
Maybe, or maybe to use Jev, which is useful?
Whether something is overmarketed or undermarketed, novel or derivative, it does not change its function.
That’s roughly what I’m hearing.
The fact that general purpose intelligent classifiers can be dynamically hacked together by an LLM in real time to allow them to build evolving labeled and understandable networks that perform substantially faster than the LLM, and can act as an intermediate sorting and organizing layer for caching context or handling simple tasks, and a complete layman like me can assemble a teachable layer of these in a few days from an inexpensive service…
That’s wild!
And then you can identify where an expert system needs a more specific ML technique for efficiency within this network that overlays the SOTA model. Or manually adjust the stored context in each secondary “neuron”. And paths forward can run programs or take actions at relative high speed.
And you can share these with others and improve them as a group.
You could insert this at the datacenters at scale with a local supervising expert to prune and encourage proper growth. You could identify specific gaps in capability that need more training, and patch over them temporarily.
Then you train those corrections back into the general purpose model, or you identify highly efficient subsystems for specific purposes.
And this is just one way to use it. High speed intelligent workflows can live in this. There’s a spot for a local LLM to learn on the fly.
Maybe I’m way off base, but for the non-experts Jev seems extremely valuable.
For those who need to dive really deep into each specific avenue and squeeze maximal quality out, the photographers will be packing DSLRs and intense gamers will wait til they get home to strap into a PS5 or a gaming rig or VR or whatever.
But "can get 90% of anyone's needs met in this field, and can do the same in dozens or hundreds of other fields simultaneously" will remain the killer solution for anyone with lots needs that each have bounded depth.
https://en.wikipedia.org/wiki/Stein%27s_example
It’s hard to justify several months to business when there is something off-shelf ready to use and doesn’t require domain specialists to run.
- the addition and standardization (with incomplete coverage) of the solution of adding typing to Python
- how much people are re-discovering the value of performance + typing (e.g. Rust)
then I'm going to take a small leap and extrapolate that the trend will be similar here.
The equivalent of the "one off script in python" will be the LLM, and the long term stable and maintainable solution will be something much more structured and focused like Jev.
I work with LLMs daily. 5 of my specialized tasks are outperformed by a custom model than a general purpose frontier model. The performance of my custom models not only beat them but are orders of magnitude low in costs and thus are able to be used by more customers.
There are lots of scenarios where specialized models still are the only option for real time, power efficiency, and so on. And transformers and other tech behind LLMs can equally produce better specialized models. But no sympathy for those who confused compute with innovation.
We ripped out custom homegrown ml models that were developed in last 10 yrs and put an llm in its place. Its the opposite of wasteful. Even local gemma models are vastly superior.
> I see it as a wake up call for the tech community to go back to basics for most tasks instead of relying solely on generic LLMs.
I always say the cheapest LLM request is no request at all.
I really doubt this actually. To me, Jev is a great example ofcounter positioning. When you consider just how hyper optimized the labs are around auto regressive LLMs, and just how much money they have already invested and are pre committed to investing in an entire stack for auto regressive transformers... then responding to Jev becomes nearly impossible actually. They would just be giving up too much.
Just think, everything from their current sources of revenue, the sales use cases they tout, the marketing on the websites, the messaging to customers, then technically to the APIs, their internal batching and scheduling algos, their GPU configs, the chips themselves. ALL OF IT is designed with generative text models in mind. Jev breaks all of it.
I think basically no chance of a response any time soon.
My company specializes in statistical long document text classification, but nowadays we mainly work with audit trail requirements because we got tired of hearing complaints about our 5 example learning curve. Seems like the industry standard is telling an llm to label and telling an llm to eval, and crossing your fingers that it’s correct.
probably a prompt injection can still affect the output though, in unforeseeable ways.
https://github.com/NandhaKishorM/laya/commits/main/
https://huggingface.co/convaiinnovations/laya/commits/main
To me, there is a meaningful difference and I'd add a third category, but I can also see the contract angle
I evaluated this project yesterday and found its claims un-credible. It's literally nothing like jev. That's some context behind why, a day later, I find it annoying that this is somehow the top story on HN.
https://news.ycombinator.com/item?id=49752902
When you market a product you make exciting claims relative to the audience you’re engaging with. When was the last time you saw a product marketing page reverently lost all the academic research and prior art that came together to make a product possible?
If Layla’s functionality was available in a SaaS form in a way that could be used by all the people who are excited about and using Jev, wouldn’t this research have won hearts and minds last year when it landed? I would have a lot more empathy for the author if they’d taken a product to market and nobody cared. But even then maybe the market wasn’t ready. There are still reasonable explanations why sometimes ideas take off. We’re on a venture capital forum this shouldn’t need an explanation.
Good models take time and effort. There wasn't a good option for satisficers until a few days ago.
The work is very amateurish, the "paper" would be a strong reject if I were still peer reviewing.
We haven’t seen any of these copy cats play doom or street fighter for instance; just categorize email.
I imagine once the author cools down and evaluates on a broad harness of tasks he may find that his new thing has a lot of engineering work ahead.
It reminds. Me of Devin. Took a while to debunk. Not saying Jev is a fraud , but the gap between structuring typed output and playing a game involving logical interpretation of frames made of pixels, screams unstructured interpretation they made and forgot to mention.
“I personally found that this sequential approach captured sales dynamics much more effectively than traditional classification models.”
https://arxiv.org/pdf/2503.23303
[1] https://arxiv.org/abs/2507.18546
[2] https://arxiv.org/abs/2311.08526
[3] https://github.com/fastino-ai/GLiNER2
I don't want to be too dismissive of Jev, but building technology in stealth for two years just doesn't make sense to me when the capabilities are so easily replicated. These are strange times, where the incentive to do public research and the incentive to develop in private are both being eroded.
Classical machine learning has been, for the most part, and just by the nature of science, behind academic terms and difficult to engage with as a product.
Jev did really well with coining up “System One” models and defining a standard application interface plus core primitives that landed in the current paradigm of software development.
I think it’s sort of like how Cursor reinvented autocomplete back then as a different UX and suddenly everyone was just using it because of how easy the bar was to understanding it.
Lastly, timing is everything. Just as Cursor had a first mover advantage, despite ML Ops being a thing for a while, they managed to encapsulate the concept behind a “System One” black box that fits the existing mental model for building software and shipping a data contract in the right point in time where the cost of tokens has been an important metric to watch.
THANK YOU, Nandakishor Mukkunnoth, for putting in the work to help to clarify this stuff!
You are like a firefighter compared to their fire-insurance racket.
That's a pretty big limitation, I would argue, unless I'm misunderstanding and it can be worked around easily somehow? I'm surprised it isn't surfaced more prominently in the comparison.
This Jev waitlist that Typesafe AI are utilising is surely going to raise questions pretty soon - it's hard to sell this to bosses when it looks like a pop-up restaurant
I'm not a researcher, but long time ago I had an idea of a new, seemingly interesting attack on TCP. Having some free time between jobs, I wrote a paper about this, created a proof of concept and decided to send the paper to USENIX Security. I got back two reviews, both in rather positive tone, but rejecting the paper on the grounds that it shows only individual steps of the attack, but it would be much stronger if it showed also the attack working end-to-end. At that point I just uploaded the paper to arXiv and called it a day. I've put a lot of work into that paper, but not enough, I don't consider it properly published and I don't expect anyone to cite it. The paper failed the peer review process and I didn't put the work to improve it further.
It's trying to use a human analogy but the analogy breaks down if you try to apply it directly
Answer: 9% chance, with 91% confidence.
Heh???
Ok, even worse. 75% chance a coin landed heads up?
State: I flipped a coin. Question:
{ "noul_result": { "type": "noul", "instructions": "Did the coin land heads up?" }, "choice_result": { "type": "choice", "instructions": "Determine if the coin landed heads or tails up.", "criteria": { "heads": "the coin landed heads up", "tails": "the coin landed tails up" } } }
Ran on: https://huggingface.co/spaces/convaiinnovations/laya-demo
Result: { "model": "laya", "answers": { "noul_result": { "type": "noul", "noul": 0.6839, "rl_agent": { "act_probability": 1.0 } }, "choice_result": { "type": "choice", "choice": "heads", "probabilities": { "heads": 0.7407, "tails": 0.2593 }, "confidence": 0.1743, "rl_agent": { "act_probability": 1.0 } } }, "usage": { "input_tokens": 76, "output_tokens": 0 }, "latency_ms": 93.8 }
Trying to be even more good-faith:
State: "A fair coin was flipped once. The result was not observed. No other information about the outcome is available."
Questions: { "noul_result": { "type": "noul", "instructions": "Given only the supplied state, what is the probability that the coin landed heads up?" }, "choice_result": { "type": "choice", "instructions": "Given only the supplied state, determine which outcome occurred.", "criteria": { "heads": "the coin landed heads up", "tails": "the coin landed tails up" } } }
Result:
{ "model": "laya", "answers": { "noul_result": { "type": "noul", "noul": 0.1265, "rl_agent": { "act_probability": 1.0 } }, "choice_result": { "type": "choice", "choice": "tails", "probabilities": { "heads": 0.2522, "tails": 0.7478 }, "confidence": 0.1853, "rl_agent": { "act_probability": 1.0 } } }, "usage": { "input_tokens": 123, "output_tokens": 0 }, "latency_ms": 154.5 }
Jev (and similar) is more for data processing and sentiment analysis. Moderation, search engines, that sort of thing. Jev has a page of proposed use cases where you can get an idea of what they're going for: https://docs.typesafe.ai/concepts/use-case-map
a 6 sided die rolled a 3
possible class names - the number is odd, the number is even
result:
the number is odd 0.945 the number is even 0.055
as someone else said, that 0.055 is probably bc of 6 and 3 being there.
[1] https://arxiv.org/abs/2503.23303
Whereas the other guy went through the unglorious but formerly respectable path of publishing software and papers for other professionals to look at. A year ago.
We're in a bad place where the latter looks less reliable than the former.
(EDIT: I'm not saying the research here is in fact the same as what "Jev" is doing; and Jev is in fact more "product shaped." But I think it's important to temper the hype and back up and focus on the fact that this whole industry is built on research by both academics and enthusiasts ... first ... and gold rushes can often bulldoze over those people who are focused primarily on making-doing-researching instead of fundraising-hyping-promoting. That's not good.)
Laya seems to be focused on sales/conversations?
Reading quickly about TypeSafe, it seems to be about creating _type-safe_ outputs from AI tools for downstream systems to consume, we actually have a system in production that's probably a glove-fit for that, it's for scanning receipts to be ingested into a system and we also have other systems in a sales-pipe that isn't too far off Laya but still sounds more pertient to TypeSafe.
You did a special case well, but just because they cover (perhaps badly) that case doesn't mean that it's the same thing.
If you’re interested in the basic trick most are using (which is probably also what Jev does) then it’s here: https://sgnt.ai/p/jev/
“Claude, roast this noob, tell him that his model isn’t novel or frontier —”
both in unison “— and make no mistakes!”
It’s all so tiresome
The implosion of hype after the .com crash was actually kind of a ... relief.
https://arxiv.org/pdf/2503.23303
Does not appear to be like what Jev is doing, they talk about RAG and embeddings and orchestrators (the stuff that was cool 1 year ago), no talk of system 1 vs 2 (before Jev), whereas Jev is apparently just a model.
There is a vLLM PR introducing Jev like capabilities for diffusion models (and more, have not delved deeply)
https://github.com/vllm-project/vllm/pull/57250
The post is conflating hype and money with technical innovation, they are not really correlated. Kurzweil is known for saying most innovations succeed based not on technology but on timing. Today, who talks about it might matter even more than timing.
Superior research often gets overlooked in favor of someone raising millions, sometimes people who have produced literally nothing manage to sell it. Not saying that's happening here, but I've seen this pattern a lot over my career.
Someone riding (or manufacturing) a hype wave is playing a completely different game from a researcher. If you're a researcher you can't really feel dejected when someone is making a business on the back of what seems like your research; legal protections are decades out of date, even ignoring vibe coding. If you want to make money/hype/whatever off of your work, do that. But realize that it's a path that's often orthogonal to research.
Now Laya promises another speed up and it's open source. Tbh if it can't run on a CPU I anyway want to buy it from an inference provider. Managing gpus in production is a non trivial problem.
What I also wondered about Jev is how different it is from something like tabular foundation models. They seem to overlap in use cases. Which then leads to the question, what is actually learned? A lot of people in machine learning spend time to making things explainable and always struggled to move beyond data induced biases.
Having it open source is awesome as fine tuning might give additional performance on the task we care about.