Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 1967 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)

36 comments

  • Comment Link คลิปหลุดแม่เรยา maereya ชวนช่า Wednesday, 25 March 2026 10:07 posted by คลิปหลุดแม่เรยา maereya ชวนช่า

    Hey there! I know this is kinda off topic however , I'd figured I'd ask. Would you be interested in exchanging links or maybe guest authoring a blog article or vice-versa? My blog addresses a lot of the same topics as yours and I feel we could greatly benefit from each other. If you're interested feel free to shoot me an e-mail. I look forward to hearing from you! Great blog by the way!

  • Comment Link คอลเสียว Tuesday, 24 March 2026 15:47 posted by คอลเสียว

    This web site won't show up appropriately on my droid - you might want to try and fix that

  • Comment Link เจ๊แนนซี่ Tuesday, 24 March 2026 14:35 posted by เจ๊แนนซี่

    you may have a fantastic blog here! would you wish to make some invite posts on my blog?

  • Comment Link 스포츠중계 Monday, 23 March 2026 13:20 posted by 스포츠중계

    I'm blown away by the quality of this content! The author has obviously put a tremendous amount of effort into exploring and structuring the information. It's exciting to come across an article that not only gives valuable information but also keeps the readers hooked from start to finish. Hats off to her for producing such a brilliant work!

  • Comment Link 스포츠중계 Monday, 23 March 2026 10:01 posted by 스포츠중계

    Spot on with this write-up, I truly suppose this website needs way more consideration. I?ll probably be once more to read way more, thanks for that info.

  • Comment Link 스포츠중계 Monday, 23 March 2026 09:34 posted by 스포츠중계

    This design is wicked! You definitely know how to keep a reader amused. Between your wit and your videos, I was almost moved to start my own blog (well, almost...HaHa!) Great job. I really loved what you had to say, and more than that, how you presented it. Too cool!

  • Comment Link rare trx Friday, 20 March 2026 14:27 posted by rare trx

    F*ckin? remarkable things here. I?m very glad to see your post. Thanks a lot and i'm looking forward to contact you. Will you please drop me a mail?

  • Comment Link vanity wallet generator Friday, 20 March 2026 11:14 posted by vanity wallet generator

    Fantastic site. Lots of useful information here. I am sending it to several friends ans also sharing in delicious. And of course, thanks for your effort!

  • Comment Link tron wallet generator Friday, 20 March 2026 10:49 posted by tron wallet generator

    I'm not sure why but this weblog is loading very slow for me. Is anyone else having this problem or is it a issue on my end? I'll check back later on and see if the problem still exists.

  • Comment Link big baller Thursday, 19 March 2026 16:16 posted by big baller

    I really appreciate this post. I have been looking all over for this! Thank goodness I found it on Bing. You have made my day! Thx again

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.