Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 2663 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)

86 comments

  • Comment Link Deneme bonusu veren siteler Thursday, 23 April 2026 10:34 posted by Deneme bonusu veren siteler

    Thanks for sharing your ideas. A very important factor is that students have a choice between national student loan plus a private education loan where it's easier to opt for student loan debt consolidation reduction than in the federal student loan.

  • Comment Link Deneme bonusu veren siteler Thursday, 23 April 2026 07:18 posted by Deneme bonusu veren siteler

    Incredible! This blog looks exactly like my old one! It's on a completely different topic but it has pretty much the same layout and design. Wonderful choice of colors!

  • Comment Link khai hoan imperial Monday, 20 April 2026 06:02 posted by khai hoan imperial

    This is hands down one of the finest articles I've read on this topic! The author's thorough knowledge and enthusiasm for the subject are apparent in every paragraph. I'm so appreciative for stumbling upon this piece as it has enhanced my understanding and sparked my curiosity even further. Thank you, author, for investing the time to craft such a phenomenal article!

  • Comment Link khai hoan imperial Monday, 20 April 2026 00:52 posted by khai hoan imperial

    It's a shame you don't have a donate button! I'd most certainly donate to this superb blog! I guess for now i'll settle for bookmarking and adding your RSS feed to my Google account. I look forward to fresh updates and will talk about this site with my Facebook group. Talk soon!

  • Comment Link khai hoan imperial Sunday, 19 April 2026 21:10 posted by khai hoan imperial

    An impressive share, I just given this onto a colleague who was doing just a little evaluation on this. And he actually bought me breakfast as a result of I found it for him.. smile. So let me reword that: Thnx for the deal with! But yeah Thnkx for spending the time to debate this, I really feel strongly about it and love studying more on this topic. If potential, as you develop into experience, would you thoughts updating your blog with extra particulars? It's extremely helpful for me. Massive thumb up for this weblog put up!

  • Comment Link khai hoan imperial Sunday, 19 April 2026 17:33 posted by khai hoan imperial

    Thanks for the different tips contributed on this site. I have noticed that many insurance companies offer customers generous reductions if they favor to insure many cars with them. A significant number of households include several automobiles these days, particularly those with more aged teenage kids still living at home, as well as savings for policies can soon increase. So it is a good idea to look for a great deal.

  • Comment Link hai hoan imperial Sunday, 19 April 2026 00:52 posted by hai hoan imperial

    I have noticed that of all sorts of insurance, medical care insurance is the most controversial because of the discord between the insurance policies company's need to remain profitable and the customer's need to have insurance. Insurance companies' revenue on health and fitness plans are certainly low, consequently some businesses struggle to generate income. Thanks for the suggestions you write about through this web site.

  • Comment Link hai hoan imperial Saturday, 18 April 2026 18:46 posted by hai hoan imperial

    Many thanks for your post. I'd really like to say that the expense of car insurance varies widely from one plan to another, mainly because there are so many different facets which contribute to the overall cost. Such as, the make and model of the motor vehicle will have a huge bearing on the charge. A reliable aged family motor vehicle will have a lower priced premium compared to a flashy fancy car.

  • Comment Link hai hoan imperial Saturday, 18 April 2026 16:54 posted by hai hoan imperial

    I?m not sure where you're getting your info, but great topic. I needs to spend some time learning more or understanding more. Thanks for fantastic info I was looking for this information for my mission.

  • Comment Link usdt wallet Friday, 17 April 2026 22:45 posted by usdt wallet

    Hi there, just became aware of your blog through Google, and found that it is really informative. I?m going to watch out for brussels. I will be grateful if you continue this in future. Numerous people will be benefited from your writing. Cheers!

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.