Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 1970 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)

36 comments

  • Comment Link big baller club casino philippines Thursday, 19 March 2026 12:20 posted by big baller club casino philippines

    Hello there, I found your web site via Google while looking for a related topic, your website came up, it looks great. I have bookmarked it in my google bookmarks.

  • Comment Link big baller Thursday, 19 March 2026 11:47 posted by big baller

    You actually make it seem so easy with your presentation but I find this topic to be actually something which I think I would never understand. It seems too complex and very broad for me. I'm looking forward for your next post, I?ll try to get the hang of it!

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 13:19 posted by คลิปหลุดสาวใหญ่

    Hello! This is my first visit to your blog! We are a collection of volunteers and starting a new initiative in a community in the same niche. Your blog provided us valuable information to work on. You have done a outstanding job!

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 09:38 posted by คลิปหลุดสาวใหญ่

    Thanks for your publication on the vacation industry. We would also like to add that if you are a senior taking into account traveling, it really is absolutely vital that you buy travel insurance for senior citizens. When traveling, retirees are at biggest risk of getting a health emergency. Buying the right insurance coverage package for your age group can look after your health and provide you with peace of mind.

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 09:07 posted by คลิปหลุดสาวใหญ่

    Simply wish to say your article is as astonishing. The clearness in your put up is just nice and i could suppose you are a professional in this subject. Fine with your permission let me to seize your RSS feed to keep up to date with approaching post. Thanks 1,000,000 and please continue the gratifying work.

  • Comment Link Absolute Decks  Basements Contracting Monday, 16 March 2026 22:57 posted by Absolute Decks Basements Contracting

    Whoa! This blog looks just like my old one! It's on a completely different subject but it has pretty much the same page layout and design. Superb choice of colors!

  • Comment Link Absolute Decks and Basements Contracting Monday, 16 March 2026 18:47 posted by Absolute Decks and Basements Contracting

    Wonderful items from you, man. I have bear in mind your stuff prior to and you're just extremely magnificent. I really like what you have got right here, certainly like what you're saying and the way through which you are saying it. You make it enjoyable and you continue to care for to stay it wise. I cant wait to learn much more from you. This is actually a tremendous site.

  • Comment Link Absolute Decks  Basements Monday, 16 March 2026 18:12 posted by Absolute Decks Basements

    Thanks for the various tips provided on this weblog. I have realized that many insurance firms offer customers generous reductions if they decide to insure a few cars together. A significant volume of households own several autos these days, particularly people with older teenage young children still living at home, and also the savings on policies can soon begin. So it will pay to look for a bargain.

  • Comment Link Lunatogel Sunday, 15 March 2026 16:22 posted by Lunatogel

    Hello there, simply was aware of your blog thru Google, and located that it's truly informative. I?m going to watch out for brussels. I will appreciate in the event you continue this in future. A lot of other folks will be benefited from your writing. Cheers!

  • Comment Link Lunatogel Sunday, 15 March 2026 13:07 posted by Lunatogel

    I'm curious to find out what blog platform you have been utilizing? I'm experiencing some small security issues with my latest website and I would like to find something more safeguarded. Do you have any solutions?

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.