Home. 
.

transparent

transparent

transparent

Altova Mailing List Archives


Understanding precision/recall graph

From: Maciej Gawinecki <mgawinecki@-----.--->
To: NULL
Date: 10/3/2008 7:21:00 AM
Two questions related to the topic

1. If I have an empty set of relevant results, then it would be
better
   to have no answers from the system at all. But neither precision
nor
   recall gives penalties for returning false positives in this case
   (0/1=0/2=...=0/100). How people handle with this ? Is there other
   measure for this cases ?

2. Let say I have ranking:

    1. A
    2. B *
    3. C
    4. D *
    5. F

   Where relevant answers are: B,D,E, and relevant answers found by
the
   system are marked with a star (*).

   Then for recall level 1/3 I have precision 1/2,
   for recall level 2/3 I have precision 2/4=1/2.

   The last position of ranking, false positive, is not counted in
the
   precision/recall measure, as in this measure "only positions where
an
   increase in recall is produced". I have the system which returns
some
   false positives at the end of ranking, but how can I measure/
compare
   it with other systems in terms of effectiveness, if precision/
recall
   does not take it into account ?

TIA,
Maciej


transparent
Print
Mail
Like It
Disclaimer
.

These Archives are provided for informational purposes only and have been generated directly from the Altova mailing list archive system and are comprised of the lists set forth on www.altova.com/list/index.html. Therefore, Altova does not warrant or guarantee the accuracy, reliability, completeness, usefulness, non-infringement of intellectual property rights, or quality of any content on the Altova Mailing List Archive(s), regardless of who originates that content. You expressly understand and agree that you bear all risks associated with using or relying on that content. Altova will not be liable or responsible in any way for any content posted including, but not limited to, any errors or omissions in content, or for any losses or damage of any kind incurred as a result of the use of or reliance on any content. This disclaimer and limitation on liability is in addition to the disclaimers and limitations contained in the Website Terms of Use and elsewhere on the site.

.
.

transparent

transparent