Failure to Replicate the Reported Evaluation Score

[prmsregmi]

Hi @xavysp, I used Edge Eval Python to evaluate the ODS/OIS score of the pre-trained model on UDED. I got an ODS score of 0.814. I used the 6th epoch checkpoint (5_model.pth) from the GitHub repository. Could there be something I’m missing that’s preventing me from achieving the 0.828 score you reported? Thanks!

[xavysp]

Hi, this is rare. I used the matlab version, the original one. Please you can see the metadata discussion here

Cheers,

Xavier