Strategies that have been deleted from the strategy submission list still appear and affect the correlation calculations of other strategies.
-
I created several types of strategies and then tested them in Jupyterlab and found that the strategies passed the correlation check. Then I submitted them. After passing the check and entering the candidate list, I tried to look at the strategies and found that some of them had a correlation above 0.9 which would make the strategy disqualified from the contest. I deleted them. The strategy went into the "delete" tab. But strangely, when I checked other strategies, I found a report that the strategy had a correlation above 0.9 with the strategy I had actually deleted. Is the system designed like that? Or is there a bug? Even if you look at it by clicking on the leaderboard, the deleted strategy still appears in the list of strategies that have correlation.
-
Hello.
The fix is to delete the submissions, not the strategies. Open the Submissions page and delete the relevant ones there, and they will drop out of the reports. For future, if the contest has already started, and they can no longer be deleted from your side, write us with their names or IDs, and we will remove them for you.
This behavior is by design, not a bug. A strategy and a submission are two different things. The strategy is the notebook in JupyterLab; a submission is a frozen copy of it, made at the moment you submit. The correlation checks, the leaderboard, and the correlation reports all reference submissions. Deleting a strategy only removes the notebook, which is what the "deleted" tab shows. The submissions created from it stay in the pool, which is why the leaderboard and the "correlation above 0.9" reports still point to them.
