Compare Rankings from Different Runs

A solution that compares the rankings of candidates in the public and private test sets using various rank metrics.

Arguments

--json_directory

Directory containing the JSON files with results. (default value: PARAMETER_VALUE)

--config_json

Path to the configuration JSON file with run names. (default value: PARAMETER_VALUE)

--beta

Beta value for the f-beta score. (default value: PARAMETER_VALUE)

--weights

Comma-separated string of weights for each particle type (e.g., type1=0.5,type2=1.0). (default value: PARAMETER_VALUE)

--output_json

Path to save the output JSON file with the results. (default value: PARAMETER_VALUE)

Please follow this link for details on how to install and run this solution.