Guide to Experiments in COMSOC

In this talk I will discuss how numerical experiments on elections were typically performed in computational social choice and what we can learn from it. In particular, we will see what election sizes were considered and what statistical cultures were used etc. Further, we will analyze which choices were reasonable and under what conditions. The talk is based on the “Guide to Experiments” project, which collects experimental election papers from AAAI/IJCAI/AAMAS conferences held since 2010.