In the post-Moore era, the main performance gains of black-box optimizers are increasingly
depending upon parallelism, especially for large-scale optimization (LSO). In this paper, we …