Special Issue in Evolutionary Computation Journal, MIT Press: Reproducibility in Evolutionary Computation

Deadline: November 30, 2021

Event entry

Nevergrad and IOHprofiler Open Optimization Competition 2021

GitHub, until 30 September 2021

Event entry

Special Issue in IEEE Transactions on Evolutionary Computation: Benchmarking Sampling-Based Optimization Heuristics: Methodology and Software (BENCH)

Deadline: August 31, 2021

Event entry

Promoted benchmarking TF event: BOCIA at IEEE CEC 2021

Special Session on Benchmarking of Computational Intelligence Algorithms (BOCIA'21) at 2021 IEEE Congress on Evolutionary Computation (CEC 2021), June 28 - July 1, 2021 in Kraków, Poland

Website Link

Three CEC 2021 Competitions

Real-World Multiobjective Constrained Optimization, Real Parameter Single Objective Bound Constrained Optimization & Multimodal Multiobjective Path Planning Optimization

Events Link

CEC Special session “RepL4Opt: Representation Learning meets Meta-heuristic Optimization”

June 28 - July 1, 2021, Kraków, Poland

Event entry

Recent benchmarking event: Benchmarking@PPSN Workshop

Good Benchmarking Practices for Evolutionary Computation, 5 September 2020, Leiden, Netherlands

Event Entry

Recent IEEE CIS event: 2020 IEEE WCCI

19 - 24th July, 2020, Glasgow (UK)

Visit Website

IEEE CIS Task Force on Benchmarking - Established

Visit Website

Purpose of the Task Force

Computational Intelligence (CI) is a huge and expanding field which is rapidly gaining importance, attracting more and more interests from both academia and industry. It  includes a wide and ever-growing variety of optimization and machine learning algorithms, which, in turn, are applied to an even wider and faster growing range of different problem domains. For all of these domains and application scenarios, we want to pick the best algorithms. Actually, we want to do more: we want to improve upon the best algorithm. This requires a deep understanding of the problem at hand, the performance of the algorithms we have for that problem, the features that make instances of the problem hard for these algorithms, and the parameter settings for which the algorithms perform the best. Such knowledge can only be obtained empirically, by collecting data from experiments, by analyzing this data statistically, and by mining new information from it. Benchmarking is the engine driving research in the fields of optimization and machine learning for decades, while its potential has not been fully explored. Benchmarking the algorithms of Computational Intelligence is an application of Computational Intelligence itself!

The purpose of this task force is to support the community by surveying, discussing, and enhancing the state-of-the-art for the purpose of building the next generation of CI techniques.

Submit new event suggestion

TF Members

Membership

Become a Member

Sign up today to get involved in this TF.

Join Our Task Force

Newsletter

Subscribe to our Newsletter

Sign up to receive our email newsletter.

Subscribe to our newsletterSubmit new newsitem suggestion
Ales Zamuda
Chair
University of Maribor, Slovenia
SMIEEE, CIS member, Slovenia Section Vice Chairman, YP Slovenia Chairman, Slovenia Section CIS Chapter Chairman
WebsiteEmailTwitter
Mike Preuss
Vice Chair
Leiden University, The Netherlands
IEEE, CIS member, chair of the games technical committee 2015/2016
WebsiteEmailTwitter
Markus Wagner
Vice Chair
University of Adelaide, Australia
IEEE, CIS member, IEEE TETCI Associate Editor, CIS subcommittee chair 2014-17, founding chair of the CIS “Task Force on Computational Intelligence in the Energy Domain”
WebsiteEmailTwitter
Thomas Baeck
Member
Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Netherlands
Website
Thomas Bartz-Beielstein
Member
Institute IDE+A, TH Köln
Prof. Applied Mathematics, Director Institute for Data Science, Engineering, and Analytics
TwitterLinkedInWebsite
Felipe Campelo
Member
Aston University, UK
Member: IEEE CIS, ACM, Foundation for Open Access Statistics
Website
Fabio Caraffini
Member
De Montfort University
IEEE CIS Member, Assoc. Prof. and Head of the A.I.Lab
Research GateLinkedInWebsite
Sowmya Chandrasekaran
Member
Technische Hochscule Köln, Germany
WebsiteResearch Gate
Bilel Derbel
Member
University of Lille, France
Website
Carola Doerr
Member
CNRS and Sorbonne University, Paris, France
CNRS researcher, IEEE member, CIS member
WebsiteTwitter
Tome Eftimov
Member
Jožef Stefan Institute, Slovenia
IEEE member, IEEE CIS member
WebsiteTwitterLinkedIn
Andreas Fischbach
Member
TH Köln - Institute for Data Science, Engineering, and Analytics, Germany
Research GateEmail
Pascal Kerschke
Member
University of Münster, Germany
WebsiteTwitter
Anna Kononova
Member
LIACS, Leiden University, The Netherlands
IEEE member, IEEE CIS member
Research Gate
William La Cava
Member
University of Pennsylvania, US
WebsiteTwitter
Bin Li
Member
University of Science and Technology of China, China
IEEE CIS member
Email
Arnaud Liefooghe
Member
University of Lille, France
http://cristal.univ-lille.fr/~liefoogaTwitterResearch Gate
Manuel López-Ibáñez
Member
University of Málaga, Spain
Website
Katherine Malan
Member
University of South Africa, South Africa
IEEE member, CIS member
Website
Jason Moore
Member
University of Pennsylvania, United States
Actively developing new benchmarks for machine learning
WebsiteTwitter
Sanaz Mostaghim
Member
Otto von Guericke University Magdeburg, Germany
IEEE CIS Members Activities VP, DLP
WebsitePhoneTwitter
Boris Naujoks
Member
TH Köln - Cologne University of Applied Sciences, Germany
Website
Aneta Neumann
Member
The University of Adelaide, Australia
Website
Frank Neumann
Member
The University of Adelaide, Australia
Website
Pietro Oliveto
Member
University of Sheffield, UK
IEEE Senior member, IEEE CIS member
WebsiteWebsiteTwitter
Valentino Santucci
Member
University for Foreigners of Perugia, Italy
WebsiteTwitter
Martin Schlueter
Member
Hokkaido University, Japan
Website
Roman Senkerik
Member
Tomas Bata University in Zlin, Czech Republic
IEEE CIS Member, Assoc. Prof. and Head of the A.I.Lab
WebsiteResearch GateTwitter
Ponnuthurai N Suganthan
Member
NTU, Singapore
IEEE Fellow, CIS DLP. U. of Cambridge (UK) BA, MA. U. of Maribor (Slovenia) Doctor Honoris Causa.
Google ScholarWebsiteWebsite (NTU)
Vanessa Volz
Member
modl.ai, Copenhagen
TwitterLinkedIn
Hao Wang
Member
Leiden University, The Netherlands
LinkedInEmail
Thomas Weise
Member
Hefei University, China
WebsiteEmailLinkedIn
Xingyi Zhang
Member
Anhui University, China
IEEE senior member
Email

IEEE CIS Technical Activities (return link): Evolutionary Computation Technical Committee