Latest accepted benchmarking event: BOCIA at IEEE CEC 2021

Special Session on Benchmarking of Computational Intelligence Algorithms (BOCIA'21) at 2021 IEEE Congress on Evolutionary Computation (CEC 2021), June 28-July 1, 2021 in Kraków, Poland

Website Link

Recent benchmarking event: Benchmarking@PPSN Workshop

Good Benchmarking Practices for Evolutionary Computation, 5 September 2020, Leiden, Netherlands

Event Entry

Recent IEEE CIS event: 2020 IEEE WCCI

19 - 24th July, 2020, Glasgow (UK)

Visit Website

IEEE CIS Task Force on Benchmarking - Established

Visit Website

Featured

Purpose of the Task Force

Computational Intelligence (CI) is a huge and expanding field which is rapidly gaining importance, attracting more and more interests from both academia and industry. It  includes a wide and ever-growing variety of optimization and machine learning algorithms, which, in turn, are applied to an even wider and faster growing range of different problem domains. For all of these domains and application scenarios, we want to pick the best algorithms. Actually, we want to do more: we want to improve upon the best algorithm. This requires a deep understanding of the problem at hand, the performance of the algorithms we have for that problem, the features that make instances of the problem hard for these algorithms, and the parameter settings for which the algorithms perform the best. Such knowledge can only be obtained empirically, by collecting data from experiments, by analyzing this data statistically, and by mining new information from it. Benchmarking is the engine driving research in the fields of optimization and machine learning for decades, while its potential has not been fully explored. Benchmarking the algorithms of Computational Intelligence is an application of Computational Intelligence itself!

The purpose of this task force is to support the community by surveying, discussing, and enhancing the state-of-the-art for the purpose of building the next generation of CI techniques.

News

Submit new event suggestionSubmit new newsitem suggestion

TF Members

Membership

Become a Member

Sign up today to get involved in this TF.

Join Our Task Force

Newsletter

Subscribe to our Newsletter

Sign up to receive our email newsletter.

Subscribe to our newsletter
Markus Wagner
Chair
University of Adelaide, Australia
IEEE, CIS member, IEEE TETCI Associate Editor, CIS subcommittee chair 2014-17, founding chair of the CIS “Task Force on Computational Intelligence in the Energy Domain”
WebsiteEmailTwitter
Mike Preuss
Vice Chair
Leiden University, The Netherlands
IEEE, CIS member, chair of the games technical committee 2015/2016
WebsiteEmailTwitter
Ales Zamuda
Vice Chair
University of Maribor, Slovenia
SMIEEE, CIS member, Slovenia Section Vice Chairman, YP Slovenia Chairman, Slovenia Section CIS Chapter Chairman
WebsiteEmailTwitter
Thomas Baeck
Member
Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Netherlands
Website
Thomas Bartz-Beielstein
Member
Institute IDE+A, TH Köln
Prof. Applied Mathematics, Director Institute for Data Science, Engineering, and Analytics
TwitterLinkedInWebsite
Felipe Campelo
Member
Aston University, UK
Member: IEEE CIS, ACM, Foundation for Open Access Statistics
Website
Fabio Caraffini
Member
De Montfort University
IEEE CIS Member, Assoc. Prof. and Head of the A.I.Lab
Research GateLinkedInWebsite
Sowmya Chandrasekaran
Member
Technische Hochscule Köln, Germany
WebsiteResearch Gate
Bilel Derbel
Member
University of Lille, France
Website
Carola Doerr
Member
CNRS and Sorbonne University, Paris, France
CNRS researcher, IEEE member, CIS member
WebsiteTwitter
Tome Eftimov
Member
Jožef Stefan Institute, Slovenia
IEEE member, IEEE CIS member
WebsiteTwitterLinkedIn
Andreas Fischbach
Member
TH Köln - Institute for Data Science, Engineering, and Analytics, Germany
Research GateEmail
Pascal Kerschke
Member
University of Münster, Germany
WebsiteTwitter
Anna Kononova
Member
LIACS, Leiden University, The Netherlands
IEEE member, IEEE CIS member
Research Gate
William La Cava
Member
University of Pennsylvania, US
WebsiteTwitter
Bin Li
Member
University of Science and Technology of China, China
IEEE CIS member
Email
Arnaud Liefooghe
Member
University of Lille, France
http://cristal.univ-lille.fr/~liefoogaTwitterResearch Gate
Manuel López-Ibáñez
Member
University of Málaga, Spain
Website
Katherine Malan
Member
University of South Africa, South Africa
IEEE member, CIS member
Website
Jason Moore
Member
University of Pennsylvania, United States
Actively developing new benchmarks for machine learning
WebsiteTwitter
Boris Naujoks
Member
TH Köln - Cologne University of Applied Sciences, Germany
Website
Aneta Neumann
Member
The University of Adelaide, Australia
Website
Frank Neumann
Member
The University of Adelaide, Australia
Website
Pietro Oliveto
Member
University of Sheffield, UK
IEEE Senior member, IEEE CIS member
WebsiteWebsiteTwitter
Martin Schlueter
Member
Hokkaido University, Japan
Website
Roman Senkerik
Member
Tomas Bata University in Zlin, Czech Republic
IEEE CIS Member, Assoc. Prof. and Head of the A.I.Lab
WebsiteResearch GateTwitter
Ponnuthurai N Suganthan
Member
NTU, Singapore
IEEE Fellow, CIS DLP. U. of Cambridge (UK) BA, MA. U. of Maribor (Slovenia) Doctor Honoris Causa.
Google ScholarWebsiteWebsite (NTU)
Vanessa Volz
Member
modl.ai, Copenhagen
TwitterLinkedIn
Hao Wang
Member
Leiden University, The Netherlands
LinkedInEmail
Thomas Weise
Member
Hefei University, China
WebsiteEmailLinkedIn
Xingyi Zhang
Member
Anhui University, China
IEEE senior member
Email