ALGORITHM OF PRUNING OF HYBRID NEURAL NETWORKS ENSEMBLE

Authors

  • O. I. Chumachenko National Technical University of Ukraine “Ihor Sikorsky Kyiv Polytechnic Institute,” Kyiv, Ukraine
  • A. O. Kuzmenko National Aviation University, Kyiv, Ukraine

DOI:

https://doi.org/10.18372/1990-5548.55.12772

Keywords:

Ensemble pruning, bagging, accuracy, diversity

Abstract

Despite the fact that the ensemble is usually more accurate than a single network, existing ensemble techniques tend to create unreasonably large ensembles that increase the use of memory and computation costs. The ensemble's pruning solves this problem. The article analyzes the compromise between accuracy and diversity and it is proved that classifiers, which are more accurate and make more predictions in the minority group, are more important for the construction of the subensemble. A metric that takes into account accuracy and diversity is proposed to evaluate the contribution of a separate classifier that will help to allocate the required number of networks with the best results.

Author Biographies

O. I. Chumachenko, National Technical University of Ukraine “Ihor Sikorsky Kyiv Polytechnic Institute,” Kyiv, Ukraine

Technical Cybernetic Department

Candidate of Science (Engineering). Assosiate Professor.

A. O. Kuzmenko, National Aviation University, Kyiv, Ukraine

Aviation Computer-Integrated Complexes Department

6th year of study student

References

Zhenyu Lu, Xindong Wu, Xingquan Zhu, and Josh Bongard, Ensemble Pruning via Individual Contribution Ordering. Burlington. 2007, 10 p.

Gonzalo Martı´nez-Munoz, Daniel Herna´ndez-Lobato, and Alberto Sua´rez, “An Analysis of Ensemble Pruning Techniques Based on Ordered Aggregation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, no. 2, 2009, pp. 245–259.

Z.-H. Zhou, J. Wu, and W. Tang, “Ensembling Neural Networks: Many Could Be Better than All,” Artificial Intelligence, vol. 137, pp. 239–263, 2002.

Downloads

How to Cite

Chumachenko, O. I., & Kuzmenko, A. O. (2018). ALGORITHM OF PRUNING OF HYBRID NEURAL NETWORKS ENSEMBLE. Electronics and Control Systems, 1(55), 53–56. https://doi.org/10.18372/1990-5548.55.12772

Issue

Vol. 1 No. 55 (2018)

Section

COMPUTER-AIDED DESIGN SYSTEMS

License

The scientific journal “Electronics and control systems” adheres to the principles of Open Access and provides free, immediate, and permanent access to all published materials without financial, technical, or legal barriers for readers.

All articles are published in Open Access under the Creative Commons Attribution 4.0 International (CC BY 4.0) license.

Copyright

Authors who publish their works in the journal “Electronics and control systems”:

  • retain the copyright to their publications;

  • grant the journal the right of first publication of the article;

  • agree to the distribution of their materials under the CC BY 4.0 license;

  • have the right to reuse, archive, and distribute their works (including in institutional and subject repositories), provided that proper reference is made to the original publication in the journal.