Information Technology: Faculty Publications
Document Type
Article
Publication Date
4-24-2025
Publication Title
Engineering Research Express
DOI
10.1088/2631-8695/add084
Abstract
This research investigates a novel hybridization strategy between Convolutional Neural Networks (CNNs) and gradient-boosted decision trees to enhance image classification accuracy. While conventional approaches focus on optimizing either CNN architectures or machine learning algorithms independently, we propose that intervening in the architecture itself—by strategically replacing the dense classifier portion of the CNN with a tree-based learner—can yield superior results. In our study, we construct a CNN composed of three convolutional blocks, each followed by ReLU activation, max-pooling, and dropout layers. Instead of proceeding through the final dense layers, we extract features immediately after the Flatten layer and input them into an XGBoost classifier. Our experiments reveal that applying XGBoost to these flattened features results in a higher classification accuracy than the fully optimized CNN. Although other datasets were examined during initial testing, this paper focuses exclusively on CIFAR-10 for clarity and reproducibility. The findings suggest that performance gains can be achieved through structural interventions in model architecture, challenging the prevailing emphasis on end-to-end optimization.
Recommended Citation
Yavas, Cemil Emre, Lei Chen, Christopher Kadlec, Jongyeop Kim.
2025.
"Enhancing CNNs via structural intervention with XGBoost."
Engineering Research Express, 7 (2): IOP Science.
doi: 10.1088/2631-8695/add084
https://digitalcommons.georgiasouthern.edu/information-tech-facpubs/189
Copyright
This work is archived and distributed under the repository's Standard Copyright and Reuse License (opens in new tab). End users may copy, store, and distribute this work without restriction. For all other uses, permission must be obtained from the copyright owners or their authorized agents.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Comments
Georgia Southern University faculty members, Lei Chen, Christopher Kadlec, and Jongyeop Kim co-authored "Enhancing CNNs via structural intervention with XGBoost".