Flow-Guided Neural Pruning: Signal-Flow Framework for Multi-Architecture Model Compression

This paper presents a novel method for pruning deep neural networks based on the concept of flow, derived from the continuous modeling of signal propagation across layers. We derive flow functions for fully connected, convolutional, and self-attention architectures, and we propose a new iterative pruning algorithm, Iterative Flow-Aware Pruning (IFAP), that leverages these measures to identify and eliminate non-essential parameters while preserving critical information pathways. Extensive experiments across ten prominent architectures (including CNNs, vision transformers, and efficient mobile networks) on ten benchmark datasets demonstrate consistent accuracy–compression trade-offs: 81% of the evaluated configurations achieve a 60–81% reduction in computational cost relative to the corresponding baseline model. Furthermore, 97% of the evaluated configurations retain more than 98% of their baseline Top-1 accuracy. These results validate flow-based importance scoring as a robust and general-purpose foundation for model optimization.

Authors

Institutions

Publication Details

Journal
Machine Learning and Knowledge Extraction
Published
2026-08-11
DOI
https://doi.org/10.3390/make8080236
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Flow-Guided Neural Pruning: Signal-Flow Framework for Multi-Architecture Model Compression

Valentin Andreevich Malykh, Alexander Savelev, Artem Nazarenko, Aleksei Toropov et al.
Machine Learning and Knowledge Extraction
Advanced Neural Network Applications
article

Flow-Guided Neural Pruning: Signal-Flow Framework for Multi-Architecture Model Compression

Valentin Andreevich Malykh, Alexander Savelev, Artem Nazarenko, Aleksei Toropov, Egor Kotenko, Aleksei Samarin, Aleksandr Motyko
article en

Abstract

This paper presents a novel method for pruning deep neural networks based on the concept of flow, derived from the continuous modeling of signal propagation across layers. We derive flow functions for fully connected, convolutional, and self-attention architectures, and we propose a new iterative pruning algorithm, Iterative Flow-Aware Pruning (IFAP), that leverages these measures to identify and eliminate non-essential parameters while preserving critical information pathways. Extensive experiments across ten prominent architectures (including CNNs, vision transformers, and efficient mobile networks) on ten benchmark datasets demonstrate consistent accuracy–compression trade-offs: 81% of the evaluated configurations achieve a 60–81% reduction in computational cost relative to the corresponding baseline model. Furthermore, 97% of the evaluated configurations retain more than 98% of their baseline Top-1 accuracy. These results validate flow-based importance scoring as a robust and general-purpose foundation for model optimization.

Machine Learning and Knowledge ExtractionVol. 8(8)
Russian Engineering Academy (RU)
Industry, innovation and infrastructure
Openalex Percentile: Top 10%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.