Flynet: Max it, Excite it, Quantize it (with Luis Guerra)

This paper shows how to make mobile net networks much more efficient by combining multi-head depthwise convolution with maxout and mean-variance aware channelwise attention and dense residual connections. The resulting Flynet achieves a twofold reduction in parameter count while maintaining accuracy on ImageNet compared to mobilenet v3.

[BMVC 2022 paper]