Deep neural networks are capable of learning powerful representation. but often limited by heavy network architectures and high computational cost. Knowledge distillation (KD) is one of the effective ways to perform model compression and inference acceleration. But the final student models remain parameter redundancy. https://foldlyers.shop/product-category/life-jackets/