week09_compression

Week 9: Efficient model inference

• Lecture: slides, video
• Seminar: notebook, video
• Homework: see homework/README.md

Further reading

Efficient architectures

• https://arxiv.org/pdf/1704.04861.pdf
• https://arxiv.org/pdf/2101.03697.pdf
• https://arxiv.org/pdf/2206.04040.pdf
• https://arxiv.org/pdf/2006.04768.pdf
• https://arxiv.org/pdf/1909.11942.pdf
• https://arxiv.org/pdf/2006.16236.pdf

Knowledge distillation

• https://arxiv.org/pdf/2106.05237.pdf
• https://arxiv.org/pdf/1910.01108.pdf
• https://arxiv.org/pdf/1909.10351.pdf

Pruning

• https://arxiv.org/abs/2302.04089
• https://arxiv.org/abs/2301.00774

Matrices decompositions

• https://arxiv.org/pdf/1906.11755.pdf
• https://arxiv.org/pdf/2004.09031.pdf
• https://arxiv.org/pdf/2009.13977.pdf
• https://arxiv.org/pdf/2004.04124.pdf
• https://arxiv.org/pdf/2111.06312.pdf

Quantization

• https://arxiv.org/abs/2208.07339
• https://huggingface.co/blog/hf-bitsandbytes-integration
• https://pytorch.org/tutorials/advanced/static_quantization_tutorial.html