Abstract: During the past Covid pandemic, the limitations of meetings or direct contact with many people made webinars a solution to keep conveying information to seminar participants. In the webinar, ...

FlashInfer is a library and kernel generator for Large Language Models that provides high-performance implementation of LLM GPU kernels such as FlashAttention, SparseAttention, PageAttention, Sampling ...