Skip to content
View DefTruth's full-sized avatar
🎯
#pragma unroll
🎯
#pragma unroll
855 followers · 75 following

Achievements

Achievement: Pair Extraordinairex4Achievement: YOLOAchievement: Pull Sharkx3Achievement: QuickdrawAchievement: Starstruckx3

Achievements

Achievement: Pair Extraordinairex4Achievement: YOLOAchievement: Pull Sharkx3Achievement: QuickdrawAchievement: Starstruckx3
Block or Report

Block or report DefTruth

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
DefTruth/README.md

Pinned Loading

  1. lite.ai.toolkit lite.ai.toolkit Public

    🛠 A lite C++ toolkit of awesome AI models, support ONNXRuntime, MNN. Contains YOLOv5, YOLOv6, YOLOX, YOLOR, FaceDet, HeadSeg, HeadPose, Matting etc. Engine: ONNXRuntime, MNN.

    C++ 3.5k 672

  2. vllm-project/vllm vllm-project/vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 22.8k 3.2k

  3. Awesome-LLM-Inference Awesome-LLM-Inference Public

    📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

    1.9k 134

  4. PaddlePaddle/FastDeploy PaddlePaddle/FastDeploy Public

    ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end…

    C++ 2.8k 442

  5. CUDA-Learn-Notes CUDA-Learn-Notes Public

    🎉CUDA 笔记 / 大模型手撕CUDA / C++笔记，更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.

    Cuda 853 85

  6. statistic-learning-R-note statistic-learning-R-note Public

    📒《统计学习方法-李航》200页PDF手推公式细节讲解，包含详细的目录以及R语言代码实现，可结合《统计学习方法》提高学习效率，适合机器学习、深度学习初学者。

    382 51