LLM inference in C/C++

📚 C/C++ 技术面试基础知识总结，包括语言、程序库、数据结构、算法、系统、网络、链接装载库等知识及面试经验、招聘、内推等信息。This repository is a summary of the basic knowledge of recruiting job seekers and beginners in the direction of C/C++ technology, in…

An open autonomous driving platform

DuckDB is an analytical in-process SQL database management system

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Dear PyGui: A fast and powerful Graphical User Interface Toolkit for Python with minimal dependencies

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

Unsupervised text tokenizer for Neural Network-based text generation.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Conversion between Traditional and Simplified Chinese

机器人视觉 移动机器人 VS-SLAM ORB-SLAM2 深度学习目标检测 yolov3 行为检测 opencv PCL 机器学习 无人驾驶

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Open source real-time translation app for Android that runs locally

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记

🛠 A lite C++ toolkit of awesome AI models, support ONNXRuntime, MNN, TNN, NCNN and TensorRT.

C++ implementation of the Python Numpy library

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

LightSeq: A High Performance Library for Sequence Processing and Generation

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)

C++ library based on tensorrt integration

Fast Open-Source Search & Clustering engine × for Vectors & 🔜 Strings × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍

A C++ Background Subtraction Library with wrappers for Python, MATLAB, Java and GUI on QT

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

library to read/write .npy and .npz files in C/C++

Nearest Neighbor Search with Neighborhood Graph and Tree for High-dimensional Data

【C++ 面试 + C++ 学习指南】 一份涵盖大部分 C++ 程序员所需要掌握的核心知识。

船长关于机器学习、计算机视觉和工程技术的总结和分享

Samples and Tools for Windows ML.