Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead

⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules.

Get your documents ready for gen AI

Official implementation of "GPT or BERT: why not both?"

Advice for writing LaTeX documents

Awesome Active Learning Paper List

Self-Training for Sample-Efficient Active Learning for Text Classification with Pre-Trained Language Models (EMNLP 2024)

Collect optimizer related papers, data, repositories

Blazingly fast cleaning swear words (and their leetspeak) in strings

the LLM vulnerability scanner

A curated list for awesome discrete diffusion models resources.

The official repository for Toxic Commons and Celadon. Toxicity Classification for public domain data.

Software for humanities scholars using quantitative or computational methods.

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…

git-bob uses AI to solve Github-issues. It runs inside the Github CI, no need to install anything on your computer.

Open-source framework for uncertainty and deep learning models in PyTorch 🌱

Starbucks: Improved Training for 2D Matryoshka Embeddings

This repo is meant to serve as a guide for Machine Learning/AI technical interviews.

Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"

One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation

yq is a portable command-line YAML, JSON, XML, CSV, TOML and properties processor

Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

Pytorch implementation of the xLSTM model by Beck et al. (2024)

real time face swap and one-click video deepfake with only a single image

Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)

Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications

depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.

Distill a Small Static Model from any Sentence Transformer

TorchFix - a linter for PyTorch-using code with autofix support