#

rotary-position-embedding

Here are 5 public repositories matching this topic...

naver-ai / rope-vit

[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"

transformer self-attention position-embedding vision-transformer rotary-position-embedding eccv2024

Updated Oct 25, 2024
Python

DAMO-NLP-SG / CLEX

[ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models

large-language-models rotary-position-embedding long-context-modeling

Updated Mar 12, 2024
Python

GlassyWing / TorchDiffusion

One Diffusion model implementation base on LibTorch

pytorch diffusion rotary libtorch diffusion-models ddpm ddim rotary-position-embedding rotary-2d-position-embedding rotary-position-encoding rotary-2d-position-encoding rectified-flow

Updated Mar 22, 2023
C++

reshalfahsi / image-captioning-mobilenet-llama3

Image Captioning With MobileNet-LLaMA 3

nlp cnn pytorch transformer image-captioning image-text flickr8k-dataset mobilenetv3 pytorch-lightning kv-cache rotary-position-embedding grouped-query-attention rms-norm llama3

Updated Jun 23, 2024
Jupyter Notebook

antoinebcx / molecule-generation-transformer

5M decoder-only transformer for molecule generation (SMILES), using rotary positional encoding.

pytorch transformer molecule-generation rotary-position-embedding

Updated Sep 23, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the rotary-position-embedding topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the rotary-position-embedding topic, visit your repo's landing page and select "manage topics."