Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
-
Updated
Jun 20, 2026 - Python
#
positional-encoding
Here are 115 public repositories matching this topic...
Cameras as Relative Positional Encoding
-
Updated
Dec 18, 2025 - Python
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
tokenizer inference transformer attention llama gpt mask language-model attention-mechanism rms rope residuals multi-head-attention kv-cache positional-encoding llms rotary-position-encoding rms-norm swiglu llm-configuration
-
Updated
Feb 24, 2025 - Jupyter Notebook
[ICML 2026] Official implementation for "DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion".
flux image-generation rope diffusion text2image positional-encoding t2i high-resolution-image flow-matching icml-2026
-
Updated
May 18, 2026 - Python
PET-NeuS: Positional Encoding Tri-Planes for Neural Surfaces (CVPR 2023)
pytorch surface-reconstruction nerf implicit-surfaces positional-encoding multi-view-reconstruction cvpr2023 tri-planes
-
Updated
May 2, 2024 - Python
Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022
graphs transformers attention representation-learning molecules message-passing lspe geometric-deep-learning graph-neural-networks graph-representation-learning gnn graph-deep-learning positional-encoding graph-transformer transformer-networks gnn-lspe
-
Updated
Feb 10, 2022 - Python
[CVPR 2021] Adversarial Generation of Continuous Images
-
Updated
Nov 10, 2021 - Python
[CVPR 2023] This is the official PyTorch implementation for "Dynamic Focus-aware Positional Queries for Semantic Segmentation".
-
Updated
Mar 4, 2023 - Python
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
deep-neural-networks deep-learning pytorch transformer deeplearning attention-is-all-you-need positional-encoding
-
Updated
Sep 30, 2024 - Python
Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch
audio text speech pytorch transformer vit cape positional-encoder positional-encoding visual-transformer positional-embedding
-
Updated
Dec 28, 2022 - Python
本仓库定位为 AI论文复现 / 从零实现 Transformer。 代码遵循原论文的模块划分，包含位置编码、多头注意力、前馈网络、编码器‑解码器等全部组件，并附带详细的中文拆解文档与英文注释，方便学习与二次开发。
natural-language-processing ai deep-learning transformer attention-mechanism encoder-decoder positional-encoding large-language-model
-
Updated
May 3, 2025 - Python
"Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang.
-
Updated
May 7, 2024 - Python
Trading Positional Complexity vs Deepness in Coordinate Networks
-
Updated
Sep 2, 2023 - Jupyter Notebook
Developed the ViViT model for medical video classification, enhancing 3D organ image analysis using transformer-based architectures.
-
Updated
May 22, 2024 - Jupyter Notebook
This repository offers a comprehensive overview and quantitative benchmarking of positional encoding methods in transformer-based time series models.
-
Updated
Jun 11, 2026 - Jupyter Notebook
Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Long-Range and Hierarchical Structures
density-functional-theory wavelet-transform graph-neural-networks positional-encoding graph-transformer
-
Updated
Oct 27, 2023 - Python
完整的原版transformer程序，complete origin transformer program
-
Updated
Mar 5, 2025 - Python
[CVPR 2026] Scalable Object Relation Encoding for Better 3D Spatial Reasoning in Large Language Models
spatial-reasoning 3d-scene pytorch-implementation positional-encoding large-language-models cvpr2026
-
Updated
May 28, 2026 - Python
Context-aware Biases for Length Extrapolation
auto-regressive-model gpt context-aware cable rope alibi positional-encoding large-language-models llm length-extrapolation
-
Updated
May 24, 2025 - Python
🧮 Algebraic Positional Encodings.
-
Updated
Jun 5, 2026 - Python
Add this topic to your repo
To associate your repository with the positional-encoding topic, visit your repo's landing page and select "manage topics."