Rectified Rotary Position Embeddings (ReRoPE) Using ReRoPE, we can more effectively extend the context length of LLM without the need for fine-tuning. Blog https://kexue.fm/archives/9706 (Chinese) https://kexue.fm/archives/9708 (Chinese) https://normxu.github.io/Rethinking-Rotary-Position-...