https://xuquant.com/posts/mathematics/position-encoding/Recent content in 位置编码：RoPE → β进制 → MLA on Xu'Bloghttps://xuquant.com/og-default.pnghttps://xuquant.com/og-default.pngHugo -- 0.152.2zhSat, 11 Apr 2026 09:00:00 +0800https://xuquant.com/posts/mathematics/position-encoding/mla-from-rope/Sat, 11 Apr 2026 09:00:00 +0800https://xuquant.com/posts/mathematics/position-encoding/mla-from-rope/RoPE 与低秩压缩的不兼容性是 MLA 设计的核心驱动力——从旋转矩阵破坏低秩结构的数学证明，到解耦 RoPE 设计的工程解法。https://xuquant.com/posts/mathematics/position-encoding/rope-ntk-extrapolation/Sat, 04 Apr 2026 09:00:00 +0800https://xuquant.com/posts/mathematics/position-encoding/rope-ntk-extrapolation/将 RoPE 的旋转角度类比为 β 进制数的各位数字，统一理解 NTK-Aware、YaRN 等长度外推方法，揭示分辨率与范围的根本取舍。https://xuquant.com/posts/mathematics/position-encoding/rope-geometry/Sat, 28 Mar 2026 09:00:00 +0800https://xuquant.com/posts/mathematics/position-encoding/rope-geometry/从复数乘法 = 旋转的几何直觉出发，推导 RoPE 的分块对角旋转矩阵构造，解释内积只依赖相对位置的核心性质。