https://xuquant.com/tags/max-entropy/Recent content in Max-Entropy on Xu'Bloghttps://xuquant.com/og-default.pnghttps://xuquant.com/og-default.pngHugo -- 0.152.2zhMon, 25 May 2026 20:00:00 +0800https://xuquant.com/posts/mathematics/probability/entropy-and-information/Mon, 25 May 2026 20:00:00 +0800https://xuquant.com/posts/mathematics/probability/entropy-and-information/从公理化角度推出 -log p 的必然性，依次过熵、互信息、KL 散度、最大熵原理，再回到深度学习里反复出现的几种形态——交叉熵损失、ELBO、信息瓶颈、最大熵强化学习。