/tags/cross-entropy/ Recent content in Cross-Entropy on Bdim Hugo -- 0.164.0 en 2021-CURRENT_YEAR Bdim Wed, 18 Sep 2024 00:01:11 +0800 /posts/understanding-cross-entropy/ Wed, 18 Sep 2024 00:01:11 +0800 /posts/understanding-cross-entropy/ <h2 id="what-is-it">What is it?</h2> <p>In deep learning, &ldquo;cross-entropy&rdquo; is a function used to measure the difference between two probability distributions, typically used in classification tasks.</p> <h3 id="analogy-guessing-the-color-of-candies">Analogy: Guessing the Color of Candies</h3> <p>Imagine you have a bag of candies containing red, green, and blue colors. You guess the color distribution of the candies is 50% red, 30% green, and 20% blue. However, the actual distribution is 60% red, 20% green, and 20% blue.</p>