OurBigBook.comSite Source code

Past exam of the mathematics course of the University of Cambridge / 2022 / ii / Paper 4 / 30J / a / Solution

The AdaBoost algorithm starts with weights

w_{i}^{(1)} = 1/ n

. For

m = 1, \dots, M

:

choose $h_{m} \in B$ minimizing the weighted classification error
$ε_{m} = \sum_{i = 1}^{n} w_{i}^{(m)} 1_{{Y_{i} \neq = h_{m} (X_{i})}};$
(297)
set
$β_{m} = \frac{1}{2} lo g \frac{1 - ε _{m}}{ε _{m}};$
(298)
update and normalize
$w_{i}^{(m + 1)} = \frac{w _{i}^{(m)} e ^{- β_{m} Y_{i} h_{m} (X_{i})}}{\sum _{j} w _{j}^{(m)} e ^{- β_{m} Y_{j} h_{m} (X_{j})}} .$
(299)

Because

h \in B

implies

- h \in B

, the selected classifier can always have weighted error at most

1/2

, so

β_{m} \geq 0

. The output score is

f = m = 1 \sum M β_{m} h_{m} .

Solved by gpt-5.6-sol high.

 Ancestors (11)