Back to the 2022 paper

Module 3: Classification and Prediction

20222m

The margin of the decision boundary in SVM is given by

(i) d=1∣w∣d = \frac{1}{|w|}
(ii) d=12⋅∣w∣d = \frac{1}{2 \cdot |w|}
(iii) d=2∥w∥d = \frac{2}{\|w\|}
(iv) d=1∣w∣2d = \frac{1}{|w|^2}

Worked SolutionAI Assisted

Answer: (iii) d=2∥w∥d = \frac{2}{\|w\|}

Explanation

For a linear SVM with separating hyperplane

w⋅x+b=0w \cdot x + b = 0

the perpendicular distance from the origin to the plane is ∣b∣/∥w∥|b|/\|w\|. If the margin is defined by the two boundary hyperplanes

w⋅x+b=+1andw⋅x+b=−1w \cdot x + b = +1 \quad \text{and} \quad w \cdot x + b = -1

then the total margin (width) is the distance between them:

d=∣1−(−1)∣∥w∥=2∥w∥d = \frac{|1 - (-1)|}{\|w\|} = \frac{2}{\|w\|}

This is the quantity maximised by SVM: maximising the margin 2/∥w∥2/\|w\| is equivalent to minimising 12∥w∥2\frac12\|w\|^2 subject to the classification constraints.

Why the others are wrong:

  • (i) 1/∣w∣1/|w| — that is the distance of one of the boundary planes from the hyperplane centre (the half-margin), not the full margin.
  • (ii) 1/(2∣w∣)1/(2|w|) — half of option (i), not the margin.
  • (iv) 1/∣w∣21/|w|^2 — has no such role in the SVM margin formula.

Hence the margin of the decision boundary in SVM is d=2/∥w∥d = 2/\|w\|.

Similar questions

Budget AppAndroid App

Pocketly on Android

Log daily food, travel, and hostel expenses instantly. Set monthly spending limits and see where your money goes without complex spreadsheets.