Back to the 2026 paper

Module 3: Linear Classification and Advanced Methods

20267m

Explain Support Vector Machines. Discuss the concept of maximum-margin hyperplane, support vectors, and soft margin.

Worked SolutionAI Assisted

Support Vector Machine (SVM)

SVM finds a separating hyperplane with the largest margin between classes. The closest training examples are support vectors; they determine the boundary.

For a linear separator (w^Tx+b=0), the geometric margin is proportional to (1/\lVert w\rVert). A soft-margin SVM allows violations using slack variables (\xi_i):

[\min_{w,b,\xi};\frac12\lVert w\rVert^2+C\sum_i\xi_i]

subject to (y_i(w^Tx_i+b)\ge1-\xi_i), (\xi_i\ge0). Large (C) penalizes violations more strongly; smaller (C) allows a wider margin with more violations. Kernel functions can create nonlinear decision boundaries by implicitly mapping data into a higher-dimensional feature space.

Similar questions

Student FinanceWeb Platform

Pocketly — Personal Finance for Students

Keep your hostel and college expenses under control. Track accounts, log spending in seconds, and stay within your monthly budget.