The questions that Micheli asked in the written pre-oral test of January 2020 are:
- Write the loss for a linear model in form of ridge regression (with Tikhonov regularization)
- Write (and briefly comment on) the most important factors ruling the flexibility of the SVM and of the NN approaches
- Compute dE/do_i for a NN (the same seen in class) showing the single steps of the derivation for the dE/do_i (assuming to have already delta for the units of the other layers indexed by h and k. Finally, write delta_k, delta_t, delta_i
- Define the VC-dim. Does the VC-dim in \Phi_1 increase or decrease if the value of the regularization parameter increases? Explain.