Hw#1: One Dimensional Regression

Correction: To see overfitting for higher order polynomials you should use the following small training data

Given the training data, validation data and their plot, you are asked to do the following:

  • fit polynomials of order zero to ten; for each one, report
    • training error
    • validation error
    • weight parameters of fitted polynomial
    • plot of fitted polynomial together with the training data
  • plot training and validation errors of fitted polynomials as a function of the polynomial order

Also derive equations of weight parameters for first-order polynomial, namely w0 and w1 in y = w0 + w1x.

You should submit:

  • all the the program code that does the calculation and plotting
  • the graphs
  • a report that gives your results

Submit hard copies (to homework box in ETA 11 PCLAB); do not submit any part of your homework by email/floppy/CD. This homework is due Friday, March 2, 14:00.

General policy: If you return your homework by next Monday, you get 50% of your grade. Any later submission will not receive any grade but ALL homeworks should be completed to pass the course.