subject
Mathematics, 14.10.2020 01:01 CSelmon23

It is well-known that ridge regression tends to give similar coefficient values to correlated variables, whereas lasso may give quite different coefficient values to correlated variables. We will now explore this property in a very simple setting. Assume n are the number of training samples, p the number of dimensions, x in the input and y the output. Suppose that n = 2, p = 2, x11 = x12, and x21 = x22. Furthermore, suppose that y1 + y2 = 0 and x11 + x21 = 0 and x12 + x22 = 0, so that the estimate for the intercept in a least squares, ridge regression, or lasso model is zero: βˆ 0 = 0. (a) Write out the ridge regression optimization problem in this setting. (b) Argue that in this setting, the ridge coefficient estimates satisfy βˆ 1 = βˆ 2. (c) Write out the lasso optimization problem in this setting. (d) Argue that in this setting, the lasso coefficients βˆ 1 and βˆ 2 are not unique – in other words, there are many possible solutions to the optimization problem. Describe these solutions

ansver
Answers: 2

Another question on Mathematics

question
Mathematics, 21.06.2019 16:30
An empty bucket is placed under a faucet dripping at a constant rate of 4 milliliters per minute. with the given information, which of these statements is a reasonable conclusion? a there will be 24 milliliters of water in the bucket after 16 hour. b there will be 60 milliliters of water in the bucket after 14 hour. c there will be 160 milliliters of water in the bucket after 20 minutes. d there will be 100 milliliters of water in the bucket after 40 minutes.
Answers: 1
question
Mathematics, 21.06.2019 20:00
Find the value of x. give reasons to justify your solutions! l, m ∈ kn
Answers: 3
question
Mathematics, 21.06.2019 20:30
Kai walked one and two-thirds of a mile on saturday and four and one-sixth of a mile on sunday. how many miles did kai walk?
Answers: 1
question
Mathematics, 21.06.2019 23:30
Which pair of numbers is relatively prime? a. 105 and 128 b. 130 and 273 c. 205 and 350 d. 273 and 333
Answers: 3
You know the right answer?
It is well-known that ridge regression tends to give similar coefficient values to correlated variab...
Questions
question
History, 30.01.2020 07:48
question
Mathematics, 30.01.2020 07:48
question
English, 30.01.2020 07:48
question
Computers and Technology, 30.01.2020 07:48
question
Mathematics, 30.01.2020 07:48
Questions on the website: 13722363