zoukankan      html  css  js  c++  java
  • why constrained regression and Regularized regression equivalent

    problem 1:

      $min_{eta} ~f_alpha(eta):=frac{1}{2}Vert y-XetaVert^2 +alphaVert etaVert$

    problem 2:

      $min_{eta} ~frac{1}{2}Vert y-XetaVert^2 \ s.t.~Vert etaVert-cleq 0$

    problem 2 Lagrangian:

          $mathcal{L}(eta,lambda)=frac{1}{2}Vert y-XetaVert^2+lambda (Vert etaVert-c)$

    kkt shows:

    dual-inner optimal:$eta^*=min_{eta}~mathcal{L}(eta,lambda):=frac{1}{2}Vert y-XetaVert^2+lambda (Vert etaVert-c)$

    primal-inner optimal:$lambda^*(Vert etaVert-c)=0$

     

    for problem 1:

    $eta^*=min_{eta} ~f_alpha(eta):=frac{1}{2}Vert y-XetaVert^2 +alphaVert etaVert$

    set $lambda = alpha$ and $c=Vert etaVert$

    can see both kkt conditions meet

  • 相关阅读:
    ListCtrl中垂直滚动条自动滚动
    auth组件
    母版的继承
    mysql数据备份和恢复
    部署MHA
    安装mysql
    yum源优化
    存储过程
    redis哨兵、集群
    redis主从同步
  • 原文地址:https://www.cnblogs.com/porco/p/4537507.html
Copyright © 2011-2022 走看看