Trust-Region (TR) algorithm for constrained nonlinear least squares problem

Step 1. Given initial iterative point x 1 R m , J ( x k ) R n 2 × N e , Δ 1 > 0 , 0 < ε < 1 , η > 0 , 0 < τ 3 < τ 4 < 1 < τ 1 , 0 τ 2 < 1 and set k : = 1 ;

Step 2. if J ( x k ) T G ( x k ) 2 ε then stop; otherwise, get s k from solving Equation (15);

Step3. Compute r k = A r e s k P r e s k ; x k + 1 = { x k , if r k < η , gotostep1 x k + s k , if r k η , gotostep4 ;

Δ k + 1 = { [ τ 3 s k 2 , τ 4 Δ k ] , if r k < τ 2 [ Δ k , τ 1 Δ k ] , if r k τ 2 ;

Step 4. Compute a new function Ψ ( x k + s k ) , k : = k + 1 and go to step 2.