The aim of this study is to develop and validate a deformable tracking algorithm for monitoring the motion of the target volume on 2D ultrasound (US) images during a radiotherapy fraction. The proposed method is applied on images acquired with a transperineal ultrasound (TP-US) probe on 31 treatment patient's sessions, treated with a prostate or after a surgery, called a prostatectomy. The developed algorithm is based on Speeded-Up Robust Features (SURF) to find and match the corresponding salient points in the reference and moving images, and Thin Plate Spline (TPS) to warp the image. The results are promising and show that the proposed algorithm performs well with either artificial transforms, or in comparison with a rigid intensity based algorithm used in clinic.