It is difficult for self-vision underwater robot to track object, and the tracking process is frequently inaccurate, unstable or even loss goals. To solve the above questions, Continuously Adaptive Mean Shift Algorithm (CamShift) is used in object tracking of self-vision underwater robot in this paper. We build a software experimental platform by VC++6.0 and Opencv1.0, with the external camera to capture video, and then apply Camshift algorithm in the environment, in which background color is not similar to the object to realize the real time tracking. The experimental results show the effectiveness of the algorithm for self-vision underwater robot.