The tracking method and the tracking system using the same that can track the position and attitude of the object to be measured in succession are provided. This tracking system includes a marker, camera portion, a first inertial measurement unit, the measurement unit 2, the inertia and the tracking processing unit. The marker is fixed to the measuring object, wherein the camera unit and outputs a marker image by photographing the markers. The first inertial measurement unit and outputs the measured first inertia including a is fixed to the camera module, the first acceleration and the first angular velocity. The second inertial measurement unit and outputs the measured second inertia including a is fixed to one of the measurement target and the marker, and the second acceleration and the second angular velocity. The tracking processing unit extracts the position and posture of the object to be measured to the secondary through the extraction, and the first and second inertial position and attitude of the object to be measured primarily over the marker image. Thus, as the camera module is fixed the first inertial measurement unit further includes in, it is possible to track the position and attitude of the object to be measured continuously.