Tracking Module IntroductionTracking Module IntroductionBefore we get started, it is important to understand what we are trying to achieve.
In the scene you see in the window, the robotic hand will close its fingers and grasp the white object. Once the object is grasped, the hand will move up to pick up the oject.
After the object has been picked up, the robot will try to place it on the second object (to the right of the hand in the initial image).
The robot will basically use the hand to pick up an object and place it in a desired position.
In this module, you will not be able to change the action of the robot; the robot will always perform the same task (pick up the object, move to the right and place it on top of the second object).
What you will be able to do is track the different moving parts in the image.
A computer can perform tracking by following an object in a scene (the same way you do; your scene is what ever you see at a specific time).
If you try tracking something that doesn't move, your eyes will remain static and if an object moves and you decide to follow it your eyes will move in a way that you keep your attention on the object you wish to follow.
In this same manner, the computer must first know which object it wishes to track and then try to "stay focused" on it, or follow it where ever it goes within the scene.
Since in our setup, the only things moving will be the hand and the object (once it is picked up by the hand); the computer should try to concentrate on one of these.
The first step in tracking is to select what you wish to follow.
In the VVL system, we have "Trackers". These trackers are boxes which can be placed on the image to tell the computer which objects within the scene it must try to follow.
Once you initialize (place a tracker on the image) and start the tracking, the "box" will follow your object around; depending on where it goes.
Up to Tracking Contents