Keyframe Interpolation

Keyframe Interpolation

Keyframe interpolation is the process of creating intermediate values between a set of keyframes. The keyframes are specified by you and then the values in the frames between the keyframes are automatically filled in.

In the iMerit Point Cloud tool, keyframe interpolation is used for object labels that change over time. For example, in a sequence with a moving car, the cuboid around the car moves in each frame. With keyframe interpolation, you only need to specify the label at certain key times, and the intermediate labels are created automatically.

Note: Keyframe interpolation is available for 3D cuboids (instance classes).

View the Keyframes of an Object

In the context of interpolation, a keyframe is a marker that indicates that at that frame, the state of the object is defined by the user. In other frames (that are not keyframes), the state of the object label is calculated automatically through interpolation.

  1. Select the annotation

  2. The keyframes are now visible in the timeline at the bottom of the editor. A normal keyframe is shown with a blue underline under the frame it belongs to.

Add a Keyframe

In the current frame

  1. Select the object.

  2. Make a change to the object in the editor. A keyframe containing the new changes is added automatically.

Or,

  1. Select the object.

  2. Press K. Without making changes, the keyframe captures the state of the object label at that frame. This means the object will not change.

Remove a keyframe

  1. Select the object.

  2. Go to a frame that is a keyframe

  3. Press K

Label Occluded Objects

Sometimes an object might be occluded, in which case you might want the object to not be present in certain frames and reappear in other frames.

  1. Create the cuboid on the object

  2. Go to the frame where the object is last visible (in above example, frame 3)

  3. Press K

  4. Go to the frame where the object reappears (in above example, frame 7)

  5. Press K

  6. Contextual click the annotation and go to Add/Delete Annotations

  7. Select the option which allows you to delete between the two keyframes (#4 to #5)

There are various ways to use the contextual menu of ‘Add/Delete Annotations’ to delete annotations from certain frames.

Use Instance IDs in Sequences

An Instance ID is an identifier assigned to each labeled object in a sequence. This instance ID can be used to track an object over multiple frames.

View the Instance ID of an Object

  • The instance ID of an object is displayed in the Class List on the left along with the classname.

  • When an object is selected, it is also displayed on the Status box.

Add a Instance ID to an Object

When creating an object, the user is asked to select a missing ID or create a new one.

Change the Instance ID of an Object (In all Frames)

  1. Select the object.

  2. Open the Annotation Details pop-up

  3. Select +Create new.

  4. Save. The new Instance ID replaces the old Instance ID in all frames.

Merge an Instance into another Instance

  1. Select the object you want to merge into another instance.

  2. Open the Annotation Details pop-up

  3. From the Select missing instance, select the other objects instance ID

Note: Merging instances is only possible when both instances have no overlapping keyframes.

Last updated