Planar Tracker Node

The Planar Tracker solves a problem the classic Tracker struggles with: following a flat surface that undergoes perspective distortion. Instead of tracking individual points, it analyzes the motion of a whole region and computes a perspective transformation (homography) on each frame.

Benefits: no manual keyframes for a corner pin, robustness to occlusions (through a mask), higher precision on tilted surfaces (road, wall, TV screen), support for the 4 operation modes.

Notable limitation: the Planar Tracker does not save its temporary tracking data (individual point trackers). As a result: all the tracking must be done in a single session - if you save and come back later, you have to track again.

• Effects Library: Tools > Tracking > Planar Tracker
• Quick add: right-click in the Node Editor → Add Tool > Tracking > Planar Tracker

Classic Tracker

2D pattern tracking. For isolated points, simple attachment, quick stabilization. Slow with perspective, sensitive to complex rotations.

Planar Tracker

Planar analysis. Ideal for whole surfaces that turn/tilt/move in perspective. Slower but more robust as soon as there is perspective.

Camera Tracker

Different: it solves the camera in 3D (not a 2D plane). For integrating 3D CGI into live action.

Rule of thumb: TV screen, panel, plate, tarp, poster → Planar. A specific point (eye, ball) → classic Tracker. A whole shot for 3D → Camera Tracker.

• Background (orange) - footage containing the flat surface.
• Corner Pin 1 (green) - foreground (image, text) to apply onto the tracked surface with perspective distortion.
• Occlusion Mask (white) - mask of the objects that partially hide the surface (hand, arm, object passing in front). The tracker ignores these areas so it does not drift.
• Effect Mask (blue) - limits the output to an area.

Screen replacement:
MediaIn (shot with a screen) → Planar Tracker (Corner Pin) → Merge 2D
                                         ↑
                Text+ / Image ───────────┘ (FG to corner-pin)

With occlusion (hand passing in front):
MediaIn → Planar Tracker → Merge 2D
            ↑
Polygon (hand rotoscope) → Occlusion Mask input

Track

Analysis mode. This is where you run the tracking on the selected region.

Steady

Removes the motion of the tracked plane. Useful for "static" paint or roto work (you work on a version without motion), then you can unsteady to bring back the original motion. A pro workflow for removing an object.

Corner Pin

Applies the tracked perspective transformation to the FG input. The standard mode for screen replacement.

Stabilize

Stabilizes the shot by counter-applying the tracked motion. Choose which parameters to smooth (X/Y, rotation, scale) and the smoothing radius. Transparent edges need to be compensated with Auto Crop or Auto Zoom.

The Planar Tracker can model the distortion of the plane at different levels of complexity. Choose based on the actual motion in the shot:

Translation

X/Y only. A plane that slides without turning or tilting.

Translation + Rotation

A plane that can rotate within the image plane.

Translation + Rotation + Scale

Adds zooming in / out of the plane.

Affine

Adds skew (shear). A slightly tilted plane.

Perspective

The most general. Supports every perspective distortion (4 free points). The default choice.

Start with Perspective. If the track drifts or is unstable, step down to a simpler model (Translation+Rotation+Scale is often enough for calm footage).

1. Remove the lens distortion from the source footage (Lens Distort node) - tracking distorted footage gives poor results.
2. Connect the footage to the background input.
3. Go to a reference frame where the flat surface is clearly visible and not occluded.
4. Draw a polygon around the flat surface (the pattern). As large and distinctive as possible.
5. Adjust the render range to cover the part of the shot to track.
6. Set the Motion Type and Track Channel (R/G/B).
7. Connect an Occlusion Mask if an object passes in front of the surface.
8. Run Track Forward from the reference frame. Then Track Backward to complete it.
9. Check the track visually frame by frame.
10. Switch the mode to Corner Pin and connect the FG for the screen replacement.

The polygon region you draw should:

• Be large - more pixels analyzed = a better track.
• Stay fully visible during tracking (not leave the frame).
• Be unoccluded - otherwise an occlusion mask is required.
• Be as large as possible relative to the subject - not just a small rectangle in the middle of the shot.
• Be fairly flat and barely distorted - draw on the surface that looks most like a plane on that frame.

• Screen replacement (TV screens, phones) - polygon on the screen → Corner Pin → FG = custom UI or video → a screen that shows the new content while following the perspective of the shot perfectly.
• License plate replacement - polygon around the plate → Text+ with the new number → automatic corner pin on every frame.
• Sign / poster replacement - replace a billboard or a company logo with another one without reshooting.
• Stabilized paint / roto (Steady mode) - switch to Steady → paint out an object on the static plate → go back to normal mode to bring the motion back.
• Stabilizing shaky camera work - Stabilize mode with smoothing, to smooth out a handheld shot without freezing the camera completely.
• Tattoo / graffiti application - tattoo image → corner pin on the skin (as long as it is fairly flat).
• Virtual projection mapping - corner pin a video onto a wall or building facade in a shot.

• Point Tracker vs Hybrid - Point Tracker is faster and handles outliers automatically. Hybrid (Point/Area) is more precise but needs more occlusion masks. Start with Point Tracker, switch to Hybrid if it drifts.
• Always correct lens distortion first - GoPro or wide-angle footage = strong lens distortion. A Lens Distort node upstream solves most tracking problems.
• Reference frame in the middle of the shot - tracking forward then backward from that frame = more consistent data than starting from the beginning.
• Everything in a single session - a crucial reminder: the temporary tracking is not saved. Plan to do the track + the full integration without closing the project.
• Auto Crop for edges in Stabilize - stabilization reveals black edges. Auto Crop or Auto Zoom compensates by zooming in slightly (keep it for a not-too-aggressive stabilization, otherwise you lose quality).
• Bake to Planar Transform - once the track works, create a Planar Transform node from the data (bake) for a faster, portable render.
• For non-flat surfaces (face, rippling fabric), the Planar Tracker is not enough. Use a tracked mesh warp (Optical Flow, Motion Vector) or third-party solutions (Mocha Pro).