Aller au contenu

Surface Tracker Node

By Kriss Norde

Surface Tracker applies a texture or an effect to a flexible surface that moves and deforms, like cloth or skin, following its folds.

Overview

DaVinci Resolve Studio only.

Surface Tracker makes the folding and deforming of the texture or effect realistically match the surface it is attached to. The node is complex, but the workflow is always the same, moving from left to right with the buttons in its settings:

1. Bounds: click on the image to define the area of the surface where you want to apply the texture. One surface at a time, without going over object edges. 2. Mesh: define the control points along the natural folds and curves of the surface. 3. Track: analyze the motion of the surface over time using this mesh. 4. Result: composite the texture on top of the moving mesh.

Across all tabs, Tracked Range shows the start and end frames that contain tracking data. Modifying the bounds or the mesh resets any existing tracking: you will need to re-track.

Where to find this node

  • Effects Library: Tools > Tracking > Surface Tracker
  • Quick add: right-click in the Node Editor → Add Tool > Tracking > Surface Tracker

Inputs

  • Input (yellow) - the media with the surface to track and composite onto.
  • Overlay (green) - a still graphic, a video or the output of a node tree, to overlay onto the surface.
  • Occlusion Mask (pink) - regions where this mask is white are not tracked. For example, a rough mask around a person moving in front of the scene.
  • Effect Mask (blue) - optional. Limits the effect to the pixels within the mask.

Setup

Footage → Surface Tracker (yellow input)
Graphic or video → Surface Tracker (green input)

Bounds tab

Choose a frame where the surface is as close and as flat-on to the camera as possible: it becomes the default reference frame. Click around the area (three points minimum) to create a polygon. Points should be on the surface, not around it: points on object edges or on the background cause tracking errors.

Boundary
the selected boundary or hole, chosen from the menu. An error message appears if there is a problem (crossed edges, too few points...).
+ Bound
adds a boundary. Multiple boundaries on the same surface join into one shape before the holes are subtracted.
+ Hole
excludes an overly complex or changing part, for example the eyes and mouth on a face.
Delete
deletes the selected boundary or hole. This operation cannot be undone.
Clear All
deletes all boundaries and holes.

Mesh tab

The mesh is best placed when the surface is flat-on and closest to the camera. Drag points to move them (Command-drag to move several), click to add one, Option-click to remove one. Avoid adding points in areas with little detail. Points cannot be added or deleted after tracking.

Regenerate Mesh
recreates the mesh at the current frame and settings, discarding manual changes.
Point Locations
Automatic or Uniform.
Automatic
the node places points on the best details for tracking. Gives the best results in most cases.
Point Number Limit
maximum number of points. It affects how the overlay flexes and folds, not directly the tracking speed.
Minimum Point Spacing
minimum distance between points, so they don't bunch together in highly detailed areas.
Uniform
a regular grid deformed during tracking by internal shape models. May do better than Automatic on a highly detailed surface.
Horizontal Spacing / Vertical Spacing
horizontal and vertical distance between grid points.

Track tab

While tracking, you can fix points one by one or with the lasso tool (Command-drag), which can also stretch, scale and rotate the mesh. A correction on one frame only affects that frame, but neighboring interpolated frames take it into account.

Go to Start / Go To End
snaps the playhead to the first or last tracked frame.
Tracking Direction Controls
Track Backwards, Track Backwards One Frame, Pause Tracking, Track Forwards Then Reverse, Track Forwards One Frame, Track Forwards.
Trimming
Remove Tracking Data Before This Frame, At This Frame, After This Frame, and Track From Last Known Match (resumes tracking from the last good tracked frame).
Motion Range
how far to search for matches. Increase it if the surface moves too quickly.
Mesh Rigidity
how flexible the mesh is. Lower for a more flexible mesh, higher for a stiffer surface.
Quality
Faster while adjusting the mesh, Better for the final track.
Interaction Overlays
Show, Hide on Drag or Hide, for the mesh display in the viewer.

Result tab

Output
six options.
Warp Input 2 Onto 1
warps the overlay to the tracked mesh and composites it onto the clip.
Warp Input 2 Onto Blank
warps the overlay and passes the alpha, to composite in another node.
Warp Input 1’s Alpha
applies the tracking result to the Effect Mask input.
Create Mesh Alpha Mask
produces an alpha mask that follows the outline of the mesh.
Stabilize-Warp Input 1
inverse warps to the reference frame to get a stabilized image, to modify with DaVinci Resolve's tools.
Rewarp Stabilized Clip
composites the stabilized, modified image back onto the original clip, using a copy of the Surface Tracker.
Overlay/Alpha Source
First Frame (still frame), Reference Frame (starts at the reference frame) or Each Frame (animated overlay or stabilized content).
Contract/Expand
adds or removes pixels at the edges of the overlay. The expanded area is not tracked.
Softness
softens the edge of the overlay.
Motion Blur
adds motion blur to the overlay.
Overlay Placement
Go To Reference, Set to Current, Reference Frame, and Positioning (Sliders, Interactive Canvas or Interactive Pins, up to four pins). Reset Position returns the overlay to its default state.
Compositing
Composite Type (blend mode) and Opacity.

Use cases

  • Overlay a logo or graphic onto clothing that follows the folds of the fabric.
  • Retouch a moving surface: Stabilize-Warp Input 1 to stabilize, retouch, then Rewarp Stabilized Clip with a copy of the node.

Tips

  • One surface per Surface Tracker: multiple boundaries on different surfaces give poor results. Use several Surface Trackers instead.
  • The bounds are for analyzing motion, not for rotoscoping. For an object passing in front, use the Occlusion Mask input.
  • If few points are detected (image too bright, too dark or low contrast in log), temporarily add a brightness/contrast node before the Surface Tracker, then disable it once tracking is done.
  • If the clip's frame rate differs from the timeline, tracking may seem to stutter. A Render In Place on the Edit page solves this.