Overview
DaVinci Resolve Studio only.
Surface Tracker makes the folding and deforming of the texture or effect realistically match the surface it is attached to. The node is complex, but the workflow is always the same, moving from left to right with the buttons in its settings:
1. Bounds: click on the image to define the area of the surface where you want to apply the texture. One surface at a time, without going over object edges. 2. Mesh: define the control points along the natural folds and curves of the surface. 3. Track: analyze the motion of the surface over time using this mesh. 4. Result: composite the texture on top of the moving mesh.
Across all tabs, Tracked Range shows the start and end frames that contain tracking data. Modifying the bounds or the mesh resets any existing tracking: you will need to re-track.
Where to find this node
- Effects Library:
Tools > Tracking > Surface Tracker - Quick add: right-click in the Node Editor →
Add Tool > Tracking > Surface Tracker
Inputs
- Input (yellow) - the media with the surface to track and composite onto.
- Overlay (green) - a still graphic, a video or the output of a node tree, to overlay onto the surface.
- Occlusion Mask (pink) - regions where this mask is white are not tracked. For example, a rough mask around a person moving in front of the scene.
- Effect Mask (blue) - optional. Limits the effect to the pixels within the mask.
Setup
Footage → Surface Tracker (yellow input)
Graphic or video → Surface Tracker (green input)
Bounds tab
Choose a frame where the surface is as close and as flat-on to the camera as possible: it becomes the default reference frame. Click around the area (three points minimum) to create a polygon. Points should be on the surface, not around it: points on object edges or on the background cause tracking errors.
- Boundary
- the selected boundary or hole, chosen from the menu. An error message appears if there is a problem (crossed edges, too few points...).
- + Bound
- adds a boundary. Multiple boundaries on the same surface join into one shape before the holes are subtracted.
- + Hole
- excludes an overly complex or changing part, for example the eyes and mouth on a face.
- Delete
- deletes the selected boundary or hole. This operation cannot be undone.
- Clear All
- deletes all boundaries and holes.
Mesh tab
The mesh is best placed when the surface is flat-on and closest to the camera. Drag points to move them (Command-drag to move several), click to add one, Option-click to remove one. Avoid adding points in areas with little detail. Points cannot be added or deleted after tracking.
- Regenerate Mesh
- recreates the mesh at the current frame and settings, discarding manual changes.
- Point Locations
- Automatic or Uniform.
- Automatic
- the node places points on the best details for tracking. Gives the best results in most cases.
- Point Number Limit
- maximum number of points. It affects how the overlay flexes and folds, not directly the tracking speed.
- Minimum Point Spacing
- minimum distance between points, so they don't bunch together in highly detailed areas.
- Uniform
- a regular grid deformed during tracking by internal shape models. May do better than Automatic on a highly detailed surface.
- Horizontal Spacing / Vertical Spacing
- horizontal and vertical distance between grid points.
Track tab
While tracking, you can fix points one by one or with the lasso tool (Command-drag), which can also stretch, scale and rotate the mesh. A correction on one frame only affects that frame, but neighboring interpolated frames take it into account.
- Go to Start / Go To End
- snaps the playhead to the first or last tracked frame.
- Tracking Direction Controls
- Track Backwards, Track Backwards One Frame, Pause Tracking, Track Forwards Then Reverse, Track Forwards One Frame, Track Forwards.
- Trimming
- Remove Tracking Data Before This Frame, At This Frame, After This Frame, and Track From Last Known Match (resumes tracking from the last good tracked frame).
- Motion Range
- how far to search for matches. Increase it if the surface moves too quickly.
- Mesh Rigidity
- how flexible the mesh is. Lower for a more flexible mesh, higher for a stiffer surface.
- Quality
- Faster while adjusting the mesh, Better for the final track.
- Interaction Overlays
- Show, Hide on Drag or Hide, for the mesh display in the viewer.
Result tab
- Output
- six options.
- Warp Input 2 Onto 1
- warps the overlay to the tracked mesh and composites it onto the clip.
- Warp Input 2 Onto Blank
- warps the overlay and passes the alpha, to composite in another node.
- Warp Input 1’s Alpha
- applies the tracking result to the Effect Mask input.
- Create Mesh Alpha Mask
- produces an alpha mask that follows the outline of the mesh.
- Stabilize-Warp Input 1
- inverse warps to the reference frame to get a stabilized image, to modify with DaVinci Resolve's tools.
- Rewarp Stabilized Clip
- composites the stabilized, modified image back onto the original clip, using a copy of the Surface Tracker.
- Overlay/Alpha Source
- First Frame (still frame), Reference Frame (starts at the reference frame) or Each Frame (animated overlay or stabilized content).
- Contract/Expand
- adds or removes pixels at the edges of the overlay. The expanded area is not tracked.
- Softness
- softens the edge of the overlay.
- Motion Blur
- adds motion blur to the overlay.
- Overlay Placement
- Go To Reference, Set to Current, Reference Frame, and Positioning (Sliders, Interactive Canvas or Interactive Pins, up to four pins). Reset Position returns the overlay to its default state.
- Compositing
- Composite Type (blend mode) and Opacity.
Use cases
- Overlay a logo or graphic onto clothing that follows the folds of the fabric.
- Retouch a moving surface: Stabilize-Warp Input 1 to stabilize, retouch, then Rewarp Stabilized Clip with a copy of the node.
Tips
- One surface per Surface Tracker: multiple boundaries on different surfaces give poor results. Use several Surface Trackers instead.
- The bounds are for analyzing motion, not for rotoscoping. For an object passing in front, use the Occlusion Mask input.
- If few points are detected (image too bright, too dark or low contrast in log), temporarily add a brightness/contrast node before the Surface Tracker, then disable it once tracking is done.
- If the clip's frame rate differs from the timeline, tracking may seem to stutter. A Render In Place on the Edit page solves this.
