AI VFX and virtual production can support the same film in different ways. Virtual production helps plan or photograph a scene using digital environments and real-time visualisation. AI VFX can create or modify imagery that is developed and integrated into the finished sequence.
The useful question is what the shot needs to preserve. A human performance, a repeatable camera move, a controlled product image or a particular location may determine the production method more strongly than the availability of a tool.
Choose the method at scene level
A scene can combine filmed performances, physical sets, digital environments and generated elements. It does not need one technique applied uniformly to every shot. A wide view may need a different approach from a close-up, even when they describe the same moment.
Begin with the action and the edit. Identify what must be continuous between views: eyelines, screen direction, light, weather, costumes, object positions and the timing of a performance. Then decide how each element will be captured or created.
A transition between methods should be tested in the sequence. A generated shot that looks convincing by itself may feel unrelated when it follows a live-action close-up. Scale, texture, camera behaviour and sound all affect the join.
When filming is the stronger starting point
Filming may be the appropriate choice when the project depends on a specific performer, detailed physical interaction or a performance the director wants to shape on set. It may also be the clearer route for material that must depict a product, place or action exactly.
A filmed performance creates a particular record. Later processing can change that record, so the production needs to decide which aspects of the photographed material must remain intact. If the intention is to preserve the original performance, review should explicitly test whether it has been altered.
The decision is not permanent for the whole production. Some moments may remain fully photographed while others are developed through a different process.
Where virtual production helps
Real-time visualisation can let a director, cinematographer and production designer assess a digital setting in relation to a physical camera and performers. It can support planning before the shoot and decisions during photography.
An LED volume adds its own production considerations. The environment, camera position, lens, exposure, reflections, physical lighting and practical foreground need to be planned together. It is not enough to have an attractive background image.
Some environments are created for direct use in camera. Others provide guidance for a shot that will receive substantial post-production. Agree which role the environment is serving, because the required preparation and final-image responsibility will differ.
Where generated imagery helps
Generated imagery can support environment development, background elements, extensions or complete shots. Its suitability depends on the action, required precision and ability to maintain the scene’s established rules.
For an element intended for compositing, define the camera relationship and integration requirements. A moving background that changes perspective incorrectly cannot be repaired merely by placing it behind a well-shot foreground.
For a complete generated shot, review what happens before and after it. Confirm the character, screen direction, light and emotional state. Avoid treating the transition into the shot as the editor’s problem to solve after production is complete.
Capture information the next department needs
On-set planning should identify the material required for later work. Depending on the shot, that can include camera and lens information, references for lighting and surfaces, useful clean views and records of the approved setup.
Collect deliberately. The purpose is to support a defined task, not to accumulate every possible reference without a retrieval plan. Material must be labelled and connected to the relevant scene or shot.
Obtain the permissions needed for any performer or reference capture. A technically useful recording does not establish permission for every later transformation or reuse.
Review integration in context
Assess a shot at its intended duration and in the edit. Look at movement through the frame, the point of contact between elements, the behaviour of shadows and reflections, and whether the camera feels consistent with surrounding material.
Watch at ordinary playback speed before examining individual frames. Some problems appear only in motion; others matter because they attract attention at a dramatic moment. A technically imperfect background detail may be less significant than a character’s expression changing at the wrong time.
Then review finishing requirements. Colour, grain, sharpness, motion treatment and sound can contribute to a coherent sequence, but they should not be used to disguise an unresolved creative or spatial problem.
A practical commissioning approach
Ask the production team to propose a method for the sequence, identify the uncertain parts and demonstrate the hardest transition. Agree what will be filmed, what will be created and who is responsible for the final combination.
The strongest plan gives each department a clear role. It also leaves room to change the method when testing shows a better route to the intended scene.
Written by Asa Bailey, director and founder of BAI-LEY.
Have a production in mind? Start an enquiry ↗