We set aside our ambitious short-film idea and tried Image-to-Video and transitions between two reference images.
he first worked fairly well. For example, our image of Illidan (from *Warcraft 3*) was turned into a short clip. The camera zoomed in on the demon hunter’s face as he scowled. Because of copyright concerns, we won’t show the image or video here.
Finally, we tested a transition between two frames:
Illidan stands on a rock. Illidan lands on the ground.
The idea: Illidan should jump from the rock (Image 1) and land on the ground (Image 2). But in the generated video, Illidan morphed into a black, bird-like shadow in between. Completely unusable.