Conjuring a Harpy

Creating a video storyboard using Adobe Firefly Text-to-Image as the starting point, then animating using Firefly Text-to-video in 5 second clips. 
Below is the original starting frame based on the previous Magical Mythological Menagerie project. I adjusted using warm tones and dramatic lighting. This image was the starting point for the video. 
From here it was a series of prompts and first frame uploads based on the last frame of the previous clip. While not a perfect 1:1 for alignment, the end results do a fairly good job of matching with the previous video using this method.
Firefly Text-To-Video also allows camera movements such as pan down or left which added subtle movement to clips. 
After all clips were rendered and downloaded, I used Adobe Premiere Pro to combine and edit the transitions between each clip. One interesting issue was with each clip the subsequent clip was about 1-2% reduced in size. In the raw edit below you can see the framing change on the sides as I had to adjust scale to match the previous clip. 
After cropping the video to remove the framing/scale issue, I use Adobe Stock audio for a soundtrack combined with the new Firefly Text-to-Sound Effects (beta). 
Below is the final edit including end title cards and the logo for the preconference. 
Back to Top