"Yule Log" Demo
I wanted to create a real-world use case for using a complete Firefly/Creative Cloud workflow to generate an acceptable quality output for commercial use.
I started with the idea of a "Yule Log" - looped lo-fi audio track with serene imagery.
This was the initial output from Adobe Firefly Gen 4. The prompt used was "A living with floor to ceiling bookshelves, roaring fireplace and comfortable leather furniture; outside the window snow is falling". The only settings were Landscape ratio and Photo for the output.
After downloading, I used this image with Firefly Image-to-Video workflow with the image set as the first frame, Widescreen aspect ratio and No Camera Motion set. The prompt used was "A roaring fireplace; outside the window snow is falling".
The output started out ok but as the video progressed, snow started falling throughout the image. I tried several other prompts to eliminate this issue but alas, I found a consistent bug in the output.
Had this worked as intended, the later edits using Photoshop would not have been necessary. But I saved this video clip knowing I could "fix in post".
The next step was to create a sound effect for the fireplace. Using the new Text-to-Sound-Effects (beta) feature in Firefly was easy enough. You can access this directly from the Text-to or Image-to-Video or on it's own and upload your own media. I chose the latter.
After uploading the Media (my Firefly video output), I entered the prompt "A crackling fireplace in a quiet living room" which gave me 4 quality audio outputs to choose from.
From here I used Adobe Photoshop to overlay the original Firefly image over the video clip, masking out the Fireplace and the windows. I then took the exported video into Premiere Pro to add in the Firefly sound effect and loop the 5 second video clip to allow for a longer run with music.
For the music track, I used Adobe Stock (built in to Premiere Pro) to choose a lo-fi piano track.
This is the final result with the Firefly image, video animation, sound effect and Stock music track.