Carlo comes out of the book

After working on the traditional hand-drawn cel animations – I was wondering what would happen if I began to mix live-action footage with the book and essentially brought the book to life. For this I brought the drawings into my 3D software and built paper “puppets” of the characters. I shot some footage outside of the open blank book and used motion tracking software to then match up the scenes with the animated footage. The result thanks to Luca’s reaction is an interaction of the drawing and the real – here are some samples. The second video adds green screen to the mix to add to an immersive storytelling experience…

this is the initial test of motion tracking and shot video:

next I tested a green screen setup with my son, luca, as a placeholder – to see what kind of results I could achieve:

then I did a test with green screen (here a quick scene from last summer in wales provides the backdrop):

the setup for shooting the live sequences:

12541036_10153841229128205_2421530400063995436_n