End of Semester Wrap Up
And we’re done! A 12 week introduction to video projection and how it can be mapped to physical surfaces, and manipulated in real-time. For those that’ve enjoyed it, there are many related avenues to explore and research from here.
Projection Pathways Forward?
We’ve emphasised mapping video to 2D planes this semester, and there are many ways to expand from this foundation.
3D Mapping –
The principles behind effective 3D Mapping…
VVVV (PC based patching software) ( See Tutorial about projecting onto 3D Geometry with VVVV.)
Meshwarp Server – (mac/PC + free) ‘A versatile Mapping Tool to create complex Video Projection Installations.’ ( Site includes detailed tutorials for 3D projection – using meshes from your 3D software etc )
Unity Game engine – Streamlined for game playing and the graphics card, this can also be used as a real-time 3D environment. Many are using this to generate and record relevant perspectives for projecting onto architecture and shapes.
What is Orthographic Projection?
Integrating video with lights
Artnet / DMX are protocols for sending information about lighting between a computer or lighting desk, and lights. ( You need a DMX interface to link a computer and lights, or a computer and a lighting desk. )
See also: DMX Lighting 101
Integrating projections with sound
Idiron (link and control Resolume with audio sequencing software, Ableton Live)
filmsound.org ( lots of ideas about audiovisual relationships, on and offscreen )
freesound.org (archives of creative commons licensed soundscapes and recordings )
VJ Forums – Great forum for exploring the world of live audiovisual software + hardware.
Integrating projections with interactivity
Digital interactives work by using some sort of sensory or gestural input.. generating data from this, and using that data to control software parameters of your projection/video. To move past simply using a mouse to control your software, there are a range of MIDI controllers available, as well as more sophisticated hardware and software that allows heavy customisation to suit each project ( eg measure temperature / colour / volume / brightness / movement etc and massage these elements into software friendly ranges of numbers for controlling software. )
max/msp : “Max gives you the parts to create unique sounds, stunning visuals, and engaging interactive media. These parts are called ‘objects’ – visual boxes that contain tiny programs to do something specific. Each object does something different. Some make noises, some make video effects, others just do simple calculations or make decisions. In Max you add objects to a visual canvas and connect them together with patchcords. You can use as many as you like. By combining objects, you create interactive and unique software without ever writing any code (you can do that too if you really want to). Just connect.”
arduino “..an open-source electronics prototyping platform based on flexible, easy-to-use hardware and software. It’s intended for artists, designers, hobbyists, and anyone interested in creating interactive objects or environments.”
Ninja Blocks – another DIY electronic sensor kit.
Kinect – infra-red camera for X-Box, capable of generating data from spatial movement within 3D depth.
LEAP motion – similar to the Kinect, but much capable of much higher resolution and more finely detailed interactions.
Game controllers, and joysticks etc – can be used to send data results to video or audio software (using software such as Junxion to translate the gestural data, into midi information for your video or audio software ).
FACEShift + FaceShift OSC – Use your facial expressions to control your software!
Other video projection software?
VDMX – my preferred live video software, can be heavily customised, providing much depth and flexibility for many purposes. Includes good Quartz Composer integration.
Millumin – developed to suit theatre performances, it prioritises cue points and timelines, in addition to built-in mapping and triggering functions.
QLab – software for stage environments, syncing and sequencing video, light, sound, midi.
Dataton Watchout – A PC based platform for controlling video across multiple displays simultaneously.
Animata – Live animation software, controllable via Quartz Composer and OSC (eg control limb movements / animation components in real-time)
Madmapper – Probably the best consumer-grade mapping software at the moment.
VPT : A free (Mac + PC ) multipurpose realtime projection and mapping tool created by artist HC Gilje.
For large scale events with multiple projectors, many use media servers (dedicated hardware + software) such as the Green Hippo.
Editing:
Read Walter Murch’s In the Blink of An Eye. (A great read, useful for any creative.)
Filming:
Understanding a DSLR will vastly improve your ability to document projects, as well as generate interesting material.
There are too many books on Cinematography to mention, ranging from the intensely formal and technical through to approaches more suited to the low-budget / DIY / independent / must-make-this-film sort of film-maker. Even a brief exploration of these will vastly improve how you approach and record video.
Post Production:
( Exploring After Effects will open up lots of video opportunities with composition, layering, motion graphics, animating elements, colour grading and adding visual effects. Take advantage of RMIT’s free access to the otherwise expensive, Lynda.com series of tutorials.)
Student Blogs / websites / video links / documentation:
[ Your blog goes here… ]
http://mahtabromianiexpandedscreen.blogspot.com.au
http://theextendedscreenscreenspace.blogspot.com.au/
Effective use of filmed perspective in the Spider Projection.
“The projectors are on the inside, projecting from the back.. The spiders were filmed from exactly the point the bystanders are standing later on. So thats why the 3d effect works.”