DIFF 2017 – Live Video Possibilities

Thanks for the workshop invitation, DIFF!

Come and explore the world of video software + hardware, light rhythms, – but mostly – ideas and possibilities. What is possible with live video today? How could you be exploring it?

Sean Healy is a video producer who specialises in audiovisual relationships, camera motion, and hybrids of custom animation and cinematography – specifically purposed for use in live events and installations. His work encompasses live-triggered video set designs for theatre productions, audio- responsive animations for concert backdrops, or projection mapped installations for festivals and events – and he has shown work at most major music festivals in Australia, as well as toured with Gotye, developed custom concert visuals for Hermitude, and performed at ACMI and the Sydney Opera House. He currently works with several music and theatre groups in Melbourne.

Sep, 2017, Darwin Film Festival Workshop.

jeanpoole @ skynoise.net

Some useful resources for those interested in exploring live video.

Creative Opportunities With Live Video in 2017

The range of video tools available  in 2017 – for creating, editing, mixing, animating, transmitting and watching video – mean there are many, manys video can be creatively explored.

  • collaborations with musicians / actors / events / buildings / settings / film sets / theatre backdrops / virtual sets / live feeds / broadcasts / social media / live editing
  • using live cameras
  • using mobile phones as controllers
  • using sensors
  • using audioreactivity
  • live mixing
  • live illustration
  • mapping to 3d shapes
  • video as lighting design / atmosphere control
  • concert visuals
  • live animation / live motion graphics creation

Live Video in Theatre

Software – for triggering cues to match actors –

Live Video in Installation

  • Example installations –
  • Interactivity?
  • sensors / live cameras / audioreactivity

Live Video with Music

Live Audiovisual

Lucky People Centre International – audiovisual relationships (about the movie // low-res on youtube)

Creative Inspirations for Live Video

Game Engines? (eg UNITY / Unreal Tournament Engine )

  • AntiVJ – “a visual label initiated by European-based artists whose work is focused on the use of projected light and its influence on our perception. “
  • Light Surgeons – “The Light Surgeons is a boutique production company that specialises in generating creative content for video productions, live performances, installations and experiences.”
  • Joanie Lemercier – “Joanie Lemercier is a French artist primarily focused on projections of light in space and its influence on our perception.”
  • Zach Lieberman – daily experiments with programming, to create new styles
  • Runwake – great for combining many styles – and photo and video with animation
  • VJ Suave from Argentina with outdoor projections.
    VJ Legoman with clever installation projections.
    Scintillation (recorded with 35,000 photographs!)

—

Software links..

VDMX (my VDMX review)
Madmapper (my madmapper review)
Millumin (my millumin review)

VDMX Resources:

A VDMX workshop at ACMI, I co-hosted with David Lublin via a video conference link – also serves as a great 3 hour video introduction to VDMX!

VDMX video tutorials (comprehensive range of topics to choose from)
VDMX Wiki (Each part of the interface broken down and explained in detail)
VDMX Forums (lots to learn from these forums)

Touch Designer – “TouchDesigner is a visual development platform that equips you with the tools you need to create stunning realtime projects and rich user experiences.”

Millumin – “Software to create audiovisuals shows. For theater, videomapping and interactive installation”

Mixers and Controllers

Video signals can be mixed with smaller hardware devices like these:

Roland V1-HD / Edirol V4 / Edirol V8 / AVM 02 / VIXID

– as well as broadcast mixers… which cost a lot more, but offer a greater range of inputs / outputs / controls.

Controllers

physical 0r virtual
What is midi? ( introduction to midi )
What is OSC?

Controlling : Video software can be controlled by much more than a double clicked mouse. Using some sort of hardware controller is one of the best ways to make live video more instrument-like, responsive, versatile and fun. Mostly we’re talking about using knobs, buttons, sliders and touchscreens to control video software parameters. Most real-time video software also allows a range of easy automated processes to control parameters – eg letting audio analysis functions use audio levels to control a parameter, or setting up a range of mathematical processes which can add randomness or ‘swing’ to your video parameters.

I use a Korg Nano controller for it’s compact size, and previously used the Novation Nocturn for its portability and on laptop screen interface.
The Monome is a minimalist controller…(see also, the arduinome)

Popular dedicated video controllers : Codanova, Livid Instruments Ohm64
Quneo: an intriguing new controller offering multi-touch, pressure, velocity and location sensitivity.

Using Turntables to control video + data ( not just music! ) –
The DVJ allows DVDs to be scratched and speed controlled like CDs.
Serato Video / Mix Emergency – Serato Scratch video and quartz composer

The Jazz Mutant Lemur sports a huge touchscreen. See the Lemur controller being used in live Audiovisual manner. ( Lemur now have an advanced ipad app that replicates this functionality.)

iphones / iPads and Android touchscreen devices as midi / OSC controllers :
Lemur (for ipad / iphone)
touchOSC (for ipad / iphone) + touchOSC for android
mrmr, MSA remote
10 midi control apps for ipad

Microsoft kinect – interacting with video : Paik times Five / Starfield / Puppet Parade

LEAP motion
FACEShift + FaceShift OSC
NINJA BLOCKS

Any USB connectable joysticks, dancemats or game controllers can be used to manipulate video parameters, using Software such as Junxion. The DIY electronics Arduino kit : “a tool for making computers that can sense and control more of the physical world than your desktop computer. Arduino can be used to develop interactive objects, taking inputs from a variety of switches or sensors, and controlling a variety of lights, motors, and other physical outputs.”

 

Software for VJing, live audiovisuals, real-time cinema

VJ Forums Wikipedia’s VJ software list.
VDMX 5 (Highly modular, adaptible, powerful possibilities, good Quartz Composer integration.)
Modul8 (well suited for motion graphics)
Resolume Avenue (Strong Audiovisual features)
Isadora (another modular contender)
Max / MSP + Jitter (Very powerful, customisable graphic programming language environment – People are excited about the MAX4Live software which integrates the sequencing possibilities of Ableton Live, and allows audio performers to tightly synchronise their custom Jitter parameters)
Processing (More accessible variety of the above)
VVVV (PC based patching software)
Animata – Live animation software, controllable via Quartz Composer and OSC (eg control limb movements / animation components in real-time)
Unity Game engine – Streamlined for game playing and the graphics card, this can also be used as a real-time 3D environment.

Syphon (for sending between video apps)   Madmapper (for projection mapping)