Even as the VJ software market matures, it’s refreshing to see with releases like CoGe – that there’s still room for new players and perspectives. From deep in his East European code-bunker, creator Tamas Nagy was kind enough to provide a review copy and an interview.

Features

“CoGe is a semi-modular, Quartz Composer® powered VJ application for Mac OS X®, designed for real-time media mixing and compositing.”

So – aside from the usual playback and manipulation of clips, what distinguishes CoGe? At first glance, the VDMX-like modular framework is immediately obvious, enabling CoGe to be easily customised for different performance styles or needs. Of the modules available, of notable merit is the very easily used sequencer.

A comprehensive wiki outlines the structure and approach ( the rendering chain / how the modular structure works / various automations+ mappings etc ) / clip synths, and a useful forum is fleshed out with fans eager to push it forward (At time of writing, CoGe 1.2.1 was just released, with significant performance increases ( lots more FPS on HD clips).

Quartz Composer is also quite deeply integrated into the software, which makes sense – given Tamas has developed a whole range of QC plug-ins which can be used within CoGe – eg PSD Brushes  / PSD layers Textfile readers / Webkit ( rendering webpages within CoGe )Beat Detektor / GPL reader ( reads GIMP palette files ) / Mouse co-ordinates etc. As well as possibilities for integrating customised Quartz files and effects, CoGe allows use of  3D animation meshes (Collada .dae format) and flash files alongside any movies and stills used for mixing and compositing. Want to build your own CoGe module using QC? Tutorial – how to create a simple effect for CoGe with Quartz Composer. And yes, rendering is through the graphics card for maximum performance, and double yes – syphon is well integrated too, for easy sending or receiving video to and from other applications.

Interface

It only took a little while to adapt to the CoGe world, and what initially seemed quirky, now makes some sense. The interface elements are easily moved, re-arranged and intelligently grouped together using what CoGe calls ‘aligners’ to “arrange other windows together into manageable organizational ‘buckets’”. It might look a little ravetastic, but it makes for easy navigation and visual feedback while performing, and the sequencer action is great.

Overall?

A welcome addition to today’s VJ software library, it’ll be interesting to see if CoGe manages to continue developing in some interesting directions, given what is being covered elsewhere.

Requirements:

$US99 (custom + educational pricing also available)
A Mac computer with 10.6.7/10.7 or later with a dual-core CPU and at least 1 GB of Ram.

**

Interview with Tamas Nagy, creator of CoGe VJ Software

Given there’s quite a range of existing VJ software – what inspired you to build CoGe?
It’s a kind of funny story I saw a first vj gig in 2001 in a music festival, and I fell in love with that thing. Never thought about being a vj, I made music before, so I’m from audio land. Then, when I got my first Mac in 2006, and saw Quartz Composer and saw how Quartonian works, I just think I can do something funny_ – never thought about to make a commercial application, haha – with a kind of sync with the music, so just tried it. It was the early version of CoGe, called LovQC, haha You can find some test videos made with it on Youtube.

Then I spent more time on the software, added lots of new features, and with 2 friends we just created a VJ team Luma Beamerz and CoGe was born. Anyway, the first version of the app was a 50mb QC composition with just an interface, then I started to learn Cocoa, Obj-C, OpenGL and other stuffs - Vade helped me a lot with the GL stuff, so CoGe now is a “real” application.

Anyway, I never used any other VJ softwares, I just created my own for my own wishes: triggering different points of movie on beat, sequencing still images, etc.

So, I think the big difference between applications is the workflow, so it depends on how you, the user think about creating things. All VJ software has a bunch of same features, triggering files, change speed, colors, etc., the big difference is the workflow, so I think an artist will choose software which works like his/her workflow. For an other example, modularity is a great thing, but a lots of users happy with built-in features in apps and never thought about it can be different.

It’s integrated into your app quite a lot – but what attracts you to Quartz Composer?
The great thing with QC is very easy to learn the basics and use for non-programers too, you shouldn’t be a coder to do a simple image rotation for example. On a developer side, the system integration – using QC stuff inside an application is easy – is a very important thing in my opinion.

It also have a lots plugins, and great media handlers, so a lots of things is possible with QC – basically, CoGe just connects QC stuffs under the hood, nothing magic.

What impact does Syphon have on how developers might approach VJ software today?
I think Syphon has a lots of potencial and its a very great stuff – connecting different sources into other applications is really opens some doors, just think about “sending” images from Max and Processing, and you can mix them in CoGe in a very simple way. That couldn’t be possible before Syphon.

Do you have opinions about whether VJ software should provide more advanced audio controls? And sequencing controls? Or is it better to sync VJ software to something like ableton?

I really like sequencing, using clips and stills in sequencing can provide really good things. With audio controls you can have some fun, but the really good choice is syncing with an audio host if you would like to make real AV things.

What are the challenges of making a good performance interface?
It depends on your workflow and what you wanna do in the performance. I recently just using 3 layers with a lots of media presets and some simple effects. If you using a lots of things the new Aligner stuff helps you to make smaller groups on the screen, I think its a very important feature.

What are you happy about in CoGe today?
CoGe 1.1 release makes me happy, i got a lots of positive feedback on it, and saw some really nice things created with CoGe. Also happy because i have a lots of ideas for the future

Thanks Tamas!

Reasons you might find yourself wanting to read this very long but very awesome Raquel Meyers interview:

- Because you love 8bit graphics and people who push them to their limits

- Because Raquel makes rad stuff ( eg her recent DVD of ‘fighting washing machines and killer lego ducks’, full of videoclips, remixes and collaborations with chiptune musicians and pixel pushers – Useless Yet Crucial).

- Because you want to find out about her ascii storytelling experiments with the C64 shredding musician Goto80.

- Because you love reading about how artists wrestle with their processes.

- Because you need a crazy and wonderful collection of visual links in your day.

Who knows, but I hope you enjoy these responses as much as I did. Thanks Raquel~!

- What’s inspiring you these days?

At the moment I am experimenting with storytelling and text-based graphics like Ascii, Ansi, Petscii and Teletext with Goto80. I’ve changed both the tools and the purpose of what I’m doing during the past months. I guess what I’m doing now is formally similar to text adventures, cartoons, silent movies, text art, demos…

I’ve been mostly inspired by animations and short movies from the 20th century, like “Little island”(1958) by Richard Williams or “Cowboys”(1991) by Phil Mulloy; and also, children’s books. Because of the brutal style of the “Simple storytelling”, the combination of a drawing plus a short phrase who builds a full dream up. This one makes me think about 2 frames animation, and how something simple it become even more brutal, especially working with the C64.

In the case of the short movies, the animation comes before the music, so the video is not the slave of the music (music video style). Sound effects increase the tension and the verve of the animation, and could be use in a shorter way like an interlude, or something longer. But the main thing is the story behind it, whit out it you cannot go further.

A cinematic new age terror is coming!. It operates in text mode, only using characters of the Commodore 64 and Amiga. This applies both to the graphics and the music.

[[ EDIT: Terror is now live - witness “2SLEEP1”, a "66-minute playlist of audiovisual performances in text mode, designed to make you fall asleep. Press play, go fullscreen and lie down. Made by Raquel Meyers and Goto80." screenshots below:]]

- What hardware and software do you use to create your animations?

I use several computers. A C64 with Letter Noperator and DigiPaint. An Amiga 1200 with DPIV, Brilliance, Prism and also an Amiga 600 provided by Archeopterix. A PC and Mac, with Flash, Photoshop, video editors and the (unreleased) petsciibrush software made by Linde. Soon I will add a Teletext device.

I’m not a gear freak. I don’t really care about the tools. I used to work primarily with Flash and Photoshop, which was a pain in the ass for the things I was doing. But I still liked it. Now I use old things (Amiga and C64), and that’s also quite painful sometimes. So to answer the question – I blend old and new technologies. It doubles the pain!

I am not a purist, I am a blender.

- How much of your creative process is defined by the limitations of such technologies?

I prefer to talk about possibilities instead of limitations. I think the technology is not the limited one, is the human behind it. It doesn’t matter how old or new the technology is, there is always something new to discover and learn. It’s not a such a big thing to use old technology, it doesn’t make everything more special, different or better. In my case, I use it because I like it.

But the things I do in Flash are different from what I do on C64. So the process is different. But I don’t really like to think too much about those things.

- Is there some cut-off line for retro computer graphics, where they are too new for you to use? What is it about 8-bit that manages to sustain appeal for you?

At least not for me, I’m not interested in the retro version of 8-bits, so I don’t think about if something is too new to use or not.

I remember playing pong with my brother in the TV console, meet my friends at ‘ la sala de máquinas’  and how I had stuck in my head every night before going to sleep the Tetris song. I grow up with arcade games and graphic adventures but, it wasn’t until 21 century when I discover a C64 music archive on Internet, and all these memories becomes something else because of the music.

It wasn’t a revival, it was something else, the imaginary frame in my head that before was a picture now become pixels looking for to be animated.

I don’t really know, but I think what keeps my interested in 8-bit is the brutalism. Big blocky objects, raw animation techniques, few frames, cuts, etc. I think it’s better if the animation method is brutal, because then it contains so much more than with some detailed video where there’s less room to think on your own.

- What do you find interesting about making live visuals versus production work?

A Live Performance is always open to improvisation and mistakes, meanwhile production work is always under control in the time line. You can rehearse or planning live visuals but at the end you don’t know what is gonna happen. Is really fun put yourself in a non control mode, keeps the spark. And since I don’t really use VJ-software to perform, it’s always a challenge.

- What work have you done on combining and compositing 8-Bit and recorded video together?

As part of Entter (2000-2007), the video clip Fantasy’ by Goto80, and ‘Dietetic Music’ by Eat Rabbit with graphics from Otro. Both of them were my earliest works in the 8-Bit, 2004 and 2005. Based on video recordings and post-production. In latest video clips, I mixed photo animations and graphics like the ‘Droidduck’ by Psilodump (2010), ‘Pink Snow’ by La belle Indifference (2010) and ‘Polybius’ by tr1c3 (2010), based on the main live cinema project ‘Polybius’ with Goto80. Also parts of the vj set contains video and graphics mixed. The reason of that is because my first background was Analog photography. I started when I was 14 years old, with black & white films and experimenting in the lab. The first thing jumping in my mind is always a static picture, a frame. My work is based in the movement or animation of such frames.

- Can you describe your AV set with musician Goto80, Polybius? ( and your aims behind it?)

Polybius …. the idea came from a post I read in my brother’s blog in 2007. The post was about an urban myth about an arcade game from the 1980s (Polybius) that created a sensory and cognitive deprivation in its users. So I started to talked with Goto80 about it and how much I would like to do something with it and with him.  The basic idea was explode the links between fiction and reality by encouraging a loss of senses. But it was not until 2009 when the french collectif ‘Homemade’ invited me for a 2 weeks residence at Le maki (Angoulême, France) when the Polybius experience become something else tahn talks. I developed there a first 20 min version, using a ‘cute’ character like a rabbit to hide my really epileptic and apophenic purpose, and Goto80 was working in the audio online from Sweden. The project was officially presented at the Cimatics festival the same year.

In the beginning of the 2010 we develop together in Berlin the second version who combines line vector aesthetics with video manipulation and 8-bit technology to induce feelings of apophenia, amnesia and panic. The Polybius experience – invented and created by us in the form of a white rabbit with a sectarian-politonic-track to be stuck in your head.

[[ Tangent alert! See also: previous 'C64 Shredding interview with GOTO80', and 'Cappadocia Skies' - a clip I'd made about a hot air balloon ride, with music by one of GOTO80's aliases, Extra Boy. ]]

- What’ve been the challenges of developing that, and what has worked or not, when performed live?

One of the biggest challenges was working in the distance via Spain-Berlin-Sweden thought Internet. Because we build the project together from the beginning and sometimes was really difficult to define and create the content without being in the same place. When we presented the project at Cimatics, we realized we need to meet physically to develop a second version and special place to performed it, out of the club experience. So in the beginning of 2010 we meet in Berlin for a week to prepared the second version, because we were invited by the PlazaPlus Festival in Eindhoven NL to performed it in january. We made a special pass before for the visualberlin collective at fh.meppen (Berlin) to test the extended version of 32min and got feed-backs from the public. The third and last version is pending, who icludes the physical game and an installation. But for this we need budget and maybe a residence to develop it. It’s one of the most complicated projects I have ever done.

- To what extent are you able to adapt the visual side of that with each performance?

My set is manual. To be able to adapt to whatever happens in the live performance. Before I was only using one laptop running an aplication who host all the visual content (graphics, animations, videos …) controlling by hand with the keyboard. So the rhythm was build in the way I click on the keyboard and load the different content. Now I’m working in a new set, who consists in a C64 and an Amiga, still in process, so I used the laptop as extra support with the same technic. A video mixer is used to change the sources, but there is not so much effects involve. The thing that takes more time is making all the animations, graphics and videos. I only used my own material, and always try to made a special set for each performance.

- Have your computer / animation processes ever entered / filtered / affected your dreams in any way?

Yes it does, because I listen so many times the songs when I’m working with it and also I dream with the animations. But ‘Polybius’ was something really insane, I had one of the tracks stuck in my head, like a trance mode to my own sense deleting experience.

- At the ‘Artists-Who-Inspired-Raquel Meyers’ Award Ceremony, who gets the following awards? 

- Visual artist who most steps outside the echo chamber of contemporary styles?

Nam June Paik, the retrospective exhibition ‘The Worlds of Nam June Paik’ in 2001 at Guggenheim Museum Bilbao I saw, put him for me in this category, like the “Magnet TV”.

- Visual artist with the most exquisite and hard to understand technique? 

Poison, I know the technique, but is not enough, because even if you use the same software you cannot have the same results. As PETSCII graphician was really impress how he made ’2frames’ animations and graphics for the C64.

- Visual artist who best gets under your skin? ( transcends technique to grab your emotions ? )

Otromatic, he is my favourite 8 bit graphician. He become one of the reasons why I start to make Lo-fi graphics and animations.

- Best coherent, integrated audiovisual act?

Gangpol & mit. Really impressive performance, one of my favorites. I really enjoy the animations.

But wait, there’s more:

This is something really difficult to do because inspiration doesn’t come only from visuals. They are so many things involve in this process. Here there is some of them, older and newer inspirations:

- Visions of Frank. The dreamlike world of ‘Frank’ a comic by Jim Woodring converted in animations.

- Jan Švankmajer and his surreal animations like ‘Meat Love‘.

- Professor Balthazar, a cartoon series for children, created for television by the Croatian animator Zlatko Grgić. Watching this as a child build a surreal imagery, who come up when you become older.

- Poison, C64 graphician. The ‘Notemaker Demo II‘, all you can do just typing characters.

- Russian and Eastern Europe cartoons (like Suur Toll- Estonia), even if we don’t share the same language, I can feel the eerie atmospheres.

- Bernd and Hilla Becher and their industrial buildings photographies. The motives of my early photographies were the factories buildings from my hometown at night when I was 15 years old.

- Kohei Yoshiyuki and his soft-core voyeur’s manual.

- Stalker, film by Andrei Tarkovsky (1979). This one change something inside me in the 90s.

The Gertrude st Projection Festival

This grows nicely each year, transforming lots of shopfronts and buildings in Gertrude st for a week. Above, a nicely mapped facade by Olaf Meyer. There was apparently a pretty good opening night party of projections, which I missed due to projecting elsewhere for the Scattermusic label launch party. Below, a mapped sculptural piece by studio neighbour, Kit Webster, alongside a fancy dress store where peering into a camera projected your face onto that of a shopfront scuplture. (More projection photos).

Inherent Vice

The National Gallery of Victoria convinced some local comic artists (Pat Grant, Mandy Ord, Michael Fikaris and Simon Hanselman + more) to transfer their private studios into the the public spotlight for a few weeks. The results included a zine fair, 24 hour comic jams, tents and drum-kits set-up in the studio, drawing lessons, an Inherent Vice tumblr and a steady stream of bug-eyed kids and adults wandering through. Check the article in the Australian, or the artist interviews on the Age website.

Winterpark Exhibition of Artworks Inspired by Album

I went to this because local video artist Lucy Benson, now in Berlin, had a hypnotic piece in it - ’Gotta Sleep now’, but my camera phone couldn’t really capture her shimmery work. Below, a sculpture that nicely incorporates video and little people. Can’t figure out from the event page who actually made it though, maybe you can. Nice idea for an exhibition, and great to see the different interpretations of the tracks.

Nosaj Thing Live at Kensington

Hadn’t even heard of the warehouse venue Nosaj was playing at – Revolt – and arrived to a building crazily decked out with technical and bar infrastructure, including pyramid mapped video sculptures by Kit in the distance. Came complete with a 90s black light chill out room. The Nosaj set was great, the rest of it got a bit wonk-saturated after a while.

Audiovisual Performances

Zeal and Time Shield have been steadily honing their AV performances around town, and recently Zeal invited me to do an AV set at Bar Open in support of his threepiece Virtual Proximity (see above). I was quite happy with this set, playing with some ambient music, ocean footage and quartz patches in VDMX. Elsewhere, Sampology came down from the subtropics to do an AV show, and Naysayer and Gilsun more recently launched their new AV set. There be audiovisual things happening. (Often at Racket – first thursday of each month at Miss Libertines in the city, and Plug N Play – last Thu of each month at Kent st bar, Fitzroy. )

MÖBIUS by ENESS

MÖBIUS from ENESS on Vimeo. This ‘collaborative stop motion scuplture’ was the brain child of Benjamin Ducroz, an extension of his work with time lapse and physical sculpture – this time using lots of help from public volunteers in rearranging the pieces over and over throughout the day.

And yeah, Melbourne International Animation Festival and the 60th Melbourne International Film Festival just whipped past. Quite a few delights and surprises in there. Will bundle together a short post and some links to the films I liked in a while. This’ll have to do for now. Springtime!

End result: Lots of fun – and a new set of challenges to deal with. Spatial composition with video is getting easier and easier, and as we outgrow the novelty of seeing buildings lit up / architectural deconstruction by light, there’s such ripe terrain to explore with today’s software. And as the barriers to entry continue to lower, it’ll be the imaginative approaches that prove most successful.

[[ Oh yeah - and that video - not a manifesto for spatial video by any means, just some example snippets from a fun night with the Scattermusic Sound System.. still getting my head around how this can all work well. And there be photos too. ]]

After doing live video for 2 shows there last weekend with the Gotye band, I can add to that list:
- It is a rabbit warren under the sails.
- The salad sandwiches in the green room are very ordinary.
- The elevator under the concert stage is faulty (I was trapped there with a weary tech guy for 5 tense minutes.. )

I got roped in to do live video for Gotye’s tour for his just released Making Mirrors album, which has accompanying animations for most songs. There’s some pretty nice work amongst it – I’ll have to do a follow-up post soon with links to all the animation houses. For me, my work is mostly editing and formatting to suit the main screen and 2 vertical side screens, then while the band plays – triggering short sections of these clips to ensure the right visual moments are synchronised with the band playing live.

Despite an almost comical list of headaches – long fog delays at Melbourne airport, animations arriving at the last minute, software quirks, a compressed set-up time, hardware quirks, that elevator(!) and so on – the first shows of the tour ended up running really well. Having a crack team of musicians (and tech folk) definitely helps in that regard (including Tim Shiel aka ‘Faux Pas’ beside me onstage). Below, the band and my hard-drive covered laptop during sound / vision check at the Opera House.

And the VDMX interface spreading its wings up on the screen briefly during rehearsal.

And once again, with people.

( More Gotye gig photos )

The Graphic Arts festival

Awesome choice for tour opener – showcasing an album and animations within a festival dedicated to comics. Graphic Arts had some great highlights this year:

- Jim Woodring, the author of FRANK, did a pretty mind-expanding talk on DEATH-CAKE apparently, and fantastic inking masterclass (attended by comic-friend Gregory Mackay (Francis Bear)).

- Tekkon Kinkreet - fantastic animated film – with accompanying live soundtrack by Plaid (Warp) + Fourplay (strings) + Synergy (robotic rubber limbed percussionists). Really luscious sound, really luscious film.

- Silent Comics – a series of comic panels projected while musicians provide a soundtrack. This included sound foley artists, Captain Beefheart-esque carnival bands, Seekae, Wally from Gotye in splinter-sample mode, and probably nailing it best, Plaid. Great idea for a session.

- Scott McCloud – from ‘Understanding Comics’ (also used as a multimedia bible in explaining media and visual storytelling concepts ) did a great one hour presentation, which harnessed visual support material as effectively as you’d hope a guy like him would. Lots of interesting points, though I found myself laughing at his interface observation-  ”Why does Tom Cruise need a glove to do all that in Minority report?”. He also ended with this pretty funny reading of a scrolling comic that involved monkeys mutating into progressively crazier proportions.

- Pete Kuper – aka the guy who did Spy Vs Spy from Mad magazine.

- An assortment of Aussie comic artists doing talks and workshops – including Mandy Ord, Pat Grant and more.

Sadly Robert Crumb wasn’t part of the mix – but I was amused to learn from the Festival organiser about the communication process they had – “Yes, Robert uses email, but that involves….” –  his assistant scanning his recent emails, printing the interesting ones, highlighting the relevant bits, cutting those out and putting them in an envelope and mailing them to Robert, who replies on the back with his pen. When he’s around.

Above, Pattern Machine, the fruits of a recent fourway collaboration in a weeklong residency on Cockatoo Island ( a former prison and shipbuilding yard in Sydney Harbour), during the 2011 Underbelly Arts Festival.

By the end of the week, after much tech configuration, island sampling*, and software wrestling, we’d concocted a work in progress that was deemed seaworthy enough for 3 x 45 minute audiovisual sets during the public exhibition night. And during that day the space was filled with people wandering around the inflatable sculpture, while cocooned by a generative surround installation busy mutating captured island sounds into new species. Turns out the accumulated ferry rides, nautical rust and winter winds were worth enduring in the end, as the performance seemed to go really well, much of the pieces falling into shape on the very last evening before the event.

For myself, it was very satisfying to have an opportunity to explore video composition in a great setting, and in a more spatial way – using an external graphics card to send a different signal to 3 different projectors simultaneously, using madmapper to position and map the video from each of these, and having the luxury of returning each day to experiment with equipment that was already set-up. And it was super-satisfying to be doing that with…

These 4 People = Pattern Machine

Jean Poole: spatial video composition and live video manipulation with 3 projectors, vdmx, quartz composer and madmapper.
Dan MacKinlay + James Nichols: Quadrophonic soundscapes using field recordings, vintage synthesisers and heavily customised super collider patches. (They don’t have much vinyl, but their phd maths books weigh a tonne.. )
Sarah Harvie: inflatable sculpture, tailor designed for our space with lots of late night industrial sewing machine sweat.

(( *My Cockatoo Island photo set, Dan’s photo set, and Dan’s stereo field recordings. ))

Underbelly Artists Shout Out:

Aside from the audacious setting, part of what made the residency great was the motley collection of artists also spending time on the island, each struggling with their own peculiar set of problems to solve. And it was inspiring to see everyone’s work evolving over the week. This extensive  festival review gives a good taste of how the exhibition day unfolded, and these were some of my favourites:

Case Study - This was my pick of the bunch, 6 artists who had the aim of building a new colonial society in their allocated portion of the island. Which they built out of everything they brought in their suitcases, as well as using their suitcases themselves to build individual artist houses. There were telescopes and projected moons, ornate water features, mossy forests growing from open suitcases and test tubes, every step a new photogenic overload.

Younes Bachir and Strings Attached got the jaw-drop-spectacle medal – with their meat-suits, paint-splashy aerial choreography ( imagine a dozen people 4 storeys up dynamically moving about in space ) and flair in abundance. ( This gives a good taste of why it excited.. )

Brad Miller’s Data_shadow video installation was super-slick, an exploration of memory, technology and how lusciously you can make a database of photographs and video wander across 4 screens with motion detection cues from visitors. Biljana Jancic‘s wooden boxed shafts of light played beautifully with the smoke machines, silhouettes and the industrial space and  SWANBRERO used inflatable car sales dancers to great effect in their piece - INFLATE MY HEART WITH 1000 GUSHES OF WIND .

Above, after much hair-pulling : VDMX merrily sending out 2400 x 600 pixels across 2 screens and 1 projector, via the set-up below.

ie – 2010 Macbook Pro –> mini display to DVI convertor –> DVI cable –> Matrox Triplehead2go Digital Edition –> DVI to VGA adaptors x 3.

According to Matrox, only the Triplehead2go DP ( Display Ports in/out) edition is compatible with the 2010 Macbook Pro. I wasn’t able to get that to send a signal to projectors, using display port to VGA adaptors. The DP-VGA adaptors by themselves worked fine on the ends of other cables, but when put after the TH2GO DP box, no signal. Weird science.

Was just about to sell the older Matrox Digital Edition, which ended up incompatible with my last machine, but aaaaaanyways. THREE SCREENS OUT. And with less than 3 hours til airport-to-Sydney time, for tomorrow’s video installing on Cockatoo Island, this is a good thing. Also good – the holy software trinity of VDMX, Syphon + Madmapper all worked perfectly across the 3 screens.

Below, Madmapper stretching across screens, even as computer leads are being stolen away from it and shoved into a bag.

Have been doing some experiments recently with Troy Innocent, involving laser cut characters, everyday scenes and projection mapped video. We’re trying to figure out what works well for us, with an eye to fleshing out something some kind of developed work later. Troy has access to a laser cutter at work, and obviously the attraction there is to play with the unique levels of intricacy that a laser cutter allows with materials such as plastic and thin plywood. Taking that a step further, we thought it’d be fun to develop some simple low frame animation loops with these physical characters and record them moving about in stop motion. We’ve done some simple tests outdoors which worked well, surprisingly popping to life when played in sequence onscreen, and most recently we tried an indoor shoot, which gave another chance to test out Madmapper.

Re-Routing Video in 2011

First up, the whole routing video clips between video applications thing, enabled by Syphon, is really fantastic. For me, this means VDMX to Syphon to Madmapper to the projector. Manipulate video in your preferred real-time software, then at the end of the chain remap this video onto what Madmapper calls ‘surfaces’, creating, positioning and reshaping as many of these surfaces as you like. This makes sense and so far the addition of running Syphon + Madmapper alongside VDMX hasn’t seemed to dent the performance of VDMX at all. That might change with more complicated projection mapping – we’ll see.

Some Madmapper Observations

As seen above, the Madmapper interface is minimal and intuitive, and this helps mapping happen super quickly. For our test mapping onto some paper skyscrapers, it was a simple process of selecting which part of the video to be sent to a surface, then clickdragging the corners of the virtual surface until it the video filled the actual surface of the paper skyscraper in front of the projector. Total time to line-up video on the sides of 3 buildings? About 5 minutes. This is a very simple example, and possible with other existing software – but this software certainly makes the process a breeze. Am going to post a full review of Madmapper soon, and discuss some of it’s strengths and weaknesses for dealing with more complex scenarios. In the meantime, it’s worth noting that although it’s pitched as a solution for reconfiguring 2D imagery onto 3D shapes – Madmapper’s ease of use also makes it a very attractive option for just even compositing imagery within 2D environments. From the close-up below it should be evident how straight forward it is to select portions of video, and quickly composite this into desired shapes.  More laters!

Now that I’ve finished marking all of the respective assignments from classes at RMIT and Swinburne, am looking forward to biting properly into a few long neglected creative projects / overloaded bookshelves / learning curves etc. And that overdue skynoise overhaul so it better reflects the 2011 web and myself. Next up though, a video island adventure in Sydney harbour.

As part of the 2011 Underbelly Arts festival, I will be creating video projections to accompany long time audio wizard collaborator Dan MacKinlay, James ‘Dubtable’ Nichols ( that’s him in the photo), and Sarah Harvie whose specialty is inflatable sculptures! We’ll be doing this as ‘Pattern Machine’ in the space photographed above, which is one of the ancient ship building rooms at Cockatoo Island in Sydney Harbour. Pattern Machine has a tumblr and a twitter account, where we’ll be documenting our preparations and experiments, and also has a festival page, alongside all the other festival artists.

This year’s festival was pitched as an island residency for developing some works in progress. Looks like it’ll be quite an interesting collection of projects, with many artists practicing / building / tinkering on site in public view, followed by a performance  and exhibition day on July 16th, showcasing what has been explored during the residency.

For our part, the work in progress will mean explorations into location sampling and weird algorithimic audio with Super-Collider (eg “New No New Age Advanced Ambient Markov Music Machine” and attempts to intertwine inflatable tendrils around the machine relic within our inherited room. Pixel-wise – I’m hoping to do some projection mapping experiments onto that machine relic, re-animating it as it were, in real-time response to the sounds happening, and similarly try to create some kind of responsive visual designs on the inflatable structures. Aside from that, I’ll also be testing out a triple screen external graphics card ( matrox triple head 2 go ) to experiment with simultaneously projecting various scenes onto the wall behind the machine and inflatable sculpture. For the scenes projected on the wall, will be playing with some simple responsive graphics and some filmed / composed sequences of various events / stop motion / locations from around the island. My tools of choice : VDMX + Quartz Composer, with Madmapper for the projection mapping (Madmapper review coming soon).

Below, James and The Machine, moustache not to scale:

June 5th, 2011.

Due to a weird Sydney Opera House ticket mix up – I ended up at YO GABBA GABBA live this weekend – instead of the planned pilgrimage to Chris Cunningham’s triple screen live cinema assault. Priceless. Etc etc

More laters…

Earlier Quartz Wrestling delivered a splitscreen effect which took any clip playing in VDMX, and replicated it 9 times to provide something like a video-wall. It also customised a few of the Quartz based VDMX transitions, and identified a new range of problems when creating in Quartz. After some more noodling, and helpful tips from both Dan Winckler and Joris de Jong (hybridvisuals.nl), I managed to solve some of these problems, and custom build an effect I’d wanted (attached below).

1. How to select a custom anchor point in Quartz, for rotating an image or video?
The idea here was to be able to generate rotations from a corner, or from create arcs of rotation, with the rotation centre being far below the image. None of the various Quartz patches I could find seemed to have an ability to adjust an anchor point.

The solution? “Reposition the clip so what you’d like to be the anchor point is in the center of the screen, then place it inside a 3D transformation patch, and use the rotation Z property of that patch to rotate it.” (via Joris)

Understanding three dimensional space is best done when you have at least a slithery grasp of 2D first, and it took me a while to figure out why the width of a quartz patch always seemed to fill the screen when it had a value of 2.

Welcome to the Quartz Composer coordinate system:

The width of a Quartz Screen is always 2, because Quartz treats the centre as 0, and gives the left and right borders of the screen the coordinates of  –1.0 and +1.0. The coordinates of the top and bottom borders depend on the screen aspect ratio (AR). In the case of a 4:3 aspect ratio, the values at the borders are +1.0 / AR = +0.75 and –1.0 / AR = –0.75. ( From the Quartz Guide written by Apple’s basement dwelling engineers. See also: Quartz Composer User Guide (PDF))

Ok. So rotating a video and changing the anchor point.

The 3D transform patch that Joris suggested placing the clip inside, is a macro patch (which in Quartz have square borders, unlike the rounded corners of most patches). Macro patches can be created as usual in the Quartz editor window, but can host subpatches within them (after double clicking them. Clicking ‘edit parent’ takes the user back up the hierarchy to the editor window containing the macro patch). Below, the anchor patch with the 3D transformation macro patch:

Some notes from that screenshot – the viewer window is showing the combined result of 3 layers – each of which is contained within the macro patch. One of those is an image of red manga speed lines (set as the top layer, with blend mode set to add), and the others are a VDMX input, and a mask image to frame the VDMX input. As you can see, the centre of the image is black – because there is no VDMX input at the moment. Creating quartz patches for VDMX seems to involve a weird workflow of using say a webcam ‘video input’ while building a patch, and then swapping over the ‘VDMX video input’ when saving, then testing to see how it works in VDMX, then going back to Quartz and reconnecting the webcam and making adjustments, before reattaching the VDMX input and saving again.

Previously I’d only been working with Billboards in Quartz, which helped avoid 3D space – billboards ’render a quad positioned with 2 coordinates and which always faces the viewer’. I’d been routing clips and effects in patches to a billboard, which generally meant  the viewer was filled with my video. So to create this anchor patch, I put a Billboard inside the 3D transform patch and set about trying to adjust the subpatch. This didn’t work, and Joris explained why:

“Billboards don’t work in 3d space, so you need to work with sprites. Sprites are basically the same as a billboard, but you need to do some of the height and width calculation yourself. I’ve attached an example of how to offset the anchor point, and how to size the sprite correctly based on different input images.”

The example included the image dimensions patch, which “gives you access to info about your current rendering environment (resolution in pixels and QC measures). You can then use the Math patch to further process this info to fit your needs. This way, when your output changes from 4×3 to 16×9 for instance, your patch will update accordingly. The QC coordination system takes a bit of getting used to, but using the RDD patch to keep things dynamic is a good practice.”

Rotations applied to the 3D macro patch, transform all of the sprites inside it, so I figured I’d try and add a few sprites and create a layered result that could be rotated at will within VDMX. Clicking on a sprite patch reveals in the settings, blend modes of ‘reveal’, ‘add’ and ‘over’. And I figured PNG images with transparency, or videos with alpha channels would allow masking and compositing within Quartz. After a bunch more trial and error, some blending tips via Dan came in handy:

“PNGs with transparency: alpha channels aren’t respected when the Blend Mode of Billboards and Sprites is set to ‘Replace.’ Choose ‘Over’ or ‘Add’ and you’ll see your black backgrounds disappear.

Blending in general: The drawing order of renderers (layers) is determined by the little 1,2,3,n… dropdown box at the upper right corner of blue Renderer patches. Make sure your Clear patch is set to 1 (first/bottom).

Other blend modes: if you type ‘blend’ in the Library search box, you’ll see all the Photoshop-esque blend modes. Again, it’s not like a video mixer — play with the patching order (the Image and Background Image inputs) some. Better yet, make your compositions into plugins and do your mixing/blending in VDMX or another QC host app!”

And eventually, I ended up with this custom masked anchor rotation effect for VDMX – which composites whatever video VDMX is playing, underneath the speed lines, masked by a circle, into the centre of the screen and allows real-time control rotation. Which is really satisfying – custom tuning an effect for a particular purpose. I’ve included the patch below – click on the image sources to replace them with your own, play around with the 3D transform values to create your own rotation variants, and for any parameters you’d wish to access inside VDMX, publish the relevant inputs and splitters.

Download the patch (with inbuilt masks. 2.3 mb) here to play in quartz, and here to use in VDMX ( place it in your QCFX folder and it should show up).

Thanks again to Joris and Dan, who provided insights at just the right times!

The downturn in advertising revenue was blamed variously on the GFC, a downturn in clubbing and an increasing shift by promoters to the internet. It was often weird writing a very net focussed column for a weekly print mag, but never more so than this week. And it has certainly been an eventful decade for a column about media technologies. ]]]

</TECHNOSCAPE>

1998: Remember when that new search engine came out, promising better results with it’s algorithmic interrogation of linked relationships online? That was Google, in its PRE-VERB DAYS. Paypal launched that year too.

1999:     Napster. RSS. SETI@Home

2000:    Blogger.

2001:     Wikipedia. Creative Commons. Bit Torrent. The first ipod arrived.

2003:     Myspace (remember that?). Skype. Second Life. the ITunes store. 4chan. Pirate Bay. Delicious. WordPress.

2004:     Facebook (Yep, it has only been that long). World of Warcraft. Flickr

2005:     Youtube. Google Earth.

2006:     Twitter, and a little site called Wikileaks.

2007:     Tumblr. The first iPhone arrived.

2009:     Kickstarter. FourSquare.

2010:     Instagram. Quora.

While I’d like to be able to say I was writing Technoscape since BEFORE GOOGLE EXISTED, I don’t think that was quite the case. 3D World on the other hand, goes back further, splashing it’s first club culture ink in 1989, before Facebook, before MySpace, before Youtube, before Google, BEFORE THE FIRST WEB BROWSER in 1993. Imagine – a time before the web even existed, and there were so many people dancing in dusty warehouses, that they needed their own magazine. In a time BEFORE STATUS UPDATES.

That loose timeline also shows we have no clue about what yet-to-be-invented internet services we’ll likely heavily rely on in only a few years time, and serves as validation for the ‘future proofing’ strategy of installing high bandwidth fibre optic under the NBN scheme. Less validating? Australia’s proposed net filter.

In 2001 some new fledgling software called Ableton Live was born in Berlin. You might’ve been using Photoshop 6.0, Final Cut Pro 3, After Effects 5.0, Cubase VST32 5.1, Pro Tools 5.0, Rebirth(!), Arkaos, VDMX and so on. And today, are we really much better, faster, stronger? A few quick keywords show how our tools and processes and possibilities have evolved: kinect hacks / serato bridge / maxforlive / processing / vvvv / syphon recorder / madmapper / quartz composer / touchOSC. More sophisticated, yepz, but arguably not much different.

3DWorld, it has been a fucking pleasure. Stay in touch via skynoise.net or twitter. I can’t believe this is the very last Technoscape sentence, and it is now exactly 400 words.

Measured in net years, Wacom’s Intuos 4 graphics tablet is already a sleek, sleepy dinosaur, having been released in 2009. On the other hand, given today’s infatuation with touchscreen tablets and their gestural capabilities, it’s worth reinvestigating what benefits a traditional graphics tablet can offer.

Straight Up
Touchscreen tablets are great media browsing devices and provide lovely accessible software interfaces. No argument there. But when it comes to fine, detailed control, touchscreen tablets can only manage the tiniest fraction of a graphics tablet’s input sensitivity.

But wait – your friend has paid money to a kickstarter project which will be sending them a newly designed conductive texta pen for use on their ipad. Or they’re getting a Bamboo stylus for the iPad. That’s awesome, but it’s still effectively only fingerpainting resolution. Fun to apply direct to the screen (and much cheaper than Wacom’s direct to screen Cintiq Interactive Pen Displays), but still very limited when it comes to precision and detail.

And when it comes to precisions, the Intuos 4 has the highest sensitivity of any graphics tablet available today (5080 lpi resolution, and 2048 levels of pressure). It also comes with a precision pen (60 degrees of detetctable tilt), customisable shortcut buttons and a radial menu system (think ipod) with LED labels (visible in the photo above). So when you’re ready to shift from fingerpainting little animated flipbooks on your touchscreen tablet, to creating highly detailed worlds, the graphics tablet is your new best friend.

Special Features
I’ve owned an Intuos 2 in the past and was skeptical there’d be much difference, but a range of carefully implemented design changes make the Intuos 4 noticably better to use. The physical shape has been slightly adjusted to feel more comfortable, the USB cable can be attached from 2 locations to suit left or right handers (there’s also a wireless Intuos option), the pen has been made more ergonomic (it actually feels better), and the express buttons and a touch ring have been nicely integrated beside the drawing surface, for easy access to whichever software menu items you set them up for (on a global or application by application basis).

What really brings it all together though for this version of the tablet though, is the addition of LED labels that accompany the express keys and touch ring, as these lit up labels help enable easy navigation of complex customisations and menu layers, which makes it possible  to avoid your keyboard for long periods of time when manipulating software.

The four mode Touch Ring for example, can be used for accurate and intuitive control of actions such as scrolling, zooming, changing brush size, rotating the canvas, flipping through layers, and more. Click the ring to select a mode such as brush size (which is LED displayed), then slide around the ring controller to change the actual size of the brush. Use one hand to modify tool properties, while the other continues on the tablet with the pen. It’s an effective combination, and can be customised to suit whatever combination of onscreen tools and menu items you need.

Whether seeking an alternative to the mouse or just seeking to avoid RSI, the precision and comfort of the Intuos 4, along with its newly lit-up custom shortcuts, make it an attractive input device for those wishing to manipulate their graphics, animation, audio or video software. Well worth a look!

Requirements for Intuos 4 tablet (USB Version):
Windows: Microsoft Windows XP with Service Pack 2 or 3 or Windows Vista
Macintosh: Mac OS X 10.4.8+
Cashola: The Intuos 4 Medium is $449 from buywacom.com.au

In Sydney

Chris Cunningham brings his triple screen live audiovisual performance to Sydney Opera house as part of the Vivid festival. To what extent his performance is live has already been debated, but the lure of this director’s back catalogue and the teasers glimpsed online mean that expectations are like that astronaut suited guy in the hot air balloon at the edge of the atmosphere. Who knows?

In Montreal

Already a fond pilgrimage for those wanting to worship at the altar of techno, drone, glitch and bass – this year’s Mutek festival promises a stellar collection of audiovisual related events:

- Mexican ambient-techno producer Murcof – teamed with Anti-VJ – co-performing a ‘three dimensional cosmos’ across 3 screens.
- Finland’s Mika Vanio ( ex – Pan Sonic ), debuting a new live audiovisual concert.
- UK’s Sculpture play their homemade zoetropic discs – “slabs of vinyl illustrated with otherworldly patterns that they play at various speeds and then film to create simultaneous cycles of analogue sound and looping, mind-melting imagery”.
- Women with Kitchen Appliances have a name that demands festival goers will at least wander in to check out what they might be doing.

Oh and ‘just music’? Amon Tobin debuts his new ‘live performance featuring an enormous stage set-up that promises otherworldly experiences’. And there’s Gold Panda, Mode Selektor, Siriusmo, Adam X, Plastikman, Fourtet improvising with UK jazzy house fusionists Rocketnumbernine, and so on. And a series of workshops including one by the makers of Madmapper, the much anticipated projection mapping software due for release shortly, and panel discussions about Augmented Reality as a creative playground. Mutek. Montreal. Daayum.

In Melbourne

Okay, so not strictly audiovisual, but visionaries like Sun Ra see with more than their eyes, and either these next few words will mean a lot to you, or they won’t, but the Sun Ra Arkestra is.playing.in.Melbourne. Also known as The Solar Myth Arkestra, His Cosmic Discipline Arkestra, The Blue Universe Arkestra and The Jet Set Arkestra etc. They’ve been kicking for six decades now, and although no longer fronted by afro cosmonaut and renowned composer Sun Ra (who passed away in 1993), this performance represents the Australian premiere and a chance to experience their unique and exhilarating, free-floating explorations of ‘tone-science’. At the Forum theatre as part of the Jazz festival, Space is the place, ladies and gentlemen.

And Then:
More babysteps with Quartz. I set about trying to make a split-screen effect quartz effect which would replicate any video 9 times within the same screen. (This was to fulfil a request for someone who wanted me to alternate between fullscreen and 9 videos on a video wall made up of 9 screens, where a hardware matrix switcher would usually be used, but couldn’t be on this for some reason.

Over at the quartz section of Vidvox forums, Vade answered my query with:

“Can’t you use 9 billboards and make them 1/3rd the size of the screen and position them accordingly?”
and even offered up an example file.. http://vade.info/9.qtz

Bingo! Coming from traditional video editing land, I hadn’t even been able to grasp that creating a new billboard effectively creates a new image that can be composited. So then, loaded with new brain juice, I set about transforming the patch so it would work within VDMX.

There were a few barriers:

1- For parameters within a Quartz patch to show up as visible, adjustible parameters within VDMX, a process called ‘adding a published input’ needs to be done. The above quartz patch was set-up to take a webcam input and replicate that 9 times. This needed to be changed to a ‘published image input’, which would mean when loaded as a VDMX effect, it would take any movie playing in that VDMX layer, and apply the replication and compostion effect to it. The adding a published input process is documented on the VDMX wiki.

2 - Although the webcam split evenly into 9 screens, when taken into VDMX the 9 clips had plenty of overlaps. This became a tedious process of working in quartz with webcam version, dimension mode on auto-height, adjusting the input parameters for each billboard a certain amount, then adding the VDMX input back in, importing to VDMX and testing what it looked like now. (If anyone has any advice on making composition arrangement in Quartz less painful, love to hear about it! ). Eventually, I managed to make a VDMX effect that can quickly turn any 16:9 clip into the desired 9×16:9 clips, in a 16:9 screen.

And here it is: http://www.skynoise.net/quartz/9screens16_9.qtz
( Dump that into your Quartz FX folder of VDMX and it should show up as an effect for any layer ).

Moving Along:

The transitions used in VDMX are available as quartz files to play with in the VDMX composition mode folder. Open them in Quartz, saving under a new name and playing around with them makes it fairly trivial to make new transitions. If you add something else useful from Quartz to them, or wish to have real-time access to any of the parameters of the transitions ( eg opacity / angle, etc ), these parameters can be published as inputs using the above methods, and then they show up as VDMX friendly parameters that can be mouse dragged or audio synced etc.

A Next Batch of Quartz Problems:

Planning to work through these over time, but figured I’d list them here, in case any pointers fly in…

- Is it possible to select an anchor point for rotating a clip in QC? (So that for example, a point well below the screen could be used as the centre of a circle that passed in an arc across the top of the screen.) I found the anchor.qtz example patch which seems more related to anchor points in HTML pages, but maybe there’s a way of using it?  And the ‘Image Transform’ effect has a rotation parameter, but no adjustible anchor point?)

- How can a slider transition be adjusted so that both clips move in sync, not just one sliding in over the other?

- Related to the slider sync – how to do seamless tiling? Am guessing once the sliding is figured out, use mirrored images at the edge of an image, to enable a seamless horizontal or vertical scrolling loop?

- Is it possible to include video masks on a layer, not just image still masks? Is it possible to use masks that effectively create blank / alpha channel space around pixels in a layer?

- Some day : separate photoshop layers with adjustible depth of field blur in sync with z depth?

- Some day II : sliders that create exponentially smaller (replicated) slices of a video.

- Some day III : more sliders, that create puzzle slider type FX, but with adjustible zooming and scaling on the pieces – so they stay the same puzzle size, but are more or less zoomed in.

So if you’ve got any advice, suggested reading / plug-ins etc about any of the above – please get in touch.

MODUL8 + Mapping Festival, Geneva (19-29 May, 2011)

As well as a thematic focus on video projections mapped onto non-screen surfaces and shapes, this year’s festival will see the official release of MadMapper, a new video mapping software created by GarageCUBE (Modul8) and 1024_architecture. There are plenty of impressive demonstrations of Madmapper on the 1024 blog, and it lokos like the final release will include ‘native communication with Modul8 and QC, unlimited mapped surfaces, masking and drawing, and much more’. Festival bonus points – Melbourne’s Kit Webster was chosen as one of the few selected from International applicants to show an installation. See more at http://kitwebster.com.au.

VDMX Beta 8 + LPM, Rome (19-22 May, 2011)

Meanwhile, another gaggle of pixel-heads converge in Rome for the annual Live Performer’s meeting. Notable this year will be the rare fleshy appearance of the VDMX coders from vidvox.net, crawling out of their bunkers briefly to describe some of the benefits of their new BETA 8 ( such as built in Syphon support, and a whole range of underlying improvements). Also of note – the launch of a book on Quartz Composer, written by VJ Shakinda and Surya Buchwald (Aka Momo the Monster).

Audiovisual Mayhem With Maxforlive

Melbourne audiovisualist, Zealousy, has been developing a series of interesting looking Max For Live patches, which he calls Vizzable VJ Plugins, and he recently joined forces with Fabrizio Poce who makes the V-Module suite, merging their projects “to provide a comprehensive suite of video, effects and real-time graphics tools for Live,” and, “If you’d like to become involved in testing and developing these plugins please join the discussion at http://groups.google.com/group/jitterinmax4live-”

But What Does It All Mean?

Berlin’s clubtransmediale.de held a symposium in February, with a spotlight on the practice of media-based audio/visual live performance considering what ‘liveness’ entails in the age of media technology. Luckily for those elsewhere, a nice long list of provocative people, ideas, links, transcripts, and videos has been generously compiled by someone in attendance – the UK’s Toby *spark, who is both a live cinema pioneer and currently framing his Phd on the topic. If interested in live video, plenty to chew on here: http://tobyz.net/tobyzstuff/diary/

Teeming Void + Transmateriality

Also well worth a read, the latest piece by Mitchell Whitelaw (resident Canberra theorist and practitioner in generative art, data visualisation, physical computing, digital materiality etc.), which explores our fascination with glowing rectangles in today’s media ecology, and how processes and techniques such as projection mapping have been offering some ways to explore digital art beyond the screen. Great project examples and plenty to think about.

Above: Batgirl on a Bangkok rooftop, mixed with Tasmanian coastal footage and some quartz gradients and transitions in VDMX. This is a still from a series of recent video experiments that have involved recording video clips of live mixing with Syphon, then immediately bringing those clips into the mixing process, and repeating. And repeating. (Hats off to Vade and Bangnoise for enabling this workflow!) Will upload some sort of crash edit of video fragments to vimeo when time permits.

Below: More stills from this process, uploaded as a batch to Flickr.

Girltalk, AudioMulching
It’s true – live performance software aside from Ableton Live, does exist. The makers of Melbourne based Audiomulch have been getting their blog on lately, posting news and tutorials about various Audiomulch features, as well as posting a series of video interviews with mash-up artist Girltalk, who discusses some of his workflow and techniques. Developer Ross Bencina also recently published some interesting thoughts about the state of live streaming. Also on the Girl Talk tip – check out some of the luscious screen and projection design for his recent tour (via tour VJ, David Lublin, one of the developers of VDMX.), and download his recent album for free ( interestingly for an album based on the unauthorised use of samples from others, it’s available with a Creative Commons licence.. )

69 Love Songs, Illustrated
Attempting to illustrate all of the Magnetic Fields’ 69 Love Songs, is: ‘How Fucking Romantic‘. Found via comic author Scott McCloud, who recently helped contribute to Google’s Will Eisner tribute. (See Mar 6th Will-modified logo here: google.com/logos)

Herzog’s 3D Cave flick steps closer to release.
And who better than New Scientist to preview Herzog’s descent into the Chauvet cave, capturing cave paintings that are almost 35,000 years old. As always, Herzog manages to uncover hidden eccentrics on his travels, including this time – a flute playing archaeologist dressed in animal furs and a former parfumier, ‘sniffing the hillside for the whiff of an undiscovered cave’.

UPDATE : The Syphon app (mentioned below) routes video losslessly between video software using the graphics card, and now the Syphon recorder can record the output of these apps. Send feedback, flowers to Vade and Bangnoise.

Free screen capture options:
PC – Camstudio /, Mac – Capture me. And Vade’s free screen capture tool (mac) allows you to ‘capture your entire desktop, or a portion of it, to an image and further process it within Quartz Composer or supported host applications. This can be used to sample other application’s windows as a source input for post processing, texture mapping on to models, etc’. Which means in practice, VJs can use it to grab screen content (eg games, DVDs, web, cams, other software output – whatever you can see on the screen ), and then process this feed in VDMX however they like.

More Broadcasty Tailored Options
Snapz Pro (mac:$69) and Screenflow (mac$99) offer simultaneous camera, microphone and audio capture as well as screencast options such as highlighting the mouse, key commands or certain windows.GrabberRaster (mac) allows sampling of any portion of the Mac screen for use as input for Quartz Composer, or as virtual camera input for QuickTime Pro, Skype, CamCamX or other QuickTime-compatible webcam software. $99 bundled with a bunch of other cam FX.

Sampling VDMX with Syphon and BoinxTV

Boinx TV is a custom video application for live mixing and recording of presentations / tutorials / news stories etc. Syphon (mac) not only samples the screen – but allows real-time sharing of full frame rate video or stills, with other applications. Future versions of Syphon are likely to have built in recording options. For now though, combining Syphon with Boinx, Berlin’s @fALk_g and Leon von Tippelskirch, one of the Boinx developers, came up with an effective way for recording VDMX – and it works in HD!

This could be a great workflow breakthrough for people creating motion graphics or doing compositing or visual effects. Being able to easily improvise with VJ software and midi controllers will never replace some of the detailed micro-level animation and editing done in dedicated editing and compositing software, but it should make it much easier and more fun to create certain kinds of clips for layering / visual effects / remixing and re-use etc. And who knows what kinds of new workflows (playflows?) and processes might follow from there..

Instructions via @fALk_g:

- Install Syphon and Quartz Syphon Plugins (free), and BoinxTV Home Edition ($49) ( see Boinx review)
- Activate Syphon Output in VDMX (beta 8 via vidvox.net)
- Load custom quartz project into BOINX, that can tap into the Syphon source. (download file 82k)
- Hit record. The custom project records with the Apple Intermediate codec (for best balance of quality and performance), but can be adjusted within settings. For best quality and framerate, Falk recommends playing clips from one drive and recording to a separate drive.

Bonus speed gain: Because Syphon is feeding video to Boinx, you can deactivate VDMX Output and use the Boinx 2nd monitor output to view your VDMX mixing – it actually seems to improve performance / frame rate.

The above instructions and file worked fine for me, but I haven’t really tested how far it can be pushed (eg lots of layers and CPU heavy FX in VDMX, while recording HD to a drive). Fun times ahead.

And finally on the screen capture front – a shout out to 9-eyes.com – an incredible collection of unusual moments captured by Google Street View, photographing every road in the world – For The Surrealist Win!

Vat Ist?
Video mixing software (mac only) set up for easy, intuitive real-time control over live cameras, recorded clips, slides, infographics, text and capable of streaming live as it happens.

The BoinxTV Interface
There’s almost nothing within BoinxTV that can’t be done with VJ software – with a lot of customisation and editing. The value of BoinxTV is that a lot of functions very useful for live video presentations, have been compiled thoughtfully into an easy to use interface. New features are selected easily and added as layers to the central interface component. Editing and refining for each layer is done in the left side panel, and the right panel shows the master output. Selecting between and triggering layers and events ( eg switching to a new camera, adding an infographic, doing a cross fade to a net based camera etc ) can be done onscreen, with user keyboard shortcuts, a midi controller or via an iPhone app. It’s a fast and efficient system and would greatly simplify the workflow for making video presentations, tutorials, podcasts or framing live event broadcasts.

Features
Aside from the basics (implemented well) such as video switching, camera switching, scaling and adjusting image quality, inserting graphics and text, Boinx also enables the use of high-grade AXIS network cameras, multiple cameras, the easy inclusion of video skype calls from others, integration of RSS feeds for ticker tape scrolls, as well as twitter feeds (allowing comments from viewers), drawing on screen and decent chroma keying (for an easy newsdesk feel or for the use of virtual backdrops). Users can also create their own custom layers using Apple’s Quartz Composer software.

One of it’s best features is the capacity to bundle all of this up and send all the final master out live online – although this isn’t as simple to access as the rest of the features and will hopefully get integrated into a future version. To stream live requires installation of further software ((either GrabberRaster($) or Camtwist (free)), which makes the Boinx signal compatible for the likes of streaming software such as quicktime broadcaster, ustream, stickam and justin.tv.

Bonus points: Using Syphon, Boinx can record real-time HD output from VJ software running on the same laptop (via @fALk_g in Berlin)

Requirements
Intel Multicore CPU based Mac with discrete graphics (MacBook Pro’s starting late 2007), Mac OS X Leopard (10.5.8) or later. QT 7.66 or later. Webcam or professional video camera with Firewire, SDI or HDMI.
And $49 for Home version, $499 for Full version. (See : http://www.boinx.com/boinxtv/home/compare)

Verdict:
The Home version will probably suit most people’s needs, and is a remarkably featured piece of software, which can greatly simplify the production of video presentations, video podcasts, screencasts, and tutorials. It’s also a very easy and convenient way to add a layer of professional depth to any live net broadcasts.

Scattermusic East Coast Tour Highlights from jeanpoole on Vimeo.

Part of the reason I’ve been quiet on the blog this year, was because of a very busy November and December with video. So it’s good to finally reflect some of that. Back in November I travelled up the Australian East Coast with the Scattermusic Sound System. Which meant 5 guys with 5 laptops in a van for 3 weeks, a dozen gigs, bouncing from Melbourne to Brisbane and back in a space-age Tarago, foam parties, passing through schoolies week in the Gold Coast, realising that our Wagga Wagga gig was at the same time as a world bantam weight boxing match being screened at the same venue, burnouts in Ballarat (as savoured by French Fries who had come along for that gig), Mat Cant twittering away and getting shout outs from Rinse.fm as we travelled, a projector mount that clamped onto anything ( including hotel cabin doorframes for late night movies ), and of course, a never ending supply of great tunes (most overheard sentence in the van? “This track is sick.”)…

Being able to actually document projections in a half-decent way now ( thanks to picking up a Canon 7D last year ), means I’m going to publishing a lot more video online from here in. It’s something that has been a long time coming, and I’m quite happy about finally getting that ball rolling.

Video credits:
Music: Scattermusic soundsystem feat Serocee – east coast anthem (mat cant dub edit)
Video edit, camera work and tour VJing by Jean Poole.
( Geelong photo by The Cheap Assassin, Bin Juice cover art by Michael Cusack )

Sampology’s Super Visual Smackdown! taster on Vimeo.

A+V on NYE: Dec 31 will find Brisbane’s Sampology scooting away from the sub-tropics, to scratch up a video storm down south at the Fall’s Festival in Apollo Bay. Sam was kind enough to answer a few words about the art of ‘AV-DJing‘ while he prepares.

What were your inspirations for expanding from turntablism into live audiovisuals?
I felt like a new challenge and Audio Visual DJing seemed in a lot of ways still really undefined and I could do my own thing with it. I’ve always been into what guys like Hexstatic, DJ Yoda plus a lot of other amazing artist have done with cool technology, video content, big ass screens and lots of people in front of them.

What are some of the challenges in producing and performing live audiovisual material?
That Audio and Visual have to relate together in each section as well as the whole set. There’s no point in asking a crowd to party as well as pay attention to the screen – if you aren’t doing anything engaging or creative with what you’re giving them. It’s always a difficult but extremely fun challenge in the prep work as well as the performance.

What kinds of qualities do you think live audiovisual material needs, to work well in on a cinematic dancefloor?
I try to lace a portion of the set with content that people will know, and then remix it in some way using humor/ emotion/ turntablism to try and do something creative. What I like about AV shows is that they aren’t defined to a set of rules and expectations, so I think there’s still a lot of avenues to take AV performances in.

Audiences tend to watch films a small number of times, yet are happy to hear the same songs over and over. Do you find that audiovisual songs have a shorter shelf life?
Sometimes. A lot of people request certain routines so they end up staying in the set for longer than I had actually planned! I’m going to trying and get more into using content that’s in headlines, but there’s a lot of prep work so you want to make it worthwhile if you’re going to only play the routine once.

What artists currently interest you?
There’s heaps of Caribbean influenced sounds that are exciting me, and I’m heavily into a certain movie genre at the moment but won’t let on as it will give away the theme for the 2011 Super Visual show. As for Live Audiovisuals, I saw this Japanese Opera recently, shot and performed live on this massive blue screen, it’s pretty gnarly.

What technologies are you currently excited about?
Mostly I’m happy with Serato Video-SL plus my trusty MPC. I’m more excited about pushing forward with what I’ve got, to make something as entertaining and unique for an audience as possible!

What’ve you got planned for your Super Visual Smackdown, and to what extent does narrative fit into your production?
I’ll preview the brand new ‘Super Visual’ show at the beginning of 2011. Until then I’ve got a really fun Summer themed festival AV set made for Falls & Southbound festivals as well as a couple of other special shows around oz.

Syphon Teaser from vade on Vimeo.

Syphon
Syphon is “an open source Mac OS X technology that allows applications to share frames – full frame rate video or stills – with one another in realtime. Now you can leverage the expressive power of a plethora of tools to mix, mash, edit, sample, texture-map, synthesize, and present your imagery using the best tool for each part of the job. Syphon gives you flexibility to break out of single-app solutions and mix creative applications to suit your needs.”

Out of the box, this means you can send live video signals between these applications: quartz composer, max msp jitter, Freeframe GL and Unity 3D Pro ( a game engine ). Within a short while of release though, this list has been extended to include Modul8 and the MadMapper mapping software, Resolume Avenue, built-in support within the new beta of VDMX, Isadora, CoGe, Open Frameworks, Cinder and Mix Emergency ( software for scratching video with a Serato turntable set-up ).

It all happens on the graphics card, not the CPU, which means HD video can be shuffled between applications at 60 frames per second. This is a great boost for live video flexibility ( lossless live video mixing in and out of 3D game engines? No problem. ), and when it evolves to include being sent over networks, awesome collaborative possibilities await.

Kinect
Another splasher in the visual tech world has been the recent release of the Kinect camera add-on for the XBox. The device features “an RGB camera, depth sensor and multi-array microphone running proprietary software”, and enables 3D motion capture, facial recognition and voice recognition. Being such a hacker’s delight of a device, within a week of release there’s already a growing range of software written that enables it to be used outside the Xbox. Some of these include the ability to draw in 3D (and rotate the image) using gestures, visual FX applications and thanks to Syphon, there’s already a way to include Kinect 3D depth images within Quartz Composer – by first using it within OF and then sending it through Syphon to your visual app of choice.

Notable Kinect shout-outs: real-time light sabers(love the use of the little mirror to frame and juxtapose the original footage here), kinect puppet shows and instant fat-suits.

And there’s a nice extended Kinect round-up of projects over at Creative Applications.

So there you go, the future is already here – *and* it is starting to become more evenly distributed…

Velcro + Laptops

Attaching spare portable Hard-drives to your laptop lid with velcro is a super-win. Not only does it save precious performance space and avoid drives being bumped, it also extends to three, the list of questions VJs will most likely asked at venues.
1- ‘Can you play a track by Another tip? Minimise external drives cutting out when firewire cables move or get unplugged, by using cable ties to tighten the firewire cable to an ethernet cable plugged into the port beside.

Hardware Mixer-Free Zones*
Hardware mixers have become a luxury (or an insurance policy against computer crashes) rather than a necessity, as most clip mixing and blending is preferably done through software and a midi controller. If tight on budget / space, mixers can be avoided. Need a live cam? Use a USB webcam to mix within your VJ software. Other USB capture devices open up worlds of lo-fi video capture, play-through and mixing. Portable midi controllers? My two favourites are the Novation Nocturn and the set of Korg nano controllers… which give the best value in terms of buttons and sliders per buck.

(*At least until *SPARK’s tiny DVI mixer is released! )

Projectors
Projectorcentral.com is a fantastic resource for comparing different projectors, and provides a great overview of what to look for in a projector.

Lumens: (brightness ) – aim for minimum 2500 for a small room, and get as many as you can.
Contrast ratio: ( eg 2000:1 ) Higher is better, richer blacks.
Zoom range: The difference between minimum and maximum sizes, which enables flexible distance from screen.
Resolution: Aim for a minimum of 720P (1280×720), which is the smallest HD size, or WXGA (1280×768). Full HD of 1920×1080 will avoid any scaling, and delivers the best image.
Aspect ratio: 16:9 native is preferable over 4:3
Inputs: VJs will want VGA inputs, and HDMI if available. Most will include RCA / composite.

eBay offers 15m VGA cables for around $30, and if you need more distance between projector and your laptop – maybe consider entering the world of baluns ( connectors / convertors that allow video signals to be sent over the much cheaper ethernet / coax cable for much longer distance without signal degradation. )

Need to build a Projector Mount that will go anywhere? ( http://vjkungfu.com/archive/build-projector-mount ) Clampalicious! Allows a projector to be easily and very securely mounted to lighting rigs, poles etc. Before and after shots below..

Got any other portable touring / rig shrinking / making-video-life-easier tips? Send them along..

[[ UPDATE: Extra tips in the comments:
via the well oiled touring machine-human hybrid, Filastine: "for VJ’s that work from stage, or for solo audio/video performers like myself-project from stage into an automotive sideview mirror clamped to a mic stand, no ladders or long cables needed"
via uDart: a more compact solution to VJ Kung Fu’s mount.
"For that reason I always buy projectors hat have a 1/4-20? camera fitting. Also the ball joint can be substituted with a ‘magic arm’. That gives you countless positioning possibilities."]]

The Executive Summary
We Made Our Own Disaster, A study of fascism in late 20th Century democracies : By Robin Mahoney and Si Begg, out now through Optronica (UK group founded in 2004 by artists/producers Addictive TV and curators Cinefeel ).
DVD, Dolby 5.1, 66 minutes.

Rewinding to The Noodles Foundation
If unfamiliar with the turn of the millenium era ‘Death Of Cool’ compilation series, browsing sibegg.com/noodles should give a good indication of what goes through the head of Si Begg when he’s not sculpting monster basslines and synth earworms (Actually, one step better – listen to 30 second snippets from each track on ‘The Complete Death of Cool’, which combined the best Noodling via the Leaf label ). Somehow those compilations managed to blend sonic sophistication, chunky basslines and quirky British humour into some sort of lovable mutant electronica. And at some point, they also released ‘a blitzkrieg assault of scratchpunk videos to feed your desktop’ entitled Ho-FuN – ‘The Smallest Film Festival In The World’.

Live Cinema and Dancefloor friendly DVDs?
Inevitably then, this study of fascism is more Ali G than Adam Curtis ( famed BBC documentary maker ). It’s best moments harness the curatorial judgments of the editors ( digital crate diggers, represent! ), their technical flair ( there are some captivating sonic and visual transitions) and the underlying dry British humour which milks televisual moments for every absurdity, horror, and occasionally sublime flavour. Midway through for example, a TV cabaret snippet is transformed beautifully, loop-stretched, as a zoom zeroes in, until eventually cross-fadeing into a clip of a cat spinning in zero gravity with a trainee astronaut. And some of the material is great by itself, such as a series of everyday characters staring awkwardly into the camera. There are many such golden moments, but on the flipside, the continual leaning to the dancefloor ( letting faster music and beats drive the editing, overly repetitive sample use etc ), diminishes its appeal as a DVD ( given the inevitable comparisons with cinema grade production levels and screenwriting ).

As a DVD, this is a notch above many of the video mixtapes now abundant online – you don’t get to be veterans of collage without learning a few tricks. That said, the idea of a remix compilation based around mostly archival footage and nostalgic tv commercials is a less compelling idea today than it was a dozen years ago, and the ability to lure eyeballs away from fragments online to something longer form, really depends on the quality, coherence and originality of the overall vision. There’s plenty of adventure to be had on the disc and Sibegg’s soundscaping for the most part plays a great part in binding everything together, but some of the disc’s techniques are quite dated, such as mixing of badly keyed footage, certain visual effects and a stuttery on/off approach to vocal samples that becomes annoying after a while. Why the repetitive triggering and re-triggering of samples, when there can be much more sophisticated and fluid sequencing possibilities used in the live terrain ( eg final scratch / Serato / Ableton Live sequencing video clips with midi, max for live used with jitter etc )? Maybe this is a result of the DVD being edited with traditional editing software, rather than explored with real-time processes? Who knows? Anyways, yes, more Nom Nom than Noam, but a fun and commendable effort, and another reminder that creating live cinema, or ambient cinema that can be tuned in and out of like music, is actually pretty difficult.

Software Aided Innovation
A stoner sitting on the edge of a rooftop tells you: “Y’know what? I really looooove software.” Grinning insights follow, some of which make sense, some which don’t. Software can permeate so much of our interactions today, our existence, that it’s easy to take for granted that effectively we live with swarms of robots in our midst. Robots that automatically pay our bills, robots that share communications with friends, robots that search for us, robots that play back media for us. When it comes to robots that might aid us in the creative disciplines though ( be it art, music, design, architecture, etc ), in what ways are we limited by their design? In other words, in a question that’s at the heart of the Form + Code book, and aimed directly at creatives who use computers – to what extent do we wish to be limited by the constraints of any particular software system?

Defining Form as visual and spatial structures and Code as computer programs and non-computer instructions ( eg IKEA furniture building instructions, or instructions for knitting a scarf ), the book wanders through a history of computer aided creative work, and attempts to meaningfully categorise the different ways code can be useful. The book is definitely aimed at non-coders, an attempt to encourage more creatives to explore the options they have available for customising and creating code to make their work. For someone only recently dipping toes into the visual programming / patch based environment of Quartz Composer, the book provides a nice framework for thinking about image manipulation, and removes some of the ( … well, let’s just say it.. ) fear surrounding abstract coding.

Some general core coding principles are presented simply, which is followed by examining how the computer relates to form – through defining co-ordinates, shapes, and colour, and then the extra layers of light, printing and fabrication bringing the form to life. It’s an approach which works well, demystifying the possibilities, and illustrating them well with a range of provocative contemporary and historically important examples ( in graphic design, typography, data mapping, digital fabrication, interactive media etc ).

Naturally there’s code to play with ( via the companion site ), and the aims behind the book are reinforced when it is understood co-author Casey Reas has also co-authored (with Ben Fry) the programming language Processing ( free for mac, linux, PC), which is described as ” a software sketchbook.. an open source programming language and environment for people who want to create images, animations, and interactions”.

( Out now through Princeton Architectural Press )

“Insights for Search aims to provide insights into broad search patterns. Several approximations are used to compute these results. (And it has to be said – their secret sauce yields a few surprising results) The Insights for Search map is intended for general analysis of volume patterns. Borders are an approximation and may not be accurate.”

( Remember, the map is not the territory, Google said so. )

VJ as a search term? Down slightly, but still flying along. Most popular by far, by people searching from countries in South East Asia, topped by Indonesia. Top search? MTV VJ, followed by Burma VJ. Couldn’t find the part where they listed ‘cool people squinting into laptops’.

VJ Software?

Arkaos lovers are most likely to live in Portugal, then Belgium, Argentina.
Resolume: Portugal, Czech Republic, Austria.
Quartz Composer: Japan, Austria, Switzerland (*Australia 4th!)
Modul8: Esp Switzerland then Austria, Italy.
VDMX: Esp Germany then UK, US.

Of note – Portugal and Austria seem to be pixel hotspots! The Arkaos graph is on a sharp decline over time, and if the search is restricted to just 2010, the numbers tilt a little differently. And also – *why do more people in Australia search for Quartz Composer, than all of the people in the United States?

And for less off the shelf VJ related packages, in order of popularity: Isadora (by a fair margin), VVVV, processing + video, max msp + jitter, pure data + gem.

Questions People Ask VJs
“What software are you using?” +300% (Bedroom VJs are on the up )
“Can you play this song?” -57% (People are getting better at distinguishing DJs / VJs, or are just sending their requests through twitter and facebook )

‘Video Jockey‘ as a search term, is thankfully on a decline. ( Most popular by far, in India.)
‘Scratch video‘ peaked in late 2005, declined, and seems to have stabilised since then. ( Most popular in U.S. )
‘DVDJ‘ – by far most popular in the U.S., on a slow decline.
‘Video mapping‘ – on the up and up, esp in India.

And In the Wild: What’s it like for practicing VJs? Are conditions improving? A few more search terms:
“Goddammit! I’m VJing from a milk crate on the side of stage again, drowning in foldback.” -24%
“This venue has built-in projectors, as well as preview monitors and cameras for use in our in-house digital mixer.” +6%
“Your VJ rider includes meals, top shelf drinks and professional shoulder massages on the hour.” +1.7%

MIDI vs OSC: Midi canes, and is apparently searched for the most in Madagascar, 4 times the nearest search-nation, France. Something to do with evolution and volcanoes I suppose. Germany loves OSC the most, followed by the Taiwanese.

Adobe After Effects Vs Apple Motion : Unsurprisingly, AE is the gorilla here, and especially in the Philippines.
Final Cut Pro VS Adobe Premiere : Premiere well ahead, though in decline. Australians are the 2nd biggest searchers for FCP ( after the U.S.).
VJ iPhone vs VJ Android: One side gets steamrollered. Guess which has the flat graph.

VJ Styles:
Worryingly, kaleidoscope is on the increase (esp in UK) and fractal remains high. Tunnel effect sacred geometry and lens flare remain threatening. ‘Data moshing’ is not yet searched for in high enough volume to warrant google graphing.

[Update: From the heart of pixelated heart of Berlin, Lucy confirms in the comments, that indeed, Google's aim is true - Germans love beer, hiking *and* VDMX. And confirmed again via Kyle, searching for VJ Loops -"Seems Portugal is the mecca!"]

[[ Update 2 (aka newsflash) : Apparently people who play behind laptops making real-time video - seem to really like statistics. The comments keep on coming - from India, Germany, Austria.. y'know, all the pixel powerhouses... ]]

In an alternate universe you have been asked to do some live remixing of Tim Burton related films. However, in that universe, inter-universe messaging systems are commonplace, and your alternate self received the following, hopefully helpful note about possible films to sample.

Take Me Back To Wonderland
Congratulations on your assignment, you are going to have fun – there’s plenty of room to move here, from the whimsy of Pee Wee Herman’s Big Adventure through to much more macabre and grotesque cinema. And this little known fact should help: Bit Torrent works the same in all known universes.

Alice in Wonderland is a great place to start digging. Try the Ravi Shankar soundtrack soaked 1966 BBC production (one of the most psychologically engaging Alice films), with Sir John Gielgud and Peter Sellers. And there are twenty or so other versions, but Jan Svankmajer’s stop motion Alice packs more invention than most. His short film Ossuary, about visiting a cathedral of bones will cross-edit nicely too.

If you lived in a universe where Prince wasn’t a newly religious recluse who complained about the internet killing culture, you’d probably find the combination of his Batdance music video ( half joker face, half batface, 80’s music video aesthetics representing) and the unaired pilot episode of Batgirl irresistible. Especially say, when paired with matching shots of his purpleness on the rain era motorbike, and Batgirl swaying on her batbike in front of a green screen, while a presumably expensive blow-drier makes like wind with her hair.

Hit Tim Shiel / Faux Pas up ( iamfauxpas.com = alternaverse friendly) for some Major Beetle Juicy Lazer file transfers. Sadly, Tim is unavailable in other universes for live soundtracking and sonic manipulation of video clips, but if you’ve got the bandwidth, he’ll bring the Day-O / Beetlejuice dinner / remix party – with Harry Belafonte and the muppets, karaoke dreamers, ableton live splinter video cut-ups, and a Major Lazer infused Day-O for dessert.

Tim will also remind that Janelle Mondae’s ‘Wondaland’ is great accompaniment for Alice’s rabbithole comedown. He’ll also likely recommend a deluxe edit of Janelle Mondae’s The Archandroid album – “delete tracks 9, 10, 11, 18 and try again – another bloated over-ambitious r&b/futurefunk record saved by some judicious editing. 78 mins of blah becomes 47 mins of pure gold!”

In your universe, Ed Wood wears budgie smugglers and complains about boat people refugees while he directs films – and the Political Opposition leader of your country, Tony Abott, slinks about Parliament after hours in a blouse and skirt, with matching stockings and heels. Work with that.

In this universe, The Tim Burton exhibition runs until Oct 10 at ACMI, Melbourne.

[ Above, Craftwife @ Horse Bazaar, Melbourne, Wed Jul 28, 2010. ]

How do you describe your show?
It’s an audio-visual performance and it looks like a techno pop music live. But I combine many elements in a show with many thoughts. So I’m very happy if audiences can see my performance in different, various way.

Kraftwerk liked machines playing notes, claiming it freed them up for composition… What have Craftwife been freed up to do?
Making music with computer is something special for me. I found many musicians are still following the traditional way, i.e imitating a physical phenomena with machine. I’m not interested in it, I’ve been trying to find the new way to play music with computer programming and technology. I really don’t like keep on doing a same thing, “Practice”. So that I’m happy I don’t need any sweaty practice to perform as Craftwife.

How does a circuit bent Pikachu fit into your show?
I have a project called “Craftwife + Kaseo + “. Kaseo (is the author of Pikarumin – bent Pikachu) plays powerful and loud noise music. The style of our music is very different, but we have common thoughts about the sound and music. And visually, you may find some Japanese “Kawaii” or “character” culture. Also I love the contrast of my “clean” programming, software and his messy, physical hardwares.

What has been your favourite / ( or would be your ideal?)  place to play a Craftwife gig?
Craftwife plays everywhere if audiences are waiting for us. I had played in different places such as a small cafe to a nice club or fashion museum  even at an academic conference. I cannot choose which was the best, we’re going to have a show in planetarium of my small town in this September and I’m really looking forward it. Hopefully, it must be fantastic if we can play with my favourite German band someday.

What do you enjoy about super collider?
It’s difficulty. Memo: sometimes people are used….. to be used by technologies. bababa .. too sleepy…..

[ Above, Craftwife + Super Collider + custom software + iphone + bonus Kristin... ]

[ Side-note: First discovered Craftwife via a blog post by David Lublin, one of the VDMX head-coders. Popped off an email to see if Takeko would like to do an interview. As well as agreeing to one, Takeko mentioned she was touring Australia soon. Which later turned out to include Melbourne. On my birthday. Thereby continuing the weird sensation that VDMX pulses somewhere near the centre of a cult universe, an electromagnetic conduit for a small but growing band of dispersed pixel gypsies.]

Hassle Canon to sell a 7D at cost price in exchange for review, knowing from using the camera, and seeing online videos, that this is a most desirable camera for shooting video.

Part 2: Zoom In

Focus the review on the video qualities of the Canon 7D, knowing that the Canon 5D MK II has much better photo image quality, and that while other video cameras are on the horizon, which promise similarly large sensors but better video handling controls ( eg the SONY NEX range), the 7D holds a unique position for video capture at this point.

Part 3: Dirt, Meet Fingernails

Run around with the camera a bit, see what it can do ( it sucks light in! ), see how it feels ( sturdy, solid, well built). Think back about shooting video with it, and analyse each component.

The Body
Jumping inside, the camera’s sensor is APS-C sized which means the focal range of all lenses used with it need to be multiplied by 1.6 ( eg a 50mm lens which gives a natural perspective on a full framed camera, will look like an 80mm lens on the Canon 7D – 50×1.6 = 80mm = a lense which gives a slightly zoomed in perspective.) Lenses are separate, and not something being considered here, but the camera itself feels great. Controls are precise and reliable, built to last. That said, this is not a traditional video camera, with ergonomic focus and zoom adjustments within reach. The small size ( relative to a big video camera) also means stabilisation is needed to prevent too much wobble-cam. There is a smorgasbord of companies rushing to supply supporting rigs, but the cost of these also needs to be considered up front if video is your goal.

Software
- Highly customisable interface ( hardware buttons can be re-defined / has 3 custom global settings for easy access to specific settings to suit particular shooting conditions )
- Saves files to a Compact Flash card, in the H264 codec. (Good quality, but needs transcoding into editing software)

Image Quality
Utterly gorgeous. Induces giddy laughter in low-light. It’s not without issues ( google 7D + jello-cam, rolling shutter, moire and aliasing ), but if you’ve come from any other video camera in the same price range, you’ll mostly just be slack-jaw amazed at what the camera is capable of.

Audio Quality
As lame as might be expected for what is essentially a photographic camera slowly morphing into becoming a video camera. A work around? Record using an external recorder such as the Zoom H4N, and use PluralEyes software to auto-sync up your high quality audio files with your lower quality ones, within your video editing software. Once synced, delete the bad audio, and your filmic masterpiece now has rich sound to match.

Part 4: Duel at Dawn

Compare the 7D with the 5D Mk II, the 7D’s only true competitor in the field.

5D: Full frame sensor, greater image quality, more depth of field. Better for wide shots. Use up to 25600 ISO ( ie great for low light). 3.9 FPS for photos. 1080p at 30p only. ( ie 1920 x1080 HD progressive / non-interlaced footage at 30 fps ).

7D: Smaller APS-C sensor ( means less image quality, but also means closer to 35mm movie sensor size and possibility, after adding mods, of using cinema lenses ). Better for telephoto shots. Use up to 12800 ISO. 8FPS for photos. 1080/30p (29.97), 1080/25p, 1080/24p (23.976), 720/60p (59.94) and 720/50p ( 50p + 60p footage can effectively create slow-motion footage at 25p and 30p ).

Aside from the above specs, the 7D also has a dedicated video record button, a better LCD screen for viewing in daylight, and better ergonomics for handling. Plus, this guy recommends it for video.

Part 5: Signing Out

When offering some final words of critical acclaim for this most desirable video camera, don’t forget to crowdsource, and point to the huge range of support material online developing around the 7D and it’s enthusiastic fanbase. People like to see it for themselves.
vimeo.com/groups/eos7d
vimeo.com/groups/canoneos7d

See also:
The skynoise intro to DSLR cameras and an overview of
steadicams and video stabilising systems DSLRs.

Thanks to Canon Australia, and to 3DWorld for printing the review.

Car Sharing
Taking a leaf out of Kurt Vonnegut’s book, and looking at civilisation from a distance – we do seem to be a species of oil crazed demons, intent on paving the planet over, and shuffling ourselves around in vehicles that weigh a whole tonne all by themselves. In cities with better urban planning and public transport, it’s obvious to citizens living there that not every single person needs to own a car to survive. Extending this idea another step, car sharing is about renting out cars for short periods of time and thereby reducing the amount of cars needed for a suburb. Some people need a car daily for various reasons, but for others who only need the occasional trip, the car sharing service can save a lot of money ( and other problems such as maintenance etc ). If you drive less than 15,000km a year you will probably find carsharing will save money. There’s three main car sharing groups operating in Sydney and Melbourne, each blowing their own eco-trumpet about the benefts of having access to a newer, fuel efficient car when you need it, and through sharing it with others, effectively reducing the amount of cars needed.

Flexicar, phone 1300 36 37 80 GoGet, phone 1300 769 389 Charter Drive, phone 1300 135 358

Renting Two Wheels?


Like car rentals, daily bicycle hire has long been an available option for visiting tourists and wandery folk. Arguing that the short trip rental could appeal to the general public, and potentially encourage them to leave cars at home, the Victorian Government has launched a $5 million scheme which will see 600 bicycles available to pick up or drop off at 50 different bike stations across Melbourne. Subscriptions cost $50 a year, $8 a week or $2.50 a day – and the first half an hour of every trip is then free, $2 for the next half an hour and so on. A credit card is needed to participate, and helmets aren’t included, so it’ll be interesting to see whether people find bringing a helmet into the city more convenient than bringing a car. [ Yet to see a single blue bike 'in the wild', though plenty of them seem missing from their racks around the city... ]

Buzzkill
Audio nerds the world over must love soccer, because there’s been a huge outpouring online of ways to filter out the drone. Create Digital Music have done a pretty great round-up of these, tackling everything from EQing with onscreen TV controls ( get rid of 233, 466, 932 and 1864 HZ if you can), free VST plug-ins for mac and pc, acoustic engineers explaining the science of why vuvzelas are annoying ( I actually enjoy the medieval carnival / sacrifice kinda vibe they add ), vuvuzela orchestra ( yes, really ), vuvuzela radio ( uhuh ), and how to re-route audio signals using JACK or Soundflower into another application that has better audio filtering and VST capacities.

Audio Re-Routing
Wormhole2 – allows routing of audio between machines on a network. Now you can make use of all the processing power in your studio. For example; set aside a machine for complex instruments or effects, route audio out to it, then back into your favorite DAW. Or route audio between your PCs and Macs to get the best of both worlds. Or share audio between laptops on stage.

Soundflower is a Mac OS X (10.2 and later) system extension that allows applications to pass audio to other applications. Soundflower is easy to use, it simply presents itself as an audio device, allowing any audio application to send and receive audio with no other support needed. Soundflower is free, open-source, and runs on Mac Intel and PPC computers. IS often used for podcasting to combine tow different audi streams, or to combine skip interview voices etc.

Jack (the Jack Audio Connection Kit ) is a low-latency audio server, written originally for the GNU/Linux operating system, and now with Mac OS X support. It can connect any number of different applications to a single hardware audio device; it also allows applications to send and receive audio to and from each other. Jack is different from other audio server efforts in that it has been designed from the ground up to be suitable for professional audio work. This means that it focuses on two key areas: synchronous execution of all clients, and low latency operation.

Video Re-Routing?
But let’s say you want to send a video signal from one program into another program – how to do that? No such re-routing software currently exists, but there is at least a work around through Vade’s excellent ( and free ) Screen Capture utility. This is a Quartz Composer patch ( and therefore mac only) which allows a portion of the screen to be selected, then sent into another compatible program. This can mean web browsing / web-flash games / computer games etc can all be displayed in one corner of a screen, and then accepted within VJ software such as VDMX and used as a live signal, and filtered, mixed or processed to your heart’s content. ( Be warned : Removing plastic horns visually is likely a bit trickier… )

But Wait, There’s More..
Vade has more in the pipeline, a video re-router that will work fast, and on the graphics card rather than CPU. Tests so far allow easy re-routing between Max MSP / Jitter / Quartz and VDMX. Bookmark his site for announcements to come. And in other news the Auvi Objects have been updated for Max 5, which will please live visualists who remember it.. )

“Auvi was designed with an attitude of sympathy towards beginners. Even now, Auvi can be a lot of fun for those who are less technically advanced — for example, those who don’t want to mess about with shaders and GL. I like to think of Max as a haven for artists whose needs aren’t met by standard software. Auvi was my attempt to increase the fun-factor for these newcomers.” Kurt Ralkse

Soccer Video Remixing
Because you need something to do with all those pipes, right? Recommendo : the 1981 Escape to Victory starring Sylvester Stallone, Michael Caine + Pele in a German prisoner of war camp. Or maybe? Pele’s viagara campaign, where he offers these last smiling words to the camera:
“Talk to your doctor, I would..”
An amusingly careful phrasing, which allows Pele to retain all suggestion of athletic virility, but let anyone else know – Pele says it’s ‘ok’.

The Cheap Option: Steadycam.org
Johnny Chung Lee has an infamous tutorial for building a steadicam with $14 of parts and needing one hour of your time – or you can order a kit for $39.95 if you wish. Bingo.

The Even Cheaper Option
A ‘string tripod’ is an old photographers trick, which simply involves finding a bolt in a hardware store that fits the underside of your camera, and attaching a 1m or 2m piece of string to it. Carry this around in your pocket, and when needed, attach bolt to camera, let string fall to ground, step on the string, and pull the camera upwards until the string is taut. Instant stabilisation.

The Bling Option: Steadicam.com
Aside from their Hollywood rigs which effectively turn camera people into stormtroopers, Steadicam also deliver smaller systems for smaller video cameras, and even a version for the iphone – the ‘Steadicam Smoothee‘ ( though you’d really have to question spending any money on that rather than getting a better camera). For smaller cameras though, there’s a whole new range of emerging players coming through.

Given the armies of DSLR wielding hipsters roaming the streets, an inevitable side industry has spawned to fit them in thin exo-skeletons for their auteur adventuring. A few of the key players include :
Redrockmicro.com – handheld, shouldermount and cinema style rigs.
Glidecam.com – These have nice ‘gimbals’, a kind of gyroscopic ball bearing system, which allows movements to be transferred to the handle, rather than the camera. Found one of these on ebay for $250.
Zacuto.com – Aside from a range of DSLR rigs, they also make add-on viewfinders, which can make the mobile filming process happen much more smoothly.
Cinevate.com – Large range of rigs

There are a quite few other manufacturers too ( eg The Blackbird Camera Stabilizer
The CB 105 counter balance video camera stabilizer), but in general these kits tend to start at around $1000 for anything vaguely useful, and spiral upwards quickly. A recent addition to the list is slightly cheaper. The “Indi System”, made in U.S. and distributed in Australia by Dragon Image – is $950 for a complete rig, including focus follower, shoulder mount, adjustable handles, and rail sections for attaching externals ( lights / monitors / microphones etc ). I was able to try one out recently at the Camera Expo – felt good, solid, reliable.

Still Need More Camera Movement?
A dolly is a wheeled platform that rides on a track or smooth floor – which generally means a lot of weight and volume to carry around for shooting. There are a couple of interesting alternative solutions around though. The Wally Dolly and Track System is a portable and minimal weight rails system made in Australia. Another option is fitting a rails system on top of a tripod, allowing the addition of smooth motion to framed shots – eg Glidetrack. Or a DIY Dolly? Sure. Built with skateboard wheels if you want. And when it’s time to graduate to a motorised dolly system, you’ll be ready to shoot the next ash spewing volcano…

See also: steadishots.org – “Where the skills of the men and women responsible for some of the most memorable shots in television and cinema history are put on display.”
How Steadicams work – see how they eliminate shaking and rolling..

To DSLR or not to DSLR?
The benefits of digital image recording ( cost / workflow etc ) combined with the advanced light controls of a SLR camera – make DSLR cameras great for photographers, and now that they’re often capable of good quality video, DSLRs are lluring in a lot of film-makers too. It’s not all win though – videomakers expecting DSLRs to have the same ease of shooting will be disappointed. Weighing it up for those interested in video, David Torcivia has summarised the pros and cons over at Poetzerofilm.com:

Nay
Ergonomics – too light / small / awkward screen and controls
Moire and Aliasing – skipped lines in video, during process to shrink large image down to video size
Shutter Rolling – fast moving objects can be in different places in the same frame
Resolution – they don’t actually shoot as well as advertised
Compression – Canon records to lossy H264 format ( which needs processing before editing )
Audio – terrible on DSLR, need to record externally ( eg with Zoom H4n) + sync (pro-tip: Plural Eyes! )

Yay
Ergonomics – The small size can also mean shooting easily in cramped spaces, and more discreet filming.
Depth of Field – Hey look, it’s blurry in the background! Beautiful, but as the web fills with it, David helpfully notes:
“Don’t wear out the effectiveness of a shallow shot by making an entire “test” film filled with nothing but micro DoF. Shallow depth of field is just another tool in the cinematographer’s box to better tell a story. It is not a crutch or a gimmick to sell a shot or a product, an idea which cheapens the art.”
Low light – Zowie! For the price, DSLRs can shoot in hearts of darkness that video cameras cannot even see. Believe.
Price – Fantastic quality and value.
Photos – Oh yeah, do they do those too – 10 stops of dynamic range, full RAW files, 18 or 21 Megapixels – all great for timelapse .
Lenses – The variety of glass available for DSLRs vastly outweighs that possible for video cameras ( hello eBay, or hello rent-a-lense for important occasions )
Media – Tapeless workflows. Drag n drop, rather than slowly capturing footage.

Plunging In…
So in the end – disregarding all the science and numbers, you’ve found yourself swooning over luscious, colour-ripe non-grainy video shot by someone in such low light conditions that you’d packed away your video camera an hour ago. THAT’S OKAY, you’re with friends.

And if being the new owner of a DSLR finds you bewildered by the array of options available – Wikipedia’s photography page is incredibly useful for getting up to speed with photographic terms and principles, and pointing to a huge range of future learning. For starters you’ll be needing to understand :
Aperture – the lens opening, measured as the f-number ( eg f2.8 ), which controls the amount of light passing through the lense.
Shutter speed – time the imaging medium is exposed to light for each
ISO speed – The higher the ISO, the greater the sensitivity to light.

There’s plenty more, and plenty more starting points too..

Which Lenses To Get?
If you need, you can actually mount cinema lenses to a DSLR, using add-ons from hotrodcameras.com. For most people though, the existing range of photography lenses will be a vast enough jump in quality from handheld video. Things to note? Lenses with lower f-numbers are preferable ( and more expensive ). Aside from lenses specific to your camera, there are also a wide range of cheap adaptors that can be fitted to any DLSR, which will enable lenses from other manufacturers to be used ( functions like auto-focussing can be lost with some of these though ). And one more complication – the Canon 7D doesn’t have a full frame sensor, and it’s smaller proportion of a frame means you have to multiply the below numbers by 1.6. In other words, a 50mm lense on the Canon 7D is the equivalent of a 80mm lense (50 x 1.6), and the perspective it brings.

50mm - The classic lense. A lense this size renders perspective in a way similar to a scene is perceived by the human eye.
Wide Angle Lenses ( Below 35mm ) – allow you to fit more in frame from closer range ( think fish eye), but exaggerate distance between objects and can distort.
Telephoto Zoom Lenses (Above 70mm ) – allow magnification of distant objects / skateboarders / small furry animals etc ( though tends to compress distance between objects ).

Macro lenses – Want to shoot close-ups? These are the lense for you – or – seek out extension tubes or adjustable bellows ( both which are placed between another lense and the camera, changing the dynamics so that close-up is possible ), or get an auxiliary close-up lense to attach to the front of a lense, or get a reversing ring ( an adaptor that allows the lense to be attached to the camera backwards, which creates extreme close-up vision ). http://en.wikipedia.org/wiki/Macro_photography

( See also Tamron’s guide to lenses, and Cambridge in Colour about lense focal lengths, zooms vs primes etc )

A range of trick filters which can be added onto existing lenses for various effects ( find out what diameter your lense is ( eg 72mm), to find appropriately fitting add-ons ). And then there’s the tilt-shift lenses ( see also lensbaby ), and other trick lenses… ( on it goes.. ).

Time Lapse?
The image quality is significantly higher quality for photos in DSLRs, than it is for video. Correspondingly, animating a series of high quality photos in sequence for timelapse bumps the ‘video’ quality up even higher. Strangely the Canon 7D doesn’t have an automated sequencing function built in, and needs an external ‘intervalometer’ to do this. Canon sells one for around $200. Hong Kong vendors on Ebay sell adequate imitators for $30. There’s also an iPhone app for remote triggering / viewing of photos – but it requires the camera to be attached to a computer ( not great for out and about shots.. )

Stability… Later…
Someone walking around with a handheld video camera, will produce jerky footage, no matter the camera… but especially so with a small camera like a DSLR,, and then there’s the additional desire to avoid troubles like the Jelly Vision mentioned above. The image quality is good enough though, that a whole industry has spawned in providing ways to minimise trouble. And so…

Next DSLR Update : Stabilisation, active filming + Steadicam Systems ( from pro to DIY )

Massive Attack @ Myer Music Bowl, Melbourne
Enhancing Massive Attack’s recent sublime musical performances during their Australian Tour, was a very elegantly integrated lighting show designed by United Visual Artists. The kind of gorgeous, restrained and stylised light show you’d hope to see while visiting Blade Runner Town. The lighting set-up was deceptively simple – over the course of the evening, every one of the limited parameters available was gradually tweaked, revealing further variation where it seemed all avenues had been explored. Pulsing dots, became horizontal lines, and then combinations of dots and horizontal lines. From the palette of mostly white, red was sporadically and only very occasionally introduced, and very effectively. Occasional smoke bursts and white lights to reveal on stage depth behind the main plane of pulsing lights. And gradually, the dots are clustered closer, so we can approach something like ascii video playing through the spread out LED wall. Cycling through ascii characters, cleverly varying font sizes and cycling methods to effect the overall image. And again, occasionally using red as individual spotlights. While lighting rigs and lighting pre-visualisation and sequencing tools are getting increasingly sophisticated ( ie crazy ), this show worked because of the restraint shown, its thoughtful choreography and pacing over the evening, and because of its tight integration with the music ( they nearly became inseparable at some points ).

Chris Cunningham’s new Audiovisual Show
This is an exciting prospect. News that one of the most acclaimed music video directors of the last decade, is working on a 75 minute live audiovisual show certainly presses buttons.

“It’s a work in progress really. It’s three giant screens, lasers and a soundtrack that will be like a big mixtape. It’s the closest I can get to what I want to do: the visceral sound of a live show but with massive screens like a cinema,” he explained in the Guardian recently, arguing, “what I do is more experimental and the visuals usually come first. That’s why the live performance is exciting. It’s not film, it’s not a gig, it’s not an installation, but it has elements of all three.”

While it’s undoubtedly an impressive show ( what a great body of work to play with! ), unfortunately the comments on the Guardian article suggest that the performance seems far from live, a sidestage witness suggesting there wasn’t much meaningful being done by Cunningham on stage, others suggesting it seemed like a linear showreel. On the one hand thats fine, the show is a stepping stone, on the other – it’s a reminder that visual technologies tend to lag behind audio in terms of power ( it’s necessarily more computer intensive to manipulate 1 minute of video than audio ). And no doubt, given that the music world has decades more behind it with manipulating loops sequences and processes, it is likely also advanced more conceptually for dealing with time based media in performances. Looking at how someone like Autechre (touring Australia shortly, and themselves with a fine Cunningham video) approach time and samples, might illuminate other approaches to video than ‘jukebox compilation’.

[[ UPDATE ]] This review sounds a bit more promising. And an amusing anecdote from William Gibson about Chris potentially directing a version of Neuromancer:
“Chris is my own 100 per cent personal choice…My only choice. The only person I’ve met who I thought might have a hope in hell of doing it right. I went back to see him in London just after he’d finished the Bjork video, and I sat on a couch beside this dead sex little Bjork robot, except it was wearing Aphex Twin’s head. We talked.”

Weimar in The House
Max Neupert explores great and granular audiovisual compositions using the free software pure data, and now runs ‘Breaking The Timeline‘, a great course at the Bauhaus University of Weimar, which is dedicated to exploring ‘performative audiovisual artworks and experiments’.

“The third dimension of the moving image is time. Manipulation of the timeline means taking control over the creative potential of this dimension. Editing film or video transforms footage into a movie, thus film and video aren’t necessarily linear, but stay static in their determined timeline. Video made analog real-time effects popular but todays graphics processors in computers make it possible to fully explore the real-time potential of digital image and sound.”

Max also makes available patches which demonstrate audiovisual programming techniques in Pure Data and the Gem library.

And let’s not confuse Max with Max for Live – another exciting Audiovisual prospect – complicated max patches ( including jitter video parameters ), controllable from inside Ableton Live and it’s sophisticated sequencing possibilities.