Labs

flarsound

AR is available for the Adobe Flash technology since Saqoosha did a port (FLARToolKit) from the NyARToolkit. Many samples and tutorials were released since then and everytime I have seen one of these my intension to build my own one becomes greater. Last week I stumbled upon a new project called FLARManager from Eric Socolofsky. This library allows you to easily implement FLARToolKit into your project and use multiple markers - I really appreciate that.

So I took the sample code of FLARManager and seperated the 3D parts of it. After doing some customizations and extensions to it I got a really stable AR environment. The existing patterns and markers were to tricky so I made some by myself and generated the DAT files with a great marker online tool. Copied the files into my assets folder, testing... perfect detection!

Choosing the right songs wasn't that hard. I just picked some of the ccMixter's All-Time favorites and copied the urls to the source code.

The result is now a virtual AR music mixer which allows to set a song's volume (distance to camera) and pan (horizontal position) by moving the markers around. For sure multiple songs at the same time are possible. The song is stopped by losing the marker. I also did some optimisations on the code to allow some kind of tolerance when losing a marker the app waits for 2 seconds until it finally removes the assigned objects (3D cube and song).

Hope you like it... feeback is welcome!
Best viewed in full-screen mode. Audio is not high quality because captued by mic :-(

Video


3rd party libraries


Trackback(0)
Comments (2)add comment

eric socolofsky said:

0
nice!
squidder made a drumkit for FLARToolkit a few months back:
http://www.squidder.com/2009/0...drum-kit/

but apart from that haven't seen much with AR and sound. i like!
reminds me, just a *little* bit, of the reactable.
http://www.reactable.com/
July 02, 2009 | url

EdShift said:

0
Awsome
That has a whole world of possibilities.
I'm a developer too. (Cad dev (Unigraphics) and SQL DBs and .net Business stuff:-(...)
But.
In my spare time I'm a musician (ccmixter=EdShift)

This technology if it was paired with a pair of display glasses could allow some really wild Midi controller software.

There is a product (you probably know all about it) the KAoss pad that is the darling of top djs. You could make a 3d (Guess it's 4 d really kaoss pad to send midi controller data.

OR

If you leveraged some plugin APIs you could create a realtime mixer plugin. (or modulator or ...)

This next decade is gonna be SOOOOO epic.
AR is ready to explode.
2-3 years and it will be everywhere.

Much respect for your mixer.
Jaw-dropping.

What are you writing in?
Are the libs/api fairly accessible?

Tempted to have a go myself...

Thx for the video and get in touch pls.
Ed.
January 12, 2010

Write comment


busy