March 15, 2004
Client-Side Remixing Conundrums
Lucas Gonze, who has added client-side remixing to his RSS+SMIL format (Analysis of RSS+Time as a playlist format) discusses the strengths and weaknesses of such client-side remixing here: Client-side remixing is sloppy. His post is in response to a couple of posts I've done on the idea of remixing "recipes": A History Palette for Music and The Grey Album - No Copying Necessary. Gonze argues, rightfully, that RSS+Time and similar such formats are not well-suited to client-side remixes:
Geeks around these parts have done many experiments with client-side remixing in SMIL, and what we found was that it works reasonably well as long as you don't need precise synchronization. If you do need precise synchronization, you'll just make yourself unhappy.
What that means for Danger Mouse and other dance-type remixers is that they will not be doable on the client side. That kind of thing requires a really tight set of operations. You have to clip out segments of a few seconds at most, then line them up with a lot of other clips. Marking a beat is a picky process with no room for sloppiness, which is exactly what HTML is not.
Mike Linksvayer agrees and provides more analysis (Client-side remixing isnít so loopy).
Their both right. However, my vision of client-side remixing is not of the RSS+Time type, which "is to precise syncrhonization as HTML is to precise layout. If you donít need precision, enjoy." Actually, I imagine a rather robust client that can achieve the level of precision that the remixer used to create the remixing "recipe." As I noted, my comparison is to Photoshop's History Palette:
Imagine if someone edits a photo [with Photoshop] and sends me the history palette but not the original photo (for copyright reasons). If I already have the original photo the editor worked with, I could recreate the new version from the history palette.
In the case of music, I imagine the client having something like a copy of Apple's GarageBand software. If you save the "history palette" for GarageBand and send me both the history and the original sound files used, I should be able to recreate the exact same finished product you have.
Such a thing is not yet available, but I don't see why it couldn't be. See, Dangermouse, the Jay-Z Construction Set and the Videogame Content Creation Model.
Posted by Ernest at 9:02 AM
Comments and Trackbacks (http://www.corante.com/cgi-bin/mt/mt-tb.cgi/1646)
Not to add to the main dialog, because you made your point well and I don't have anything to add, but this makes me think of mediAgora. Kevin Mark's idea there was to compensate sampled musicians by having listeners buy all the source works. If people listening to remixes had to get copies of the original sources, the problem of compensation for sampling would be solved.
I'm surprised that anybody would argue that something like the Grey Album couldn't be exactly reproduced via recipe.
Assuming that all the source came from those two CDs, and that people could reliably use a different pair of the same CDs in place of ones used to make the original mix, I can't see any reason why it couldn't be reproduced exactly.
(obviously all bets are off if using vinyl)
The first thing that comes to mind are video Edit Decision Lists, from Adobe's site:
"An edit decision list (EDL) is a list of video edits made in a video-editing project and includes reel number, clip names, in and out points, and other editing information, such as transitions and split edits, depending on the EDL format. Adobe Premiere includes several EDL export options."
"If you plan to use a post-production facility for final editing, you will probably need an EDL. Post-production facilities use EDLs to automate the video-editing process. At the post-production facility, an edit controller uses the EDL file to make a master tape of the project."
So, in that scenario, the end-user is the post-production facility making a new master tape.
Furthermore, I'll cite Acid, popular looping software. I think it stores edits in a separate file from the source. So, if you ripped your CDs, created an Acid project, and then shared the project file with somebody who then supplied their own copies of the souce audio, that very well may work.
In any case, I can't see why it couldn't be done with software, though it certinly might require new software.