Isolating Voice only in WAV

Wondering how to accomplish a certain animation task? Ask here.

Moderators: Víctor Paredes, Belgarath, slowtiger

Post Reply
wizaerd
Posts: 415
Joined: Fri Aug 25, 2006 7:08 pm
Location: Gilbert, AZ

Isolating Voice only in WAV

Post by wizaerd »

I have a WAV file that's a recorded song, but if I try to use it for my lip synching in a switch layer, the mouth moves with just the music. How can I best isolate just the voice of a recorded WAV file?
User avatar
Lost Marble
Site Admin
Posts: 2347
Joined: Tue Aug 03, 2004 6:02 pm
Location: Scotts Valley, California, USA
Contact:

Post by Lost Marble »

An audio wizard may be able to answer that, but one approach would be to use Papagayo to manually lipsync the voice, rather than relying on the automatic lipsync.
User avatar
slowtiger
Posts: 6078
Joined: Thu Feb 16, 2006 6:53 pm
Location: Berlin, Germany
Contact:

Post by slowtiger »

Short answer: you can't extract a voice track from a complete recording with music and stuff, not even with the kind of gadgets they seem too use in CSI and NCIS.

Workaround: Just sing the track yourself. Put the original on headphones with low volume, record your own voice only. It doesn't matter if you can't hit any note, it is good enough if you just speak the lyrics in the correct tempo. Now take this recording into Papagayo, and voilá!

PS. Don't forget to replace your voice with the original song for the finished film.
myles
Posts: 821
Joined: Sat Aug 21, 2004 3:32 am
Location: Australia, Victoria, Morwell
Contact:

Post by myles »

slowtiger - nice solution! Creative and practical!


Just thinking aloud:

With some commercially recorded music, they put the voice on both stereo tracks, but different instruments on each track.

By inverting one track (or something like that - I've only heard about this) you can combine the track and the voice cancels out to a large extent, leaving mainly instruments.
It's a technique used by some karaoke software.

Now, I wonder if by somehow inverting that result and combining it with the full track, could you mainly cancel the instruments and leave mainly just the voice?

I have no idea if this is workable or not.

Regards, Myles.
"Quote me as saying I was mis-quoted."
-- Groucho Marx
Bones3D
Posts: 217
Joined: Tue Jun 13, 2006 3:19 pm
Contact:

Post by Bones3D »

myles wrote:Just thinking aloud:

With some commercially recorded music, they put the voice on both stereo tracks, but different instruments on each track.

By inverting one track (or something like that - I've only heard about this) you can combine the track and the voice cancels out to a large extent, leaving mainly instruments.
It's a technique used by some karaoke software.

Now, I wonder if by somehow inverting that result and combining it with the full track, could you mainly cancel the instruments and leave mainly just the voice?

I have no idea if this is workable or not.

Regards, Myles.
This is actually not accurate. Wave inversion is generally used for noise cancelation purposes... and only works on the "noise" in question in its entirety. Basically, it'd competely eliminate the entire sound (music and vocals) in one fell swoop.

Many of these pseudo-karaoke devices/software instead rely on a "one-size-fits-all" form of frequency filtering to "remove" the vocals from a given song. Generally speaking though, the vocals are still present in the sound, but get muffled out enough to be overpowered by the music. Also, parts of the music itself usually get muffled out well.

While this does suggest that doing the reverse to filter out the music would probably work, the end result would probably not be worth the time and effort involved to do it with any sort of intelligence behind the process.

I imagine if you ever want to explore this for yourself, software like ProTools and Logic probably have filters that can be used to do this sort of thing.
8==8 Bones 8==8
User avatar
heyvern
Posts: 7035
Joined: Fri Sep 02, 2005 4:49 am

Post by heyvern »

Another... really really long shot option...

If the song has been used in a movie... rent the DVD... sometimes when they mix the audio for surround sound... the singer MIGHT be "extractable".

You would have to have some kind of surround sound system... and a way to isolate it.

This.. is... a long shot... a real long shot.... one in a million.

-vern
myles
Posts: 821
Joined: Sat Aug 21, 2004 3:32 am
Location: Australia, Victoria, Morwell
Contact:

Post by myles »

Hi Bones3D,
Bones3D wrote:This is actually not accurate. Wave inversion is generally used for noise cancelation purposes... and only works on the "noise" in question in its entirety. Basically, it'd competely eliminate the entire sound (music and vocals) in one fell swoop.
Ah, but this trick relies on the fact that the only identical content on both tracks is the voice - the instruments on left and righ channels are different. So, the left track contains the voice and, say, drums and guitar, while the right track also contains the voice and, say, electric organ and trumpet.
Of course, not all music+voice is recorded this way, but it will work with some.

Splitting the 2 stereo tracks into 2 mono tracks, inverting one, then combining them, only cancels where the 2 tracks were identical - this will get mostly the voice, although it doesn't work 100% because voice and instruments are mixed.

There's a tutorial for doing it in Audacity here: https://wiki.brown.edu/confluence/displ ... y+Tutorial

Regards, Myles.
"Quote me as saying I was mis-quoted."
-- Groucho Marx
User avatar
DK
Posts: 2854
Joined: Mon Aug 09, 2004 6:06 am
Location: Australia

Post by DK »

Get a microphone and reord yourself singing along with the song then use that audio file as your auto lipsinc master.

D.K
User avatar
DK
Posts: 2854
Joined: Mon Aug 09, 2004 6:06 am
Location: Australia

Post by DK »

Oops...sorry did'nt see slowtigers post.

D.K
Post Reply