Lip synching

This forum is for the general discussion of Anime Music Videos.

Lip synching

Postby StarMasayume » Thu Sep 29, 2005 7:52 pm

I've been making amvs for one to two years now, and so far about 4 out of 6 had lip synching, the two current projects I'm working on have lip synching, and many of the future projects I have in mind will as well. I've gotten fairly decent ratings for it (gradually rising from 8.42 to9.08) though I would really like to improve it still. I've been through the guide for it and have gained a lot of experience.

I've found lip synching to be a big challenge but I always love the feeling after its been done right. It amazes me how sometimes the lip synching falls into place with hardly any editing at all while others takes painstaking hours and I'm still not satisfied.

I have trouble sometimes making it look natural. I'll go through parts frame by frame and it seems to go with the words when I drag through it slowly, but then when I export it and watch it that same lip synching might come across as looking awkward. I've been trying to mouth the words with it to to try and help get a feel for it but sometimes it still looks just a bit rushed or off somehow.

Well, so this is my lip synching-pains... being good but night quite satisfied yet. Has anyone else have any more specific things they keep in mind while lip-synching or tips in general? The things I've tried have all helped me, but there are always those parts that are a pain and I can't figure out why... :? Maybe some clips are just destined to be a lip-synchers nitemare. ^_^

-star
User avatar
StarMasayume
 
Joined: 03 Nov 2003
Location: Florida

Postby Scintilla » Thu Sep 29, 2005 8:08 pm

After "NERV Evening News...", I told myself that I'd always keep my mouths in the same position for at least two frames before moving in any future lip synching endeavours, because I got quite a few comments saying that the lip synch job on that one looked too flappy.

But you can probably get away with one-frame-only mouth positions if you're editing at 23.976 (or 24) fps and/or if you're synching to a fast song.

Hope this helps.
ImageImage
:pizza: :pizza: Image :pizza: :pizza:
User avatar
Scintilla
(for EXTREME)
 
Joined: 31 Mar 2003
Location: New Jersey
Status: Quo

Postby AquaSky » Thu Sep 29, 2005 8:19 pm

Ditto on what Scintilla said about the two-frame rule. It really does help things look more natural. Other than that, the only real trick to it is to utilize the waveform. I've found it to be a much more reliable way to sync than by simply 'playing by ear', so to speak. Of course, even with that method there are bound to be pitfalls; a spike in the waveform was due to some non-speech noise, there's too much ambient noise to differentiate the syllables, or the sync just plain looks off when you export it. The latter happens to me with every lip-sync project - I just try to pinpoint what syllable is out-of-sync and correct it. So there's always a bit of trial and error involved.
User avatar
AquaSky
Master of Science
 
Joined: 15 Apr 2003
Location: Palm Beach Gardens, FL.

Postby badmartialarts » Thu Sep 29, 2005 8:54 pm

I usually look at my own mouth in a mirror saying the same words the same way. It's a much better guide to when to have the mouth fully open, half open, and closed (as those are usually the only positions you have in anime).
Life's short.
eBayhard.
User avatar
badmartialarts
Bad Martial Artist
 
Joined: 25 Oct 2003
Location: In ur Kitchen Stadium, eatin ur peppurz

Postby StarMasayume » Thu Sep 29, 2005 8:56 pm

Yeah... the song I'm currently working on has too much else going on to go by the wavelength so I'm kind of forced to play it by ear. I'll have to try that 2-frame rule though. That includes the little inbetween frames for the mouths opening and closing?
User avatar
StarMasayume
 
Joined: 03 Nov 2003
Location: Florida

Re: Lip synching

Postby genestarwind21122 » Thu Sep 29, 2005 9:24 pm

StarMasayume wrote:I've been making amvs for one to two years now, and so far about 4 out of 6 had lip synching, the two current projects I'm working on have lip synching, and many of the future projects I have in mind will as well. I've gotten fairly decent ratings for it (gradually rising from 8.42 to9.08) though I would really like to improve it still. I've been through the guide for it and have gained a lot of experience.

I've found lip synching to be a big challenge but I always love the feeling after its been done right. It amazes me how sometimes the lip synching falls into place with hardly any editing at all while others takes painstaking hours and I'm still not satisfied.

I have trouble sometimes making it look natural. I'll go through parts frame by frame and it seems to go with the words when I drag through it slowly, but then when I export it and watch it that same lip synching might come across as looking awkward. I've been trying to mouth the words with it to to try and help get a feel for it but sometimes it still looks just a bit rushed or off somehow.

Well, so this is my lip synching-pains... being good but night quite satisfied yet. Has anyone else have any more specific things they keep in mind while lip-synching or tips in general? The things I've tried have all helped me, but there are always those parts that are a pain and I can't figure out why... :? Maybe some clips are just destined to be a lip-synchers nitemare. ^_^

-star


"It amazes me how sometimes the lip synching falls into place with hardly any editing at all while others takes painstaking hours and I'm still not satisfied. "

Keep in mind I haven't seen any of your videos and I'll check them out.

I'm sorry I know that feeling where you drop in a clip and it seems to good to be true, but it is. I tried lipsyncing in my earlier videos and it really wasn't that great. The people watching it get the feeling that you were trying to lipsync but doesn't seem like Sierra Lorna, or doki doki style type of lipsync where it flows smoothly and the mouths hit the syllabels of the words. Opens up wide when the word is at its max, and smaller as the word slowly fades out. Eventhough it looks good it really can be improved. I've become more aware of this as I have edited in my newest amv which willn't be released until after AUSA at least that's what I'm thinking right now. Anyway, lipsyncing shouldn't just work out. In order to get a good lip sync to work and look natural. It really should be done on a frame by frame basis. Not saying literally frame by frame but by natural movements. One mouth open up 1/4 of the way, 1/2 way, 3/4 of the way and closed if possible. Try to find those four scenes if you want to do a still lipsync. To do a lipsync with movement I recommend leaving in the original scene and then going into Photoshop to cut out the lips. Then use the motion to adjust them so they overlay on top of the previous image.

Keep in mind I haven't seen any of your videos and I'll check them out. Lipsyncing done properly will take time but it is worth it. Well I hope I have been of some help.

If you have any other question feel free to ask us here.

Gene Starwind 21122
Image
User avatar
genestarwind21122
 
Joined: 23 Feb 2003
Location: space the final frontier....

Re: Lip synching

Postby genestarwind21122 » Thu Sep 29, 2005 9:26 pm

genestarwind21122 wrote: One mouth open up 1/4 of the way, 1/2 way, 3/4 of the way and closed if possible. Try to find those four scenes if you want to do a still lipsync.

Gene Starwind 21122


And also an all the way open shot. That makes 5.

I kinda rushed while I was typing.
Image
User avatar
genestarwind21122
 
Joined: 23 Feb 2003
Location: space the final frontier....

Postby Scintilla » Thu Sep 29, 2005 9:34 pm

Yup, it holds for in-between shots (that was the whole reason I told myself to do it that way, was that the in-between shots were going too fast, making the mouth "move" too fast).

Also, scrubbing through slowly enough that you can hear the individual "frames" of audio (for lack of a better term) can be quite useful in many cases.
ImageImage
:pizza: :pizza: Image :pizza: :pizza:
User avatar
Scintilla
(for EXTREME)
 
Joined: 31 Mar 2003
Location: New Jersey
Status: Quo

Re: Lip synching

Postby Scintilla » Thu Sep 29, 2005 9:39 pm

genestarwind21122 wrote:
genestarwind21122 wrote: One mouth open up 1/4 of the way, 1/2 way, 3/4 of the way and closed if possible. Try to find those four scenes if you want to do a still lipsync.

Gene Starwind 21122

And also an all the way open shot. That makes 5.

The problem is that, most of the time, the animators only provide us with three different mouth positions for any given talking scene. They're cheap like that.

Mind you, I said "most of the time". If you're lucky enough to find that a scene you want *does* have more positions than that, then by all means use them.
ImageImage
:pizza: :pizza: Image :pizza: :pizza:
User avatar
Scintilla
(for EXTREME)
 
Joined: 31 Mar 2003
Location: New Jersey
Status: Quo

Postby genestarwind21122 » Thu Sep 29, 2005 9:46 pm

That's true. That's why you can go closed, half, full, half, closed. If necessary to lipsync. For example " Can You..." From the line Can you feel the love tonight would be starting out closed before the word, half then to full, then to half for the word "Can", then back to full for "You", then back to half before the word Feel.
Image
User avatar
genestarwind21122
 
Joined: 23 Feb 2003
Location: space the final frontier....

Postby downwithpants » Thu Sep 29, 2005 9:57 pm

only half of lip synching is in the lips. speech production uses muscles from the upper chest, throat, and face. for example, you generally drop your shoulders slightly when you speak. also, make sure facial expression, body gestures, and body posture are appropriate. finally, never have a single lip synching scene (one shot of the speaker, without significant change in the scenery) go on for more than 5 seconds. any like any video effect, make sure you know when to use lip synching and when not -- don't place it in the video randomly.
maskandlayer()|My Guide to WMM 2.x
a-m-v.org Last.fm|<a href="http://www.frappr.com/animemusicvideosdotorg">Animemusicvideos.org Frappr</a>|<a href="http://tinyurl.com/2lryta"> Editors and fans against the misattribution of AMVs</a>
User avatar
downwithpants
BIG PICTURE person
 
Joined: 03 Dec 2002
Location: storrs, ct
Status: out of service

Postby StarMasayume » Thu Sep 29, 2005 10:50 pm

I'm sorry I know that feeling where you drop in a clip and it seems to good to be true, but it is. I tried lipsyncing in my earlier videos and it really wasn't that great. The people watching it get the feeling that you were trying to lipsync but doesn't seem like Sierra Lorna, or doki doki style type of lipsync where it flows smoothly and the mouths hit the syllabels of the words. Opens up wide when the word is at its max, and smaller as the word slowly fades out. Eventhough it looks good it really can be improved. I've become more aware of this as I have edited in my newest amv which willn't be released until after AUSA at least that's what I'm thinking right now. Anyway, lipsyncing shouldn't just work out. In order to get a good lip sync to work and look natural. It really should be done on a frame by frame basis. Not saying literally frame by frame but by natural movements. One mouth open up 1/4 of the way, 1/2 way, 3/4 of the way and closed if possible. Try to find those four scenes if you want to do a still lipsync. To do a lipsync with movement I recommend leaving in the original scene and then going into Photoshop to cut out the lips. Then use the motion to adjust them so they overlay on top of the previous image.

Gene - I suppose I should clarify that. I've never dropped a clip in there for lip synching without editing it SOMEHOW. But some just seem to take more than ten minutes before it looks right while others have just been an endless nitemare for me. I do think I need to take into consideration more about when the mouth opens wider or longer -within- the word for different pitches. It's harder though to get such detail when the clip you're lip synching with doesn't give enough mouth positions for the part. I think I have a hard time judging what positions to use sometimes. I also think that two second frame rule might help me as well.

Thanks for your response and really, I would appreciate it so much if after you look at one of my amvs you could let me know what you think I could improve on doing for my lip synching. Either of my last two you should be able to judge well enough. I can't quite figure out why Luffy's Arabian Night lip synch rating is higher than Miyazawa in Love as I feel they were about the same.

Also, scrubbing through slowly enough that you can hear the individual "frames" of audio (for lack of a better term) can be quite useful in many cases.

Yeah, that's what I mean that I usually do. :) It's what I was referring to when I said when I play through it slowly it seems fine but when I export it and watch it it might seem off.

only half of lip synching is in the lips. speech production uses muscles from the upper chest, throat, and face. for example, you generally drop your shoulders slightly when you speak. also, make sure facial expression, body gestures, and body posture are appropriate. finally, never have a single lip synching scene (one shot of the speaker, without significant change in the scenery) go on for more than 5 seconds. any like any video effect, make sure you know when to use lip synching and when not -- don't place it in the video randomly.

:shock: I think it'd be a bit hard to get the other little gestures right for lip synching an anime character. They don't give you that. Besides... it's a pain enough to work with just the mouth sometimes. ^_^ I agree that you shouldn't keep on one lip synch for long without some kind of scene change and also the importance of where to place them.

Thanks for the response so far to all of you!
User avatar
StarMasayume
 
Joined: 03 Nov 2003
Location: Florida


Return to General AMV

Who is online

Users browsing this forum: No registered users and 3 guests