Anim8or Community

Please login or register.

Login with username, password and session length
Advanced search  

News:

An update to Anim8or, v1.00b, is available with a few bug fixes. Get your copy HERE. See the "ReadMe" file for details.

Pages: 1 2 3 [4]

Author Topic: Lip Sync Tool  (Read 2441 times)

johnar

  • Sr. Member
  • ****
  • Posts: 923
  • Make it, Move it--Give it Life
    • View Profile
    • youtube vids
Re: Lip Sync Tool
« Reply #45 on: July 14, 2020, 05:28:58 am »

Quote
(There is a little bug that when you delete a figure's phoneme the two blue zero keys aren't deleted.)
well, i'm not seeing that any more.
 In fact, everything seems to be working just fine. Even cutting, copying and pasting doesn't seem to cause any problems. I'll let you know if something comes up, but so far everything seems 'just dandy' 


I wanted to test the lipsync tool against  my statement that "Using only the phoneme and graph editor", to create keys, "could produce credible lipsync."

 So here's a  short clip using the phoneme track editor, scrubbing, and graph editor only. No pen and paper,  , and no timetrack editing/tweaking or polishing.
  The speech is fast, which can be difficult to time properly at the best of times, so it's a good test for the lipsync setup in anim8or.
 Remember this is just the placing of keys, and value adjustment with graph editor, and no tweaking/polishing at all.
 (its short and fast, so repeats 3 times)
thecolclough sorry, top teeth should not be moving. Am going to make a new character that will 'stick to the  rules'


 This short clip is mostly a mixture of 'mouth open' and 'mouth closed' phonemes. I think this test shows that lipsyncing fast speech can be accomplished by using no less than the default spacing of 2, for lead and tail keys. and without  overlaping any of the same phoneme keys.
 This is really good news.
 Fast speech is normally the hardest lipsync to get right. (it throws auto-lipsync software/apps into a 'flapping, popping' spin, and the time required to tidy it up, if possible, would have been better spent, imho,  manually laying down the initial phoneme keys in the right place at the beginning.)

The 'Lipsync tool(s)', in Anim8or, are seriously awesome.
 Not sure what other plans you have steve, but I would already give Anim8or a 10 out of 10 for simplicity and capability in creating credible lipsync.

Magic stuff.

 Bye bye Magpie.
« Last Edit: July 14, 2020, 05:33:18 am by johnar »
Logged
%

ianross

  • Full Member
  • ***
  • Posts: 177
  • Imagination is the elixir of life.
    • View Profile
    • https://www.tradebit.com/filedetail.php/164976574-part-1-anim8or-tutor-course
Re: Lip Sync Tool
« Reply #46 on: July 14, 2020, 07:47:17 am »




    Firstly thank you Steve for the new sound build, it works great and it very easy to add morph targets while scrubbing the sound bar along. Also  I like the way the morph targets names expand out when you click on them.
I agree with Johnar this is the easiest way to add sound to a talking head.
Also thank you Johnar for the postimage.org  advise.
This is wonderful, thank you Steve.
« Last Edit: July 14, 2020, 07:48:21 am by ianross »
Logged

ianross

  • Full Member
  • ***
  • Posts: 177
  • Imagination is the elixir of life.
    • View Profile
    • https://www.tradebit.com/filedetail.php/164976574-part-1-anim8or-tutor-course
Re: Lip Sync Tool
« Reply #47 on: July 14, 2020, 08:59:51 am »

Alter Ego is a free vocal synthesizer.

It is specially tailored for musical needs simply type in your lyrics, and then play on your MIDI keyboard. Its a true synthesizer, the sound can be extensively modified for easy and expressive performances.




Logged

davdud101

  • Hero Member
  • *****
  • Posts: 1031
  • Couldn't ever use Blender or Maya. Anim8or's good.
    • View Profile
Re: Lip Sync Tool
« Reply #48 on: July 14, 2020, 03:50:46 pm »

Alter Ego is a free vocal synthesizer.

It is specially tailored for musical needs simply type in your lyrics, and then play on your MIDI keyboard. Its a true synthesizer, the sound can be extensively modified for easy and expressive performances.


But I might redownload and try again.






I will have to admit - I gave it a try a while back (big into music production for almost a decade) - I couldn't figure it out at ALL... admittedly I didn't try any tutorials or anything. But it doesn't seem very tailored to the casual user who just wants to dip their toe in speech/vocal synthesis
Logged
?

Steve

  • Administrator
  • Hero Member
  • *****
  • Posts: 1875
    • View Profile
Re: Lip Sync Tool
« Reply #49 on: July 16, 2020, 10:25:09 am »

johnar Wow! Your 2 mouth-shape speech is really amazing. It will really help for larger groups of minor characters, etc. You won't need to make manyh shapes for each character, etc. I suspect that it would start to break down for slow speech, but it's so much easier that I'd always start with fewer rather than more morphs, then see if it needed improving.

Nice demo.
Logged

johnar

  • Sr. Member
  • ****
  • Posts: 923
  • Make it, Move it--Give it Life
    • View Profile
    • youtube vids
Re: Lip Sync Tool
« Reply #50 on: July 16, 2020, 09:56:13 pm »

Thanks steve. yes, all mouth open and mouth closed, except 'F' was used 4 times, ('if', 'give', 'of' and advice and 'S' once, in 'advice'.

Quote
I suspect that it would start to break down for slow speech

 True. but also, I'm finding that, easily, the most used phonemes are mouth open, mouth closed, F, E, and O, and probably 'S'. ( S = 'E' with teeth)
 I'm pretty confident that those 6 mouth shapes, in conjunction with graph editor, are enough to cover pretty well any speech. 
« Last Edit: July 16, 2020, 09:57:29 pm by johnar »
Logged
%

Steve

  • Administrator
  • Hero Member
  • *****
  • Posts: 1875
    • View Profile
Re: Lip Sync Tool
« Reply #51 on: July 16, 2020, 10:13:07 pm »

ianross I forgot to reply to you post. Nice pointer to Alter Ego. It's a great, FREE tool and will work well with Anim8or. Somebody or bodies with digital sound experience has really made a contribution!
Logged

johnar

  • Sr. Member
  • ****
  • Posts: 923
  • Make it, Move it--Give it Life
    • View Profile
    • youtube vids
Re: Lip Sync Tool
« Reply #52 on: July 18, 2020, 05:20:10 am »

 I've also realised i should have responded to your post, and i'm definately quite keen to check that out. I've actually just downloaded the program, and am about to download the .pdf users guide. (nudge nudge to davdud101 )

 Thanks for the heads up ianross this might be just what the band needs, a voice..
« Last Edit: July 18, 2020, 09:08:57 am by johnar »
Logged
%
Pages: 1 2 3 [4]