Sammie-Roto - ANOTHER Rotoscoping/masking tool

[Zarxrax]

So, one year ago I launched Cutie-Roto, a tool to help with masking and rotoscoping video clips.
Now I have released an entirely different tool, which kinda does the same thing, called Sammie-Roto.

So, what's the difference? Aside from having an entirely different interface, Sammie-Roto is based on Meta's "Segment Anything Model 2", which is kind of the new state of the art in image and video segmentation. It was not trained on anime content, but still does a pretty respectable job on it. I would hopefully like to try to fine-tune the model on anime content in the future.

So, is Sammie-Roto better than Cutie-Roto for anime? Well, I dunno. Maybe? Each one might work better in different situations, so just consider it another tool in the toolbox.

https://github.com/Zarxrax/Sammie-Roto

Update: Use the newer Sammie-Roto 2 instead: https://github.com/Zarxrax/Sammie-Roto-2

[SQ]

Thanks for another great tool!
I started using cutie roto not too long ago and it performed much better than I expected.
I'm excited to see what Sammie can do, once I have a project that might have a use for it.

[Zarxrax]

I just released version 1.1 which adds support for Human Video Matting via MatAnyone, in addition to several improvements and quality of life fixes. The matting is not particularly useful for anime though, its more of a feature for live-action content.

https://github.com/Zarxrax/Sammie-Roto

[Zarxrax]

Would love to see a way to refine edges manually after the segmentation. Any plans for that?

I dont believe there is much more that I could do regarding the edges of the segmentation masks other than adding a blur option. And I haven't added that because I think it doesnt look very good. You can tweak the mattes in an editing program like resolve or after effects though. Note that there is already an option to grow/shrink the mask, as well as an edge smoothing option under the export settings.

[Zarxrax]

Sammie-Roto 2 has been released! This is a complete rewrite from the ground up, with tons of new features and enhancements.

https://github.com/Zarxrax/Sammie-Roto-2

[Sonicfreak1111]

Sammie-Roto 2 has been released! This is a complete rewrite from the ground up, with tons of new features and enhancements.

https://github.com/Zarxrax/Sammie-Roto-2

It's worth it to try it out, the program itself responds way faster through the Qt framework as opposed to Gradio with Sammie-Roto-1. Also the new object removal functionaly is pretty nifty.