Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MasaCtrl with T2I adapter #42

Open
lavenderrz opened this issue May 8, 2024 · 1 comment
Open

MasaCtrl with T2I adapter #42

lavenderrz opened this issue May 8, 2024 · 1 comment

Comments

@lavenderrz
Copy link

Hi there,

Thanks for your great work. I tried using masactrl with T2I adapter - openpose variant. The T2I adapter is able to generate images in input pose, but as soon as I add the inverted latent + masactrl, the conditioning from the pose seems to disappear. The pose does not change according to conditioning from the input pose and where it does change (however minimal), the generated image looks distorted. Do you have any idea what is causing this? I have tried turning guidance scale very high, but doesn't help much.

@ljzycmd
Copy link
Collaborator

ljzycmd commented May 10, 2024

Hi @lavenderrz, thanks for your interest. As for this case, you may change the control hyper-parameters: step and layer to obtain better results.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants