# Multiple conditioning in diffusion
**URL:**
**Author:**  [@Anjusree](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAnjusree)%5C
**Post date:** [August 19, 2025, 3:44am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-conditioning-in-diffusion%2F167235%2F1 "2025-08-19T03:44:23Z")
How can I add multi-conditioning to a diffusion model, it can be a text embedding and an image. I tried with concatenation and cross attention. But experiencing a problem, the performance of the model increases to a certain point and keeps on decreasing after that, but the loass curves looks perfect both are decreasing. I tried with earlystopping but teh model is not reaching teh expected performance. I appreciate if there is any lead on this from someone.
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [August 19, 2025, 7:31am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-conditioning-in-diffusion%2F167235%2F2 "2025-08-19T07:31:04Z")
Hmm… How about using [IP-Adapter](https://huggingface.co/docs/diffusers/en/using-diffusers/ip_adapter) or [T2I-Adapter](https://github.com/TencentARC/T2I-Adapter) or [ControlNet](https://github.com/lllyasviel/ControlNet), etc. ?
---
**Author:**  [@Anjusree](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAnjusree)%5C
**Post date:** [August 21, 2025, 1:24am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-conditioning-in-diffusion%2F167235%2F3 "2025-08-21T01:24:44Z")
Hi John thanks for the response, the model I am using is a DDPM based one Hope it will work for the same
---
**Author:**  [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [August 21, 2025, 1:48am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-conditioning-in-diffusion%2F167235%2F4 "2025-08-21T01:48:31Z")
I can’t say for sure whether the weight will function as it is now, but [in principle, I think something similar should work](https://arxiv.org/abs/2302.08453).
---
**Author:**  [@Anjusree](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FAnjusree)%5C
**Post date:** [August 21, 2025, 2:00am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-conditioning-in-diffusion%2F167235%2F5 "2025-08-21T02:00:32Z")
Okay thanks John