Video Sound Generator-Hunyuan Foley-workflow

You can click on the link below to try it out directly. If the effect is good, you can deploy it locally

style="color:rgb(230, 73, 128)">Fan benefits,register to get 1000 points,daily login 100 points,play 4090!Experience the super power of 48G.

is Hunyuan+Foley, Video Sound Generator workflow. After testing, its sound generation effect is excellent, and the required video memory for operation is not high. It is worth recommending! If there is a higher demand for sound quality, it can be achieved by increasing the number of steps.

Local deployment installation steps:
1. Download Hunyuan+Foley model:
/>Place folder: models \ hunyuan_foley
2. Download the siglip2 model:
/>Place folder: models \ hunyuan_foley \ siglip2
3. Download the CLAP text model:
/>Place folder: models \ hunyuan_foley \ clap
4. Install plugins
-ov-file
Place folder: custom_nodes
5. Run the command in the plugin directory (custom_nodes \ Vantage HunyuanFoley):
pip install -r requirements.txt

Attention: If there is a dependency conflict prompt during the requirements process, you can try running the command:
pip install protobuf==3.19.6 diffusers timm transformers descript-audiotools omegaconf

Please refer to the original author's introduction of the plugin for details. It should be noted that this model requires a lot of dependencies and is difficult to install.