AnimateDiff

Provided by FalLearn More

AnimateDiff allows you to transform text and video prompts into dynamic videos with a wide range of motion types.

Preview

Inputs

Prompt
text

The prompt to use for generating the video. Be as descriptive as possible for best results.

Video
video

The video to transform.

optional: true
Negative Prompt
text

The negative prompt to use. Use it to address details that you don't want in the image.

default: (bad quality, worst quality:1.2), ugly faces, bad anime
Number of Frames
number

The number of frames to generate. Value is ignored when video is provided.

default: 16
First N Seconds
number

The first N number of seconds of video to animate.

default: 3
Steps
number

The number of inference steps to perform. 4-12 is recommended for turbo mode.

default: 8
Strength
number

The strength of the input video in the final output.

default: 0.7
Guidance Scale
number

The CFG scale is a measure of how close you want the model to stick to your prompt.

default: 1
Seed
seed

The same seed and prompt will output the same image every time.

default: 4788
FPS
number

Number of frames per second to extract from the video.

default: 8
Motions
dropdown

The motions to apply to the video.

optional: trueAccepts: Zoom Out, Zoom In, Pan Left, Pan Right, Tilt Up, Tilt Down
Video Size
dropdown

The size of the video to generate.

default: square_hdAccepts: Square HD, Square, Portrait 4:3, Portrait 16:9, Landscape 4:3, Landscape 16:9
Use Turbo
toggle

Turbo mode is faster but may produce lower quality results.

default: true

Outputs

Generated Video
video

The generated video from the model.