Skip to main content
This guide shows you how to use AI-generated video clips as scene backgrounds. Instead of stock footage, generate unique motion video clips from text prompts using AI video models, each offering different quality levels, durations, and AI credit costs.

What You Will Learn

AI Video Generation

Generate unique video clips as scene backgrounds

Video Models

Choose from Pixverse 5.5, Veo 3.1 Fast, and Veo 3.1

Duration Control

Configure clip duration from 4 to 10 seconds per model

AI Credit Costs

Understand per-second credit costs for each model

Before You Begin

Make sure you have:
  • A Pictory API key
  • Node.js or Python installed on your machine
  • Sufficient AI credits in your account (video generation costs more than image generation)
  • Basic understanding of AI video generation concepts

How It Works

When you set background.type to "video" and provide an aiVisual configuration, Pictory generates a unique AI video clip for the scene background:
  1. Prompt Processing: Your text prompt (or auto-generated prompt from story text) describes the desired motion video
  2. Video Generation: The chosen video model creates a unique clip of the specified duration
  3. Scene Integration: The generated video clip is used as the scene background
AI video generation takes significantly longer than image generation and costs more AI credits. The credit cost is calculated per second of video generated. Plan for additional processing time and budget accordingly.

Configuration Reference

Background Object

When using AI-generated video clips, set the background object on a scene as follows:
Mutually Exclusive: The background object can only have one of visualUrl, color, or aiVisual. You cannot combine them in the same scene.

aiVisual Parameters

Available Video Models

Each model has different quality, supported durations, aspect ratios, and per-second AI credit costs.

Duration Options

Each model supports specific clip durations. If videoDuration is omitted or invalid for the selected model, the first (shortest) duration is used as the default.

Supported Aspect Ratios

The video aspect ratio is determined by the aspectRatio property at the top level of the request. Different models support different aspect ratios:
If the request’s aspectRatio is not supported by the selected video model, the system automatically falls back to the model’s first supported aspect ratio.

AI Credit Cost Calculator

AI credits for video generation are calculated as: credits per second x duration in seconds.
Cost-Saving Strategy:
  • Use pixverse5.5 at "5s" (8 credits) for testing and drafts
  • Use shorter durations when possible: a 4s clip costs half of an 8s clip
  • Reserve veo3.1 for final production where cinematic quality matters

Examples

Example 1: Single Story Without Prompt

One scene with a story paragraph. The system splits the story into multiple scenes using createSceneOnEndOfSentence and auto-generates a visual prompt for each scene from its story text.

Example 2: Single Story with Creative Direction

Same as Example 1, but with a prompt that acts as creative direction for the entire video. Since the story is split into multiple scenes, the prompt guides the overall visual tone rather than describing a specific scene. A good creative direction prompt follows this structure: [Action/Movement] + [Scene/Environment] + [Camera Technique] + [Visual Style].

Example 3: Multiple Scenes with Prompts

Three separate scenes, each with a one-sentence story and a scene-specific prompt. The prompt directly describes the visual for that scene.

Example 4: Multiple Scenes Without Prompts

Three separate scenes, each with a one-sentence story. No prompts are provided, so the system auto-generates a visual prompt from each scene’s story text.

Tracking AI Credits Used

When your video includes AI-generated visuals, the job response includes an aiCreditsUsed field that reports the total AI credits consumed across all scenes. This field is present only when at least one scene used aiVisual configuration.
Use this value to track credit consumption and manage your AI credit budget. For detailed job response documentation, refer to the Get Storyboard Preview Job or Get Video Render Job API reference.

Best Practices

Video prompts should describe motion and action, not just a static scene:
  • Include movement: “camera slowly panning across”, “particles flowing”, “waves crashing”
  • Describe transitions: “sunrise gradually illuminating”, “zoom into details”
  • Be specific about motion: “cars driving through city streets” vs. just “city street”
  • Keep under 500 characters: Focused prompts produce better results
Good: “Aerial drone shot slowly flying over a tropical coastline with turquoise waves rolling onto white sand”Poor: “Beach scene”
Start with pixverse5.5 for iteration, then switch to veo3.1_fast or veo3.1 for production.
Video generation can consume credits quickly. Plan your budget:
  • Use shorter durations when possible: 4s is often enough for a single scene
  • Use pixverse5.5 for scenes where basic motion is sufficient
  • Reserve veo3.1 for hero scenes that need premium quality
  • Mix AI video clips with AI images or stock visuals across scenes to manage costs
AI video generation takes significantly longer than image generation:
  • pixverse5.5: Fastest video generation
  • veo3.1_fast: Moderate processing time
  • veo3.1: Longest processing time but highest quality
  • Multiple scenes with AI video clips will multiply total processing time
  • Consider using AI video for key scenes only
Not all models support all aspect ratios:
  • pixverse5.5 supports 16:9, 9:16, 1:1
  • veo3.1_fast and veo3.1 only support 16:9 and 9:16
  • If your video uses 1:1 aspect ratio, use pixverse5.5
  • The system auto-corrects unsupported aspect ratios to the model’s default

Troubleshooting

  • Add motion-specific language to your prompt: “slowly panning”, “zooming in”, “flowing”
  • Avoid static descriptions; describe what is happening, not just what is there
  • Try a higher-quality model for more nuanced motion rendering
Each model has specific valid durations:
  • pixverse5.5: "5s", "8s", "10s"
  • veo3.1_fast: "4s", "6s", "8s"
  • veo3.1: "4s", "6s", "8s"
Make sure you use a duration supported by your selected model.
Video generation costs AI credits per second. Check your balance:
  • A veo3.1 clip at "8s" costs 160 credits per scene
  • Switch to pixverse5.5 at "5s" (8 credits) for budget-friendly generation
  • Reduce videoDuration to lower the cost
If you specify an aspect ratio not supported by the video model, the system automatically falls back to the model’s default:
  • veo3.1 / veo3.1_fast only support 16:9 and 9:16
  • Use pixverse5.5 for 16:9, 9:16, and 1:1 aspect ratios

Next Steps

AI-Generated Background Images

Use AI-generated images as scene backgrounds

AI Voice-Over

Add professional narration to your videos

Brand Settings

Apply consistent branding automatically

Background Music

Add music to complement your visuals

API Reference

Render Storyboard Video

Direct video rendering with AI visuals

Create Storyboard Preview

Create preview before rendering

Get Storyboard Preview Job

Monitor storyboard creation progress

Search Media

Search stock visuals as alternative to AI