✅ Gen-AI Images in Storyboard API — Now Live

We're excited to announce that AI-Generated Visual Support is now available in the Pictory Storyboard API! You can now automatically generate custom background images using advanced AI models directly through our API.

What's New?

The Storyboard API now supports the aiVisual parameter in the background property, allowing you to:

• Generate custom images on-the-fly using AI models
• Choose from multiple AI models including SeeDream 3.0, Flux-Schnell, Nanobanana, and Titan
• Apply different visual styles such as photorealistic, artistic, cartoon, minimalist, vintage, and futuristic
• Provide custom prompts to describe the exact images you want for your video backgrounds

How It Works

Instead of providing a visualUrl or color for your scene backgrounds, you can now use the aiVisual object:

{
  "background": {
    "aiVisual": {
      "prompt": "A serene beach at sunset with golden sand and calm waves",
      "model": "seedream3.0",
      "mediaStyle": "photorealistic"
    },
    "type": "image",
    "settings": {
      "zoomAndPan": true
    }
  }
}

Key Features

AI Models Available

• seedream3.0 - High-quality image generation with excellent detail
• flux-schnell - Fast generation with good quality balance
• nanobanana - Optimized for quick results
• titan - Advanced model for complex visual requirements

Visual Styles

• photorealistic - Realistic, photo-like images
• artistic - Creative, artistic interpretations
• cartoon - Stylized, cartoon-like images
• minimalist - Clean, simple designs
• vintage - Classic, retro aesthetics
• futuristic - Modern, sci-fi inspired images

Flexible Prompt Support

• Provide custom prompts up to 500 characters
• If no prompt is provided, the AI will automatically generate images based on your scene's story content
• Combine with scene settings like zoom and pan for dynamic effects

Use Cases

1. Automated Content Creation - Generate unique images for each scene without manual image sourcing
2. Consistent Brand Aesthetics - Use the same model and style across all scenes for cohesive videos
3. Rapid Prototyping - Quickly test different visual concepts without sourcing stock media
4. Custom Illustrations - Create specific images that match your exact requirements
5. Dynamic Storytelling - Generate contextual backgrounds that enhance your narrative

Example Request

Here's a complete example showing how to create a video with AI-generated images:

{
  "videoName": "ai_generated_video",
  "language": "en",
  "backgroundMusic": {
    "enabled": true,
    "autoMusic": true,
    "volume": 0.5
  },
  "voiceOver": {
    "enabled": true,
    "aiVoices": [
      {
        "speaker": "Jackson",
        "speed": 100
      }
    ]
  },
  "scenes": [
    {
      "story": "Welcome to the future of video creation with AI-generated images.",
      "createSceneOnEndOfSentence": true,
      "background": {
        "aiVisual": {
          "prompt": "Futuristic digital workspace with holographic displays",
          "model": "seedream3.0",
          "mediaStyle": "futuristic"
        },
        "type": "image",
        "settings": {
          "zoomAndPan": true
        }
      }
    }
  ]
}

Important Notes

• The aiVisual property is mutually exclusive with visualUrl and color - you can only use one per background
• When using aiVisual, the background type must be set to "image"
• AI-generated images work with all background settings including zoom and pan effects and Ken Burns effects.
• The prompt field is optional - if not provided, the AI will generate appropriate images based on your story content
• Generation time may vary depending on the selected model and complexity of the prompt