constraint.py

SYS_PROMPT = ""

USER_PROMPT = """# CONTEXT #

You are a powerful video captioner.I want to tag 200,000 video files for use in training a text-to-video dataset. The purpose of the video tags is to train a text-to-video model. You need to provide a structured, detailed, and accurate description of the given video. 

# OBJECTIVE #

Video Description Task Instructions
Video Content Description:

Detail and Accuracy: Provide a detailed and accurate description of the video content. Include all key objects, their types, colors, actions, positions, and relative positions. Describe the overall atmosphere.
Persons and Animals: If there are people, describe their appearance and actions. If there are animals, describe their behavior to give a clear understanding of the scene.
Multiple Scenes: If the video has multiple scenes, describe how they transition and highlight the differences between them.
Objectivity: Do not include imagined content or overly subjective feelings. Ensure all descriptions are based on what can be confidently determined from the video.
Grammar and Length: Use correct English grammar. Each descriptive sentence should be at least three sentences long.
Video Quality Evaluation:

Aesthetic Value: Evaluate the aesthetic value, including composition, color harmony, and overall visual effect. Score this aspect from 1 to 5 and explain your reasoning.
Clarity: Assess the clarity, including resolution and detail presentation. Score this aspect from 1 to 5 and explain your reasoning.
Emotional Impact: Evaluate the emotional impact, including how well the video conveys emotions and resonates with the audience. Score this aspect from 1 to 5 and explain your reasoning.
Summary: Provide a summary of the scores for aesthetic value, clarity, and emotional impact.
Film Perspective Analysis:

Shot Analysis: Analyze the type of shots used (close-up, medium, long shot, etc.).
Camera Movements: Describe the camera movements (push, pull, pan, tilt, track, crane, etc.).
Composition: Analyze the composition of the shots.
Interpretation: Provide your interpretation and feelings about the photographic work.

# STYLE #
cinematic language，such as narrative techniques, visual aesthetics, editing styles, and sound design. 

# Output Structure #
Video Content:

{Detailed description of the video here, meeting the above requirements}.

Video Quality:

{Evaluation score and explanation of the video quality here}.
Film Perspective Description:


{Analysis of the video from a film perspective here}.
Example:

Video Content:

A stylish woman strides down a Tokyo street illuminated by warm neon lights and animated city signage. She sports a black leather jacket, a long red dress, black boots, and carries a black purse. Her look is completed with sunglasses and red lipstick. Her demeanor is confident and casual. The damp street reflects the vibrant lights, creating a mirror effect. The scene is bustling with numerous pedestrians.
Video Quality:

Aesthetic Value:
- Composition and Color: The video showcases a well-balanced composition with harmonious color schemes, achieving a visually pleasing effect. Techniques such as symmetry and dynamic composition are skillfully employed.
- Camera Work: The visual experience is enhanced by smooth transitions and diverse angles.
- Score: 4/5

Clarity:
- Resolution: The video boasts high resolution with clear details.
- Detail Presentation: It presents rich details with no noticeable blurriness or distortion.
- Score: 5/5

Emotional Impact:
- Emotion Conveyance: The video successfully conveys joy and excitement, striking a chord with the audience.
- Resonance: The compelling emotional expression, supported by well-integrated music and visuals, creates a strong impact.
- Score: 4/5

Summary:
- Aesthetic Value: 4/5
- Video Clarity: 5/5
- Emotional Impact: 4/5
Film Perspective Description:

Characters:
- Woman: A stylish woman dressed in a black leather jacket, long red dress, black boots, and carrying a black purse. She wears sunglasses and red lipstick.

Scenes:
- Tokyo Street: The street is filled with warm glowing neon lights and animated city signage, with damp reflective surfaces and numerous pedestrians.

Shot 1:
- The woman walks confidently and casually down the Tokyo street.
- She heads towards the camera in a panoramic view with central composition. The camera is at eye level and follows her with a handheld shot.
- Duration: 36 seconds

Shot 2:
- The woman continues her walk down the Tokyo street, maintaining her confident and casual demeanor.
- She approaches the camera, with a close-up of her face, transitioning to a torso mid-shot. The camera remains at eye level, following her with a handheld shot.
- Duration: 24 seconds

"""

SKIP = 2
TEMP = 0.3
TOP = 0.75
MAX_TOKEN = 512

API_CLASSES = {
    'Azure': 'AzureAPI',
    'Google': 'GoogleAPI',
    'Anthropic': 'AnthropicAPI',
    'OpenAI': 'OpenAIAPI'
}

PROVIDERS_CONFIG = {
    'Azure': {
        'model': ['GPT-4o', 'GPT-4v'],
        'key_label': 'Azure API Key',
        'endpoint_label': 'Azure Endpoint'
    },
    'Google': {
        'model': ['Gemini-1.5-Flash', 'Gemini-1.5-Pro'],
        'key_label': 'Google API Key',
        'endpoint_label': 'Google API Endpoint'
    },
    'Anthropic': {
        'model': ['Claude-3-Opus', 'Claude-3-Sonnet'],
        'key_label': 'Anthropic API Key',
        'endpoint_label': 'Anthropic Endpoint'
    },
    'OpenAI': {
        'model': ['GPT-4o', 'GPT-4v'],
        'key_label': 'OpenAI API Key',
        'endpoint_label': 'OpenAI Endpoint'
    }
}

GENERAL_CONFIG = {
    'temp': {
        'label': 'Temperature',
        'default': 0.3,
        'min': 0,
        'max': 1,
        'step': 0.1
    },
    'top_p': {
        'label': 'Top-P',
        'default': 0.75,
        'min': 0,
        'max': 1,
        'step': 0.1
    },
    'max_tokens': {
        'label': 'Max Tokens',
        'default': 4096,
        'min': 512,
        'max': 4096,
        'step': 1
    },
    'frame_format': {
        'label': 'Frame Format',
        'default': 'JPEG',
        'choices': ['JPEG', 'PNG']
    },
    'frame_skip': {
        'label': 'Frame Skip',
        'default': 2,
        'min': 2,
        'max': 100,
        'step': 1
    },
    'group_size': {
        'label': 'Group Size',
        'default': 10,
        'min': 1,
        'max': 100,
        'step': 1
    }
}