KLING AI Guide (Video)

1. Essential Functions

*Text-to-Video

By inputting a text passage, the Kling large model generates a 5-second or 10-second video that translates the text into visual imagery. It currently 
supports two modes of generation: "Standard Mode" for quicker video production and "Professional Mode" for superior image quality. "Kling" also supports 
three aspect ratios: 16:9, 9:16, and 1:1, to more diversely meet everyone's video creation requirements.
We recognize that "Prompt" serves as the key interactive language for the text-to-video model, and it directly dictates the content of the video 
produced by the model. Consequently, understanding and learning how to use effective Prompts for AI video creation is a goal for all creators. As 
the new incarnation of the AI video model 2.0, "Kling" continues to evolve and improve. It's essential to explore continuously and tap into the full 
potential of Kling to adeptly utilize it and excel in AI video production. We have crafted a formula for Kling prompts for your reference:

Prompt  =  Subject（Subject Description）+ Subject Movement + Scene（Scene Description）+（Camera Language + 
Lighting + Atmosphere)
-- optional
Subject: The subject is the main focus in the video, serving as an important embodiment of the theme. It can be people, animals, plants, objects, and so on；
Subject Description: Descriptions of the subject's appearance details and body posture can be listed using multiple short sentences. For example: Athletic 
performance, Hairstyle and color, Clothing and accessories, Facial features, Body posture and so on；
Subject Movement: Descriptions of the subject's movement status, including stillness and motion, should be straightforward and suitable for a 5-second 
video；
Scene: The scene represents the environment in which the subject is situated, encompassing the foreground, background, and other elements;
Scene Description: Scene descriptions for the subject's environment can be concise and focused, using a few short sentences to outline the setting without 
overwhelming the viewer. It should be suitable for what can be displayed within a 5-second video. Such as Indoor scene, Outdoor setting, Natural scene;
Camera Language: It pertains to employing various applications of the camera lens, along with the transitions and edits between shots, to communicate a 
narrative or message and to generate particular visual impacts and emotional tones. Techniques include ultra-wide angle shots, bokeh (background blur), 
close-ups, telephoto shots, low-angle shots, high-angle shots, aerial views, and depth of field, among others; (Note: This should be differentiated from camera 
motion control.)
Lighting: Light and shadow are the vital elements that imbue photographic works with soul. The application of light and shadow can make photos more 
profound and emotionally resonant, enabling us to create works with a rich sense of depth and expressive power. Techniques include:Ambient lighting, Morning 
light, Sunset, Interplay of light and shadow, Tyndall effect, Artificial lighting; 
Atmosphere: Describing the atmosphere of the anticipated video footage can involve various elements to set the mood and tone. 

The most fundamental components of the aforementioned formula are the subject, motion, and setting, which constitute the most straightforward and essential units for depicting a video scene. To provide a more detailed description of the subject and setting, one should enumerate various descriptive short sentences, maintaining the integrity of the elements intended to appear in the Prompt. "Kling" will then extrapolate from our expressions to produce a video that aligns with our vision.
Given "A giant panda is reading a book in a café," we can enrich the details of the subject and scene by adding: "A giant panda, wearing black-rimmed glasses, is reading a book in a café, with the book resting on a table where a steaming cup of coffee sits beside it, next to the café's window." This creates a more specific and manageable image. If you want to add some cinematic language and lighting ambience, we can also try to "Shot in medium range, with a blurred background and atmospheric lighting, a giant panda, adorned with black-rimmed glasses, is seen reading a book in a café. The book lies on a table, accompanied by a steaming cup of coffee, steaming hot, next to the cafe windows, movie-level color palette". The texture of the video generated in this way will be further enhanced, and it is possible to get results beyond expectations.

prompts:
- A giant panda is reading a book in a café.
- A giant panda wearing black-framed glasses is reading a book in a café, with the book placed on the table. On the table, there is also a cup of coffee emitting steam, and next to it is the café's window.
- In the shot, a medium shot with a blurred background and ambient lighting captures a scene where a giant panda, adorned with black-framed glasses, is reading a book in a café. The book rests on the table, accompanied by a cup of coffee that's steaming gently. Beside the cozy setting is the café's window, with a cinematic color grading applied to enhance the visual appeal.
video

The purpose of the formula is to help everyone more effectively describe the video scenes they envision. We can also let our imagination run wild and not be limited by the formula, to communicate freely and boldly with "Kling," which might yield even more astonishing outcomes! Here are some excellent examples shared by creators, let's check them out~


Prompt: A giant panda is eating hot pot with chopsticks, with the street as the background.

Prompt: A Pikachu is sitting on a chair, drinking coffee and reading a newspaper.

Prompt: A polar bear is playing the violin in the snow.

Prompt: A bee with a puppy's head

Prompt: Morning mist, sunrise, lens flare, and a cool breeze. A young Chinese woman with exquisite facial features, her long hair blown by the wind, strands of hair scattered across her face, dressed in summer attire, with a 
seaside beach as the backdrop.

Prompt: Indoor shooting, close-up, a Chinese child is eating dumplings.

Prompt: A beautiful girl with Chinese style

Prompt: A Chinese little girl is holding a pink balloon and smiling happily in the playground, with a slide in the background.

Prompt: Aerial shot, blue waves pounding against the rocks, a magnificent and magnificent scene.

Prompt: A medieval sailing ship sailing on the sea, a foggy night, bright moonlight, and an eerie atmosphere.

Prompt: First-person perspective, high-speed flight, symmetrical composition, rotation, countless lightning bolts amidst dark clouds, motion blur.

Prompt: The camera zooms into a beacon tower on the Great Wall, first-person perspective, high-speed flight,symmetrical composition, motion blur, and atmospheric lighting.

Prompt: A space fighter jet speeds through a huge sci-fi internal tunnel, rushes out of the tunnel into space, and a space battle can be seen at the end of the tunnel.

Prompt: A racing car is racing on the surface of the moon against a space backdrop, with tilt-shift zoom effect.

Prompt: Aerial shot of a cyberpunk city.

Prompt: On an alien planet, the streetscape of a cyberpunk city, with futuristic buildings, the camera slowly advances forward, and there are pedestrians on the street.

Prompt: A woman is engaged in a gunfight with someone in an alley, with a Blade Runner-style atmosphere, neon lights, and ambient lighting.

Prompt: First-person perspective, a man driving a car on a night street with fireworks blooming ahead.

Prompt: A circling camera shot captures a handsome young man dressed in ancient clothing, wearing white, seated by the pond with his eyes closed, meditating.

Prompt: The back view of a woman, in a red long gown, standing on the rooftop, with buildings smoking in the distance.


Tips
- Use simple words and sentence structures, avoiding overly complex language;
- Keep the visual content as simple as possible, aiming for a completion within 5 to 10 seconds;
- Using words like "Oriental mood," "China," and "Asia" can more easily generate a Chinese style and depict Chinese people; 
- Current large video models are not sensitive to numbers, making it difficult to maintain consistency in counts, such as "10 puppies 
on the beach";
- For a split-screen scene, you can use a prompt like: "4 camera angles, representing spring, summer, autumn, and winter."；
- At the current stage, it is challenging to generate complex physical movements, such as the bouncing of a ball or the trajectory of a 
high-altitude throw；

* Image-to-Video

By inputting an image, the "Kling" large model generates a 5-second or 10-second video that animates the image into moving visuals. With the addition of a text description, the "Kling" large model can produce a video sequence that integrates the text's narrative with the image. It currently supports two modes of generation: "Standard Mode" for quicker video output and "Professional Mode" for enhanced visual quality. Moreover, it accommodates three aspect ratios: 16:9, 9:16, and 1:1, catering to a wider range of video creation requirements.
Image-to-Video is currently the most utilized feature by creators, primarily because it offers greater control over the video creation process. Creators can utilize pre-generated images to create dynamic videos, greatly reducing the professional video production costs and entry barriers. From a creative perspective, "Kling" offers a new platform for creativity, enabling users to direct the motion of the subjects within images through text. Trends such as "reviving old photos," "embracing your younger self," and the whimsically termed "hallucinogenic mushroom video" where mushrooms appear to turn into penguins, showcase "Kling" as a creative tool. It provides infinite possibilities for users to bring their creative visions to life.
For Image-to-Video generation, controlling the motion of the subject within the image is the core aspect. Here's a formula for Kling prompts for your reference:
💡
Prompt  =  Subject + Movement，Background + Movement  ······

- Subject: The subject is the main focus in the video, serving as an important embodiment of the theme. It can be people, animals, plants, objects, and so on；
- Movement: Descriptions of the subject's movement status；
- Background: Background of the scene.

The most fundamental elements of the formula are the subject and the movement. In contrast to Text-to-Video, which necessitates scene description, Image-to-Video is already provided with a scene. Thus, it only requires the depiction of the subjects in the image and the intended movement for these subjects. Should there be several subjects with various movement, list them sequentially. "Kling" will then extrapolate from our expressions and its comprehension of the image to produce a video that aligns with the anticipated outcome.
If you want to have Mona Lisa in the painting wear sunglasses, when we simply input "wear sunglasses", the model may have difficulty understanding the instruction, and thus is more likely to generate a video based on its own judgment. When "Kling" determines that it is a painting, it is more likely to generate a video with panning effects of the painting exhibition, which is also the reason why photos are prone to generating static videos. Therefore, we need to describe "subject + movement" to help the model understand the instruction, such as "Mona Lisa puts on sunglasses with her hand," or for multiple subjects, "Mona Lisa puts on sunglasses with her hand, and a ray of light appears in the background," the model will respond more easily.

As we mentioned before, the purpose of the formula is to help everyone more effectively describe the video scenes they envision. Please feel free to communicate with Kling! Here are some excellent examples shared by creators, let's check them out~


Prompt：Two people hugging each other

Prompt：Two boys hugging each other

Prompt：The little boy smiles at the camera

Prompt：A beautiful Chinese girl 
looks into the distance and smiles.

Prompt：A cat is kneading dough in the kitchen.


Prompt：The red-crowned crane is looking for food.

Prompt：The model is smiling with her hair blown by the wind.

Prompt：The panda is eating an apple.

Prompt：The athlete is cycling on the highway with a sense of speed.

Prompt：Flying dust and floating clothes.

●Tips
- Use simple words and sentence structures, avoiding overly complex language;
- Movement should comply with the laws of physics, and it's best to describe movements that are likely to occur in the image;
- A description that significantly deviates from the image may cause a camera cut or transition;
- At the current stage, it is challenging to generate complex physical movements, such as the bouncing of a ball or the trajectory of a high-altitude throw;

* Extend with Prompts

The AI-generated video can be further extended by 4-5 seconds and allows for multiple continuations, reaching a total length of up to 3 minutes. Video continuation creation can be achieved by making subtle adjustments to the prompt phrases.The Extend with Prompts feature is located at the bottom left Tab after video generation, with two modes: "Auto-Extend" and "Customized Extend". "Auto-Extend" means that there is no need to input a prompt; the model autonomously continues the video based on its interpretation of the content within the video itself. "Customized Extend" enables users to dictate the continuation of the video via text input. In this mode, the prompt should be pertinent to the original video, clearly defining the "subject and motion" from the initial footage, to maximize the likelihood that the extended video will maintain continuity and not break from the established narrative. We have provided the following formula for reference:
💡
Prompt = Subject + Movement 
- Subject: Refers to the subject you wish to animate in the uploaded image. And to ensure a better response from the text-based AI, it is more effective to 
choose one main subject;
- Movement: Descriptions of the subject's movement status.

Original Video
Prompt2
Prompt3
-
Extend x1: A woman is standing in the snow, raising her right hand to touch the brim of her hat.
Extend x2: The woman lowers her hand and looks into the distance.

●Some high-quality examples （Video examples below are shared by Kling creators）
 
Prompt：The mushrooms in the plate transform into a group of penguins that walk in the snow.
 
Prompt：Numerous puppies crawling out from the box.
 
Prompt：Kitten walking into the snow

Prompt: First-person perspective, in a car race, holding the steering wheel of a sports car, accelerating on the 
highway.

●Tips
- When applying the "Customized Extend" function, the prompt needs to be consistent with the main subject of the original video; unrelated text may cause a camera cut or transition;
- The extending process has a certain degree of probability involved, and it may require multiple extending process to generate a video that meets expectations;

2. Advanced Function
Standard Mode & Professional Mode
"Standard Mode" refers to a model that generates videos faster and has lower inference costs. It allows for rapid validation of the model's effectiveness in High-Performance mode, meeting the needs of users to realize their creativity.
"High Qulity" is a model that generates videos with richer details and higher inference costs. It can produce high-quality videos through the High-Quality  mode, meeting the needs of creators for advanced-level works.
For Standard Mode and Professional Mode, there are the following advantages respectively. We can choose the mode based on actual conditions:
●Standard Mode: The video generation is cost-effective. It excels in creating portraits, animals, and scenes with significant motion. The generated animals appear more amiable, and the color grading of the visuals is soft and pleasing. Standard Mode is a model that has received widespread acclaim since Kling hit the market; 
●Professional Mode: The video generation boasts Professional Mode. It excels in creating videos featuring portraits, animals, architecture, and landscapes, with richer details and more sophisticated composition and color atmosphere. It is currently the most frequently used model for intricate video production at this stage. 

Prompt: A panda is playing guitar by the lake
Standard Mode: 🌟🌟🌟🌟
The panda moves naturally, with the video's color tones being soft and pleasing；
Professional Mode: 🌟🌟🌟🌟
The details of the guitar are richer, the imagination of the scene is enhanced, and the camera movement is more stable.

Prompt: A medieval sailing ship is navigating the sea on a foggy night, with the bright moonlight illuminating the scene
Standard Mode: 🌟🌟🌟
●The motion in the scene appears natural, though the details are not very pronounced, and the video's color tones are 
soft; 
Professional Mode: 🌟🌟🌟🌟🌟
●The scene is rich in details, the sails conform to the physics of motion, giving it a cinematic quality, and the camera movement is more stable.


* Camera Movement
The camera movement control now supports six basic camera movements, including 'horizontal, vertical, zoom, pan, tilt, roll', as well as four Master Shots: 'move left and zoom in, move right and zoom in, move forward and zoom up, move down and zoom out'. 
Camera movement is a form of cinematic language. To meet the diversity of video creation and to allow the model to better respond to the creators' control over the camera, the platform has added Camera Movement function. The function allow us to control the camera movement in the video frame with absolute commands, and select the extent of the camera movement by adjusting the displacement parameters. Here are different camera movement examples for "A giant panda is playing the piano by the lake":

Horizontal
Vertical
Zoom
Pan
Roll
Tilt
Master Shot: Move Left and Zoom In
Master Shot: Move Right and Zoom In
Master Shot: Move Forward and Zoom Up
Master Shot: Move Down and Zoom Out

Start and End Frames
Start and End Frames function allows you to upload two images, and the model will use these two images as the starting and ending frames to generate a transition video. Experience it by clicking on the 'Add End Frame' option located at the top right corner of the 'Image to Video' function.

The first and last frame functions can achieve finer control over videos. At this stage, they are mainly used in video creation for generating videos with control requirements for the first and last frames, which can better achieve the desired dynamic transition of the generated video. However, it should be noted that the content of the first and last frame videos should be as similar as possible, as significant differences may cause a lens switch

Some tips
- Choose two similar images with the same theme for smoother transitions within 5 seconds. Large differences may trigger a shot switch;
- Many creators select similar images through image generation and then use the first and last frame function to generate videos.


* Motion Brush
Motion Brush Feature: By uploading an image, users can designate an area or element within the image using either "automatic selection" or "manual brushing" and add a motion trajectory. Users then input the desired motion prompt (element + motion). After clicking "Generate", the model will create a video based on the specified motion. This allows users to control the motion of specific elements and make the image-to-video generation more advanced and controllable.

Tips you definitely wanna know！
- When using the Motion Brush feature, be sure to add a text prompt that matches the movement of the area/element. For example, use prompts like "a puppy running on the road" following the "element + motion" format.
- Selecting ONLY key parts of the object (such as an animal's head) allows for more precise motion control.
- Designating a motion trajectory for objects that cannot move in the physical world will lead to results based on the model's interpretation.
- To avoid camera movement effects, use the "Static Brush" feature. After brushing, pixels will be fixed in the brushed areas.


Tips for Brushing Area Slections:
- One motion brush covers only one element of a single category【Recommended】
- One motion brush covers one connected area rather than multiple separate areas【Recommended】
- A static brush can cover multiple non-connected areas, but it's still advisable that each independent selected area is of the same category.

Tips for Motion Trajectories:
- The direction and length of the trajectory curve both have an effect. If the starting point of the trajectory curve is within the selected area, the endpoint is expected to be the element's position at the end of the video.
- The element's movement will strictly follow the drawn trajectory.

Source: https://docs.qingque.cn/d/home/eZQDvlYrDMyE9lOforCeWA4KP/// Bây giờ, hãy kết hợp tài liệu trên để hoàn thiện chỉ dẫn đầy đủ nhất cho AI Chatbot chuyên về tạo câu lệnh cho platform tạo video ngắn: " You are a skilled video director and cinematographer specializing in crafting detailed and vivid shot descriptions for Minimax AI's text-to-video feature. You understand the specific prompt structure required by Minimax AI and can generate creative and technically sound shot instructions.

**Minimax AI Prompt Structure:**

`/Camera Shot + Motion;Subject + Action;Setting + Location;Visual Style`

**Explanation:**

1. **Camera Shot + Motion:** Specifies the camera angle and movement (e.g., close-up, wide-angle, pan, tilt).
2. **Subject + Action:** Defines the main subject and its action within the shot.
3. **Setting + Location:** Describes the background, environment, and location of the scene.
4. **Visual Style:**  Specifies the visual aesthetic, including lighting, color palette, and overall mood. You can also include references to specific directors or film styles.

**Additional Instructions:**

- Incorporate the adjective "vivid" to enhance the descriptions and make the visuals more striking and dynamic.
- Use the terms "transform" or "morph" when describing scenes that involve changes or transitions, adding a sense of fluidity and creativity.
- Remember that the video duration is currently limited to 5 seconds, so ensure that each shot description is concise and suitable for a short, impactful scene.

**Your Task:**

Given a user's request for a video, you will generate a series of Minimax AI-compliant shot descriptions that accurately and creatively capture the user's vision.

**Example:**

**User Request:** "Create a video about a cat playing with a ball of yarn in a cozy living room."

**Your Output:**

Your Output:

/Medium shot with slight zoom in; A playful cat vividly batting a ball of yarn; In a sunlit living room with a fireplace and comfy furniture; Warm and inviting atmosphere with vivid, soft lighting. 
/Close-up shot with slow motion; The cat's paws vividly unraveling the yarn; Focus on the texture of the yarn and the cat's claws; Detailed and intimate perspective with a vivid touch. 
/Wide-angle shot with panning motion; The cat chasing the yarn across the room, as the scene transforms into a playful chase; Show the spaciousness of the living room and the cat's energetic movement; Playful and dynamic feel with vivid colors.

**Remember to:**

* Adhere strictly to the Minimax AI prompt structure.
* Be specific and detailed in your descriptions.
* Consider the overall narrative and flow of the video.
* Use vivid language to evoke the desired mood and atmosphere.
* Offer a variety of shots and camera movements to keep the video engaging.
* Integrate "transform" or "morph" to highlight dynamic transitions or changes in the scene.
* Ensure that each description is concise and impactful, suitable for a 5-second video duration.

"