update

README.md

@@ -7,81 +7,3 @@ app_file: app.py
 pinned: false
 license: apache-2.0
 ---
-
-# Zero2Story
-
-![](assets/overview.png)
-
-Zero2Story is a framework built on top of [PaLM API](https://developers.generativeai.google), [Stable Diffusion](https://en.wikipedia.org/wiki/Stable_Diffusion), [MusicGen](https://audiocraft.metademolab.com/musicgen.html) for ordinary people to create their own stories. This framework consists of the **background setup**, **character setup**, and **interative story generation** phases.
-
-**1. Background setup**: In this phase, users can setup the genre, place, and mood of the story. Especially, genre is the key that others are depending on. 
-
-**2. Character setup**: In this phase, users can setup characters up to four. For each character, users can decide their characteristics and basic information such as name, age, MBTI, and personality. Also, the image of each character could be generated based on the information using Stable Diffusion. 
-- PaLM API translates the given character information into a list of keywords that Stable Diffusion could effectively understands.
-- Then, Stable Diffusion generates images using the keywords as a prompt.
-
-**3. Interactive story generation:**: In this phase, the first few paragraphs are generated solely based on the information from the background and character setup phases. Afterwards, users could choose a direction from the given three options that PaLM API generated. Then, further stories are generated based on users' choice. This cycle of choosing an option and generating further stories are interatively continued until users decides to stop. 
-- In each story generation, users also could generate background images and music that describe each scene using Stable Diffusion and MusicGen.
-- If the generated story, options, image, and music in each turn, users could ask to re-generate them.
-
-## Prerequisites
-
-### PaLM API key
-
-This project heavily depends on [PaLM API](https://developers.generativeai.google). If you want to run it on your own environment, you need to get [PaLM API key](https://developers.generativeai.google/tutorials/setup) and paste it in `.palm_api_key.txt` file within the root directory.
-
-### Packages
-
-Make sure you have installed all of the following prerequisites on your development machine:
-* CUDA Toolkit 11.8 with cuDNN 8 - [Download & Install CUDA Toolkit](https://developer.nvidia.com/cuda-toolkit) It is highly recommended to run on a GPU. If you run it in a CPU environment, it will be very slow.
-* Poetry - [Download & Install Poetry](https://python-poetry.org/docs/#installation) It is the python packaging and dependency manager.
-* SQLite3 v3.35.0 or higher - It is required to be installed due to dependencies.
-    - Ubuntu 22.04 and later
-    ```shell
-    $ sudo apt install libc6 sqlite3 libsqlite3
-    ```
-    - Ubuntu 20.04
-    ```shell
-    $ sudo sh -c 'cat <<EOF >> /etc/apt/sources.list
-      deb http://archive.ubuntu.com/ubuntu/ jammy main
-      deb http://security.ubuntu.com/ubuntu/ jammy-security main
-      EOF'
-    $ sudo apt update
-    $ sudo apt install libc6 sqlite3 libsqlite3
-    ```
-* FFmpeg (Optional) - Installing FFmpeg enables local video mixing, which in turn generates results more quickly than [other methods](https://huggingface.co/spaces/fffiloni/animated-audio-visualizer)
-    ```shell
-    $ sudo apt install ffmpeg
-
-## Installation
-
-Before running the application for the first time, install the required dependencies:
-```shell
-$ poetry install
-```
-
-If dependencies change or need updates in the future, you can use:
-```shell
-$ poetry update
-```
-
-## Run
-
-```shell
-$ poetry run python app.py
-```
-
-## Todo
-
-- [ ] Exporting of generated stories as PDF
-
-
-## Stable Diffusion Model Information
-
-### Checkpoints
-- For character image generation: [CIVIT.AI Model 129896](https://civitai.com/models/129896)
-- For background image generation: [CIVIT.AI Model 93931](https://civitai.com/models/93931?modelVersionId=148652)
-
-### VAEs
-- For character image generation: [CIVIT.AI Model 23906](https://civitai.com/models/23906)
-- For background image generation: [CIVIT.AI Model 65728](https://civitai.com/models/65728)

app.py

@@ -301,39 +301,45 @@ with gr.Blocks(css=STYLE) as demo:
 				clear_btn = gr.Button("clear", elem_classes=["control-button"])
 
 	pre_to_setup_btn.click(
-		view_change_ui.move_to_next_view,
+		fn=None, 
 		inputs=None,
-		outputs=[pre_phase, background_setup_phase]
+		outputs=[pre_phase, background_setup_phase],
+		_js=view_change_ui.pre_to_setup_js
 	)
  
 	back_to_pre_btn.click(
-		view_change_ui.back_to_previous_view,
+		fn=None,
 		inputs=None,
-		outputs=[pre_phase, background_setup_phase]
+		outputs=[pre_phase, background_setup_phase],
+		_js=view_change_ui.back_to_pre_js
 	)
 
 	world_setup_confirm_btn.click(
-		view_change_ui.move_to_next_view,
+		fn=None,
 		inputs=None,
-		outputs=[background_setup_phase, character_setup_phase]
+		outputs=[background_setup_phase, character_setup_phase],
+		_js=view_change_ui.world_setup_confirm_js
 	)
  
 	back_to_background_setup_btn.click(
-		view_change_ui.back_to_previous_view,
+		fn=None,
 		inputs=None,
-		outputs=[background_setup_phase, character_setup_phase]		
+		outputs=[background_setup_phase, character_setup_phase],
+		_js=view_change_ui.back_to_background_setup_js
 	)
  
 	restart_from_story_generation_btn.click(
-		view_change_ui.move_to_next_view,
+		fn=None,
 		inputs=None,
-		outputs=[pre_phase, writing_phase]		
+		outputs=[pre_phase, writing_phase],
+		_js=view_change_ui.restart_from_story_generation_js
 	)
 
 	story_writing_done_btn.click(
-		view_change_ui.move_to_next_view,
+		fn=None,
 		inputs=None,
-		outputs=[writing_phase, export_phase]
+		outputs=[writing_phase, export_phase],
+		_js=view_change_ui.story_writing_done_js
 	)
 
 	title_gen_btn.click(
@@ -343,18 +349,20 @@ with gr.Blocks(css=STYLE) as demo:
 	)
 
 	export_done_btn.click(
-		view_change_ui.move_to_next_view,
+		fn=None,
 		inputs=None,
-		outputs=[export_phase, export_view_phase]
-	).then(
+		outputs=[export_phase, export_view_phase],
+		_js=view_change_ui.export_done_js
+	)        
+	export_done_btn.click(
 		export_ui.export,
 		inputs=[
 			title_txt,
 			cursors, 
-			selected_main_char_image1, name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, selected_side_char_image1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, selected_side_char_image2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, selected_side_char_image3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,			
+			selected_main_char_image1, name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, selected_side_char_image1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, selected_side_char_image2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, selected_side_char_image3, name_txt4, age_dd4, personality_dd4, job_dd4,			
 		],
 		outputs=[
 			export_html
@@ -362,16 +370,19 @@ with gr.Blocks(css=STYLE) as demo:
 	)
  
 	back_to_story_writing_btn.click(
-		view_change_ui.back_to_previous_view,
+		fn=None,
 		inputs=None,
-		outputs=[writing_phase, export_phase]
+		outputs=[writing_phase, export_phase],
+		_js=view_change_ui.back_to_story_writing_js
 	)
 
 	restart_from_export_view_btn.click(
-		view_change_ui.back_to_previous_view,
+		fn=None,
 		inputs=None,
-		outputs=[pre_phase, export_view_phase]		
-	).then(
+		outputs=[pre_phase, export_view_phase],
+		_js=view_change_ui.restart_from_export_view_js
+	)
+	restart_from_export_view_btn.click(
 		ui.reset,
 		inputs=None,
 		outputs=[
@@ -392,10 +403,12 @@ with gr.Blocks(css=STYLE) as demo:
 	)
 
 	restart_from_export_btn.click(
-		view_change_ui.back_to_previous_view,
+		fn=None,
 		inputs=None,
-		outputs=[pre_phase, export_phase]
-	).then(
+		outputs=[pre_phase, export_phase],
+		_js=view_change_ui.restart_from_export_js
+	)
+	restart_from_export_btn.click(
 		ui.reset,
 		inputs=None,
 		outputs=[
@@ -416,10 +429,12 @@ with gr.Blocks(css=STYLE) as demo:
 	)
 
 	character_setup_confirm_btn.click(
-		view_change_ui.move_to_next_view,
+		fn=None,
 		inputs=None,
-		outputs=[character_setup_phase, writing_phase]
-	).then(
+		outputs=[character_setup_phase, writing_phase],
+		_js=view_change_ui.character_setup_confirm_js
+	)
+	character_setup_confirm_btn.click(
 		story_gen_ui.disable_btns,
 		inputs=None,
 		outputs=[
@@ -434,10 +449,10 @@ with gr.Blocks(css=STYLE) as demo:
 		inputs=[			
 			cursors,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,
 		],
 		outputs=[
 			cursors, cur_cursor, story_content, story_progress, image_gen_btn, audio_gen_btn,
@@ -448,10 +463,10 @@ with gr.Blocks(css=STYLE) as demo:
 		inputs=[
 			cursors,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,
 		],
 		outputs=[
 			action_btn1, action_btn2, action_btn3, progress_comp
@@ -483,10 +498,10 @@ with gr.Blocks(css=STYLE) as demo:
 		inputs=[
 			cursors,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,
 		],
 		outputs=[
 			action_btn1, action_btn2, action_btn3, progress_comp
@@ -518,10 +533,10 @@ with gr.Blocks(css=STYLE) as demo:
 		inputs=[
 			cursors, cur_cursor,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,			
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,			
 		],
 		outputs=[
 			cursors, cur_cursor, story_content, story_progress, image_gen_btn, audio_gen_btn
@@ -531,10 +546,10 @@ with gr.Blocks(css=STYLE) as demo:
 		inputs=[
 			cursors,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,
 		],
 		outputs=[
 			action_btn1, action_btn2, action_btn3, progress_comp
@@ -561,50 +576,54 @@ with gr.Blocks(css=STYLE) as demo:
 	gen_char_btn1.click(
 		ui.gen_character_image,
 		inputs=[
-			gallery_images1, name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1, genre_dd, place_dd, mood_dd, creative_dd1],
+			gallery_images1, name_txt1, age_dd1, personality_dd1, job_dd1, genre_dd, place_dd, mood_dd, creative_dd1],
 		outputs=[char_gallery1, gallery_images1, selected_main_char_image1]
 	)
 
 	gen_char_btn2.click(
 		ui.gen_character_image,
-		inputs=[gallery_images2, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2, genre_dd, place_dd, mood_dd, creative_dd2],
+		inputs=[gallery_images2, name_txt2, age_dd2, personality_dd2, job_dd2, genre_dd, place_dd, mood_dd, creative_dd2],
 		outputs=[char_gallery2, gallery_images2, selected_side_char_image1]
 	)
 
 	gen_char_btn3.click(
 		ui.gen_character_image,
-		inputs=[gallery_images3, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3, genre_dd, place_dd, mood_dd, creative_dd3],
+		inputs=[gallery_images3, name_txt3, age_dd3, personality_dd3, job_dd3, genre_dd, place_dd, mood_dd, creative_dd3],
 		outputs=[char_gallery3, gallery_images3, selected_side_char_image2]
 	)
 
 	gen_char_btn4.click(
 		ui.gen_character_image,
-		inputs=[gallery_images4, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4, genre_dd, place_dd, mood_dd, creative_dd4],
+		inputs=[gallery_images4, name_txt4, age_dd4, personality_dd4, job_dd4, genre_dd, place_dd, mood_dd, creative_dd4],
 		outputs=[char_gallery4, gallery_images4, selected_side_char_image3]
 	)
 
 	random_name_btn1.click(
-		ui.get_random_name,
+		fn=None,
 		inputs=[name_txt1, name_txt2, name_txt3, name_txt4],
 		outputs=[name_txt1],
+		_js=ui.get_random_name_js
 	)
 
 	random_name_btn2.click(
-		ui.get_random_name,
+		fn=None,
 		inputs=[name_txt2, name_txt1, name_txt3, name_txt4],
 		outputs=[name_txt2],
+		_js=ui.get_random_name_js
 	)
 
 	random_name_btn3.click(
-		ui.get_random_name,
+		fn=None,
 		inputs=[name_txt3, name_txt1, name_txt2, name_txt4],
 		outputs=[name_txt3],
+		_js=ui.get_random_name_js
 	)
 
 	random_name_btn4.click(
-		ui.get_random_name,
+		fn=None,
 		inputs=[name_txt4, name_txt1, name_txt2, name_txt3],
 		outputs=[name_txt4],
+                _js=ui.get_random_name_js
 	)
  
 	### Story generation
@@ -732,10 +751,10 @@ with gr.Blocks(css=STYLE) as demo:
 			cursors,
 			action_btn1,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,	
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,	
 		],
 		outputs=[
 			cursors, cur_cursor,
@@ -748,10 +767,10 @@ with gr.Blocks(css=STYLE) as demo:
 		inputs=[
 			cursors,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,
 		],
 		outputs=[
 			action_btn1, action_btn2, action_btn3, progress_comp
@@ -784,10 +803,10 @@ with gr.Blocks(css=STYLE) as demo:
 			cursors,
 			action_btn2,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,	
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,	
 		],
 		outputs=[
 			cursors, cur_cursor,
@@ -800,10 +819,10 @@ with gr.Blocks(css=STYLE) as demo:
 		inputs=[
 			cursors,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,
 		],
 		outputs=[
 			action_btn1, action_btn2, action_btn3, progress_comp
@@ -836,10 +855,10 @@ with gr.Blocks(css=STYLE) as demo:
 			cursors,
 			action_btn3,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,	
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,	
 		],
 		outputs=[
 			cursors, cur_cursor,
@@ -852,10 +871,10 @@ with gr.Blocks(css=STYLE) as demo:
 		inputs=[
 			cursors,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,
 		],
 		outputs=[
 			action_btn1, action_btn2, action_btn3, progress_comp
@@ -888,10 +907,10 @@ with gr.Blocks(css=STYLE) as demo:
 			cursors,
 			custom_action_txt,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,	
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,	
 		],
 		outputs=[
 			cursors, cur_cursor,
@@ -904,10 +923,10 @@ with gr.Blocks(css=STYLE) as demo:
 		inputs=[
 			cursors,
 			genre_dd, place_dd, mood_dd, 
-			name_txt1, age_dd1, mbti_dd1, personality_dd1, job_dd1,
-			side_char_enable_ckb1, name_txt2, age_dd2, mbti_dd2, personality_dd2, job_dd2,
-			side_char_enable_ckb2, name_txt3, age_dd3, mbti_dd3, personality_dd3, job_dd3,
-			side_char_enable_ckb3, name_txt4, age_dd4, mbti_dd4, personality_dd4, job_dd4,
+			name_txt1, age_dd1, personality_dd1, job_dd1,
+			side_char_enable_ckb1, name_txt2, age_dd2, personality_dd2, job_dd2,
+			side_char_enable_ckb2, name_txt3, age_dd3, personality_dd3, job_dd3,
+			side_char_enable_ckb3, name_txt4, age_dd4, personality_dd4, job_dd4,
 		],
 		outputs=[
 			action_btn1, action_btn2, action_btn3, progress_comp

assets/palm_prompts.toml

@@ -1,3 +1,204 @@
+[story_gen]
+add_side_character = """side character #{cur_side_chars}
+- name: {name},
+- job: {job},
+- age: {age},
+- personality: {personality}
+
+"""
+first_story_gen = """Write the first three paragraphs of a novel as much detailed as possible. They should be based on the background information. Blend 5W1H principle into the stories as a plain text. Don't let the paragraphs end the whole story.
+
+background information:
+- genre: {genre}
+- where: {place}
+- mood: {mood}
+
+main character
+- name: {main_char_name}
+- job: {main_char_job}
+- age: {main_char_age}
+- personality: {main_char_personality}
+{side_char_placeholder}
+Fill in the following JSON output format:
+{{"paragraphs":"string"}}
+
+Write the JSON output:
+"""
+next_story_gen = """Write the next paragraphs. The next paragraphs should be determined by an option and well connected to the current stories. 
+
+background information:
+- genre: {genre}
+- where: {place}
+- mood: {mood}
+
+main character
+- name: {main_char_name}
+- job: {main_char_job}
+- age: {main_char_age}
+- personality: {main_char_personality}
+{side_char_placeholder}
+Fill in the following JSON output format:
+{{"paragraphs":"string"}}
+
+stories
+{stories}
+
+option to the next stories: {action}
+
+Write the JSON output:
+"""
+actions_gen = """Suggest the 20 options to drive the stories to the next based on the information below. 
+
+background information:
+- genre: {genre}
+- where: {place}
+- mood: {mood}
+
+main character
+- name: {main_char_name}
+- job: {main_char_job}
+- age: {main_char_age}
+- personality: {main_char_personality}
+{side_char_placeholder}
+Fill in the following JSON output format:
+{{"options":["string1", "string2", "string3"]}}
+
+summary of the story
+{summary}
+
+Write the JSON output:
+"""
+summarize = """Summarize the text below
+
+{stories}
+
+"""
+
+[chat_gen]
+chapter_title_ctx = """
+chapter{title_idx} {{
+    title: {chapter_title},
+    plot: {chapter_plot}
+}}
+"""
+add_side_character = """side character{cur_side_chars}: {{
+name: {name},
+job: {job},
+age: {age},
+personality: {personality} 
+}}
+
+"""
+chat_context = """You are a professional writing advisor, especially specialized in developing ideas on plotting stories and creating characters. I provide genre, where, and mood along with the rough description of one main character and three side characters. 
+
+Give creative but not too long responses based on the following information.
+
+genre: {genre}
+where: {place}
+mood: {mood}
+
+main character: {{
+name: {name1},
+job: {job1},
+age: {age1},
+personality: {personality1} 
+}}
+{side_char_placeholder}
+{chapter_title_placeholder}
+"""
+
+[plot_gen]
+main_plot_gen="""Write a title and an outline of a novel based on the background information below in Ronald Tobias's plot theory. The outline should follow the  "rising action", "crisis", "climax", "falling action", and "denouement" plot types. Each should be filled with a VERY detailed and descriptive at least two paragraphs of string. Randomly choose if the story goes optimistic or tragic.
+
+background information:
+- genre: string
+- where: string
+- mood: string
+
+main character
+- name: string
+- job: string
+- age: string
+- personality: string
+
+JSON output:
+{{
+	"title": "string", 
+	"outline": {{
+		"rising action": "paragraphs of string", 
+		"crisis": "paragraphs of string", 
+		"climax": "paragraphs of string", 
+		"falling action": "paragraphs of string", 
+		"denouement": "paragraphs of string"
+	}}
+}}
+
+background information:
+- genre: {genre}
+- where: {place}
+- mood: {mood}
+
+main character
+- name: {main_char_name}
+- job: {main_char_job}
+- age: {main_char_age}
+- personality: {main_char_personality}
+{side_char_placeholder}
+JSON output:
+"""
+first_story_gen="""Write the chapter title and the first few paragraphs of the "rising action" plot based on the background information below in Ronald Tobias's plot theory. Also, suggest three choosable actions to drive current story in different directions. The first few paragraphs should be filled with a VERY MUCH detailed and descriptive at least two paragraphs of string. 
+	
+REMEMBER the first few paragraphs should not end the whole story and allow leaway for the next paragraphs to come. 
+The whole story SHOULD stick to the "rising action -> crisis -> climax -> falling action -> denouement" flow, so REMEMBER not to write anything mentioned from the next plots of crisis, climax, falling action, and denouement yet.
+
+background information:
+- genre: string
+- where: string
+- mood: string
+
+main character
+- name: string
+- job: string
+- age: string
+- personality: string
+
+overall outline
+- title: string
+- rising action: string
+- crisis: string
+- climax: string
+- falling action: string
+- denouement: string
+
+JSON output:
+{{
+	"chapter_title": "string",
+	"paragraphs": ["string", "string", ...],
+	"actions": ["string", "string", "string"]
+}}
+
+background information:
+- genre: {genre}
+- where: {place}
+- mood: {mood}
+
+main character
+- name: {main_char_name}
+- job: {main_char_job}
+- age: {main_char_age}
+- personality: {main_char_personality}
+{side_char_placeholder}
+overall outline
+- title: {title}
+- rising action: {rising_action}
+- crisis: {crisis}
+- climax: {climax}
+- falling action: {falling_action}
+- denouement: {denouement}
+
+JSON output:
+"""
+
 [image_gen]
 neg_prompt="nsfw, worst quality, low quality, lowres, bad anatomy, bad hands, text, watermark, signature, error, missing fingers, extra digit, fewer digits, cropped, worst quality, normal quality, blurry, username, extra limbs, twins, boring, jpeg artifacts"
 

constants/desc.py

@@ -8,7 +8,7 @@ background_setup_phase_description = """
 In this phase, users can setup the genre, place, and mood of the story. Especially, genre is the key that others are depending on. 
 """
 character_setup_phase_description = """
-In this phase, users can setup characters up to four. For each character, users can decide their characteristics and basic information such as name, age, MBTI, and personality. Also, the image of each character could be generated based on the information using Stable Diffusion. 
+In this phase, users can setup characters up to four. For each character, users can decide their characteristics and basic information such as name, age and personality. Also, the image of each character could be generated based on the information using Stable Diffusion. 
 
 PaLM API translates the given character information into a list of keywords that Stable Diffusion could effectively understands. Then, Stable Diffusion generates images using the keywords as a prompt.
 """

constants/init_values.py

@@ -40,7 +40,6 @@ jobs = {
 }
 
 ages = ["10s", "20s", "30s", "40s", "50s"]
-mbtis = ["ESTJ", "ENTJ", "ESFJ", "ENFJ", "ISTJ", "ISFJ", "INTJ", "INFJ", "ESTP", "ESFP", "ENTP", "ENFP", "ISTP", "ISFP", "INTP", "INFP"]
 random_names = ["Aaron", "Abigail", "Adam", "Adrian", "Alan", "Alexandra", "Alyssa", "Amanda", "Amber", "Amy", "Andrea", "Andrew", "Angela", "Angelina", "Anthony", "Antonio", "Ashley", "Austin", "Benjamin", "Brandon", "Brian", "Brittany", "Brooke", "Bruce", "Bryan", "Caleb", "Cameron", "Carol", "Caroline", "Catherine", "Charles", "Charlotte", "Chase", "Chelsea", "Christopher", "Cody", "Colin", "Connor", "Cooper", "Corey", "Cristian", "Daniel", "David", "Deborah", "Denise", "Dennis", "Derek", "Diana", "Dorothy", "Douglas", "Dylan", "Edward", "Elizabeth", "Emily", "Emma", "Eric", "Ethan", "Evan", "Gabriel", "Gavin", "George", "Gina", "Grace", "Gregory", "Hannah", "Harrison", "Hayden", "Heather", "Helen", "Henry", "Holly", "Hope", "Hunter", "Ian", "Isaac", "Isabella", "Jack", "Jacob", "James", "Jason", "Jeffrey", "Jenna", "Jennifer", "Jessica", "Jesse", "Joan", "John", "Jonathan", "Joseph", "Joshua", "Justin", "Kayla", "Kevin", "Kimberly", "Kyle", "Laura", "Lauren", "Lawrence", "Leah", "Leo", "Leslie", "Levi", "Lewis", "Liam", "Logan", "Lucas", "Lucy", "Luis", "Luke", "Madison", "Maegan", "Maria", "Mark", "Matthew", "Megan", "Michael", "Michelle", "Molly", "Morgan", "Nathan", "Nathaniel", "Nicholas", "Nicole", "Noah", "Olivia", "Owen", "Paige", "Parker", "Patrick", "Paul", "Peter", "Philip", "Phoebe", "Rachel", "Randy", "Rebecca", "Richard", "Robert", "Roger", "Ronald", "Rose", "Russell", "Ryan", "Samantha", "Samuel", "Sandra", "Sarah", "Scott", "Sean", "Sebastian", "Seth", "Shannon", "Shawn", "Shelby", "Sierra", "Simon", "Sophia", "Stephanie", "Stephen", "Steven", "Sue", "Susan", "Sydney", "Taylor", "Teresa", "Thomas", "Tiffany", "Timothy", "Todd", "Tom", "Tommy", "Tracy", "Travis", "Tyler", "Victoria", "Vincent", "Violet", "Warren", "William", "Zach", "Zachary", "Zoe"]
 personalities = ['Optimistic', 'Kind', 'Resilient', 'Generous', 'Humorous', 'Creative', 'Empathetic', 'Ambitious', 'Adventurous']
 

interfaces/chat_ui.py

@@ -1,89 +1,77 @@
 import gradio as gr
 
 from interfaces import utils
-from modules import palmchat
+from modules import (
+    palmchat, palm_prompts,
+)
 
 from pingpong import PingPong
 
 def rollback_last_ui(history):
     return history[:-1]
 
+
+def add_side_character(enable, name, age, personality, job):
+    cur_side_chars = 1
+    prompt = ""
+    for idx in range(len(enable)):
+        if enable[idx]:
+            prompt += palm_prompts['chat_gen']['add_side_character'].format(
+                                        cur_side_chars=cur_side_chars,
+                                        name=name[idx],
+                                        job=job[idx],
+                                        age=age[idx],
+                                        personality=personality[idx]
+                                    )
+            cur_side_chars += 1
+    return "\n" + prompt if prompt else ""
+
+
+def add_chapter_title_ctx(chapter_title, chapter_plot):
+    title_idx = 1
+    prompt = ""
+    for idx in range(len(chapter_title)):
+        if chapter_title[idx] :
+            prompt += palm_prompts['chat_gen']['chapter_title_ctx'].format(
+                                        title_idx=title_idx,
+                                        chapter_title=chapter_title[idx],
+                                        chapter_plot=chapter_plot[idx],
+                                    )
+            title_idx += 1
+    return "\n" + prompt if prompt else ""
+
+
 async def chat(
     user_input, chat_mode, chat_state,
     genre, place, mood,
-    name1, age1, mbti1, personality1, job1,
-    name2, age2, mbti2, personality2, job2,
-    name3, age3, mbti3, personality3, job3,
-    name4, age4, mbti4, personality4, job4,
+    main_char_name, main_char_age, main_char_personality, main_char_job,
+    side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+    side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+    side_char_name3, side_char_age3, side_char_personality3, side_char_job3,
     chapter1_title, chapter2_title, chapter3_title, chapter4_title,
-    chapter1_plot, chapter2_plot, chapter3_plot, chapter4_plot
+    chapter1_plot, chapter2_plot, chapter3_plot, chapter4_plot,
+    side_char_enable1, side_char_enable2, side_char_enable3,
 ):
-    chapter_title_ctx = ""
-    if chapter1_title != "":
-        chapter_title_ctx = f"""
-chapter1 {{
-    title: {chapter1_title},
-    plot: {chapter1_plot}
-}}
-
-chapter2 {{
-    title: {chapter2_title},
-    plot: {chapter2_plot}
-}}
-
-chapter3 {{
-    title: {chapter3_title},
-    plot: {chapter3_plot}
-}}
-
-chapter4 {{
-    title: {chapter4_title},
-    plot: {chapter4_plot}
-}}
-"""
-
-    ctx = f"""You are a professional writing advisor, especially specialized in developing ideas on plotting stories and creating characters. I provide genre, where, and mood along with the rough description of one main character and three side characters. 
-
-Give creative but not too long responses based on the following information.
-
-genre: {genre}
-where: {place}
-mood: {mood}
-
-main character: {{
-name: {name1},
-job: {job1},
-age: {age1},
-mbti: {mbti1},
-personality: {personality1} 
-}}
-
-side character1: {{
-name: {name2},
-job: {job2},
-age: {age2},
-mbti: {mbti2},
-personality: {personality2} 
-}}
-
-side character2: {{
-name: {name3},
-job: {job3},
-age: {age3},
-mbti: {mbti3},
-personality: {personality3} 
-}}
-
-side character3: {{
-name: {name4},
-job: {job4},
-age: {age4},
-mbti: {mbti4},
-personality: {personality4} 
-}}
-
-{chapter_title_ctx}
-"""
+    chapter_title_ctx = add_chapter_title_ctx(
+        [chapter1_title, chapter2_title, chapter3_title, chapter4_title],
+        [chapter1_plot, chapter2_plot, chapter3_plot, chapter4_plot],
+    )
+    side_char_prompt = add_side_character(
+        [side_char_enable1, side_char_enable2, side_char_enable3],
+        [side_char_name1, side_char_name2, side_char_name3],
+        [side_char_job1, side_char_job2, side_char_job3],
+        [side_char_age1, side_char_age2, side_char_age3],
+        [side_char_personality1, side_char_personality2, side_char_personality3],
+    )
+    prompt = palm_prompts['chat_gen']['chat_context'].format(
+        genre=genre, place=place, mood=mood,
+        main_char_name=main_char_name,
+        main_char_job=main_char_job,
+        main_char_age=main_char_age,
+        main_char_personality=main_char_personality,
+        side_char_placeholder=side_char_prompt,
+        chapter_title_placeholder=chapter_title_ctx,
+    )
 
     ppm = chat_state[chat_mode]
     ppm.ctx = ctx

interfaces/export_ui.py

@@ -29,10 +29,10 @@ title: """
 
 def export(
     title, cursors,
-	main_char_img, main_char_name, main_char_age, main_char_mbti, main_char_personality, main_char_job,
-	side_char_enable1, side_char_img1, side_char_name1, side_char_age1, side_char_mbti1, side_char_personality1, side_char_job1,
-	side_char_enable2, side_char_img2, side_char_name2, side_char_age2, side_char_mbti2, side_char_personality2, side_char_job2,
-	side_char_enable3, side_char_img3, side_char_name3, side_char_age3, side_char_mbti3, side_char_personality3, side_char_job3,    
+	main_char_img, main_char_name, main_char_age, main_char_personality, main_char_job,
+	side_char_enable1, side_char_img1, side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+	side_char_enable2, side_char_img2, side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+	side_char_enable3, side_char_img3, side_char_name3, side_char_age3, side_char_personality3, side_char_job3,    
 ):
     print(main_char_img)
     characters = [
@@ -42,13 +42,13 @@ def export(
         }
     ]
     utils.add_side_character_to_export(
-        characters, side_char_enable1, side_char_img1, side_char_name1, side_char_age1, side_char_mbti1, side_char_personality1, side_char_job1
+        characters, side_char_enable1, side_char_img1, side_char_name1, side_char_age1, side_char_personality1, side_char_job1
     )
     utils.add_side_character_to_export(
-        characters, side_char_enable2, side_char_img2, side_char_name2, side_char_age2, side_char_mbti2, side_char_personality2, side_char_job2
+        characters, side_char_enable2, side_char_img2, side_char_name2, side_char_age2, side_char_personality2, side_char_job2
     )
     utils.add_side_character_to_export(
-        characters, side_char_enable3, side_char_img3, side_char_name3, side_char_age3, side_char_mbti3, side_char_personality3, side_char_job3
+        characters, side_char_enable3, side_char_img3, side_char_name3, side_char_age3, side_char_personality3, side_char_job3
     )
 
     html_as_string = parser.gen_from_file(

interfaces/plot_gen_ui.py

@@ -1,91 +1,37 @@
 import re
 import gradio as gr
 from interfaces import utils
-from modules import palmchat
+from modules import(
+	palmchat,
+	palm_prompts,
+)
 
-def _add_side_character(
-	enable, prompt, cur_side_chars,
-	name, age, mbti, personality, job
-):
-	if enable:
-		prompt = prompt + f"""
-side character #{cur_side_chars}
-- name: {name},
-- job: {job},
-- age: {age},
-- mbti: {mbti},
-- personality: {personality}
-
-"""
-		cur_side_chars = cur_side_chars + 1
-		
-	return prompt, cur_side_chars
-	
+print(palm_prompts)
 
 async def plot_gen(
 	temperature,
 	genre, place, mood,
 	side_char_enable1, side_char_enable2, side_char_enable3,
-	name1, age1, mbti1, personality1, job1,
-	name2, age2, mbti2, personality2, job2,
-	name3, age3, mbti3, personality3, job3,
-	name4, age4, mbti4, personality4, job4,
+	main_char_name, main_char_age, main_char_personality, main_char_job,
+	side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+	side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+	side_char_name3, side_char_age3, side_char_personality3, side_char_job3,
 ):
-	cur_side_chars = 1
-	prompt = f"""Write a title and an outline of a novel based on the background information below in Ronald Tobias's plot theory. The outline should follow the  "rising action", "crisis", "climax", "falling action", and "denouement" plot types. Each should be filled with a VERY detailed and descriptive at least two paragraphs of string. Randomly choose if the story goes optimistic or tragic.
-
-background information:
-- genre: string
-- where: string
-- mood: string
-
-main character
-- name: string
-- job: string
-- age: string
-- mbti: string
-- personality: string
-
-JSON output:
-{{
-	"title": "string", 
-	"outline": {{
-		"rising action": "paragraphs of string", 
-		"crisis": "paragraphs of string", 
-		"climax": "paragraphs of string", 
-		"falling action": "paragraphs of string", 
-		"denouement": "paragraphs of string"
-	}}
-}}
-
-background information:
-- genre: {genre}
-- where: {place}
-- mood: {mood}
-
-main character
-- name: {name1}
-- job: {job1}
-- age: {age1}
-- mbti: {mbti1}
-- personality: {personality1}
-
-"""
-
-	prompt, cur_side_chars = _add_side_character(
-		side_char_enable1, prompt, cur_side_chars,
-		name2, job2, age2, mbti2, personality2
+	side_char_prompt = utils.add_side_character(
+		[side_char_enable1, side_char_enable2, side_char_enable3],
+		[side_char_name1, side_char_name2, side_char_name3],
+		[side_char_job1, side_char_job2, side_char_job3],
+		[side_char_age1, side_char_age2, side_char_age3],
+		[side_char_personality1, side_char_personality2, side_char_personality3],
 	)
-	prompt, cur_side_chars = _add_side_character(
-		side_char_enable2, prompt, cur_side_chars,
-		name3, job3, age3, mbti3, personality3
+	prompt = palm_prompts['plot_gen']['main_plot_gen'].format(
+		genre=genre, place=place, mood=mood,
+		main_char_name=main_char_name,
+		main_char_job=main_char_job,
+		main_char_age=main_char_age,
+		main_char_personality=main_char_personality,
+		side_char_placeholder=side_char_prompt,
 	)
-	prompt, cur_side_chars = _add_side_character(
-		side_char_enable3, prompt, cur_side_chars,
-		name4, job4, age4, mbti4, personality4
-	)
-
-	prompt = prompt + "JSON output:\n"
 	
 	print(f"generated prompt:\n{prompt}")
 	parameters = {
@@ -95,7 +41,7 @@ main character
 		'top_k': 40,
 		'top_p': 1,
 		'max_output_tokens': 4096,
-	}    	
+	}
 	response_json = await utils.retry_until_valid_json(prompt, parameters=parameters)
 
 	return (
@@ -114,84 +60,33 @@ async def first_story_gen(
 	rising_action, crisis, climax, falling_action, denouement,
 	genre, place, mood,
 	side_char_enable1, side_char_enable2, side_char_enable3,
-	name1, age1, mbti1, personality1, job1,
-	name2, age2, mbti2, personality2, job2,
-	name3, age3, mbti3, personality3, job3,
-	name4, age4, mbti4, personality4, job4, 
+	main_char_name, main_char_age, main_char_personality, main_char_job,
+	side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+	side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+	side_char_name3, side_char_age3, side_char_personality3, side_char_job3,
 	cursors, cur_cursor
 ):
-	cur_side_chars = 1
-	
-	prompt = f"""Write the chapter title and the first few paragraphs of the "rising action" plot based on the background information below in Ronald Tobias's plot theory. Also, suggest three choosable actions to drive current story in different directions. The first few paragraphs should be filled with a VERY MUCH detailed and descriptive at least two paragraphs of string. 
-	
-REMEMBER the first few paragraphs should not end the whole story and allow leaway for the next paragraphs to come. 
-The whole story SHOULD stick to the "rising action -> crisis -> climax -> falling action -> denouement" flow, so REMEMBER not to write anything mentioned from the next plots of crisis, climax, falling action, and denouement yet.
-
-background information:
-- genre: string
-- where: string
-- mood: string
-
-main character
-- name: string
-- job: string
-- age: string
-- mbti: string
-- personality: string
-
-overall outline
-- title: string
-- rising action: string
-- crisis: string
-- climax: string
-- falling action: string
-- denouement: string
-
-JSON output:
-{{
-	"chapter_title": "string",
-	"paragraphs": ["string", "string", ...],
-	"actions": ["string", "string", "string"]
-}}
-
-background information:
-- genre: {genre}
-- where: {place}
-- mood: {mood}
-
-main character
-- name: {name1}
-- job: {job1},
-- age: {age1},
-- mbti: {mbti1},
-- personality: {personality1}
-
-"""
-
-	prompt, cur_side_chars = _add_side_character(
-		side_char_enable1, prompt, cur_side_chars,
-		name2, job2, age2, mbti2, personality2
+	side_char_prompt = utils.add_side_character(
+		[side_char_enable1, side_char_enable2, side_char_enable3],
+		[side_char_name1, side_char_name2, side_char_name3],
+		[side_char_job1, side_char_job2, side_char_job3],
+		[side_char_age1, side_char_age2, side_char_age3],
+		[side_char_personality1, side_char_personality2, side_char_personality3],
 	)
-	prompt, cur_side_chars = _add_side_character(
-		side_char_enable2, prompt, cur_side_chars,
-		name3, job3, age3, mbti3, personality3
+	prompt = palm_prompts['plot_gen']['first_story_gen'].format(
+		genre=genre, place=place, mood=mood,
+		main_char_name=main_char_name,
+		main_char_job=main_char_job,
+		main_char_age=main_char_age,
+		main_char_personality=main_char_personality,
+		side_char_placeholder=side_char_prompt,
+		title=title,
+		rising_action=rising_action,
+		crisis=crisis,
+		climax=climax,
+		falling_action=falling_action,
+		denouement=denouement,
 	)
-	prompt, cur_side_chars = _add_side_character(
-		side_char_enable3, prompt, cur_side_chars,
-		name4, job4, age4, mbti4, personality4
-	)
-
-	prompt = prompt + f"""
-overall outline
-- title: {title}
-- rising action: {rising_action}
-- crisis: {crisis}
-- climax: {climax}
-- falling action: {falling_action}
-- denouement: {denouement}
-
-JSON output:
-"""
 
 	print(f"generated prompt:\n{prompt}")
 	parameters = {
@@ -201,7 +96,7 @@ JSON output:
 		'top_k': 40,
 		'top_p': 1,
 		'max_output_tokens': 4096,
-	}    
+	}
 	response_json = await utils.retry_until_valid_json(prompt, parameters=parameters)
 
 	chapter_title = response_json["chapter_title"]

interfaces/story_gen_ui.py

@@ -6,38 +6,44 @@ from gradio_client import Client
 from pathlib import Path
 
 from modules import (
-	ImageMaker, MusicMaker, palmchat, merge_video
+	ImageMaker, MusicMaker, palmchat, palm_prompts, merge_video
 )
 from interfaces import utils
 
 from pingpong import PingPong
 from pingpong.context import CtxLastWindowStrategy
 
-# TODO: Replace checkpoint filename to Huggingface URL
-img_maker = ImageMaker('landscapeAnimePro_v20Inspiration.safetensors') # without VAE
-#img_maker = ImageMaker('landscapeAnimePro_v20Inspiration.safetensors', vae="stabilityai/sd-vae-ft-mse")
-#img_maker = ImageMaker('fantasyworldFp16.safetensors', vae="cute20vae.safetensors")
-#img_maker = ImageMaker('forgesagalandscapemi.safetensors', vae="anythingFp16.safetensors")
+img_maker = ImageMaker('https://huggingface.co/jphan32/Zero2Story/landscapeAnimePro_v20Inspiration.safetensors',
+						vae="https://huggingface.co/jphan32/Zero2Story/cute20vae.safetensors")
+
 bgm_maker = MusicMaker(model_size='small', output_format='mp3')
 
-video_gen_client_url = "https://0447df3cf5f7c49c46.gradio.live"
+video_gen_client_url = None # e.g. "https://0447df3cf5f7c49c46.gradio.live"
+
+# default safety settings
+safety_settings = [{"category":"HARM_CATEGORY_DEROGATORY","threshold":1},
+					{"category":"HARM_CATEGORY_TOXICITY","threshold":1},
+					{"category":"HARM_CATEGORY_VIOLENCE","threshold":2},
+					{"category":"HARM_CATEGORY_SEXUAL","threshold":2},
+					{"category":"HARM_CATEGORY_MEDICAL","threshold":2},
+					{"category":"HARM_CATEGORY_DANGEROUS","threshold":2}]
 
 async def update_story_gen(
 	cursors, cur_cursor_idx,
 	genre, place, mood,
-	main_char_name, main_char_age, main_char_mbti, main_char_personality, main_char_job,
-	side_char_enable1, side_char_name1, side_char_age1, side_char_mbti1, side_char_personality1, side_char_job1,
-	side_char_enable2, side_char_name2, side_char_age2, side_char_mbti2, side_char_personality2, side_char_job2,
-	side_char_enable3, side_char_name3, side_char_age3, side_char_mbti3, side_char_personality3, side_char_job3,
+	main_char_name, main_char_age, main_char_personality, main_char_job,
+	side_char_enable1, side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+	side_char_enable2, side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+	side_char_enable3, side_char_name3, side_char_age3, side_char_personality3, side_char_job3,
 ):
     if len(cursors) == 1:
         return await first_story_gen(
 			cursors,
 			genre, place, mood,
-			main_char_name, main_char_age, main_char_mbti, main_char_personality, main_char_job,
-			side_char_enable1, side_char_name1, side_char_age1, side_char_mbti1, side_char_personality1, side_char_job1,
-			side_char_enable2, side_char_name2, side_char_age2, side_char_mbti2, side_char_personality2, side_char_job2,
-			side_char_enable3, side_char_name3, side_char_age3, side_char_mbti3, side_char_personality3, side_char_job3,
+			main_char_name, main_char_age, main_char_personality, main_char_job,
+			side_char_enable1, side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+			side_char_enable2, side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+			side_char_enable3, side_char_name3, side_char_age3, side_char_personality3, side_char_job3,
 			cur_cursor_idx=cur_cursor_idx
 		)
     else:
@@ -45,10 +51,10 @@ async def update_story_gen(
 			cursors,
 			None,
 			genre, place, mood,
-			main_char_name, main_char_age, main_char_mbti, main_char_personality, main_char_job,
-			side_char_enable1, side_char_name1, side_char_age1, side_char_mbti1, side_char_personality1, side_char_job1,
-			side_char_enable2, side_char_name2, side_char_age2, side_char_mbti2, side_char_personality2, side_char_job2,
-			side_char_enable3, side_char_name3, side_char_age3, side_char_mbti3, side_char_personality3, side_char_job3,
+			main_char_name, main_char_age, main_char_personality, main_char_job,
+			side_char_enable1, side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+			side_char_enable2, side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+			side_char_enable3, side_char_name3, side_char_age3, side_char_personality3, side_char_job3,
 			cur_cursor_idx=cur_cursor_idx
 		)
 
@@ -56,10 +62,10 @@ async def next_story_gen(
 	cursors,
 	action,
 	genre, place, mood,
-	main_char_name, main_char_age, main_char_mbti, main_char_personality, main_char_job,
-	side_char_enable1, side_char_name1, side_char_age1, side_char_mbti1, side_char_personality1, side_char_job1,
-	side_char_enable2, side_char_name2, side_char_age2, side_char_mbti2, side_char_personality2, side_char_job2,
-	side_char_enable3, side_char_name3, side_char_age3, side_char_mbti3, side_char_personality3, side_char_job3,	
+	main_char_name, main_char_age, main_char_personality, main_char_job,
+	side_char_enable1, side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+	side_char_enable2, side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+	side_char_enable3, side_char_name3, side_char_age3, side_char_personality3, side_char_job3,	
 	cur_cursor_idx=None
 ):
 	stories = ""
@@ -71,46 +77,23 @@ async def next_story_gen(
 	for cursor in cursors[:end_idx]:
 		stories = stories + cursor["story"]
 
-	prompt = f"""Write the next paragraphs. The next paragraphs should be determined by an option and well connected to the current stories. 
-
-background information:
-- genre: {genre}
-- where: {place}
-- mood: {mood}
-
-main character
-- name: {main_char_name}
-- job: {main_char_job}
-- age: {main_char_age}
-- mbti: {main_char_mbti}
-- personality: {main_char_personality}
-"""
-
-	prompt, cur_side_chars = utils.add_side_character(
-		side_char_enable1, prompt, cur_side_chars,
-		side_char_name1, side_char_job1, side_char_age1, side_char_mbti1, side_char_personality1
-	)
-	prompt, cur_side_chars = utils.add_side_character(
-		side_char_enable2, prompt, cur_side_chars,
-		side_char_name2, side_char_job2, side_char_age2, side_char_mbti2, side_char_personality2
+	side_char_prompt = utils.add_side_character(
+		[side_char_enable1, side_char_enable2, side_char_enable3],
+		[side_char_name1, side_char_name2, side_char_name3],
+		[side_char_job1, side_char_job2, side_char_job3],
+		[side_char_age1, side_char_age2, side_char_age3],
+		[side_char_personality1, side_char_personality2, side_char_personality3],
 	)
-	prompt, cur_side_chars = utils.add_side_character(
-		side_char_enable3, prompt, cur_side_chars,
-		side_char_name3, side_char_job3, side_char_age3, side_char_mbti3, side_char_personality3
-	)
-
-	prompt = prompt + f"""
-stories
-{stories}
 
-option to the next stories: {action}
-
-Fill in the following JSON output format:
-{{
-	"paragraphs": "string"
-}}
-
-"""
+	prompt = palm_prompts['story_gen']['next_story_gen'].format(
+		genre=genre, place=place, mood=mood,
+		main_char_name=main_char_name,
+		main_char_job=main_char_job,
+		main_char_age=main_char_age,
+		main_char_personality=main_char_personality,
+		side_char_placeholder=side_char_prompt,
+		stories=stories, action=action,
+	)
 
 	print(f"generated prompt:\n{prompt}")
 	parameters = {
@@ -120,8 +103,13 @@ Fill in the following JSON output format:
 		'top_k': 40,
 		'top_p': 1,
 		'max_output_tokens': 4096,
-	}    	
-	response_json = await utils.retry_until_valid_json(prompt, parameters=parameters)
+		'safety_settings': safety_settings,
+	}
+	try:
+		response_json = await utils.retry_until_valid_json(prompt, parameters=parameters)
+	except Exception as e:
+		print(e)
+		raise gr.Error(e)
 
 	story = response_json["paragraphs"]
 	if isinstance(story, list):
@@ -155,10 +143,10 @@ Fill in the following JSON output format:
 async def actions_gen(
 	cursors,
 	genre, place, mood,
-	main_char_name, main_char_age, main_char_mbti, main_char_personality, main_char_job,
-	side_char_enable1, side_char_name1, side_char_age1, side_char_mbti1, side_char_personality1, side_char_job1,
-	side_char_enable2, side_char_name2, side_char_age2, side_char_mbti2, side_char_personality2, side_char_job2,
-	side_char_enable3, side_char_name3, side_char_age3, side_char_mbti3, side_char_personality3, side_char_job3,
+	main_char_name, main_char_age, main_char_personality, main_char_job,
+	side_char_enable1, side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+	side_char_enable2, side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+	side_char_enable3, side_char_name3, side_char_age3, side_char_personality3, side_char_job3,
 	cur_cursor_idx=None
 ):
 	stories = ""
@@ -168,11 +156,8 @@ async def actions_gen(
 	for cursor in cursors[:end_idx]:
 		stories = stories + cursor["story"]
 
-	summary_prompt = f"""Summarize the text below
-
-{stories}
+	summary_prompt = palm_prompts['story_gen']['summarize'].format(stories=stories)
 
-"""
 	print(f"generated prompt:\n{summary_prompt}")
 	parameters = {
 		'model': 'models/text-bison-001',
@@ -181,47 +166,32 @@ async def actions_gen(
 		'top_k': 40,
 		'top_p': 1,
 		'max_output_tokens': 4096,
-	}    	
-	_, summary = await palmchat.gen_text(summary_prompt, mode="text", parameters=parameters)
-
-	prompt = f"""Suggest the 30 options to drive the stories to the next based on the information below. 
-
-background information:
-- genre: {genre}
-- where: {place}
-- mood: {mood}
-
-main character
-- name: {main_char_name}
-- job: {main_char_job}
-- age: {main_char_age}
-- mbti: {main_char_mbti}
-- personality: {main_char_personality}
-"""
-	prompt, cur_side_chars = utils.add_side_character(
-		side_char_enable1, prompt, cur_side_chars,
-		side_char_name1, side_char_job1, side_char_age1, side_char_mbti1, side_char_personality1
-	)
-	prompt, cur_side_chars = utils.add_side_character(
-		side_char_enable2, prompt, cur_side_chars,
-		side_char_name2, side_char_job2, side_char_age2, side_char_mbti2, side_char_personality2
+		'safety_settings': safety_settings,
+	}
+
+	try:
+		_, summary = await palmchat.gen_text(summary_prompt, mode="text", parameters=parameters)
+	except Exception as e:
+		print(e)
+		raise gr.Error(e)
+
+	side_char_prompt = utils.add_side_character(
+		[side_char_enable1, side_char_enable2, side_char_enable3],
+		[side_char_name1, side_char_name2, side_char_name3],
+		[side_char_job1, side_char_job2, side_char_job3],
+		[side_char_age1, side_char_age2, side_char_age3],
+		[side_char_personality1, side_char_personality2, side_char_personality3],
 	)
-	prompt, cur_side_chars = utils.add_side_character(
-		side_char_enable3, prompt, cur_side_chars,
-		side_char_name3, side_char_job3, side_char_age3, side_char_mbti3, side_char_personality3
+	prompt = palm_prompts['story_gen']['actions_gen'].format(
+		genre=genre, place=place, mood=mood,
+		main_char_name=main_char_name,
+		main_char_job=main_char_job,
+		main_char_age=main_char_age,
+		main_char_personality=main_char_personality,
+		side_char_placeholder=side_char_prompt,
+		summary=summary,
 	)
 
-	prompt = prompt + f"""
-summary of the story
-{summary}
-
-Fill in the following JSON output format:
-{{
-    "options": ["string", "string", "string", ...]
-}}
-
-"""
-
 	print(f"generated prompt:\n{prompt}")
 	parameters = {
 		'model': 'models/text-bison-001',
@@ -230,8 +200,13 @@ Fill in the following JSON output format:
 		'top_k': 40,
 		'top_p': 1,
 		'max_output_tokens': 4096,
-	}    	
-	response_json = await utils.retry_until_valid_json(prompt, parameters=parameters)
+		'safety_settings': safety_settings,
+	}
+	try:
+		response_json = await utils.retry_until_valid_json(prompt, parameters=parameters)
+	except Exception as e:
+		print(e)
+		raise gr.Error(e)
 	actions = response_json["options"]
 
 	random_actions = random.sample(actions, 3)
@@ -246,49 +221,29 @@ Fill in the following JSON output format:
 async def first_story_gen(
 	cursors,
 	genre, place, mood,
-	main_char_name, main_char_age, main_char_mbti, main_char_personality, main_char_job,
-	side_char_enable1, side_char_name1, side_char_age1, side_char_mbti1, side_char_personality1, side_char_job1,
-	side_char_enable2, side_char_name2, side_char_age2, side_char_mbti2, side_char_personality2, side_char_job2,
-	side_char_enable3, side_char_name3, side_char_age3, side_char_mbti3, side_char_personality3, side_char_job3,
+	main_char_name, main_char_age, main_char_personality, main_char_job,
+	side_char_enable1, side_char_name1, side_char_age1, side_char_personality1, side_char_job1,
+	side_char_enable2, side_char_name2, side_char_age2, side_char_personality2, side_char_job2,
+	side_char_enable3, side_char_name3, side_char_age3, side_char_personality3, side_char_job3,
 	cur_cursor_idx=None
 ):
 	cur_side_chars = 1
 
-	prompt = f"""Write the first three paragraphs of a novel as much detailed as possible. They should be based on the background information. Blend 5W1H principle into the stories as a plain text. Don't let the paragraphs end the whole story.
-
-background information:
-- genre: {genre}
-- where: {place}
-- mood: {mood}
-
-main character
-- name: {main_char_name}
-- job: {main_char_job}
-- age: {main_char_age}
-- mbti: {main_char_mbti}
-- personality: {main_char_personality}
-"""
-
-	prompt, cur_side_chars = utils.add_side_character(
-		side_char_enable1, prompt, cur_side_chars,
-		side_char_name1, side_char_job1, side_char_age1, side_char_mbti1, side_char_personality1
+	side_char_prompt = utils.add_side_character(
+		[side_char_enable1, side_char_enable2, side_char_enable3],
+		[side_char_name1, side_char_name2, side_char_name3],
+		[side_char_job1, side_char_job2, side_char_job3],
+		[side_char_age1, side_char_age2, side_char_age3],
+		[side_char_personality1, side_char_personality2, side_char_personality3],
 	)
-	prompt, cur_side_chars = utils.add_side_character(
-		side_char_enable2, prompt, cur_side_chars,
-		side_char_name2, side_char_job2, side_char_age2, side_char_mbti2, side_char_personality2
+	prompt = palm_prompts['story_gen']['first_story_gen'].format(
+		genre=genre, place=place, mood=mood,
+		main_char_name=main_char_name,
+		main_char_job=main_char_job,
+		main_char_age=main_char_age,
+		main_char_personality=main_char_personality,
+		side_char_placeholder=side_char_prompt,
 	)
-	prompt, cur_side_chars = utils.add_side_character(
-		side_char_enable3, prompt, cur_side_chars,
-		side_char_name3, side_char_job3, side_char_age3, side_char_mbti3, side_char_personality3
-	)
-
-	prompt = prompt + f"""
-Fill in the following JSON output format:
-{{
-	"paragraphs": "string"
-}}
-
-"""	
 
 	print(f"generated prompt:\n{prompt}")
 	parameters = {
@@ -298,8 +253,13 @@ Fill in the following JSON output format:
 		'top_k': 40,
 		'top_p': 1,
 		'max_output_tokens': 4096,
-	}    	
-	response_json = await utils.retry_until_valid_json(prompt, parameters=parameters)
+		'safety_settings': safety_settings,
+	}
+	try:
+		response_json = await utils.retry_until_valid_json(prompt, parameters=parameters)
+	except Exception as e:
+		print(e)
+		raise gr.Error(e)
 
 	story = response_json["paragraphs"]
 	if isinstance(story, list):
@@ -363,12 +323,12 @@ def image_gen(
 	for _ in range(3):
 		try:
 			prompt, neg_prompt = img_maker.generate_background_prompts(genre, place, mood, title, "", story_content)
-			neg_prompt
 			print(f"Image Prompt: {prompt}")
 			print(f"Negative Prompt: {neg_prompt}")
 			break
 		except Exception as e:
 			print(e)
+			raise gr.Error(e)
 			
 	if not prompt:
 		raise ValueError("Failed to generate prompts for background image.")
@@ -400,12 +360,13 @@ def audio_gen(
 			break
 		except Exception as e:
 			print(e)
+			raise gr.Error(e)
 
 	if not prompt:
 		raise ValueError("Failed to generate prompt for background music.")
 
 	# generate music
-	bgm_filename = bgm_maker.text2music(prompt, length=30)
+	bgm_filename = bgm_maker.text2music(prompt, length=60)
 	cursors[cur_cursor]["audio"] = bgm_filename
 
 	return (

interfaces/ui.py

@@ -16,39 +16,64 @@ from modules import (
 
 from interfaces import utils
 
-# TODO: Replace checkpoint filename to Huggingface URL
-#img_maker = ImageMaker('hellonijicute25d_V10b.safetensors', vae="kl-f8-anime2.vae.safetensors")
-img_maker = ImageMaker('hellonijicute25d_V10b.safetensors') # without_VAE
+img_maker = ImageMaker('https://huggingface.co/jphan32/Zero2Story/hellonijicute25d_V10b.safetensors',
+						vae="https://huggingface.co/jphan32/Zero2Story/klF8Anime2Fp16.safetensors")
 
 ############
 # for plotting
 
+get_random_name_js = f"""
+function get_random_name(cur_char_name, char_name1, char_name2, char_name3) {{
+        console.log("hello world");
+
+	const names = {random_names};
+	const names_copy = JSON.parse(JSON.stringify(names));
+
+        console.log(names);
+
+	let index = names_copy.indexOf(cur_char_name);
+	names_copy.splice(index, 1);
+
+	index = names_copy.indexOf(char_name1);
+	names_copy.splice(index, 1)
+
+	index = names_copy.indexOf(char_name2);
+	names_copy.splice(index, 1);
+
+	index = names_copy.indexOf(char_name3);
+	names_copy.splice(index, 1);
+
+	return names_copy[(Math.floor(Math.random() * names_copy.length))];
+}}
+"""
+
 def update_selected_char_image(evt: gr.EventData):
     return evt.value
 
-def get_random_name(cur_char_name, char_name1, char_name2, char_name3):
-	tmp_random_names = copy.deepcopy(random_names)
-	tmp_random_names.remove(cur_char_name)
-	tmp_random_names.remove(char_name1)
-	tmp_random_names.remove(char_name2)
-	tmp_random_names.remove(char_name3)
-	return random.choice(tmp_random_names)
+# def get_random_name(cur_char_name, char_name1, char_name2, char_name3):
+# 	tmp_random_names = copy.deepcopy(random_names)
+# 	tmp_random_names.remove(cur_char_name)
+# 	tmp_random_names.remove(char_name1)
+# 	tmp_random_names.remove(char_name2)
+# 	tmp_random_names.remove(char_name3)
+# 	return random.choice(tmp_random_names)
 
 
 def gen_character_image(
   gallery_images, 
-  name, age, mbti, personality, job, 
+  name, age, personality, job, 
   genre, place, mood, creative_mode
 ):
 	# generate prompts for character image with PaLM
 	for _ in range(3):
 		try:
-			prompt, neg_prompt = img_maker.generate_character_prompts(name, age, job, keywords=[mbti, personality, genre, place, mood], creative_mode=creative_mode)
+			prompt, neg_prompt = img_maker.generate_character_prompts(name, age, job, keywords=[personality, genre, place, mood], creative_mode=creative_mode)
 			print(f"Image Prompt: {prompt}")
 			print(f"Negative Prompt: {neg_prompt}")
 			break
 		except Exception as e:
 			print(e)
+			raise gr.Error(e)
 
 	if not prompt:
 		raise ValueError("Failed to generate prompts for character image.")
@@ -157,4 +182,4 @@ def reset():
 		'Your Own Story', # title_txt
 
 		"", # export_html
-	)
+	)

interfaces/utils.py

@@ -3,12 +3,15 @@ import json
 import string
 import random
 
-from modules import palmchat
+from modules import (
+	palmchat, palm_prompts,
+)
+
 from pingpong.context import CtxLastWindowStrategy
 
 def add_side_character_to_export(
 	characters,	enable, img, 
-	name, age, mbti, personality, job
+	name, age, personality, job
 ):
 	if enable:
 		characters.append(
@@ -20,23 +23,20 @@ def add_side_character_to_export(
 
 	return characters
 
-def add_side_character(
-	enable, prompt, cur_side_chars,
-	name, age, mbti, personality, job
-):
-	if enable:
-		prompt = prompt + f"""
-side character #{cur_side_chars}
-- name: {name},
-- job: {job},
-- age: {age},
-- mbti: {mbti},
-- personality: {personality}
-
-"""
-		cur_side_chars = cur_side_chars + 1
-		
-	return prompt, cur_side_chars
+def add_side_character(enable, name, age, personality, job):
+	cur_side_chars = 1
+	prompt = ""
+	for idx in range(len(enable)):
+		if enable[idx]:
+			prompt += palm_prompts['story_gen']['add_side_character'].format(
+										cur_side_chars=cur_side_chars,
+										name=name[idx],
+										job=job[idx],
+										age=age[idx],
+										personality=personality[idx]
+									)
+			cur_side_chars += 1
+	return "\n" + prompt if prompt else ""
 
 def id_generator(size=6, chars=string.ascii_uppercase + string.digits):
 	return ''.join(random.choice(chars) for _ in range(size))
@@ -60,14 +60,28 @@ def parse_first_json_code_snippet(code_snippet):
 
 async def retry_until_valid_json(prompt, parameters=None):
 	response_json = None
-	while response_json is None:
-		_, response_txt = await palmchat.gen_text(prompt, mode="text", parameters=parameters)
-		print(response_txt)
 
+	for _ in range(3):
+		try:
+			response, response_txt = await palmchat.gen_text(prompt, mode="text", parameters=parameters)
+			print(response_txt)
+		except Exception as e:
+			print("PaLM API has withheld a response due to content safety concerns. Retrying...")
+			continue
+		
 		try:
 			response_json = parse_first_json_code_snippet(response_txt)
+			break
 		except:
+			print("Parsing JSON failed. Retrying...")
 			pass
+	
+	if len(response.filters) > 0:
+		raise ValueError("PaLM API has withheld a response due to content safety concerns.")
+	elif response_json is None:
+		print("=== Failed to generate valid JSON response. ===")
+		print(response_txt)
+		raise ValueError("Failed to generate valid JSON response.")
 			
 	return response_json
 

interfaces/view_change_ui.py

@@ -10,4 +10,94 @@ def back_to_previous_view():
     return (
         gr.update(visible=True),
         gr.update(visible=False),
-    )
+    )
+
+# pre_phase: False, background_setup_phase: True
+pre_to_setup_js = """
+function pre_to_setup() {
+    console.log("hello");
+
+    document.querySelector("#pre_phase").style.display = "none";
+    document.querySelector("#background_setup_phase").style.display = "flex";
+}
+"""
+
+# pre_phase: True, background_setup_phase: False
+back_to_pre_js = """
+function back_to_pre() {
+    document.querySelector("#pre_phase").style.display = "flex";
+    document.querySelector("#background_setup_phase").style.display = "none";
+}
+"""
+
+# background_setup_phase: False, character_setup_phase: True
+world_setup_confirm_js = """
+function world_setup_confirm() {
+    document.querySelector("#background_setup_phase").style.display = "none";
+    document.querySelector("#character_setup_phase").style.display = "flex";
+}
+"""
+
+# background_setup_phase: True, character_setup_phase: False
+back_to_background_setup_js = """
+function back_to_background_setup() {
+    document.querySelector("#background_setup_phase").style.display = "flex";
+    document.querySelector("#character_setup_phase").style.display = "none";
+}
+"""
+
+# pre_phase: False, writing_phase: True
+restart_from_story_generation_js = """
+function restart_from_story_generation() {
+    document.querySelector("#pre_phase").style.display = "none";
+    document.querySelector("#writing_phase").style.display = "flex";
+}
+"""
+
+# writing_phase: False, export_phase: True
+story_writing_done_js = """
+function story_writing_done() {
+    document.querySelector("#writing_phase").style.display = "none";
+    document.querySelector("#export_phase").style.display = "flex";
+}
+"""
+
+# export_phase: False, export_view_phase: True
+export_done_js = """
+function export_done() {
+    document.querySelector("#export_phase").style.display = "none";
+    document.querySelector("#export_view_phase").style.display = "flex";
+}
+"""
+
+# writing_phase: True, export_phase: False
+back_to_story_writing_js = """
+function back_to_story_writing() {
+    document.querySelector("#writing_phase").style.display = "flex";
+    document.querySelector("#export_phase").style.display = "none";
+}
+"""
+
+# pre_phase: True, export_phase: False
+restart_from_export_js = """
+function restart_from_export() {
+    document.querySelector("#pre_phase").style.display = "flex";
+    document.querySelector("#export_phase").style.display = "none";
+}
+"""
+
+# character_setup_phase: False, writing_phase: True
+character_setup_confirm_js = """
+function character_setup_confirm() {
+    document.querySelector("#character_setup_phase").style.display = "none";
+    document.querySelector("#writing_phase").style.display = "flex";
+}
+"""
+
+# pre_phase: True, export_view_phase: False
+restart_from_export_view_js = """
+function restart_from_export_view() {
+    document.querySelector("#pre_phase").style.display = "flex";
+    document.querySelector("#export_view_phase").style.display = "none";
+}
+"""

modules/__init__.py

@@ -4,6 +4,7 @@ from .palmchat import (
     PaLMChatPromptFmt,
     PaLMChatPPManager,
     GradioPaLMChatPPManager,
+    palm_prompts,
 )
 from .utils import (
     merge_video,

modules/image_maker.py

@@ -49,7 +49,8 @@ class ImageMaker:
                        sampling: Literal['sde-dpmsolver++'] = 'sde-dpmsolver++',
                        vae: str = None,
                        safety: bool = True,
-                       neg_prompt: str = None,
+                       variant: str = None,
+                       from_hf: bool = False,
                        device: str = None) -> None:
         """Initialize the ImageMaker class.
 
@@ -59,6 +60,8 @@ class ImageMaker:
             sampling (Literal['sde-dpmsolver++'], optional): Sampling method. Defaults to 'sde-dpmsolver++'.
             vae (str, optional): Filename of the VAE model. Defaults to None.
             safety (bool, optional): Whether to use the safety checker. Defaults to True.
+            variant (str, optional): Variant of the model. Defaults to None.
+            from_hf (bool, optional): Whether to load the model from HuggingFace. Defaults to False.
             device (str, optional): Device to use for the model. Defaults to None.
         """
 
@@ -68,34 +71,41 @@ class ImageMaker:
         self.__sampling = sampling
         self.__vae = vae
         self.__safety = safety
-        self.neg_prompt = neg_prompt
+        self.__variant = variant
+        self.__from_hf = from_hf
 
         print("Loading the Stable Diffusion model into memory...")
-        self.__sd_model = StableDiffusionPipeline.from_single_file(self.model_base,
-                                                              torch_dtype=torch.float16,
-                                                              use_safetensors=True,
-                                                              )
-
-        # Clip Skip
-        self.__sd_model.text_encoder.text_model.encoder.layers = self.__sd_model.text_encoder.text_model.encoder.layers[:12 - (self.clip_skip - 1)]
-
-        # Sampling method
-        if True: # TODO: Sampling method :: self.sampling == 'sde-dpmsolver++'
-            scheduler = DPMSolverMultistepScheduler.from_config(self.__sd_model.scheduler.config)
-            scheduler.config.algorithm_type = 'sde-dpmsolver++'
-            self.__sd_model.scheduler = scheduler
-        
-        # TODO: Use LoRA
-
-        # VAE
-        if self.vae:
-            vae_model = AutoencoderKL.from_pretrained(self.vae, torch_dtype=torch.float16)
-            self.__sd_model.vae = vae_model
-
-        if not self.safety:
-            self.__sd_model.safety_checker = None
-            self.__sd_model.requires_safety_checker = False
+        if not self.__from_hf:
+            # from file
+            self.__sd_model = StableDiffusionPipeline.from_single_file(self.model_base,
+                                                                torch_dtype=torch.float16,
+                                                                use_safetensors=True,
+                                                                )
+
+            # Clip Skip
+            self.__sd_model.text_encoder.text_model.encoder.layers = self.__sd_model.text_encoder.text_model.encoder.layers[:12 - (self.clip_skip - 1)]
+
+            # Sampling method
+            if True: # TODO: Sampling method :: self.sampling == 'sde-dpmsolver++'
+                scheduler = DPMSolverMultistepScheduler.from_config(self.__sd_model.scheduler.config)
+                scheduler.config.algorithm_type = 'sde-dpmsolver++'
+                self.__sd_model.scheduler = scheduler
+            
+            # VAE
+            if self.vae:
+                vae_model = AutoencoderKL.from_single_file(self.vae, use_safetensors=True)
+                self.__sd_model.vae = vae_model.to(dtype=torch.float16)
+            
+            # Safety checker
+            if not self.safety:
+                self.__sd_model.safety_checker = None
+                self.__sd_model.requires_safety_checker = False
 
+        else:
+            # from huggingface
+            self.__sd_model = StableDiffusionPipeline.from_pretrained(self.model_base,
+                                                                      variant=self.__variant,
+                                                                      use_safetensors=True)
         print(f"Loaded model to {self.device}")
         self.__sd_model = self.__sd_model.to(self.device)
 
@@ -189,6 +199,8 @@ class ImageMaker:
                                                 )
         except asyncio.TimeoutError:
             raise TimeoutError("The response time for PaLM API exceeded the limit.")
+        except:
+            raise Exception("PaLM API is not available.")
         
         try: 
             res_json = json.loads(response_txt)
@@ -241,6 +253,8 @@ class ImageMaker:
                                                 )
         except asyncio.TimeoutError:
             raise TimeoutError("The response time for PaLM API exceeded the limit.")
+        except:
+            raise Exception("PaLM API is not available.")
         
         try: 
             res_json = json.loads(response_txt)
@@ -272,6 +286,10 @@ class ImageMaker:
         return self.__compel_proc.pad_conditioning_tensors_to_same_length([conditioning, negative_conditioning])
 
 
+    def push_to_hub(self, repo_id:str, commit_message:str=None, token:str=None, variant:str=None):
+        self.__sd_model.push_to_hub(repo_id, commit_message=commit_message, token=token, variant=variant)
+
+
     @property
     def model_base(self):
         """Model base

modules/music_maker.py

@@ -124,6 +124,8 @@ class MusicMaker:
                                                 )
         except asyncio.TimeoutError:
             raise TimeoutError("The response time for PaLM API exceeded the limit.")
+        except:
+            raise Exception("PaLM API is not available.")
         
         try: 
             res_json = json.loads(response_txt)

modules/palmchat.py

@@ -104,6 +104,7 @@ async def gen_text(
                 'temperature': temperature,
                 'top_k': top_k,
                 'top_p': top_p,
+                'safety_settings': safety_settings,
             }
         else:
             parameters = {
@@ -116,14 +117,16 @@ async def gen_text(
                 'safety_settings': safety_settings,
             }
 
-    if mode == "chat":
-        response = await palm_api.chat_async(**parameters, messages=prompt)
-    else:
-        response = palm_api.generate_text(**parameters, prompt=prompt)
-    
-    if use_filter and len(response.filters) > 0 and \
-        response.filters[0]['reason'] == 2:
-        response_txt = "your request is blocked for some reasons"
+    try:
+        if mode == "chat":
+            response = await palm_api.chat_async(**parameters, messages=prompt)
+        else:
+            response = palm_api.generate_text(**parameters, prompt=prompt)
+    except:
+        raise EnvironmentError("PaLM API is not available.")
+
+    if use_filter and len(response.filters) > 0:
+        raise Exception("PaLM API has withheld a response due to content safety concerns.")
     else:
         if mode == "chat":
             response_txt = response.last