how to concat soundscapes

README.md

@@ -27,7 +27,7 @@ tags:
 
 ## Available Voices
 
-<a href="https://audeering.github.io/shift/">Listen Voices!</a>
+<a href="https://audeering.github.io/shift/">Listen to available voices!</a>
 
 ## Flask API
 
@@ -46,8 +46,6 @@ Flask
 CUDA_DEVICE_ORDER=PCI_BUS_ID HF_HOME=./hf_home CUDA_VISIBLE_DEVICES=2 python api.py
 ```
 
-## Inference
-
 The following need `api.py` to be running on a `tmux session`. 
 
 ## Text 2 Speech

api.py

@@ -29,14 +29,15 @@ Path(CACHE_DIR).mkdir(parents=True, exist_ok=True)
 #   ssh-add ~/.ssh/id_ed25519_github2024
 #
 #   git remote set-url origin git@github.com:audeering/shift
-# ==
+# == 
 
 def _shift(x):
     n = x.shape[0]
     i = np.random.randint(.24 * n, max(1, .74 * n))  # high should be above >= 0
     x = np.roll(x, i)
-    # fade_in = .5 + .5 * np.tanh(4*(np.linspace(-10, 10, x.shape[0]) + 9.4))
-    # x = x * fade_in
+    # fade_in = .5 * np.tanh(-4*(np.linspace(-10, 10, n) - 9.4)) 
+    x[0] = .5 * x[1]
+    x[-1] = .5 * x[-2]  # smooth woof
     return x
 
 def overlay(x, sound_background=None):
@@ -47,11 +48,12 @@ def overlay(x, sound_background=None):
             n_repeat = len_speech // len(sound_background) + 1
             replica = [sound_background] * n_repeat
             replica = [_shift(_) for _ in replica]
+            # The patch makes a woof assure smooth start to multiply the patch by a 
             sound_background = np.concatenate(replica)
             
             
-        print(f'\nSOUND BACKGROUND SHAPE\n{sound_background.shape=}\n{x.shape=}\n- - - -')
-        x = .74 * x + .26 * sound_background[:len_speech]
+        print(f'\n====SOUND BACKGROUND SHAPE\n{sound_background.shape=}{np.abs(sound_background.max())=}\n{x.shape=}\n- - - -')
+        x = .9 * x + .1 * sound_background[:len_speech]
     return x
 
 def tts_multi_sentence(precomputed_style_vector=None,

landscape2soundscape.py

@@ -46,7 +46,7 @@ DESCRIPTIONS = [
         '01_Schick_AII840_001.jpg',                               # image
         '01_Schick_AII840_001.txt',                               # text
         'Statue in shire hill on autumn beach.',                  # audiocraft
-        'Gottlieb Schick 1802 - Bildnis der Heinrike Dannecker', # cv2 puttext title
+        'G. Schick, Bildnis der Heinrike Dannecker, 1802', # cv2 puttext title
         'en_US/m-ailabs_low#mary_ann',
      ],  
     # 2
@@ -54,23 +54,23 @@ DESCRIPTIONS = [
         '02_Constable_AI555_001.jpg',
         '02_Constable_AI555_001.txt',
         'Meadows country farm village in sight',
-        'John Constable 1804 - Dorf An Dem Flusse Stour',
-        'en_US/m-ailabs_low#mary_ann',
+        'J. Constable, Dorf An Dem Flusse Stour, 1804',
+        'en_US/m-ailabs_low#elliot_miller',
     ],
     # 3
     [
         '03_Schinkel_WS200-002.jpg',
         '03_Schinkel_WS200-002.txt',
         'Arriving at the shore on horses',
-        'Karl Friedrich Schinkel 1815 - Gotische Kirche Auf Einem Felsen Am Meer',
-        'en_US/m-ailabs_low#mary_ann',
+        'K. F. Schinkel, Gotische Kirche Auf Einem Felsen Am Meer, 1815',
+        'en_US/hifi-tts_low#6097',
     ],
     #
     [
         '04_Friedrich_FV317_001.jpg',
         '04_Friedrich_FV317_001.txt',
         'Land steppes',
-        'Friedrich Caspar David 1824 - Der Watzmann',
+        'C. D. Friedrich, Der Watzmann, 1824',
         'en_US/m-ailabs_low#mary_ann',
     ],
     #
@@ -78,15 +78,15 @@ DESCRIPTIONS = [
         '05_Blechen_FV40_001.jpg',
         '05_Blechen_FV40_001.txt',
         'fjords',
-        'Carl Blechen 1829 - Unwetter In Der Romischen Campagna',
+        'C. Blechen, Unwetter In Der Romischen Campagna, 1829',
         'en_US/m-ailabs_low#mary_ann',
     ],
     # 6
     [
         '06_Menzel_AI900_001.jpg',
         '06_Menzel_AI900_001.txt',
-        'Olive trees in Seville',
-        'Adolph Menzel 1846 - Bauplatz mit Weiden',
+        'Olive Seville',
+        'A. Menzel, Bauplatz mit Weiden, 1846',
         'en_US/m-ailabs_low#mary_ann',
     ],
     # 7
@@ -94,7 +94,7 @@ DESCRIPTIONS = [
         '07_Courbet_AI967_001.jpg',
         '07_Courbet_AI967_001.txt',
         'Storm at the strand of waves Tsunami',
-        'Gustave Courbet 1870 - Die Welle',
+        'G. Courbet, Die Welle, 1870',
         'en_US/m-ailabs_low#mary_ann',
     ],
     # 8
@@ -102,7 +102,7 @@ DESCRIPTIONS = [
         '08_Monet_AI1013_001.jpg',
         '08_Monet_AI1013_001.txt',
         'Mai flowers blossom picnic',
-        'Claude Monet 1874 - Sommertag',
+        'C. Monet, Sommertag, 1874',
         'en_US/m-ailabs_low#mary_ann',
     ],
     # 9
@@ -110,7 +110,7 @@ DESCRIPTIONS = [
         '09_Blechen_AII823_001.jpg',
         '09_Blechen_AII823_001.txt',
         'Cascade in Africa',
-        'Carl Blechen 1832 - Wasserfälle Bei Tivoli',
+        'C. Blechen, Wasserfälle Bei Tivoli, 1832',
         'en_US/m-ailabs_low#mary_ann',
     ],
     # 10
@@ -118,7 +118,7 @@ DESCRIPTIONS = [
         '10_Boecklin_967648_NG2-80_001_rsz.jpg',
         '10_Boecklin_967648_NG2-80_001.txt',
         'Hades ades at it sisland',
-        'Arnold Böcklin 1883 - Toteninsel',
+        'A. Böcklin, Toteninsel, 1883',
         'en_US/m-ailabs_low#mary_ann',
     ],
     # 11
@@ -126,7 +126,7 @@ DESCRIPTIONS = [
         '11_Liebermann_NG4-94_001.jpg',
         '11_Liebermann_NG4-94_001.txt',
         'Tavern at the waterfront',
-        'Max Tiebermann 1916 - Gartenlokal An Der Havel. Nikolskoe',
+        'M. Tiebermann, Gartenlokal An Der Havel. Nikolskoe, 1916',
         'en_US/m-ailabs_low#mary_ann',
     ],
     # 12
@@ -134,7 +134,7 @@ DESCRIPTIONS = [
         '12_Slevogt_AII1022_001.jpg',
         '12_Slevogt_AII1022_001.txt',
         'toy sailing yachts pool',
-        'Max Slevogt 1905 - Segelboote Auf Der Alster Am Abend',
+        'M. Slevogt, Segelboote Auf Der Alster Am Abend, 1905',
         'en_US/m-ailabs_low#mary_ann',
     ],
 ]
@@ -159,7 +159,7 @@ for img, text, scene, title, voice in DESCRIPTIONS[:20]:
     fram = np.zeros((94, im.shape[1], 3), dtype=np.uint8)
     h, w, _ = fram.shape
     font                   = cv2.FONT_HERSHEY_SIMPLEX
-    bottomLeftCornerOfText = (240, 74)  # w,h
+    bottomLeftCornerOfText = (4, 74)  # OFFSET IN BANNER (240, 74)  # w,h 
     fontScale              = 2
     fontColor              = (255, 255, 255)
     thickness              = 4
@@ -171,7 +171,7 @@ for img, text, scene, title, voice in DESCRIPTIONS[:20]:
         fontColor,
         thickness,
         lineType)
-    offset_h = 0
+    offset_h = 24
     im[offset_h:h+offset_h, :w, :] = (.4 * im[offset_h:h+offset_h, :w, :] + .6 * fram).astype(np.uint8)    
 
     cv2.imwrite('_tmp_banner.png', im)

uc_spk_Landscape2Soundscape_Masterpieces_pics/01_Schick_AII840_001.txt

@@ -1 +1 @@
-After studying for four years with the legendary Parisian painter Jacques-Louis David, Christian Gottlieb Schick returned to Stuttgart in 1802. That very year, he began painting the portrait of Heinrike Dannecker, the wife of his close friend and mentor, Johann Heinrich Dannecker. The Danneckers' home, known as the "Danneckerei," was more than just a house—it was a hub for art lovers, filled with ancient sculpture replicas. Schick’s portrait of Heinrike wasn’t just any portrait, though. Her relaxed pose, with a clear and confident gaze, reflected a new sense of freedom for women, one that had grown in the wake of the French Revolution. It’s no accident that Heinrike’s outfit subtly nods to the colors of the French flag—red, white, and blue. And the bouquet she holds, with bellflowers, roses, buttercups, and clover, stands out vividly against her deep blue dress, hinting at her natural, effortless beauty. Schick later wrote to Dannecker, “I remember struggling with the hand holding the flowers. I made all sorts of funny faces to help, and your wife and I laughed every time it came together. I was so happy painting her portrait.” Heinrike sits on a stone bench that brings to mind ancient ruins, her figure extending elegantly beyond the horizon, framed by soft curves that end with the graceful bend of her foot. Behind her, the landscape stretches into gentle mountain ranges, passing over dark green shrubs and a tranquil river valley. Schick masterfully captured her individuality while infusing a timeless, classical beauty. In this painting, Schick’s dream of blending classical ideals with real life reached a stunning peak. Interestingly, an unfinished version of this portrait—abandoned and trimmed by Schick himself—can still be found in the Staatsgalerie Stuttgart.
+After studying for four years with the legendary Parisian painter Jacques-Louis David, Christian Gottlieb Shic returned to Stuttgart in 1802. That year he began painting the portrait of Heinrike Dannecker the wife of his close friend and mentor Johannheinrich Dannecker. The home of the Danneckers known as the Danneckeray become a living hub for art lovers filled with ancient sculpture replicas. Schic portrait of Heinrike wasn’t any portrait as her relaxed pose, appalled to a clear confidenence of gaze reflects a new sense of freedom for the woman, one that arose in the wake of the French Revolution. It’s no accident that Heinrike’s outfit subtly nods to the colors of the French flag red, white, and blue. And the bouquet she holds, with bellflowers, roses, buttercups, and clover, stands out vividly against her deep blue dress, hinting at an effortless beauty. Lady Heinrike sits on a stone reminiscent of ancient pillars, her figure extending elegantly beyond the horizon. Behind her, the landscape ravels horizons and mountain ranges down to a tranquil river valley Interestingly, an unfinished version of this portrait—abandoned and trimmed by Schick himself—can still be found in the Staatsgalerie Stuttgart.