|
--- |
|
license: other |
|
license_name: flux-1-dev-non-commercial-license |
|
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md |
|
language: |
|
- en |
|
tags: |
|
- flux |
|
- diffusers |
|
- lora |
|
- replicate |
|
base_model: "black-forest-labs/FLUX.1-dev" |
|
pipeline_tag: text-to-image |
|
instance_prompt: RTMI |
|
library_name: diffusers |
|
|
|
inference: |
|
parameters: |
|
width: 1024 |
|
height: 1024 |
|
widget: |
|
- text: "RTMI style. Guybrush threepwood, a tall man with blonde hair, wearing a blue pirate coat with gold accents. He has a white shirt underneath, a belt with a gold buckle, and dark pants. His expression is thoughtful, and he has a slight stubble on his face, adding to his adventurous appearance. Guybrush is programming with many computers. Cyberpunk style." |
|
example_title: "Guybrush programmer" |
|
output: |
|
url: "samples/guybrush-programmer.png" |
|
|
|
- text: "RTMI style. An empty interior scene just inside the entrance of a towering building constructed and inhabited by cockroaches. The perspective is distorted and cartoonish, with the camera positioned as if you're standing just past the grand, slightly arched door that leads into the building. The interior is a labyrinth of narrow, winding corridors that twist and turn unpredictably, with passageways leading up, down, and in all directions, creating a sense of disorientation. The ceiling, walls, and floors are all pristine white, with the floor retroilluminated, casting a soft glow upwards. The hallways have a sleek, futuristic appearance, but are still dimly lit, with shadows that accentuate the strange angles of the walls. The retro-style TVs embedded in the walls have bright orange plastic casings, while the screens emit a soft, white light. The screens are tilted at odd angles, flickering with static or displaying quirky, old-school TV shows, adding a nostalgic glow to the cold environment. The staircases are modern and minimalist, without handrails, their black steps creating a stark contrast against the white surroundings. The stairs spiral upward in erratic directions, some leading to higher floors, while others abruptly end in dead ends. The stairways are crooked, with steps of varying heights and widths, enhancing the building’s surreal, disjointed atmosphere. The white walls are adorned with subtle, recessed cockroach logos, creating an embossed effect that adds texture and detail to the otherwise smooth surfaces. Additional doors are scattered throughout the corridor, some leading to hidden rooms, while others open into completely dark tunnels. The hallways also bifurcate in places, with some passages leading into these pitch-black tunnels, creating a sense of mystery and unease. The entire scene is bathed in a mix of dim lighting from the ceiling, the soft glow from the floor, and the eerie light of the orange TVs, creating a mysterious and slightly unsettling atmosphere." |
|
example_title: "Tv nest" |
|
output: |
|
url: "samples/tv-channel.png" |
|
|
|
- text: "RTMI style. textured paper collage The paper texture is very visible. There are different textures. The papers are handmade painted with watercolor and crayons. An empty stylized game background scene using muted colors, mainly blue, yellow, orange, black and violet. A winding path crosses the screen, curving from the top left to the bottom right. Below the path, whimsical trees with irregular, bulbous shapes and playful, swirling bushes fill the scene. To the right stands a cozy, old-fashioned restaurant with large glass windows, through which warm, soft light spills onto the empty street. Inside, simple wooden tables and chairs are arranged neatly, but the restaurant is vacant, giving it a peaceful, quiet vibe. The restaurant's exterior features a large, aged wooden sign, slightly crooked, with an oversized fork carved into it and the text \"Crespín Restorán\" in quirky, uneven letters. Outside, a few tufts of grass poke through the cracks of the weathered sidewalk tiles, adding to the rustic charm. The night sky above is dark, with a crescent moon shining softly, casting gentle shadows. The street is empty and lonely, illuminated by a few antique-style street lamps that emit a dim, warm light, contrasting with the cold, bluish light of the street itself. The lamps are bent and irregular, with wavy lines, and their light creates playful, wavy reflections on the pavement. The visual style in these images can be characterized as highly exaggerated and car." |
|
example_title: "Restaurant outdoor" |
|
output: |
|
url: "samples/restaurant-outdoor.png" |
|
|
|
- text: "RTMI game background design. Fisheye lens panorama background for a point-and-click game. The horizon is curvy, and the scene is viewed from a low angle on a deserted beach with soft, golden sand. In the foreground, gentle waves of the deep blue ocean lap against the shore. Far in the distance, a steep cliff rises dramatically from the beach, and perched on top is a very large wooden cabin with a rustic, adventurous design. The cabin features a thatched roof and sturdy log walls in various shades of brown. A winding dirt path carves its way up the cliffside, connecting the beach with the cabin above. Below the cliff, a small wooden pier extends into the water, where a boat is gently swaying in the breeze. On the distant horizon, a small picturesque village resembling Capri is nestled on a hill, its buildings barely visible against the bright, sunny sky. The entire scene is peaceful and tranquil, with the sun casting a warm light over the landscape, while the sense of adventure lingers in the air from the towering cliff and the solitary wooden cabin above. . This visual style is defined by a strong emphasis on exaggerated forms and dynamic compositions. The shapes throughout are distorted and twisted, moving away from realistic representations and instead creating a world that feels fluid and constantly in motion. Buildings and objects often appear bent, curved, or skewed, giving the environment a surreal quality that emphasizes a playful and imaginative tone. The architecture seems to defy gravity, with structures leaning at odd angles, contributing to the overall whimsical feel. Perspective is another key aspect of this style, where traditional rules are intentionally bent or broken. Instead of using a realistic vanishing point, the perspective often resembles a wide-angle or fisheye lens, with objects stretching and warping as they recede into the distance. This creates a sense of depth that is exaggerated and immersive, drawing the viewer into the scene while maintaining a distinctly stylized and cartoonish appearance. Lighting is used to define the shapes and enhance the sense of depth and dimension. Highlights and shadows are applied in a bold, almost graphic manner, bringing out the contours of the objects and creating a strong contrast between different elements. This approach adds to the overall dynamism of the composition, making the scenes feel energetic and full of life. The compositions themselves are carefully structured to guide the viewer’s eye across the scene. The use of exaggerated perspective and distorted shapes creates a visual flow that leads from one area to another, encouraging exploration and engagement with the environment. This sense of movement within the static image helps to reinforce the idea of a world that is in constant flux, where nothing is quite as it seems. Overall, the style focuses on distortion, dynamic perspective, and strong lighting to create an engaging and surreal visual experience. The world feels lively and imaginative, with every element contributing to a cohesive and playful aesthetic that invites the viewer into its unique and fantastical universe." |
|
example_title: "Beach" |
|
output: |
|
url: "samples/beach-01.png" |
|
|
|
- text: "RTMI illustration style. View from a cliffside lookout, looking down towards large rocks and the ocean below. The edge of the cliff is covered in rough, gray rocks with small cracks and patches of resilient vegetation growing between them. The deep blue ocean below gently crashes against the rocks at the base of the cliff, creating swirls of white foam. Some of the rocks are partially submerged in water, while others jut out, weathered by the waves. On the right, the ocean extends toward the horizon, with the sunlight reflecting off the water, creating bright glimmers. The sky above is clear, with soft sunlight bathing the scene. The atmosphere is peaceful, with soft shadows cast on the rocks and water. The base of the cliff is composed of dark, rugged rocks with patches of algae that catch the light, while gentle waves leave traces of foam as they break against the rocks. . The visual style in these images can be characterized as highly exaggerated and cartoonish, with a playful use of perspective and distortion. The style features bold and vibrant color schemes, where each area of the scene uses a limited but intense palette, allowing the shapes and forms to stand out sharply. These colors are often applied in large, flat planes, giving the visuals a somewhat graphic novel-like quality, even though they are rendered with a painterly texture. The perspective is notably warped, creating an almost fisheye lens effect in some cases. This warping is especially evident in how walls and floors curve unnaturally, as if the viewer is seeing the scene through a distorted lens. This creates a surreal and exaggerated space that enhances the whimsical and absurd nature of the scenes. Shapes are angular, with a mix of sharp and flowing lines. There’s a clear emphasis on abstraction, where objects and architectural elements are simplified to their most recognizable forms but are bent and twisted to fit the playful tone of the scene. The use of negative space is also significant, where shadows and silhouettes create dynamic contrasts, further adding to the overall exaggerated aesthetic. The perspective does not follow strict rules of realism. Instead, it is dynamically altered to guide the viewer’s eye across the scene, often leading to a sense of depth through exaggerated angles. The lens-like distortion pulls the edges of the scene outward, creating a sense of expansion, as if the environment is stretching away from the viewer. This helps to create a visually engaging and immersive experience, despite the flatness of the color application. Overall, the style combines vibrant, exaggerated color with distorted shapes and a playful approach to perspective, resulting in a visually unique and whimsical world that feels both surreal and immersive. The style is a collage that emphasizes texture and a handmade feel. Use simple geometric shapes cut from textured paper, incorporating a mix of rough, uneven edges to mimic the look of hand-torn paper. Incorporate crayon or pastel-like effects on some of the elements, adding a slightly uneven, grainy texture. The colors should be soft and muted, with subtle variations in hue, as if lightly shaded or colored by hand. The background should have a textured, almost sponge-like appearance, with visible brush strokes or speckled effects. Overall, the piece should have a playful, handcrafted look, combining the rough, tactile qualities of traditional collage with the expressive, childlike feel of crayon or pastel artwork." |
|
example_title: "Cliff" |
|
output: |
|
url: "samples/punta-01.png" |
|
|
|
- text: "RTMI cartoon character design. The image shows two singers passionately performing on stage, both holding microphones and singing with great emotion. The man on the left is bald, with a neatly trimmed beard and wearing a dark blue suit jacket over a white shirt. His head is tilted slightly upward as he sings, with his mouth wide open, conveying intensity and energy. His right hand grips the microphone tightly, and his left hand is extended outwards, as if emphasizing the power of his performance. To his right is a woman with long, curly blonde hair cascading over her shoulders. She is wearing a black, sparkling dress with a deep neckline, and she too is singing with enthusiasm. Her expression is powerful, with her mouth open wide as she belts out a note. She holds her microphone in her right hand, while her left hand is extended in a dramatic gesture, as if reaching out to the audience. She wears a watch on her left wrist and a ring on her right hand, adding to her glamorous appearance. The background features a stage with a decorative backdrop that includes a large circular design in shades of yellow and orange, resembling an abstract sun. Overhead, green stage lights illuminate the scene, casting a vibrant glow on the performers. Behind them, a dark curtain provides contrast, making the singers stand out even more. The atmosphere is lively, with the lighting and their dynamic expressions capturing the essence of a passionate performance." |
|
example_title: "Singers" |
|
output: |
|
url: "samples/singers-01.png" |
|
|
|
- text: "RTMI style. illustration of spiderman at the comic con" |
|
example_title: "Spiderman" |
|
output: |
|
url: "samples/spiderman.png" |
|
|
|
|
|
- text: "RTMI style. character design. The image depicts Monna Lisa by leonardo da vinci in cartoon RTMI style." |
|
example_title: "Monna Lisa" |
|
output: |
|
url: "samples/monna-lisa-03.png" |
|
|
|
--- |
|
|
|
# Flux Lora Rtmi |
|
A Flux Lora trained on **"Return to Monkey Island"** screen captures. |
|
|
|
Trained on Replicate using: |
|
|
|
https://replicate.com/ostris/flux-dev-lora-trainer/train |
|
|
|
|
|
## Trigger words |
|
You should use `RTMI` to trigger the image generation. |
|
|
|
|
|
## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers) |
|
|
|
```py |
|
from diffusers import AutoPipelineForText2Image |
|
import torch |
|
|
|
pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda') |
|
pipeline.load_lora_weights('lichorosario/flux-lora-rtmi', weight_name='lora.safetensors') |
|
image = pipeline('your prompt').images[0] |
|
``` |
|
|
|
<Gallery /> |
|
|
|
|
|
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters) |
|
|
