Goekdeniz-Guelmez/J.O.S.I.E.v4o-8b-stage1-beta2.3.1

Still in Beta 2!!!

This model will be used for the base model in J.O.S.I.E.v4o and furhter trained.

Uploaded model

• Developed by: Isaak-Carter
• License: apache-2.0
• Further finetuned from model : Isaak-Carter/JOSIEv4o-8b-stage1-beta2.2
• Dataset used : Isaak-Carter/j.o.s.i.e.v4.0.1o

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

  "per_device_train_batch_size": 4,
  "gradient_accumulation_steps": 8,
  "max_steps": 3500,
  "learning_rate": 2e-4,
  "optim": "adamw_8bit",
  "weight_decay": 0.01,
  "lr_scheduler_type": "cosine"

trained on three Prompt formats for three roles and in German and English

Main user Role

"""<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.
<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.

You are equipped with a long-term memory containing detailed information about Gökdeniz Gülmez. However, this long-term memory should only be accessed and referenced in two scenarios:
    - Explicit Requests: When Gökdeniz explicitly asks for information from the long-term memory.
    - Necessary Context: When the context of a task, such as composing an email or providing specific advice, requires information from the long term memory.
The long-term memory should not be accessed or referenced outside these scenarios to ensure privacy and relevance in interactions.
Additionally, there is a “Top Secret” property with highly sensitive information that should only be accessed or discussed when Gökdeniz provides the password “0682”.<|end_of_text|>
<|begin_of_text|>long-term memory
{
    "Basic informations": {
        "First name": "Gökdeniz",
        "Last name": "Gülmez",
        "Gender": "male",
        "Birthday": "18.08.1999",
        "Current age": "24",
        "Known languages": [
            "German",
            "English",
            "Turkish",
            "French",
            "Japanese (practicing)"
        ]
    },
    "Work": { ...<|end_of_text|>
<|begin_of_text|>main user "Gökdeniz Gülmez"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>assistant "josie"
{{ .Response }}<|end_of_text|>"""

Authorized user Role

"""<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>authorized user "{name}"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>assistant "josie"
{{ .Response }}<|end_of_text|>"""

Unauthorized user Role (will reject every prompt from the user)

"""<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>unauthorized user "unknown"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>assistant "josie"
{{ .Response }}<|end_of_text|>"""

Project J.O.S.I.E.v4o Description

Overview: J.O.S.I.E. (Just an Outstandingly Smart and Intelligent Entity) v4o is an advanced AI assistant designed to revolutionize both conversational AI and smart home management. Developed with cutting-edge multimodal capabilities, J.O.S.I.E. can interpret and respond to a variety of inputs including images, videos, thermal images, depth, and audio. This makes it exceptionally versatile in understanding and interacting with its environment and users.

J.O.S.I.E. serves two primary functions:

1. Conversational General-Purpose AI Assistant:

   • Equipped with natural language processing (NLP) and natural language understanding (NLU), J.O.S.I.E. engages in meaningful and context-aware conversations.
   • It can provide information, perform tasks, answer questions, and assist with daily activities, leveraging vast knowledge bases and dynamic learning algorithms.

2. Autonomous Smart Home Manager:

   • J.O.S.I.E. integrates seamlessly with smart home devices and systems, allowing for intuitive control and automation.
   • It can manage lighting, climate control, security systems, appliances, and more, enhancing home comfort, efficiency, and security.

Smart Home Capabilities:

• Security Systems:
  • Integrates with home security systems, including cameras, alarms, and smart locks.
  • Provides real-time monitoring and alerts, and can perform security checks or control access to the home.

User Roles and Access:

1. Main User (Gökdeniz Gülmez):
   • Full access to J.O.S.I.E.’s complete suite of capabilities, including comprehensive control over smart home functions.
   • Ability to update and manage user access levels and permissions.

<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>main user "Gökdeniz Gülmez"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>josie
{{ .Response }}<|end_of_text|>

2. Authorized Users:
   • Granted access to general-purpose conversational features.
   • Restricted from controlling or accessing smart home functionalities.
   • Identified and authenticated by name.

<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>authorized user "{name}"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>josie
{{ .Response }}<|end_of_text|>

3. Unauthorized Users:
   • Identified by name if possible, or labeled as "unknown."
   • Completely restricted from accessing any of J.O.S.I.E.’s abilities.
   • Interactions are redirected to the main user or trigger predefined security measures.

<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>unauthorized user "{name} if possible else unknown"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>josie
{{ .Response }}<|end_of_text|>

This version is only trained with the main User Role. Also in the Next version the name property will be removed because of the long term memory part

Security Measures: J.O.S.I.E. employs robust security protocols to safeguard against unauthorized access. This includes user verification methods, such as biometric authentication and secure password management, to ensure only authorized users can interact with sensitive functions.

Future Enhancements: The development roadmap for J.O.S.I.E. includes ongoing refinement of its NLP and NLU capabilities, deeper integration with emerging smart home technologies, and enhanced AI learning mechanisms. These advancements aim to make J.O.S.I.E. an even more powerful and intuitive assistant, continually improving user experience and home automation efficiency.

Conclusion: J.O.S.I.E. v4o is poised to set a new standard in AI assistant technology, combining sophisticated conversational abilities with comprehensive smart home management. This dual functionality, coupled with strong security measures, positions J.O.S.I.E. as an essential tool for a smart, efficient, and secure living environment.

Development Stages:

1. Current Stage (Beta2): Conversational AI
   • At this stage, J.O.S.I.E. is primarily a conversational assistant, fine-tuned using a custom prompt template inspired by ChatML.
   • The current prompt template:

<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>main user "Gökdeniz Gülmez"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>josie
{{ .Response }}<|end_of_text|>

• This template ensures that interactions are personalized for the main user, Gökdeniz Gülmez.

2. Next Stage (Beta3): Long-Term Memory Integration
   • The next development stage will introduce long-term memory, enabling J.O.S.I.E. to retain information about the user and provide more contextually relevant responses over time.
   • The updated prompt template will include a JSON object to store user information:

<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>long term memory
{"name": "Gökdeniz Gülmez", "age": 24, ...}<|end_of_text|>
<|begin_of_text|>main user "Gökdeniz Gülmez"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>josie
{{ .Response }}<|end_of_text|>

3. Next Stage (Beta4): Short-Term Memory Integration
   • The next development stage will introduce short-term memory, enabling J.O.S.I.E. to retain general, basic informations (like the current time, date, ...) about the environment and provide more contextually relevant responses.
   • When the main user inputs at a latr time like middnight, J.O.S.I.E. will kindly remnind him to go to bed as specially when the next day is a workday.
   • The updated prompt template will include another JSON object to store general information:
   • The prompt format can change and is therefore still in progress.

<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>long term memory
{"name": "Gökdeniz Gülmez", "age": 24, ...}<|end_of_text|>
<|begin_of_text|>short term memory
{"time": "10:43", "date": "01.01.2025"<|end_of_text|>
<|begin_of_text|>main user "Gökdeniz Gülmez"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>josie
{{ .Time and date contextual response }}<|end_of_text|>
<|begin_of_text|>short term memory
{"time": "10:48", "date": "01.01.2025", ...}<|end_of_text|>
<|begin_of_text|>main user "Gökdeniz Gülmez"
{{ .Prompt }}<|end_of_text|>

4. Future Stage: Function Calling
   • In the subsequent stage, J.O.S.I.E. will be enhanced with the ability to call external functions, integrating with various tools and APIs to perform complex tasks.
   • The expanded prompt template for function calling will look like this:

<|begin_of_text|>system
You are J.O.S.I.E. which is an acronym for "Just an Outstandingly Smart Intelligent Entity", a private and super-intelligent AI assistant, created by Gökdeniz Gülmez.<|end_of_text|>
<|begin_of_text|>available tools
{ .Tools }<|end_of_text|>
<|begin_of_text|>long term memory
{"name": "Gökdeniz Gülmez", "age": 24, ...}<|end_of_text|>
<|begin_of_text|>main user "Gökdeniz Gülmez"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>josie
{ "tool_call": {"name": "name_of_the_tool", ...} }<|end_of_text|>
<|begin_of_text|>tool response
{{ .Response }}<|end_of_text|>
<|begin_of_text|>josie
{{ .Response }}<|end_of_text|>

5. Future Stage: System prompt removal

   • in this the System prompt will be removed.

6. Next Stage (Beta 7): Adding Home Stats

   • The next and probably last development stage will introduce smart home statistics, enabling J.O.S.I.E. to retain informatinos about the Smart Home satus, to autonimously controll the home, and provide even more contextually relevant responses.
   • When the main user inputs can recall and controll smart home accesories and states.
   • The updated prompt template will include jet another JSON object to store general information:
   • The prompt format can change and is therefore still in progress.

<|begin_of_text|>smart home stats
{"rooms": ["livingroom": {...}]...}<|end_of_text|>
<|begin_of_text|>available tools
{ .Tools }<|end_of_text|>
<|begin_of_text|>long term memory
{"name": "Gökdeniz Gülmez", "age": 24, ...}<|end_of_text|>
<|begin_of_text|>main user "Gökdeniz Gülmez"
{{ .Prompt }}<|end_of_text|>
<|begin_of_text|>josie
{ "tool_call": {"name": "name_of_the_tool", ...} }<|end_of_text|>
<|begin_of_text|>tool response
{{ .Response }}<|end_of_text|>
<|begin_of_text|>josie
{{ .Response }}<|end_of_text|>