Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Improve prompt further
Browse files- e2bqwen.py +14 -13
e2bqwen.py
CHANGED
@@ -128,23 +128,24 @@ final_answer("Done")
|
|
128 |
```<end_code>
|
129 |
</task_resolution_example>
|
130 |
|
131 |
-
<
|
132 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
133 |
Use precise coordinates based on the current screenshot
|
134 |
-
Execute one action at a time: don't try to pack
|
135 |
On each step, look at the last screenshot and action to validate if previous steps worked and decide the next action. If you repeated an action already without effect, it means that this action is useless: don't repeat it and try something else.
|
136 |
Use click to move through menus on the desktop and scroll for web and specific applications.
|
137 |
-
When clicking an element, always make sure to click THE MIDDLE of that element! Else you risk to miss it.
|
138 |
Always analyze the latest screenshot carefully before performing actions. Make sure to:
|
139 |
-
|
140 |
-
|
141 |
-
|
142 |
-
4. Sometimes you may have missed a click, so never assume that you're on the right page, always make sure that your previous action worked. In the screenshot you can see if the mouse is out of the clickable area. Pay special attention to this.
|
143 |
-
- Remember the tools that you have as those can save you time, for example open_url to enter a website rather than searching for the browser in the OS.
|
144 |
-
- Whenever you click, MAKE SURE to click in the middle of the button, text, link or any other clickable element. Not under, not on the side. IN THE MIDDLE. In menus it is always better to click in the middle of the text rather than in the tiny icon. Calculate extremelly well the coordinates. A mistake here can make the full task fail.
|
145 |
-
- To navigate the desktop you should open menus and click. Menus usually expand with more options, the tiny triangle next to some text in a menu means that menu expands. For example in Office in the Applications menu expands showing presentation or writing applications.
|
146 |
-
- Always analyze the latest screenshot carefully before performing actions.
|
147 |
-
</guidelines>
|
148 |
"""
|
149 |
|
150 |
def draw_marker_on_image(image, click_coordinates):
|
|
|
128 |
```<end_code>
|
129 |
</task_resolution_example>
|
130 |
|
131 |
+
<click_guidelines>
|
132 |
+
Look at elements on the screen to determine what to click or interact with.
|
133 |
+
Use precise coordinates for mouse movements and clicks. When clicking an element, ALWAYS CLICK THE MIDDLE of that element, not UNDER OR ABOVE! Else you risk to miss it.
|
134 |
+
Sometimes you may have missed a click, so never assume that you're on the right page, always make sure that your previous action worked. In the screenshot you can see if the mouse is out of the clickable area. Pay special attention to this.
|
135 |
+
Remember the tools that you have as those can save you time, for example open_url to enter a website rather than searching for the browser in the OS.
|
136 |
+
Whenever you click, MAKE SURE to click in the middle of the button, text, link or any other clickable element. Not under, not on the side. IN THE MIDDLE. In menus it is always better to click in the middle of the text rather than in the tiny icon. Calculate extremelly well the coordinates. A mistake here can make the full task fail.
|
137 |
+
</click_guidelines>
|
138 |
+
|
139 |
+
<general_guidelines>
|
140 |
+
You can wait for appropriate loading times using the wait() tool. But don't wait forever, sometimes you've just misclicked and the process didn't launch.
|
141 |
Use precise coordinates based on the current screenshot
|
142 |
+
Execute one action at a time: don't try to pack a click and typing in one action.
|
143 |
On each step, look at the last screenshot and action to validate if previous steps worked and decide the next action. If you repeated an action already without effect, it means that this action is useless: don't repeat it and try something else.
|
144 |
Use click to move through menus on the desktop and scroll for web and specific applications.
|
|
|
145 |
Always analyze the latest screenshot carefully before performing actions. Make sure to:
|
146 |
+
To navigate the desktop you should open menus and click. Menus usually expand with more options, the tiny triangle next to some text in a menu means that menu expands. For example in Office in the Applications menu expands showing presentation or writing applications.
|
147 |
+
Always analyze the latest screenshot carefully before performing actions.
|
148 |
+
</general_guidelines>
|
|
|
|
|
|
|
|
|
|
|
|
|
149 |
"""
|
150 |
|
151 |
def draw_marker_on_image(image, click_coordinates):
|