Fatal Error

#14
by seadude - opened

Hello,

I'm completely new here, so bear with me.
I just spun up a DataBricks trial to test dolly out. I'm feeling like the free trial may be limited in the memory, etc and thats what caused this error?

image.png

Thoughts on this one?

Thank you

Fatal error: The Python kernel is unresponsive.
---------------------------------------------------------------------------
The Python process exited with exit code 137 (SIGKILL: Killed). This may have been caused by an OOM error. Check your command's memory usage.

The last 10 KB of the process's stderr and stdout can be found below. See driver logs for full logs.
---------------------------------------------------------------------------
Last messages on stderr:
Thu Apr 13 05:58:50 2023 Connection to spark from PID  1173
Thu Apr 13 05:58:50 2023 Initialized gateway on port 46403
Thu Apr 13 05:58:50 2023 Connected to spark.
---------------------------------------------------------------------------
Last messages on stdout:
NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work.

To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see https://github.com/ipython/ipython/issues/2049


To connect another client to this kernel, use:
    --existing /databricks/kernel-connections/X.json
Command took 4.03 minutes -- by  at 4/12/2023, 10:58:56 PM on  Cluster

The problem lies in the memory usage, as the model is quite large.

Databricks org

Sorry I'm not familiar with the details of what is available in the free trial. Does your cluster have GPUs available? We just released some smaller versions of the model (see below) but you will probably still need to use a GPU for generation to complete in a reasonable amount of time.

https://huggingface.co/databricks/dolly-v2-2-8b
https://huggingface.co/databricks/dolly-v2-6-9b

srowen changed discussion status to closed

Sign up or log in to comment