Added token probability calculation