FIDEL Is a DEcoder and Language model