Clue: Art set in amalgam, a rectangular arrangement (6)
Answer: MATRIX
Explanation: Definition: a rectangular arrangemen
An envelope ('in') of ATR, an anagram ('set') of 'art' in MIX ('amalgam'), with a mathematical definition.