An apparatus (100, 400) for processing a plurality of data sets for mutual-transposition of scalar and vector data, wherein one data set of the plurality of data sets comprises N components and has a data type of one of a scalar type and a vector type, and N is a positive integer number, wherein a data set of the scalar type comprises a scalar with N components, each component representing a same component of respective one of N image data variables, and a data set of the vector type comprises a vector with N components, each component representing a different one of N components of an image data variable, the apparatus (100, 400) comprising: a memory module (104, 404), comprising N memory units configured to store the plurality of data sets, each memory unit having N entries and wherein each component of a data set is written into a corresponding entry of a corresponding memory unit; and a data accessing module (102, 402), configured to write the data set into the memory module (104, 404) according to a write data index corresponding to the data set and one of a first writing mapping information and a second writing mapping information, wherein the first writing mapping information is employed when the data type is one of the scalar and the vector type and the second writing mapping information is employed when the data type is the other of the scalar and the vector type, wherein the data accessing module (102, 402) is further configured to read out the plurality of data sets from the memory module to provide a plurality of output data sets, characterized in that the output data set is provided according to a read data index corresponding to the output data set and one of a first reading mapping information and a second reading mapping information, wherein the first reading mapping information is employed when the output data set is of one of the scalar and the vector type and the second reading mapping information is employed when the output data set is of the other of the scalar and the vector type, wherein the first writing mapping information corresponds components of the data set into a same entry of different memory units of the memory module (104, 404), wherein the second writing mapping information corresponds components of the data set into different entries of different memory units of the memory module (104, 404), wherein the first reading mapping information corresponds components of the same entry of different memory units of the memory module (104, 404) into the data set, and wherein the second reading mapping information corresponds components of different entries of different memory units of the memory module (104, 404) into the data set. a memory module (104, 404), comprising N memory units configured to store the plurality of data sets, each memory unit having N entries and wherein each component of a data set is written into a corresponding entry of a corresponding memory unit; and a data accessing module (102, 402), configured to write the data set into the memory module (104, 404) according to a write data index corresponding to the data set and one of a first writing mapping information and a second writing mapping information, wherein the first writing mapping information is employed when the data type is one of the scalar and the vector type and the second writing mapping information is employed when the data type is the other of the scalar and the vector type, wherein the data accessing module (102, 402) is further configured to read out the plurality of data sets from the memory module to provide a plurality of output data sets, characterized in that the output data set is provided according to a read data index corresponding to the output data set and one of a first reading mapping information and a second reading mapping information, wherein the first reading mapping information is employed when the output data set is of one of the scalar and the vector type and the second reading mapping information is employed when the output data set is of the other of the scalar and the vector type, wherein the first writing mapping information corresponds components of the data set into a same entry of different memory units of the memory module (104, 404), wherein the second writing mapping information corresponds components of the data set into different entries of different memory units of the memory module (104, 404), wherein the first reading mapping information corresponds components of the same entry of different memory units of the memory module (104, 404) into the data set, and wherein the second reading mapping information corresponds components of different entries of different memory units of the memory module (104, 404) into the data set.