title: Meta-Learning and the Full Model Selection Problem

authors: Sun, Quan

subjects: meta-learning

abstract: When working as a data analyst, one of my daily tasks is to select appropriate tools from a set of existing data analysis techniques in my toolbox, including data preprocessing, outlier detection, feature selection, learning algorithm and evaluation techniques, for a given data project. This indeed was an enjoyable job at the beginning, because to me finding patterns and valuable information from data is always fun. Things become tricky when several projects needed to be done in a relatively short time. 

Naturally, as a computer science graduate, I started to ask myself, "What can be automated here?"; because, intuitively, part of my work is more or less a loop that can be programmed. Literally, the loop is "choose, run, test and choose again... until some criterion/goals are met". 

In other words, I use my experience or knowledge about machine learning and data mining to guide and speed up the process of selecting and applying techniques in order to build a relatively good predictive model for a given dataset for some purpose. So the following questions arise:

"Is it possible to design and implement a system that helps a data analyst to choose from a set of data mining tools? Or at least that provides a useful recommendation about tools that potentially save some time for a human analyst."

To answer these questions, I decided to undertake a long-term study on this topic, to think, define, research, and simulate this problem before coding my dream system. This thesis presents research results, including new methods, algorithms, and theoretical and empirical analysis from two directions, both of which try to propose systematic and efficient solutions to the questions above, using different resource requirements, namely, the meta-learning-based algorithm/parameter ranking approach and the meta-heuristic search-based full-model selection approach. 

Some of the results have been published in research papers; thus, this thesis also serves as a coherent collection of results in a single volume.

text: Meta-Learning and the Full Model Selection Problem When working as a data analyst, one of my daily tasks is to select appropriate tools from a set of existing data analysis techniques in my toolbox, including data preprocessing, outlier detection, feature selection, learning algorithm and evaluation techniques, for a given data project. This indeed was an enjoyable job at the beginning, because to me finding patterns and valuable information from data is always fun. Things become tricky when several projects needed to be done in a relatively short time. 

Naturally, as a computer science graduate, I started to ask myself, "What can be automated here?"; because, intuitively, part of my work is more or less a loop that can be programmed. Literally, the loop is "choose, run, test and choose again... until some criterion/goals are met". 

In other words, I use my experience or knowledge about machine learning and data mining to guide and speed up the process of selecting and applying techniques in order to build a relatively good predictive model for a given dataset for some purpose. So the following questions arise:

"Is it possible to design and implement a system that helps a data analyst to choose from a set of data mining tools? Or at least that provides a useful recommendation about tools that potentially save some time for a human analyst."

To answer these questions, I decided to undertake a long-term study on this topic, to think, define, research, and simulate this problem before coding my dream system. This thesis presents research results, including new methods, algorithms, and theoretical and empirical analysis from two directions, both of which try to propose systematic and efficient solutions to the questions above, using different resource requirements, namely, the meta-learning-based algorithm/parameter ranking approach and the meta-heuristic search-based full-model selection approach. 

Some of the results have been published in research papers; thus, this thesis also serves as a coherent collection of results in a single volume.

year: 2014

title: Social Class: Te Mātaiaho | the New Zealand Curriculum Refresh’s ‘Inconvenient Truth’?

authors: Estellés, Marta

abstract: In this paper, we connect with Martin Thrupp’s calls for class-based analysis in education policy by problematising the absence of social class in the refreshed New Zealand curriculum, Te Mātaiaho (2023). To contextualise this absence, we locate this curriculum policy in a historical perspective and interpret its ‘identity turn’ as an expression of what philosopher Nancy Fraser calls ‘progressive neoliberalism’. We conclude our contribution with a reflection on the reactionary neoliberal response of the current National-led government and a call for educational researchers in Aotearoa New Zealand to more seriously consider social class in their analyses.

text: Social Class: Te Mātaiaho | the New Zealand Curriculum Refresh’s ‘Inconvenient Truth’? In this paper, we connect with Martin Thrupp’s calls for class-based analysis in education policy by problematising the absence of social class in the refreshed New Zealand curriculum, Te Mātaiaho (2023). To contextualise this absence, we locate this curriculum policy in a historical perspective and interpret its ‘identity turn’ as an expression of what philosopher Nancy Fraser calls ‘progressive neoliberalism’. We conclude our contribution with a reflection on the reactionary neoliberal response of the current National-led government and a call for educational researchers in Aotearoa New Zealand to more seriously consider social class in their analyses.

year: 2024

title: Cultural diversity and identity discourses in the design and implementation of the New Zealand curriculum key competencies: a Bernsteinian analysis

authors: Glogowski, Sonia Theresa

subjects: Culture

abstract: The key competencies as a curriculum construct have appeared in several national curricula from the early 2000s. Many have their origins in the Definition and Selection of Key Competencies Project (DeSeCo), commissioned by the supra-national Organisation for Economic Co-operation and Development (OECD). A number of international critiques have highlighted tensions between neoliberal ideologies that underpin the key competencies, and broader socio-cultural and social justice issues within their respective countries (e.g., Crick, 2008; Sjøberg, 2016; Takayama, 2013).
This research investigated who and what influenced the design and implementation of the key competencies in the 2007 New Zealand Curriculum, and how students’ cultural diversity and identities were considered as part of this. Data for this case study were collected from three sources: interviews with key policy officials and academic consultants six years after the launch of the official curriculum; analysis of policy documents and discussion papers from government archives, and focus group interviews with teachers from two schools seven years into implementation. Bernstein’s (2000) theory of the pedagogical device, was used to focus analysis on the agents, influences, debates and events that impacted on the design and implementation of the curriculum. Fraser’s (1989) needs’ discourse theory was used to examine interpretations of cultural diversity and identity, and the implications of implicit valued attitudes and behaviours of the key competencies.
Findings indicated that in the New Zealand educational policy context, the roles and interactions between agents and processes in the fields of production and reproduction were more ‘fluid’ and consultative than Bernstein’s (2000) structuralist model would suggest. This may be reflective of New Zealand’s small population and more informal collaboration between agents in different fields. The development of this curriculum prioritised the ‘process’ of understanding curriculum through consultation and feedback, compared to previous curricula which were more focussed on curriculum as a ‘product’.
New Zealand’s socio-political climate, and its bicultural Treaty of Waitangi, appeared to impact on how the key competencies were conceived, and how student diversity and identity were interpreted at different points in the curriculum design and implementation process. Interviews with key policy officials and academic consultants revealed that cultural diversity was largely associated with ethnicity, and in particular, differences between indigenous Māori and Pākehā (New Zealand European). Less attention was given to the concept of multiple identities and intersections between ethnicity, socio economic class, gender and so on, and how these might influence interpretations of the key competencies. This was despite evidence of early discussion papers highlighting these complexities.
At the curriculum implementation level, Bernstein (2000) argues that schools and teachers can often ‘reproduce’ middle class values and expected behaviours through ‘invisible’ pedagogical practices, with little awareness of potential disjuncts for disadvantaged groups. Yet he also states that this is not necessarily deterministic, and the finding for the two school focus groups demonstrated this. Despite no evidence that student diversity was a specific aspect of their professional development on key competencies, the teachers discussed some complexities of student diversity in their schools and how the key competencies might be interpreted in different ways. However, given the case study schools were considered to be particularly ‘diverse’, this type of discussion and consideration may not be typical of other New Zealand schools.
The findings support the notion that the New Zealand curriculum key competencies were ‘weakly classified’ and ‘strongly framed’ (Bernstein, 2000). This means a high level of interpretation was located with school leaders and teachers, within the context of a permissive curriculum and thus presents both opportunities and risks.
This case study highlights the importance of agents in every field understanding the complexities and implications of diversity in education. In addition, if the key competencies genuinely seek to enhance both vocational and social justice outcomes for a more cohesive and equitable society, then education for diversity would seem to be important.
This research contributes new knowledge in relation to the process of curriculum design, highlighting the impact of a unique socio-political context on the interpretation of a curriculum construct, and the implications of ‘valued’ attitudes and behaviours of the key competencies on diverse students. It provides an example of how Bernstein’s (2000) theory of the pedagogical device can be used to identify important influences and processes that impact on the different stages of a curriculum design and implementation process. It also illustrates how the device can be usefully complemented by another theory, in this case Fraser’s (1989) needs discourse theory, to examine more closely the discourse that relates to a particular lens of the research.

text: Cultural diversity and identity discourses in the design and implementation of the New Zealand curriculum key competencies: a Bernsteinian analysis The key competencies as a curriculum construct have appeared in several national curricula from the early 2000s. Many have their origins in the Definition and Selection of Key Competencies Project (DeSeCo), commissioned by the supra-national Organisation for Economic Co-operation and Development (OECD). A number of international critiques have highlighted tensions between neoliberal ideologies that underpin the key competencies, and broader socio-cultural and social justice issues within their respective countries (e.g., Crick, 2008; Sjøberg, 2016; Takayama, 2013).
This research investigated who and what influenced the design and implementation of the key competencies in the 2007 New Zealand Curriculum, and how students’ cultural diversity and identities were considered as part of this. Data for this case study were collected from three sources: interviews with key policy officials and academic consultants six years after the launch of the official curriculum; analysis of policy documents and discussion papers from government archives, and focus group interviews with teachers from two schools seven years into implementation. Bernstein’s (2000) theory of the pedagogical device, was used to focus analysis on the agents, influences, debates and events that impacted on the design and implementation of the curriculum. Fraser’s (1989) needs’ discourse theory was used to examine interpretations of cultural diversity and identity, and the implications of implicit valued attitudes and behaviours of the key competencies.
Findings indicated that in the New Zealand educational policy context, the roles and interactions between agents and processes in the fields of production and reproduction were more ‘fluid’ and consultative than Bernstein’s (2000) structuralist model would suggest. This may be reflective of New Zealand’s small population and more informal collaboration between agents in different fields. The development of this curriculum prioritised the ‘process’ of understanding curriculum through consultation and feedback, compared to previous curricula which were more focussed on curriculum as a ‘product’.
New Zealand’s socio-political climate, and its bicultural Treaty of Waitangi, appeared to impact on how the key competencies were conceived, and how student diversity and identity were interpreted at different points in the curriculum design and implementation process. Interviews with key policy officials and academic consultants revealed that cultural diversity was largely associated with ethnicity, and in particular, differences between indigenous Māori and Pākehā (New Zealand European). Less attention was given to the concept of multiple identities and intersections between ethnicity, socio economic class, gender and so on, and how these might influence interpretations of the key competencies. This was despite evidence of early discussion papers highlighting these complexities.
At the curriculum implementation level, Bernstein (2000) argues that schools and teachers can often ‘reproduce’ middle class values and expected behaviours through ‘invisible’ pedagogical practices, with little awareness of potential disjuncts for disadvantaged groups. Yet he also states that this is not necessarily deterministic, and the finding for the two school focus groups demonstrated this. Despite no evidence that student diversity was a specific aspect of their professional development on key competencies, the teachers discussed some complexities of student diversity in their schools and how the key competencies might be interpreted in different ways. However, given the case study schools were considered to be particularly ‘diverse’, this type of discussion and consideration may not be typical of other New Zealand schools.
The findings support the notion that the New Zealand curriculum key competencies were ‘weakly classified’ and ‘strongly framed’ (Bernstein, 2000). This means a high level of interpretation was located with school leaders and teachers, within the context of a permissive curriculum and thus presents both opportunities and risks.
This case study highlights the importance of agents in every field understanding the complexities and implications of diversity in education. In addition, if the key competencies genuinely seek to enhance both vocational and social justice outcomes for a more cohesive and equitable society, then education for diversity would seem to be important.
This research contributes new knowledge in relation to the process of curriculum design, highlighting the impact of a unique socio-political context on the interpretation of a curriculum construct, and the implications of ‘valued’ attitudes and behaviours of the key competencies on diverse students. It provides an example of how Bernstein’s (2000) theory of the pedagogical device can be used to identify important influences and processes that impact on the different stages of a curriculum design and implementation process. It also illustrates how the device can be usefully complemented by another theory, in this case Fraser’s (1989) needs discourse theory, to examine more closely the discourse that relates to a particular lens of the research.

year: 2020