Facilitating Effective Collaboration under the JWCRP using the JASMIN Platform Ag Stephens (ag.stephens@stfc.ac.uk). Science & Technology Facilities Council, Didcot, Oxon, OX11 0QX. UPSCALE - massive HPC outputs, transfers and analyses! MONSooN HPC Overflow Converting Climate runs to CF-NetCDF Atmospheric Dispersion Modelling Regional Climate Modelling 4. RUN YOUR OWN VMs (Root included!) 1. SHARE “LARGE” DATA WITH COLLABORATORS 3. EFFICIENT DATA TRANSFERS The Joint Weather & Climate Research Programme ( ) is a shared programme between NERC and the Met Office. Its goals are to ensure that the UK maintains and strengthens its leading international position in weather and climate science, and hence in weather and climate forecasting and provision of advice for policy. The JWCRP involves a commitment to sustain and grow the UK's national capability and research in observing, understanding, modelling and predicting weather and climate, along with the infrastructure required to deliver that national capability and research. It also focuses on aligning major research initiatives and programmes to ensure the most effective impact of that research and pull-through into the delivery of services to government and business. B. N. Lawrence, V. Bennett, J. Churchill, M. Juckes, P. Kershaw, P. Oliver, M. Pritchard & A. Stephens (2012). The JASMIN super-data-cluster. http://arxiv.org/abs/1204.3553 Pascoe, S. (2013). Growing a community analysis platform with JASMIN and the Community Intercomparison Suite. NCAS Staff Meeting 2013. Poster. Stephens, A. (2013). Running the Met Office NAME dispersion model on the JASMIN computing platform: A new community tool and trajectory service. NCAS Staff Meeting 2013. Poster. UM Conversion Tool page on the CEDA Services wiki: http://proj.badc.rl.ac.uk/cedaservices/wiki/JASMIN/SupportForScience/UMConversionTool JASMIN website: http://www.jasmin.ac.uk JWCRP website: http://www.jwcrp.org.uk CEDA website: http://www.ceda.ac.uk is a data and computing platform designed to meet the needs of scientists working with very large datasets that require complex and computationally expensive analysis. Managed by STFC’s Centre for Environmental Data Archival (CEDA) the platform now holds the complete archives of the NCAS BADC and NEODC. JASMIN also provides access to high-performance disk, a virtualisation environment, compute cluster and high-speed networking. Satellite nodes are deployed in the Universities of Leeds, Bristol and Reading. Plans to expand this capability are being developed. The JASMIN computing platform at NCAS BADC provides access to high-performance disk, a virtualisation platform, compute cluster and high-speed networking. One key aspect from the NCAS perspective is that resources are equally accessible to researchers in UK universities and the UK Met Office. This makes JASMIN an excellent candidate for hosting services to support collaborations under the Joint Weather and Climate Research Programme (JWCRP). 2. ANALYSE DATA 5. PARALLEL PROCESSING Specific projects may require dedicated computing resources and/or specific software environments. JASMIN provides root access to project-specific virtual machines so that external administrators can build and maintain specialised environments with minimum overhead and support. Projects, such as those discussed below (UPSCALE, NAME and PRECIS), typically marry this provision with a Group Workspace to store their inputs and outputs. Many projects are making JASMIN a focal point for collaboration by setting up a “Group Workspace”. This is a shared disk made accessible to a chosen group of scientists working on the same project. Group Workspaces currently range between 5Tb and 380Tb in size. Typically they are used for: • Sharing large data – pushing from remote sites • Accessing data – retrieving to remote sites • Analysing data – space for storing big outputs • Intercomparison – comparing data with established archived datasets, such as CMIP5 and ERA-Interim