Structural Biology in the Clouds: The WeNMR-EOSC Ecosystem

<jats:p>Structural biology aims at characterizing the structural and dynamic properties of biological macromolecules at atomic details. Gaining insight into three dimensional structures of biomolecules and their interactions is critical for understanding the vast majority of cellular processes, with direct applications in health and food sciences. Since 2010, the WeNMR project (<jats:ext-link>www.wenmr.eu</jats:ext-link>) has implemented numerous web-based services to facilitate the use of advanced computational tools by researchers in the field, using the high throughput computing infrastructure provided by EGI. These services have been further developed in subsequent initiatives under H2020 projects and are now operating as Thematic Services in the European Open Science Cloud portal (<jats:ext-link>www.eosc-portal.eu</jats:ext-link>), sending &amp;gt;12 millions of jobs and using around 4,000 CPU-years per year. Here we review 10 years of successful e-infrastructure solutions serving a large worldwide community of over 23,000 users to date, providing them with user-friendly, web-based solutions that run complex workflows in structural biology. The current set of active WeNMR portals are described, together with the complex backend machinery that allows distributed computing resources to be harvested efficiently.</jats:p>

section_content: Proteins and nucleic acids are the main biological macromolecules responsible for function and maintenance of most of the machinery of life. The study of these macromolecules, their threedimensional (3D) structure, dynamical behavior and interactions are crucial to gain a better understanding of relevant biological processes both related to biotechnological applications as well as health related such as the development of new drugs. 

Since many years, in the context of WeNMR (www. wenmr. eu) now operating as a Thematic service provider in the European Open Science Cloud (EOSC), we have provided the community with relevant and specialized software that make up a valuable toolkit for structural biology researchers. One critical aspect aside from providing the community with valuable tools is to also provide the means of executing them in a user-friendly, efficient and cost-effective distributed manner, as done via the DIRAC Workload Manager (Tsaregorodtsev and Project, 2014). 

Here we present an overview of the structural biology services provided via the WeNMR-EOSC ecosystem, what are the technological challenges and solutions that need to be implemented for an efficient use of distributed computing resources and how those are used by an active community worldwide.
section_name: INTRODUCTION

section_content: The study of macromolecular structures is a multifaceted challenge in which researchers must apply different approaches and tools to gain a better understanding of their function, behavior and dynamics. To this end, within the WeNMR-EOSC project, we have been developing different tools, making them freely available to the community as webservices. The following paragraphs provide a short overview of currently active services under the EOSC portal.
section_name: SERVICES

section_content: The AMPS-NMR (AMBER-based Portal Server for NMR structures) (Bertini et al., 2011) provides a user-friendly interface to run restrained molecular dynamics simulations (rMD) to refine experimental NMR structures, and to perform molecular dynamics simulations of biomacromolecular systems in general. Calculations can be run on CPUs or GPGPUs. The latter provide significantly faster performance (Andreetto et al., 2017) but are limited in availability. For NMR structures, the use of the AMPS-NMR portal results in a consistent improvement of features such as rotamer distributions, backbone normality and occurrence of steric clashes, without affecting agreement with the experimental data. The effect of rMD refinement is especially relevant for protein regions where the amount of experimental information is scarce. The rMD protocol has been implemented as a predefined multi-step procedure, so that the user does not need to know in detail how to tune the many parameters involved in a relatively complex MD calculation; the portal also handles automatically the most commonly used formats for experimental data. The AMPS-NMR webserver is available at http://py-enmr. cerm. unifi. it/access/index.
section_name: AMBER-Based Portal Server for-NMR

section_content: The interaction between molecules can be experimentally characterized with methods such as cross-linking mass spectrometry (XL-MS) and FRET (Okamoto and Sako, 2017; Yu and Huang, 2017) which can provide information about which residues are participating in the interaction as well as the distance (or an upper limit to it) between the reacting groups of the residues. DISVIS is a tool that allows researchers to visualize the threedimensional distance-restrained possible interaction space between the interacting proteins partners. It can be used to investigate if the restraints are mutually exclusive and identify possible false positives in the input data. DISVIS is freely available at https://wenmr. science. uu. nl/disvis.
section_name: DISVIS

section_content: FANTEN (Rinaldelli et al., 2015) aims at the determination of the anisotropy tensors associated with NMR paramagnetic pseudocontact shifts (pcs) and/or residual dipolar couplings (rdc's). FANTEN also permits the pcs-driven determination of the 3D structure of proteinprotein adducts using a rigid body approach; the user can then submit these models directly to HADDOCK for flexible refinement. The FANTEN web server is available at http://abs. cerm. unifi. it:8080/.
section_name: FANTEN

section_content: The pioneer of integrative docking, HADDOCK (High Ambiguity Driven biomolecular DOCKing) (Dominguez et al., 2003) allows users to make use of a variety of experimental and theoretical information to drive the docking of up to 20 macromolecules. The latest version (v2. 4) supports the docking of proteins, smallmolecules, nucleic acids, peptides, cyclic peptides, glycans, and glycosylated proteins. To accommodate the complexity that naturally arises from >18 years of development of new features and docking modes without compromising usability and accessibility, HADDOCK has been made freely available (with registration) to the community since 2008 via an intuitive webserver (Vries et al., 2010; Zundert et al., 2016). Since exposing 400+ parameters could hinder user experience (and usability), users are separated in access tiers: Users belonging to the "Easy" tier can access and modify a limited number of parameters whereas users belonging to the "Guru" tier (granted upon specific request from users in their registration page) have full access and control of the docking protocol. The HADDOCK webserver is available at https://wenmr. science. uu. nl/haddock2. 4.
section_name: HADDOCK

section_content: MetalPDB (Andreini et al., 2013a; Putignano et al., 2017 ) is a database collecting information on the metal-binding sites present in the 3D structures of biological macromolecules (Putignano et al., 2017). In particular, metal sites are represented in MetalPDB, as 3D templates describing the local environment around the metal ion(s) independently of the overall macromolecular fold. Among its features, MetalPDB provides detailed statistical analyses regarding metal usage in proteins of known 3D structure, encompassing protein families, and in catalysis; it also includes tools for the structural comparison of metal sites (Andreini et al., 2013b). MetalPDB is available at https://metalpdb. cerm. unifi. it/
section_name: MetalPDB

section_content: The classic Protein Data Bank (PDB) file format is a flat text file that is still used by many structural biology software to represent the spatial coordinates of macromolecular structures, even though the official format of the worldwide PDB (wwPDB) (Berman et al., 2003) has now shifted to the Crystallographic Information Framework (mmCIF) dictionary (Bourne et al., 1997). The simple flat text PDB format, despite its apparent simplicity, follows strict formatting rules which can be easily overlooked during editing resulting in various errors. Such errors are usually of syntactic nature (e. g., shifting columns or missing fields) due to typos introduced by users after manual-editing PDB files, although semantic errors are also very common (e. g., incorrect atom naming, overlapping numbering, duplications, etc. ). PDB-tools web (Jiménez-García et al., 2021) is a fully configurable, user-friendly web interface for the command-line application pdb-tools (Rodrigues et al., 2018). Using the portal users can, in a few clicks, build a complex pipeline which can then be saved (and uploaded) for future use and reproducibility. This pipeline is composed by different processing blocks with atomic tasks on the PDB provided data, to name a few, removing certain atom types, renaming chains, renumbering residues, removing multiple occupancies or detecting gaps among many others. 

The webserver is available at https://wenmr. science. uu. nl/pdbtools/ and the list of all available processing blocks is described on the online manual at https://wenmr. science. uu. nl/pdbtools/manual.
section_name: Protein Data Bank-Tools Web

section_content: Cryo-electron microscopy (cryo-EM) is an experimental technique that can be used to obtain direct images of large macromolecular complexes (Fernandez-Leiro and Scheres, 2016). When the resolution of the resulting EM data is not sufficient to build models directly in the maps, it is common to fit existing 3D structures into those maps. To this end, Powerfit has been developed as a Python package for fast and sensitive rigid body fitting of molecular structures into EM density maps with a core-weighted local cross correlation scoring function (Zundert and Bonvin, 2015b). It is freely available as a webserver (Zundert et al., 2017) running on both local and GPU-accelerated distributed infrastructures at https://alcazar. science. uu. nl/services/ POWERFIT.
section_name: Powerfit

section_content: Monoclonal antibodies have been consolidated as therapeutic tools due to their high affinity and specificity towards their target. proABC-2 (Ambrosetti et al., 2020), the updated version of proABC (Olimpieri et al., 2013), is a valuable tool that predicts which antibody residues can form intermolecular contacts with its antigen and further give insight into the chemical components of such interactions, differentiating between hydrophobic and hydrophilic interactions. 

The latest version replaced the previously used random forest paratope predictor by a convolutional neural network algorithm. Predictions obtained by proABC-2 can be used for example, to guide molecular docking, leading to improvements of success rate and quality of the predicted models. proABC-2 is available at https:// wenmr. science. uu. nl/proabc2/.
section_name: proABC-2

section_content: In addition to elucidating the structural aspects of a biomolecular complex and its interacting components, it is of crucial importance to be able to estimate the strength of the interaction, or, in other words, to be able to predict the binding affinity of the complex. PRODIGY, the PROtein binDIng enerGY Prediction tool (Vangone and Bonvin, 2015) allows to predict the binding affinity of protein-protein complexes from their three-dimensional structures. It does so by calculating features derived both from interfacial residue contacts as well as those from the non-interface residues (Kastritis et al., 2014). The same rationale has been expanded to protein-ligand complexes (PRODIGY-LIGAND) (Kurkcuoglu et al., 2018; Vangone et al., 2018) and to the classification of interfaces in crystal structures as biological or crystallographic (PRODIGY-CRYSTAL) (Elez et al., 2018; Jiménez-García et al., 2019). PRODIGY services are available at https://wenmr. science. uu. nl/prodigy/.
section_name: Prodigy

section_content: Once an interaction has been characterized, it is valuable to know which parts of the interface contribute more to the binding, namely what are interaction "hot spots"-residues that upon mutation to alanine confer a difference in the binding free energy of the complex greater than 2. 0 kcal/mol. The experimental identification of these regions is typically low throughput, laborious and expensive since it involves multiple rounds of point mutations and binding energy evaluations. SpotON was developed a computational approach to identify and classify interface residues as either hot spots, with positive contribution to the interface or null spots, with little to no significant contribution to the interface (Melo et al., 2016; Moreira et al., 2017). Its predictor combines different machine-learning algorithms, and it is available as a free and easy-to-use webserver https://alcazar. science. uu. nl/services/SPOTON.
section_name: SpotON

section_content: The WeNMR portals use either local or distributed computing resources, while harvesting GPU resources in some cases to speed up the computations. Some portals, especially the ones making use of the EOSC-EGI high-throughput computational resources (see below) do require registration for use (Figure 1 ).
section_name: INFRASTRUCTURE

section_content: The EGI Federation is an international e-Infrastructure providing advanced computing and data analytics for research and innovation. In the last decade it evolved from the high energy physics compute grid (WLCG) towards a multi-disciplinary, multi-technology infrastructure federating hundreds of resource centers worldwide and delivering large-scale data analysis capabilities (>1 millions of CPU-cores and >900 PB of disk and tape storage) to more than 70,000 researchers covering many scientific disciplines. During 2020 it delivered 13 billions of CPU hours of High Throughput Computing (HTC) and 18 millions of CPU hours of cloud computing (Figure 2 ).
section_name: European Open Science Cloud-EGI

section_content: The WeNMR community has since the beginning recognized the importance of having a Single Sign-On (SSO) mechanism to access their web portals with unique login credentials. The first SSO was implemented in 2013 under the WeNMR European project, allowing users to subscribe to portals, validate personal grid certificates and manage job submissions all from one web page, collecting at the same time accounting records and user's geographic information. is part of EOSC service catalogue, and has also been adopted by the Instruct-ERIC infrastructure. Nowadays all the WeNMR portals integrate EGI Check-in as SSO mechanism. Users can register to the EGI Check-in at https://aai. egi. eu and use those credentials to register to WeNMR services. All portals are compliant with the European General Data Protection Regulation (GDPR) with clear condition of use (https:// wenmr. science. uu. nl/conditions) and privacy measures (https:// wenmr. science. uu. nl/privacy).
section_name: Single Sign-On

section_content: The EGI Workload Manager is a service enabling users to access distributed computing resources of various types through a single user-friendly interface. It is one of the services offered by the EGI e-infrastructure project and it is also available via the EOSC Compute Platform. The service is built upon the software from the DIRAC Interware project (http://diracgrid. org) (Tsaregorodtsev and Project, 2014). The project is providing a development framework and a set of ready-to-use components to build distributed computing systems of arbitrary complexity. It provides a complete solution for communities needing access to computing and storage resources distributed geographically, integrated in different grid and cloud infrastructures or standalone computing clusters and supercomputers. The DIRAC Workload Manager serves multiple scientific communities-partners of the EGI e-infrastructure and the WeNMR Collaboration as one of its most active users. User tasks prepared by the WeNMR application portals are submitted to the Workload Manager service. The service performs reservation of computing resources by means of so-called pilot jobs which are submitted to various computing centers with appropriate access protocols. Once deployed on worker nodes, pilot jobs verify the execution environment and then request user payloads from the central DIRAC Task Queue. Altogether, the pilot jobs and the central Task Queue form a dynamic virtual batch system that overcomes the heterogeneity of the underlying computing infrastructures. This workload scheduling architecture allows to easily add new resources transparently for the users. It also makes it easy to apply usage policies by defining fine grained priorities to certain activities. For example, during the COVID pandemic it allowed to quickly make available resources of the sites willing to contribute to the COVID-related studies and ensure high priority of these jobs compared to other regular WeNMR activities.
section_name: Dirac Workload Manager

section_content: The WeNMR services combined have had over 150. 000+ users (Table 1 ). User satisfaction is monitored and the services have various support mechanisms summarized at https://www. wenmr. eu/support allowing users to fill in requests and ask specific questions. This large userbase is provided with tutorials to ensure the tools are being used to their best (Table 2 ). The user's feedback and issues are one of the driving forces towards the improvement of the services and implementation of new features. 

The services discussed here have been making use of EGI HTC resources since 2009. Figure 1, plots the normalized CPU usage per month, clearly showing the increasing use of the EGI HTC resources over time, culminating in 2020 to the equivalent of ∼5300 CPU years' worth of computing. 

During the COVID pandemic, one of the most used WeNMR service, HADDOCK, has seen a significant increase of both the number of submissions and single users, with about 1/3 of all submissions since April 2021 being COVID-related (Figure 3 ).
section_name: COMMUNITY AND USAGE

section_content: Over more than a decade the WeNMR project has facilitated the use of advanced computational tools. Taking advantage of the EGI high throughput compute infrastructure, it has developed as a Thematic Services in the European Open Science Cloud. Its large worldwide user community of over 23,000 users distributed over 125 countries, submitted in 2020 >12 million jobs that accounted for ∼4,000 CPU-years. In tight collaboration with EGI, WeNMR has constantly improved its services, for example, piloting the use of distributed GPU resources and facilitating user access through the implementation of a single sign one mechanism. Its valuable services are offered via userfriendly web-based solutions that allows researchers to execute complex workflows at the click of their mouse without having to deal with the complexity of managing and distributing computations. The impact is evident from both usage of the services in research and education and from the number of citations of the various tools (>800 since 2020). The active WeNMR user community, in turn, acts a catalyst for further development and improvement of the services.
section_name: CONCLUSION

section_name: ACKNOWLEDGMENTS

section_content: The EGI team over the years is acknowledged for their continuous support in the operation of our services and facilitating the access to the EOSC/EGI HTC resources.
section_name: ACKNOWLEDGMENTS

section_name: FUNDING

section_content: This work is co-funded by the Horizon 2020 projects EOSC-hub (Grant number 777536 ), EGI-ACE (Grant number 101017567 ) and BioExcel (Grant numbers 823830 and 675728 ) and by a computing grant from NWO-ENW (project number 2019. 053 ).
section_name: FUNDING

section_name: DATA AVAILABILITY STATEMENT

section_content: Support AMPS-NMR https://www. wenmr. eu/tutorials/#rmd-amber Via e-mail DISVIS https://www. bonvinlab. org/education/Others/disvis-webserver/ https://ask. bioexcel. eu FANTEN http://abs. cerm. unifi. it:8080/manual/FANTEN_manual. pdf Via e-mail HADDOCK https://www. bonvinlab. org/education/HADDOCK24/ https://ask. bioexcel. eu MetalPDB https://metalpdb. cerm. unifi. it/glossary Via e-mail PDB-tools web https://wenmr. science. uu. nl/pdbtools/manual https://ask. bioexcel. eu Powerfit https://www. bonvinlab. org/education/Others/powerfit-webserver https://ask. bioexcel. eu proABC-2 https://wenmr. science. uu. nl/proabc2/manual Via e-mail Prodigy https://wenmr. science. uu. nl/prodigy/manual https://ask. bioexcel. eu SpotON https://alcazar. science. uu. nl/cgi/services/SPOTON/spoton/help https://ask. bioexcel. eu

section_content: The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding authors.
section_name: DATA AVAILABILITY STATEMENT

section_name: AUTHOR CONTRIBUTIONS

section_content: RH and AB conceived the structure of the manuscript and all authors contributed to the writing.
section_name: AUTHOR CONTRIBUTIONS

section_content: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. BJ-G is the editor of the "Web Tools for Modeling and Analysis of Biomolecular Interactions" research topic. 

Publisher's Note: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
section_name: Conflict of Interest: