Sunet Drive - Continuous Testing at a Global Scale | Nextcloud Conference 2023
Channel: Nextcloud
Date: 2023-10-05

#Nextcloud #NextcloudConference2023 #LightningTalk 
Sunet Drive is a national file storage infrastructure for universities and research institutions in Sweden. It is based on a Nextcloud Global Scale setup and is comprised of 54 nodes, one prepared for each institution. This setup ensures data sovereignty while being part of a larger federation, including the ScienceMesh for international collaboration. The setup is duplicated in a test environment which is also used for staging and development. In total, around 300 virtual servers are deployed, and a setup using k8s is in preparation.

One step in ensuring the functional stability of such a large setup is rigorous and automated testing. This covers basic tests of the status.php sites, but also OCS tests for user lifecycle management and app-consistency, WebDAV tests, as well as more sophisticated Selenium testing for login, TOTP, Collabora for file editing and more. Automated testing currently generates around 25000 daily test points, ensuring the stability and consistency of the deployed solution. Scalability and load testing is done using a setup that can simulate the load from many users, and has been used to test for up to 6000 users.

The lightning talk will highlight the core-elements of the tests and test setup using Jenkins with multiple workers and X virtual framebuffer (Xvfb), how it supports regression testing especially after updates, and how they complement conventional infrastructure monitoring with solutions such as Thruk.

https://sunet.se/services/molnbaserade-tjanster/sunet-drive

--

Richard Freitag - Project Manager @ Sunet

Since 2020, Richard leads the development of Sunet Drive, a federated storage solution for research data currently used by 16 Swedish Universities. This includes collaboration and integration into the ScienceMesh, as well as leading efforts to port RDS (Research Data Services) to Sunet Drive/Nextcloud, for the publication of data to public repositories.

--

More Lightning Talks from Nextcloud Conference 2023:
https://www.youtube.com/playlist?list=PL4eBKdNy6FCHKdSalFYipOhBqIaZXqH1A