Workflows Community Summit 2024: Future Trends and Challenges in Scientific Workflows
Creators: name: da Silva, Rafael Ferreira
name: Bard, Deborah
name: Chard, Kyle
name: de Witt, Shaun
name: Foster, Ian T.
name: Gibbs, Tom
name: Goble, Carole
name: Godoy, William
name: Gustafsson, Johan
name: Haus, Utz-Uwe
name: Hudson, Stephen
name: Jha, Shantenu
name: Los, Laila
name: Paine, Drew
name: Suter, Frédéric
name: Ward, Logan
name: Wilkinson, Sean
name: Amaris, Marcos
name: Babuji, Yadu
name: Bader, Jonathan
name: Balin, Riccardo
name: Balouek, Daniel
name: Beecroft, Sarah
name: Belhajjame, Khalid
name: Bhattarai, Rajat
name: Brewer, Wes
name: Brunk, Paul
name: Caino-Lores, Silvina
name: Casanova, Henri
name: Cassol, Daniela
name: Coleman, Jared
name: Coleman, Taina
name: Colonnelli, Iacopo
name: Da Silva, Anderson Andrei
name: de Oliveira, Daniel
name: Elahi, Pascal
name: Elfaramawy, Nour
name: Elwasif, Wael
name: Etz, Brian
name: Fahringer, Thomas
name: Ferreira, Wesley
name: Filgueira, Rosa
name: Tande, Jacob Fosso
name: Gadelha, Luiz
name: Gallo, Andy
name: Garijo, Daniel
name: Georgiou, Yiannis
name: Gritsch, Philipp
name: Grubel, Patricia
name: Gueroudji, Amal
name: Guilloteau, Quentin
name: Hamalainen, Carlo
name: Enriquez, Rolando Hong
name: Huet, Lauren
name: Kesling, Kevin Hunter
name: Iborra, Paula
name: Jahangiri, Shiva
name: Janssen, Jan
name: Jordan, Joe
name: Kanwal, Sehrish
name: Kunstmann, Liliane
name: Lehmann, Fabian
name: Leser, Ulf
name: Li, Chen
name: Liu, Peini
name: Luettgau, Jakob
name: Lupat, Richard
name: Fernandez, Jose M.
name: Maheshwari, Ketan
name: Malik, Tanu
name: Marquez, Jack
name: Matsuda, Motohiko
name: Medic, Doriana
name: Mohammadi, Somayeh
name: Mulone, Alberto
name: Navarro, John-Luke
name: Ng, Kin Wai
name: Noelp, Klaus
name: Kinoshita, Bruno P.
name: Prout, Ryan
name: Crusoe, Michael R.
name: Ristov, Sashko
name: Robila, Stefan
name: Rosendo, Daniel
name: Rowell, Billy
name: Rybicki, Jedrzej
name: Sanchez, Hector
name: Saurabh, Nishant
name: Saurav, Sumit Kumar
name: Scogland, Tom
name: Senanayake, Dinindu
name: Shin, Woong
name: Sirvent, Raul
name: Skluzacek, Tyler
name: Sly-Delgado, Barry
name: Soiland-Reyes, Stian
name: Souza, Abel
name: Souza, Renan
name: Talia, Domenico
name: Tallent, Nathan
name: Thamsen, Lauritz
name: Titov, Mikhail
name: Tovar, Benjamin
name: Vahi, Karan
name: Vardar-Irrgang, Eric
name: Vartina, Edite
name: Wang, Yuandou
name: Wouters, Merridee
name: Yu, Qi
name: Bkhetan, Ziad Al
name: Zulfiqar, Mahnoor
Publisher: name: arXiv
Year: 2024
Subjects: subject: Distributed, Parallel, and Cluster Computing (cs.DC)
subject: FOS: Computer and information sciences
subject: FOS: Computer and information sciences

description: The Workflows Community Summit gathered 111 participants from 18 countries to discuss emerging trends and challenges in scientific workflows, focusing on six key areas: time-sensitive workflows, AI-HPC convergence, multi-facility workflows, heterogeneous HPC environments, user experience, and FAIR computational workflows. The integration of AI and exascale computing has revolutionized scientific workflows, enabling higher-fidelity models and complex, time-sensitive processes, while introducing challenges in managing heterogeneous environments and multi-facility data dependencies. The rise of large language models is driving computational demands to zettaflop scales, necessitating modular, adaptable systems and cloud-service models to optimize resource utilization and ensure reproducibility. Multi-facility workflows present challenges in data movement, curation, and overcoming institutional silos, while diverse hardware architectures require integrating workflow considerations into early system design and developing standardized resource management tools. The summit emphasized improving user experience in workflow systems and ensuring FAIR workflows to enhance collaboration and accelerate scientific discovery. Key recommendations include developing standardized metrics for time-sensitive workflows, creating frameworks for cloud-HPC integration, implementing distributed-by-design workflow modeling, establishing multi-facility authentication protocols, and accelerating AI integration in HPC workflow management. The summit also called for comprehensive workflow benchmarks, workflow-specific UX principles, and a FAIR workflow maturity model, highlighting the need for continued collaboration in addressing the complex challenges posed by the convergence of AI, HPC, and multi-facility research environments.