Lustre Community Update
Peter Jones
OpenSFS Lustre Working Group
December 10th 2021

2020 – A Decade of CommunityDevelopment• External contributions were rare

– Lustre 1.8 (2009) had no externalcontributions– Lustre 2.13 (2019) had contributions from85 developers from 25 organizations

Lustre Contributions by Release150
10050Developers

2.1
0.
2.1
1.
2.1
2.
2.1
3.
2.1
4.

2.8.
2.9.

2.6.
2.7.

2.4.
2.5.

2.2.
2.3
.

0
1.8.
2.1.

• Since 2010 we have had Lustre codecontributions from over 200 individual
developers

Organizations• Many of the developers have worked for
multiple organizations over that period
Lustre Code Change by Release
1500
1000
500
01.8.
2.1.
2.2.
2.3.
2.4
.
2.5
.
2.6.
2.7
.
2.8
.
2.9
.
2.1
0.
2.1
1.
2.1
2.
2.1
3.
2.1
4.

• The contribution model means Lustre
continues to thrive even as participatingorganizations change strategies

CommitskLOC

Data courtesy of Dustin Leverman (ORNL) and Chris Morrone (LLNL)Lustre 2.12.x LTS• Lustre 2.12.7 went GA in July
• RHEL 7.9 server and client support• RHEL 8.4 and SLES12 SP5 client support• http://wiki.lustre.org/Lustre_2.12.7_Changelog• Lustre 2.12.8 expected towards the end of the yearRHEL 8.5 GA will affecttiming!

Which Lustre versions do you use in production? (select all that apply)
100.00%80.00%
60.00%

Current LTS

FormerLTS

40.00%
20.00%
0.00%
Lustre 2.5.x Lustre 2.7.x Lustre 2.10.x Lustre 2.11 Lustre 2.12.x Lustre 2.13 Lustre 2.14
2019

2020

2021

3

Lustre 2.14
• Went GA in February• OS support• RHEL 8.3 servers/clients• RHEL 8.3/SLES15 SP2/Ubuntu 20.04
clients• Interop/upgrades from 2.13 andlatest Lustre 2.12.x• Number of useful features• Client-side Data Encryption (LU12275)• OST Pool Quotas (11023)• DNE Auto Restriping (LU-11025)• http://wiki.lustre.org/Release_2.14.0

Number of Commits

Aeon
LLNL
Other
SUSE 24Uber 1 Amazon55
11Oracle 1
MellanoATOS52
Seagatex1
Intel 71
CEA 7
ORNL
66

HPE 264

Google1Fujitsu
1DDN-…

Data courtesy of Dustin Leverman (ORNL)

4

Lustre 2.15
• Targeted for Q4 release• OS support Likely RHEL 8.5 by GA time!
• RHEL 8.4 servers/clients• RHEL 8.4/SLES15 SP3/Ubuntu 20.04
clients• Interop/upgrades from 2.14 andlatest Lustre 2.12.x• Number of useful features• Client-side Directory Encryption (LU13717)• GPU Direct (LU-14798)• Network Selection Policy (UDSP) (LU9121)• http://wiki.lustre.org/Release_2.15.0

5LTS Recommendation• Lustre 2.15 to become the new LTS branch with RHEL 8.x
as primary distro for servers• Allows time for broader testing ahead of the initial GA• Will improve the quality of initial release• Provides time to work out alternative to CentOS (Alma/Rocky)• What about those who prefer to remain on 2.12.x?
• 2.12.x releases should continue for about another year
• Interop between LTS releases means 2.12.x servers could be
used with 2.15.x clients• Open source means that it is easy for interested parties tocollaborate and publish any updates needed6

Lustre Community Events
Include SC21 data?

• Most 2021 events were stillvirtual

10987
6543210SC10SC11SC12SC13SC14SC15SC16SC17SC18SC19SC20Sites in Top10Historic Lustre Top 100% of Top100– LUG21 May 19th – 20thhttps://www.opensfs.org/events/lug- 90802021/70– ISC21 Lustre BOF Jul 1st
https://sc21.supercomputing.org/https 60
50://www.eofs.eu/events/21-isc-lustre40
bof30– LAD20 Sep 28th – 30th China LUG dates
20
may changes
https://www.eofs.eu/events/lad2110rdth– China LUG Nov 3 – 40
http://lustrefs.cn/clug2021/– SC21 Lustre BOF Nov 18th
https://sc21.supercomputing.org/presentation/?id=bof117&sess=sess364– Japan LUG Dec 10th
https://www.jlug.info

Data analysis of Top500.org lists• We hope to be able to meet inperson again in 2022

7

Thank you

Open Scalable File Systems, Inc.
3855 SW 153rd Drive
Beaverton, OR 97006
Ph: 503-619-0561
Fax: 503-644-6708
admin@opensfs.org

www.opensfs.org