LAD’14 – Lustre Administrators and Developers Workshop

September 22-23, 2014
Domaine Pommery, Reims – France

Organized by EOFS and OpenSFS in collaboration with the University of Reims Champagne-Ardenne

LAD’14 will take place in Reims, France, at Domaine Pommery during 2 days, on September 22-23, 2014. This will be a great opportunity for worldwide Lustre administrators and developers to gather and exchange their experiences, developments, tools, good practices and more!

Reims is reachable by train from Paris downtown and CDG Airport in about 45 minutes by the TGV, France’s high speed rail line.

We are waiting for your registration and presentation proposal!

WEB PAGE
Please use the following link to keep updated on LAD’14 agenda and logistics:

http://www.eofs.org/?id=lad14

PRESENTATIONS
We are inviting community members to send proposals for presentations at this event. No proceeding is required, just an abstract of a 30-min (technical) presentation.
Please send this to lad@eofs.eu before July 25th, 2014.

Topics may include (but are not limited to): site updates or future projects, Lustre administration, monitoring and tools, Lustre feature overview, Lustre client performance (hot topic ;-), benefits of hardware evolution to Lustre (like SSD, many-cores…), comparison between Lustre and other parallel file systems (perf. and/or features), Lustre and Exascale I/O, etc.

REGISTRATION
Registration for the workshop is now open (early-bird rate):

http://lad.eofs.org/register.php

We also recommend booking your hotel in downtown Reims as soon as possible.

SOCIAL EVENT
On Monday evening, there will be a guided visit of Pommery Champagne cellars followed by a social dinner on site. A limited number of spouses can attend too (on a first-come, first-served basis). Register quickly!

SPONSORS
This event is organized thanks to the following generous sponsors:
CEA, DataDirect Networks and Intel

We expect more sponsors to be confirmed soon. Please contact stephane.thiell@cea.fr if your company wants to sponsor LAD.

For any other information, please contact lad@eofs.eu

New Report from the Benchmarking Working Group

I/O Characterization of Large-Scale HPC Centers — Benchmarking Working Group, OpenSFS (PDF)

The  OpenSFS  Benchmarking  Working  Group  (BWG)  was  created  with  the  intent  of  defining  an  I/O  benchmark suite to satisfy the requirements of the scalable parallel file system users and facilities. The  first step toward this end was identified as characterization of I/O workloads, from small scale to very large scale parallel file systems, deployed at various highCperformance and parallel computing (HPC) facilities  and  institutions.  The  characterization  will  then  drive  the  design  of  the  I/O  benchmarks  that  emulate  these workloads.

As part of the characterization, the BWG released a survey at the Supercomputing Conference in 2012,  to  solicit  participation  and  collect  data  on  file systems  and  workloads  in  HPC  centers.  This  paper  summarizes the data collected and our analysis.

Lustre Strategy Survey Open

The OpenSFS Community Development Working Group is gathering data from organizations using Lustre in order to develop a long-term support strategy recommendation going forward. We want to ensure that future Lustre releases are well-aligned with the needs of the Lustre community.

Please complete this short survey to make sure that your organization’s voice is heard!
https://www.surveymonkey.com/s/P3HFY7R

Note that all questions are optional you may submit a partially completed survey if you prefer.

SuperComputing 2013

OpenSFS and the Lustre Community were at Supercomputing 2013 (SC’13) in Denver, November 18-21.

Presentations from our BoF session and related talks on the SC’13 show floor will be posted shortly.

More…

Lustre 2.5.0

The Lustre® Community Development Working Group (CDWG) is pleased to announce that the Lustre 2.5.0 Release is now available for download. The source code is also available from git.
This major release includes a number of new features:

  • Hierarchal Storage Management (HSM) (LU-3608) – allows data to be transferred between different storage types
  • Extended Attribute Cache (Xattr Cache) (LU-2869) – improved performance when reading extended attributes

Fuller details can be found in the change log, the scope statement and the test matrix. The following are known issues in the Lustre 2.5.0 Release:

  • LU-3833 : HSM does not check whether a file is sparse before archiving which could lead to unexpected results
  • LU-4152 : Under rare access patterns while re-exporting NFS it is possible that MDT threads might block until external action is performed on a file
  • LU-4159 : Lustre 2.4.x clients are unable to access a released file

Work is in progress for these issues and it is likely that these will be addressed in the 2.5.1 release scheduled for Q1 2014.

Please log any issues found in this release at the issue tracking website

We would like to thank OpenSFS for their contributions towards the cost of this release, and also to all Lustre community members who have contributed to the release with code and/or testing.

— October 30, 2013