How to use Lustre File System

What is Lustre File System ?

Lustre file system is a parallel distributed file system widely used in supercomputers and large-scale data processing environments.
In mdx II, it can be connected to each virtual machine for your use.

Compared to the default storage connected to virtual machines, Lustre has the following features:

  • High access performance
    Enables fast read/write of large-scale data and improves computational efficiency.
  • Accessible from multiple servers simultaneously
    Multiple virtual machines can access the same data area at the same time.

Application for Using Lustre File System Mount

To use the Lustre file system, please create a virtual machine in advance and then submit an application for Lustre mount with the following information to the system administrators via the form below.

When launching a virtual machine, please note the following:

  • Select “lustre-network”. An IP address such as 192.168.100.XX or 192.168.101.XX will be assigned to the VM. Please enter this IP address into the form below.
  • Select a flavor of vc8m16g or larger. If you select a smaller flavor and try to mount Lustre, a mount error may occur due to insufficient memory.






     

    How to Mount the Lustre File System on a Virtual Machine

    After receiving notification from the system administrator that Lustre mount is available, please configure the Lustre client on your virtual machine.

    For Rocky Linux / Ubuntu Server templates, the Lustre client package and configuration files are already included, so you can configure it using the following steps:

    (1) Log in to the virtual machine and switch to the root account (e.g., with sudo su).

    (2) Check the interface name assigned with the Lustre network IP address (192.168.100.XX or 192.168.101.XX).

    (Command)
    ip a

    (Example Output)
    …omitted…
    2: eth0:<BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1442 qdisc fq_codel state UP group default qlen 1000
    …omitted…

    → In this example, the interface name is eth0.

    (3) Edit /etc/modprobe.d/lustre.conf to replace the interface name with the one you confirmed.

    → options lnet networks=tcp(specify the interface name here, e.g. eth0)

    (Command)
    vi /etc/modprobe.d/lustre.conf

    (Example)
    options lnet networks=tcp(eth0)
    options lnet lnet_transaction_timeout=100
    options ksocklnd rx_buffer_size=16777216
    options ksocklnd tx_buffer_size=16777216
    options ksocklnd conns_per_peer=8
    options ksocklnd nscheds=8

    (4) Edit /etc/sysconfig/lustre_client (Rocky Linux) or /etc/lustre_client (Ubuntu Server) and update the interface name with the one you confirmed (e.g., eth0).

    For Rocky Linux For Ubuntu Server
    (Command)
    vi /etc/sysconfig/lustre_client

    (Example)
    …omitted…
    #++++++++++++++++++++++++++++++++++++
    # LNET Interface
    #
    IF1=eth0
    …omitted…

    (Command)
    vi /etc/lustre_client

    (Example)
    …omitted…
    #++++++++++++++++++++++++++++++++++++
    # LNET Interface
    #
    IF1=eth0
    …omitted…

    (5) Start the Lustre client service.

    systemctl start lustre_client.service

    (6) Check the mount status of the Lustre file system.

    (Command)
    df -h -t lustre

    (Example Output)
    Filesystem Size Used Avail Use% Mounted on
    10.10.0.16@tcp:10.10.0.18@tcp:10.10.0.17@tcp:10.10.0.19@tcp:/lustre 503T 520G 497T 1% /lustre

    (7) (Optional) Enable auto-start of lustre_client.service so that Lustre is automatically mounted at VM startup.

    systemctl enable lustre_client.service

    (8) Lustre file system is now available. When storing data, please use “/lustre” directory. Enjoy high-performance data access with Lustre!