[JHPCN] How to Use the Lustre File System

How to Use the Lustre File System

If you wish to use the Lustre file system, please create a virtual machine first and then apply for Lustre mount access by submitting the following information to the system administrator using the form below.






    After receiving notification from the system administrator that the Lustre mount is available, please configure the Lustre client on your virtual machine. The Lustre client packages and configuration files are pre-installed in the Rocky Linux / Ubuntu Server templates, so you can complete the setup by following the steps below.

    (1) Log in to the virtual machine and switch to the root account using sudo su, etc.

    (2) Check the interface name to which the private network IP address (172.16.10.X) is assigned on the virtual machine.

    (Command to execute)
    ip a

    (Example output)
    …omitted…
    2: eth0: mtu 1442 qdisc fq_codel state UP group default qlen 1000
    …omitted…

    → In this example, the interface name is “eth0”.

    (3) Edit /etc/modprobe.d/lustre.conf and replace the interface name with the one confirmed above.

    → options lnet networks=tcp(specify eth0 confirmed above here)

    (Command to execute)
    vi /etc/modprobe.d/lustre.conf

    (Example modification)
    options lnet networks=tcp(eth0)
    options lnet lnet_transaction_timeout=100
    options ksocklnd rx_buffer_size=16777216
    options ksocklnd tx_buffer_size=16777216
    options ksocklnd conns_per_peer=8
    options ksocklnd nscheds=8

    (4) Edit the interface name in /etc/sysconfig/lustre_client to the confirmed interface name (eth0 in this example). The file path differs between Rocky Linux (RHEL-based) and Ubuntu Server.

    For Rocky Linux For Ubuntu Server
    (Command to execute)
    vi /etc/sysconfig/lustre_client

    (Example output)
    …omitted…
    #++++++++++++++++++++++++++++++++++++
    # LNET Interface
    #
    IF1=eth0
    …omitted…

    (Command to execute)
    vi /etc/lustre_client

    (Example output)
    …omitted…
    #++++++++++++++++++++++++++++++++++++
    # LNET Interface
    #
    IF1=eth0
    …omitted…

    (5) Start lustre_client.service.

    systemctl start lustre_client.service

    (6) Check the mount status of the Lustre file system.

    (Command to execute)
    df -h -t lustre

    (Example output)
    Filesystem Size Used Avail Use% Mounted on
    10.10.0.16@tcp:10.10.0.18@tcp:10.10.0.17@tcp:10.10.0.19@tcp:/lustre 503T 520G 497T 1% /lustre

    (7) (Optional) Enable automatic startup of lustre_client.service so that Lustre is mounted automatically when the virtual machine boots.

    systemctl enable lustre_client.service

    (8) You can now use the Lustre file system. When storing data on Lustre, please use directories under “/lustre”.