NVIDIAxCESGA Workshop

Description:

The NeMo framework provides an accelerated workflow for training with 3D parallelism techniques. It offers a choice of several customization techniques and is optimized for at-scale inference of large-scale models for language and image applications, with multi-GPU and multi-node configurations. NeMo makes generative AI model development easy, cost-effective, and fast for enterprises. During this workshop, we will learn how to leverage NeMo Framework to train a foundation model. We’ll cover from preparing a dataset that can be fed into the model, to launch the model training and analyze its output.

Schedule:

09.00 - 09.30: Check-in
09.30 - 09.45: Welcome from CESGA and plans to support the AI community
09.45 - 10.00: Introduction to NVIDIA AI Technology Center
10.00 - 11.00: Cluster access and Slurm workshop
11.00 - 11.30: Coffee Break
11.30 - 13.30: How to train LLMs using NeMo Framework

Form:

Name and surname*

Name

Surname

Email*

Institution/Entity*

Are you interested in attending any of the hands-on sessions? The spots for these are limited due to our cluster constraints, so please indicate which session(s) you would like to attend and your motivation”: Cluster access / LLM training / Both / None*

Cluster access

LLM training

Both

None

Why would you like to participate in these sessions?*

Basic Information on Data Protection In compliance with current regulations regarding data protection, Regulation (EU) 2016/679 of the European Parliament and Council of April 27, 2016 (GDPR), Organic Law of Data Protection and Guarantee of Digital Rights (LOPDGDD, Law 3/2018 of December 5), we provide you with the following information that you must read before signing the registration form as a user of CESGA services: Responsible for the processing of personal data: Galicia Center for Supercomputing Technology Center (CESGA), with NIF: G15852981 and address at Avenida de Vigo, s / n Campus Sur, CP: 15705, Santiago de Compostela.rgpd[at]cesga[dot]es Purposes of the treatment: The personal data provided will be used for the management of the users of the services offered by CESGA. Legitimation: Express consent of the interested party. Recipients: No assignments will be made. No international data transfers will be made. Rights: You have the right to access, rectify and delete the data, as well as other rights, as explained in the additional information.Additional information: Privacy Policy

Consent for the processing of your personal data The interested party declares to be over 16 years old and gives his or her consent for the processing of their personal data, in accordance with the information provided and the conditions set forth in the Data Protection Policy. Likewise, it declares that the data provided is accurate and truthful, and undertakes to communicate in writing to the Galician Center for Supercomputing Technology Center (CESGA), Avenida de Vigo, s / n Campus Sur, CP: 15705, Santiago de Compostela, any variation or modification that occurs in the aforementioned data.

I accept the processing of personal data and the conditions of service*

I accept the processing of personal data and the conditions of service