Training Dynamics of Adam (Internship), Short Course | Part time | King Abdullah University of Science and Technology (KAUST) | Thuwal, Saudi Arabia
3 months
Duration
Free
Free
Unknown
Tuition fee
Anytime
Unknown
Apply date
Anytime
Unknown
Start date

About

One of the most used algorithm to train deep neural networks is Adam. In particular, existing mathematical theories fail to capture a quantifiable advantage over the classic stochastic gradient descent. The Training Dynamics of Adam (Internship) project is offered at King Abdullah University of Science and Technology (KAUST)

Visit the Visit programme website for more information

Overview

About the project

In this  Training Dynamics of Adam (Internship) project offered at King Abdullah University of Science and Technology (KAUST) ., we will take a different route: Instead of studying Adam as a black-box under simplified assumptions, we will carefully analyze its empirical training dynamics, in particular in the first iterations. We aim at pinpointing the key differences between the training dynamics of Adam and the ones of stochastic gradient descent with momentum. Later, using the gathered knowledge, we will formulate a mathematical model of its behavior.

Key information

Duration

  • Part-time
    • 3 months

Start dates & application deadlines

You can apply for and start this programme anytime.
More details

Students can choose their own start and end dates as the program runs across the year

Language

English
TOEFL admission requirements TOEFL® IBT
79

Delivered

On Campus

Academic requirements

GPA admission requirements GPA
3.5

English requirements

TOEFL admission requirements TOEFL® IBT
79

Student insurance

Make sure to cover your health, travel, and stay while studying abroad. Even global coverages can miss important items, so make sure your student insurance ticks all the following:

  • Additional medical costs (i.e. dental)
  • Repatriation, if something happens to you or your family
  • Liability
  • Home contents and baggage
  • Accidents
  • Legal aid

We partnered with Aon to provide you with the best affordable student insurance, for a carefree experience away from home.

Get your student insurance now

Starting from €0.53/day, free cancellation any time.

Remember, countries and universities may have specific insurance requirements. To learn more about how student insurance work at King Abdullah University of Science and Technology (KAUST) and/or in Saudi Arabia, please visit Student Insurance Portal.

Other requirements

General requirements

  • Official Transcript(s) in English from current and previous institutions
  • Letter of Recommendation from faculty member in field of study
  • Valid Passport(with six months validity)
  • CV - Summary of your career, qualifications and education.
  • Statement of Purpose-Explain your motivation to become a VSRP intern

Tuition Fee

To always see correct tuition fees
  • International

    Free
    Tuition Fee
    Based on the tuition of 0 SAR per year during 3 months.
  • National

    Free
    Tuition Fee
    Based on the tuition of 0 SAR per year during 3 months.

This is a fully-funded internship; it includes tuition, airfare, housing, medical insurance, visa reimbursement and a monthly stipend of $1,000.

Living costs for Thuwal

2270 - 3445 SAR /month
Living costs

The living costs include the total expenses per month, covering accommodation, public transportation, utilities (electricity, internet), books and groceries.

Funding

Other interesting programmes for you

Our partners

Training Dynamics of Adam (Internship)
-
King Abdullah University of Science and Technology (KAUST)

Wishlist

Go to your profile page to get personalised recommendations!