Description
The group of Dr. Anand Subramoney at the Royal Holloway, University of London is open to hosting Master and Bachelor students from RUB through the DAAD PROMOS program for research internships of up to 6 months, including thesis work. Refer to the DAAD PROMOS program page for eligibiilty criteria and details of application process.
Potential research topics include:
- Continual lifelong learning and meta-learning in deep learning
- Developing new training methods for recurrent neural networks
- Distillation and compression of recurrent language models
- Studying in-context learning in large language models based on both transformers and recurrent networks
- High performance implementations of recurrent (language) models
- Models for neuromorphic computing, including digital and analog systems
Required skills:
- A solid level of mathematics as taught in the Angewandte Informatik Bachelor‘s. This includes basic probability theory/statistics, linear algebra, calculus.
- Experience working with deep neural networks.
- Knowledge of Python, and deep learning frameworks such as Tensorflow/Pytorch/JAX.
- Knowledge of advanced deep learning including transformers, recurrent networks, language models is a plus.
- For high-performance implementations, good Knowledge of one of Rust/Elixir/C++/CUDA depending on the choice of implementation and knowledge of concurrent programming concepts.
Email anand.subramoney@rhul.ac.uk if you're interested in applying for this opportunity.
Royal Holloway, University of London, is located on a leafy and friendly 135-acre campus in Egham, UK. With the Founder's Building, an impressive Victorian masterpiece based on a French chateau, as its heart, it has been likened to Harry Potter's Hogwarts and "living in a castle" by some of the 500 students who live here. Egham, Surrey, has direct public transport links to central London (40 min) and Heathrow airport (20 min), is surrounded by green spaces and close to historical landmarks such as Windsor Castle and the site of Magna Carta's signing.