I am Professor and Head of Department of Electrical and
Computer Systems Engineering at Monash University

email: tom.drummond@monash.edu


Research Topics:

Approximate Fisher Information Matrix to Characterize the Training of Deep Neural Networks (WITH Zhibin Liao, Ian Reid and Gustavo Carneiro)

This paper looks at how to measure the condition number of the training problem for deep networks, how this is affected by batch size and learning rate, and how this characterises performance in terms of convergence and generalisation.

[PAMI 2018 paper]

No comments:

Post a comment

Note: only a member of this blog may post a comment.