The aim of this EPSRC DTP project is to leverage our knowledge of the brain and foraging behaviour of ants to see if both incorporating biological constraints and naturalistic training data can generate DNN’s whose perceptual abilities have the robustness and generalisability of biological vision. This project is under the supervision of Dr Benjamin Evans.
Over the past decade, Deep neural networks (DNNs) have revolutionised AI, achieving highly impressive perceptual feats especially in the domain of vision. In particular, convolutional neural networks have surpassed humans in their ability to classify naturalistic images. These findings, together with their similarities in architecture and activity patterns, have sparked major renewed interest in DNNs as models of the brain. However, these models diverge from the perceptual abilities of biological vision in important and unexpected ways, e.g., through their weakness to noise, susceptibility to adversarial attacks and inability to recognise stylised representations. This has been shown to be due to their over-reliance on diagnostic but brittle features such as texture [1] or even a single pixel correlated with the image class [2]. In part, these limitations arise from a lack of inductive biases in the models to regularise their learning, coupled with unrealistic training environments. Some of these shortcomings have recently been addressed through incorporating more of the properties of the primate visual system into these models [3] or by using more extensive and naturalistic training regimes [4].
The aim of this project is to leverage our knowledge of the brain and foraging behaviour of ants to see if both incorporating biological constraints and naturalistic training data can generate DNN’s whose perceptual abilities have the robustness and generalisability of biological vision.
References
[1] Geirhos, R., Rubisch, P., Michaelis, C., Bethge, M., Wichmann, F. A. & Brendel, W. (2019). ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness.arXiv:1811.12231.
[2] Malhotra, G., Evans, B. D. and Bowers, J. S. (2020) Hiding a plane with a pixel: examining shape-bias in CNNs and the benefit of building in biological constraints.Vision Research 174, pp. 57–68.
[3] Evans, B. D. Malhotra, G. & Bowers, J. S. (2021). Biological convolutions improve DNN robustness to noise and generalisation. Neural Networks 148, pp. 96–110.
[4] Mehrer, J., Spoerer, C. J., Jones, E. C., Kriegeskorte, N. & Kietzmann, T. C. (2021). An ecologically motivated image dataset for deep learning yields better models of human vision.Proceedings of the National Academy of Sciences, 118(8).
Eligible candidates will have a 2:1 degree or equivalent in a related field.
Please clearly state on your application form that you are applying for the EPSRC DTP 2022 under the supervision of Dr Benjamin Evans (B.D.Evans@sussex.ac.uk)
For queries related to the admissions process please contact PhD.Informatics@sussex.ac.uk. For queries related to research project please contact B.D.Evans@sussex.ac.uk