# Module 06-32167 (2019)

## Neural Computation

## Level 3/H

Jinming Duan Per Kristian Lehre | Semester 1 | 20 credits |

### Outline

This module introduces the basic concepts and techniques of neural computation, and its relation to automated learning in computing machines more generally. It covers the main types of formal neuron and their relation to neurobiology, showing how to construct large neural networks and study their learning and generalization abilities in the context of practical applications.

### Aims

The aims of this module are to:

- Introduce some of the fundamental techniques and principles of neural computation
- Investigate some common neural-based models and their applications
- Present neural network models in the larger context of state-of-the-art techniques of automated learning

### Learning Outcomes

On successful completion of this module, the student should be able to:

- understand the relationship between real brains and simple artificial neural network models
- describe and explain some of the principal architectures and learning algorithms of neural computation
- explain the learning and generalisation aspects of neural computation
- demonstrate an understanding of the benefits and limitations of neural-based learning techniques in context of other state-of-the-art methods of automated learning

### Restrictions

Students must have A-Level Mathematics or equivalent

### Taught with

- 06-32212 - Neural Computation (Extended)

### Cannot be taken with

- 06-32212 - Neural Computation (Extended)

### Teaching methods

3 hrs/week of lectures

Contact Hours: 200 hours Lecture: 33 hours Practical classes/workshops: 22 hours Guided independent study: 145 hours

### Assessment

Sessional: 2 hr examination (80%), continuous assessment (20%)

Supplementary (where allowed): 2 hr examination (100%)

### Detailed Syllabus

- Introduction to Neural Networks and their History
- Biological Neurons and Neural Networks, Artificial Neurons
- Networks of Artificial Neurons, Single Layer Perceptrons
- Learning and Generalization in Single Layer Perceptrons
- Hebbian Learning, Gradient Descent Learning
- The Generalized Delta Rule, Practical Considerations
- Learning in Multi-Layer Perceptrons - Back-Propagation
- Learning with Momentum, Conjugate Gradient Learning
- Bias and Variance - Under-Fitting and Over-Fitting
- Improving Generalization
- Applications of Multi-Layer Perceptrons
- Recurrent Neural Networks
- Radial Basis Function Networks: Introduction
- Radial Basis Function Networks: Algorithms
- Radial Basis Function Networks: Applications
- Self Organizing Maps: Fundamentals
- Self Organizing Maps: Properties and Applications
- Learning Vector Quantization
- Committee Machines
- Model Selection and Evolutionary Optimization

### Programmes containing this module

- BSc Artificial Intelligence & Computer Science [0144]
- BSc Artificial Intelligence & Computer Science with an Industrial Year [9502]
- BSc Artificial Intelligence & Computer Science with Study Abroad [452B]
- BSc Computer Science [4436]
- BSc Computer Science with an Industrial Year [9499]
- BSc Computer Science with Study Abroad [5571]
- BSc Mathematics and Computer Science [5196]
- BSc Mathematics and Computer Science with an Industrial Year [9495]
- MSci Computer Science [4443]
- MSci Computer Science with an Industrial Year [9509]
- MSci Computer Science with Study Abroad [5576]
- MSci Mathematics and Computer Science [5197]
- MSci Mathematics and Computer Science with an Industrial Year [9496]