University of BirminghamComputer Science

SYLLABUS PAGE, 2005/06

06-12412
Introduction to Neural Computation

Level 4/M

Dr P Tiño
10 credits in Sem1

Programmes | Modules | Updates | Outline | Aims | Outcomes | Prerequisites | Teaching | Assessment | Books | Detailed Syllabus | Links

The School of Computer Science Module Description is a strict subset of this Syllabus Page. (The University module description has not yet been checked against the School's.)

Changes and Updates

Most recent update: 13 May 2005.

Outline

Basic Neurobiology; Neural Networks; Single Neuron Models; Single Layer Perceptrons; Multi-Layer Perceptrons; Recurrent Networks; Radial Basis Function networks; Committee machines; Kohonen networks; Applications of neural networks.

Aims

The aims of this module are to:

Learning Outcomes

On successful completion of this module, the student should be able to:Assessed by:
1Understand the relation between real brains and simple artificial neural network models.Examination
2Describe and explain the most common architectures and learning algorithms for Multi-Layer Perceptrons, Recurrent Networks, Radial-Basis Function Networks, Committee Machines, and Kohonen Self-Organising Maps.Examination
3Explain the learning and generalisation aspects of neural computation.Examination, assignment
4Demonstrate an understanding of the implementational issues for common neural network systems.Examination, assignment
5Demonstrate an understanding of the practical considerations in applying neural computation to real classification and regression problems.Examination, assignment

Restrictions, Prerequisites and Corequisites

Restrictions:

None

Prerequisites:

None

Co-requisites:

None

Teaching

Teaching methods:

2 hrs of lectures per week plus labs

Contact hours:

24

Assessment

1.5 hr open book examination (70%), continuous assessment (30%). Resit (where allowed) by examination only with the continuous assessment mark carried forward.

Recommended Books

TitleAuthor(s)Publisher, DateComments
Neural Networks: A Comprehensive FoundationS HaykinPrentice Hall, 1999Very comprehensive, a bit heavy in maths
Neural Networks for Pattern RecognitionC M BishopOxford University Press, 1995Highly recommended for mathematically minded students
An Introduction to Neural NetworksK GurneyRoutledge, 1997Soft, non-mathematical introduction
An Introduction to the Theory of Neural ComputationJ Hertz, A Krogh & R G PalmerAddison Wesley, 1991Good all round book, but slightly mathematical
Introduction to Neural NetworksR Beale & T JacksonIOP Publishing, 1990Introductory text

Detailed Syllabus

  1. Introduction to Neural Networks and their History.
  2. Biological Neurons and Neural Networks, Artificial Neurons.
  3. Networks of Neurons, Single Layer Perceptrons (SLPs).
  4. Learning and Generalization in SLPs.
  5. Hebbian Learning, Gradient Descent Learning.
  6. The XOR Problem, Linear Separability, Multi-Layer Perceptrons (MLPs).
  7. The Back-Propagation Learning Algorithm and its Variations.
  8. Other optimization algorithms - Line Searches, Conjugate Gradient.
  9. Bias and Variance, Improving Generalization.
  10. Constructive Algorithms, Pruning Algorithms.
  11. Applications of Multi-Layer Perceptrons.
  12. Recurrent Networks.
  13. Radial-Basis Function Networks.
  14. Applications of Radial-Basis Function Networks.
  15. Committee Machines.
  16. Kohonen Self-Organising Maps (SOMs).
  17. Learning Vector Quantisation (LVQ).
  18. Overview of More Advanced Topics.
  19. Summary and Review.

Relevant Links

See Introduction to Neural Computation Web-page for module material and further useful links.

Programmes | Modules | Updates | Outline | Aims | Outcomes | Prerequisites | Teaching | Assessment | Books | Detailed Syllabus | Links

Page maintained by:Dr P Coxhead
Content last updated:13 May 2005
Source:/resources/modules/2005/xml/12412.xml