Module 02360 (2003)
Syllabus page 2003/2004
06-02360
Introduction to Neural Networks
Level 2/I
Links | Outline | Aims | Outcomes | Prerequisites | Teaching | Assessment | Books | Detailed Syllabus
The Module Description is a strict subset of this Syllabus Page. (The University module description has not yet been checked against the School's.)
Relevant Links
Outline
Basic Neurobiology; Neural Networks; Single Neuron Models; Single Layer Perceptrons; Multi-Layer Perceptrons; Radial Basis Function networks; Committee machines; Kohonen networks; Applications of neural networks.
Aims
The aims of this module are to:
- introduce some of the fundamental techniques and principles of neural network systems
- investigate some common models and their applications
Learning Outcomes
| On successful completion of this module, the student should be able to: | Assessed by: | |
| 1 | understand the relation between real brains and simple artificial neural network models | Examination |
| 2 | describe and explain the most common architectures and learning algorithms for Multi-Layer Perceptrons, Radial-Basis Function Networks, Committee Machines, and Kohonen Self-Organising Maps | Examination |
| 3 | explain the learning and generalisation aspects of neural network systems | Examination, assignment |
| 4 | demonstrate an understanding of the implementational issues for common neural network systems | Examination, assignment |
| 5 | demonstrate an understanding of the practical considerations in applying neural networks to real classification, recognition and approximation problems | Examination, assignment |
Restrictions, Prerequisites and Corequisites
Restrictions:
None
Prerequisites:
None
Co-requisites:
None
Teaching
Teaching Methods:
2 hrs of lectures per week plus labs
Contact Hours:
Assessment
- Supplementary (where allowed): As the sessional assessment
- 2 hr examination (70%), continuous assessment (30%). Resit by written examination only with the continuous assessment mark carried forward.
Recommended Books
| Title | Author(s) | Publisher, Date |
| An Introduction to Neural Networks | K Gurney | Routledge, 1997 |
| Neural Networks: A Comprehensive Foundation | S Haykin | Prentice Hall, 1999 |
| Neural Networks for Pattern Recognition | C M Bishop | Oxford University Press, 1995 |
| The Essence of Neural Networks | R Callan | Prentice Hall Europe, 1999 |
| Introduction to Neural Networks | R Beale & T Jackson | IOP Publishing, 1990 |
| An Introduction to the Theory of Neural Computation | J Hertz, A Krogh & R G Palmer | Addison Wesley, 1991 |
| Principles of Neurocomputing for Science and Engineering | F M Ham & I Kostanic | McGraw Hill, 2001 |
Detailed Syllabus
- Introduction to Neural Networks and their History.
- Biological Neurons and Neural Networks. Artificial Neurons.
- Networks of Artificial Neurons. Single Layer Perceptrons.
- Learning and Generalization in Single Layer Perceptrons.
- Hebbian Learning. Gradient Descent Learning.
- The Generalized Delta Rule. Practical Considerations.
- Learning in Multi-Layer Perceptrons. Back-Propagation.
- Learning with Momentum. Conjugate Gradient Learning.
- Bias and Variance. Under-Fitting and Over-Fitting.
- Improving Generalization.
- Applications of Multi-Layer Perceptrons.
- Radial Basis Function Networks: Introduction.
- Radial Basis Function Networks: Algorithms.
- Radial Basis Function Networks: Applications.
- Committee Machines.
- Self Organizing Maps: Fundamentals.
- Self Organizing Maps: Algorithms and Applications.
- Learning Vector Quantisation (LVQ).
- Overview of More Advanced Topics.
Last updated: 22 Sep 2003
Source file: /internal/modules/COMSCI/2003/xml/02360.xml
Links | Outline | Aims | Outcomes | Prerequisites | Teaching | Assessment | Books | Detailed Syllabus