Module 12412 (2007)

Syllabus page 2007/2008

06-12412
Introduction to Neural Computation

Level 4/M

Peter Tino
10 credits in Semester 1

Links | Outline | Aims | Outcomes | Prerequisites | Teaching | Assessment | Books | Detailed Syllabus


The Module Description is a strict subset of this Syllabus Page. (The University module description has not yet been checked against the School's.)

Relevant Links

See the Introduction to Neural Computation Web-page for module material and further useful links.


Outline

Through both lectures and practical work, the module introduces the basic concepts and techniques of neural computation and, more generally, automated learning in computing machines. It covers various forms of formal neurons and their relation to neurobiology, showing how to construct larger networks of formal neurons and study their learning and generalisation in the context of practical applications. Finally, neural-based learning techniques are contrasted with other state-of-the-art techniques of automated learning.


Aims

The aims of this module are to:

  • Introduce some of the fundamental techniques and principles of neural computation
  • Investigate some common neural-based models and their applications
  • Present neural network models in the larger context of state-of-the-art techniques of automated learning

Learning Outcomes

On successful completion of this module, the student should be able to: Assessed by:
1Understand the relationship between real brains and simple artificial neural network models Examination
2Describe and explain some of the principal architectures and learning algorithms of neural computation Examination
3Explain the learning and generalisation aspects of neural computation Examination
4Apply neural computation algorithms to specific technical and scientific problems Continuous Assessment
5Demonstrate an understanding of the benefits and limitations of neural-based learning techniques in context of other state-of-the-art methods of automated learning Examination

Restrictions, Prerequisites and Corequisites

Restrictions:

May not be taken by anyone who has taken or is taking 06-20416 (Neural Computation).

Prerequisites:

None

Co-requisites:

None


Teaching

Teaching Methods:

2 hrs/week of lectures, assigned course work

Contact Hours:

24


Assessment

  • Sessional: 1.5 hr examination (80%), continuous assessment (20%)
  • Supplementary (where allowed): By examination only.

Recommended Books

TitleAuthor(s)Publisher, Date
Neural Networks: A Comprehensive Foundation (Second Edition)Simon HaykinPrentice Hall, 1999
Neural Networks for Pattern RecognitionC M BishopOxford University Press, 1995
An Introduction to Neural NetworksK GurneyRoutledge, 1997
The Elements of Statistical Learning: Data Mining, Inference, and PredictionTrevor Hastie, Robert Tibshirani, and Jerome FriedmanSpringer, 2001

Detailed Syllabus

  1. Brain, biological and formal neurons.
  2. Learning in formal neurons.
  3. Layered networks of formal neurons.
  4. Optimisation algorithms, gradient-based search.
  5. Learning in layered neural networks.
  6. Learning and generalisation, bias and variance.
  7. Recurrent neural networks.
    • Learning on temporally dependent data (time series).
  8. Probabilistic models of data.
  9. Discriminatory vs. generative approaches to classification.
  10. Symbiosis between neural networks and probabilistic learning systems.

Last updated: 25 May 2006

Source file: /internal/modules/COMSCI/2007/xml/12412.xml

Links | Outline | Aims | Outcomes | Prerequisites | Teaching | Assessment | Books | Detailed Syllabus