Module Code - Title:
CE6012
-
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING
Year Last Offered:
2025/6
Hours Per Week:
Grading Type:
N
Prerequisite Modules:
Rationale and Purpose of the Module:
Artificial Intelligence is the broader concept of machines being able to carry out tasks in a way that we would consider "smart". Machine Learning is a current application of AI based around the idea that we should be able to give machines access to data and let them learn for themselves.
The module covers what is is we mean by learning from data and using patterns in data to learn from it as long as we have enough data from which to learn. We will look at how to learn from data, using basic techniques and trialing them on data sets, we will look a algorithms to make or learning better.
Syllabus:
1. The learning problem: feasibility of learning, error and noise
2. Theory of generalization: Effective number of hypothesis, VC bound, sample and model complexity, approximation-generalization trade-off, bias and variance
3. Linear classification and regression, logistic regression, gradient descent and feature space transformations
4. Overfitting and regularisation
5. Validation and model selection, data snooping
6. Neural Networks: Perceptrons, Multi-Layer Perceptrons and the Back-Propagation training algorithm.
7. Optimal Margin Classifiers and Support Vector Machines.
8. Parametric vs. Non-Parametric classifiers.
Learning Outcomes:
Cognitive (Knowledge, Understanding, Application, Analysis, Evaluation, Synthesis)
At the end of this module students will be able to:
1. Demonstrate an understanding of the theory of generalisation and its practical implications for machine learners, the concept of model complexity, in particular the VC bound and its practical interpretation.
2. Be able to apply regularization.
3. Demonstrate an understanding of and be able to apply non-linear transformations to feature spaces.
4. Recognise and manage under- and overfitting.
5. Be able to apply methods for model validation and model selection.
6. Be able to apply a number of linear and non-linear and parametric and non-parametric machine learners: linear regression, logistic regression, feed forward neural networks and SVMs.
Affective (Attitudes and Values)
At the end of this module students will be able to:
1. Given a classification problem, identify and defend an appropriate classification technique.
2. Given a data set, train a machine learner with due consideration for bias and data snooping.
3. Given a machine learner trained on a data set, assess the impact of the availability of data on the machine learner's performance.
Psychomotor (Physical Skills)
N/A
How the Module will be Taught and what will be the Learning Experiences of the Students:
The module will be delivered using a blended learning approach using on-line lectures, virtual labs and tutorials.
Research Findings Incorporated in to the Syllabus (If Relevant):
Prime Texts:
Yaser Abu Mostafa, Malik Magdon-Ismailm Hsuan-Tien Lin (2012)
Learning from Data
, AML
Aurelien Geron (2017)
Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems
, O'Reilly
Andrew Ng (2020)
Machine Learning Yearning
, https://www.deeplearning.ai/machine-learning-yearning/
Other Relevant Texts:
Trevor Hastie, Robert Tibshirani, Jerome Friedman (2009)
The elements of statistical learning
, Springer
Andreas C. Müller and Sarah Guido (2016)
Introduction to Machine Learning with Python: A Guide for Data Scientists
, O'Reilly
Programme(s) in which this Module is Offered:
Semester(s) Module is Offered:
Spring
Module Leader:
pepijn.vandeven@ul.ie