Students

COMP8420 – Advanced Natural Language Processing

2026 – Session 1, In person-scheduled-weekday, North Ryde

General Information

Download as PDF
Unit convenor and teaching staff Unit convenor and teaching staff Professor
Longbing Cao
3IR
Lecturer
Qiongkai Xu
Credit points Credit points
10
Prerequisites Prerequisites
COMP6420
Corequisites Corequisites
Co-badged status Co-badged status
Unit description Unit description

Human communication, with humans and virtual agents alike, is done in a natural language such as English. Humans have the amazing ability to learn, process and use natural languages. However, for machines it is difficult. This unit aims to familiarise students with the fundamental concepts and ideas in natural language processing (NLP) and Natural Language Understanding (NLU). It will help students develop a deeper appreciation of both algorithms for processing linguistic information and the underlying computational properties of natural languages, as well as their applications. 

Learning in this unit enhances student understanding of global challenges identified by the United Nations Sustainable Development Goals (UNSDGs) Industry, Innovation and Infrastructure

Important Academic Dates

Information about important academic dates including deadlines for withdrawing from units are available at https://www.mq.edu.au/study/calendar-of-dates

Learning Outcomes

On successful completion of this unit, you will be able to:

  • ULO1: Compare and evaluate the key natural language processing applications that meet the current and emerging industry needs.
  • ULO2: Explain the main techniques that are used to develop and implement natural language processing applications.
  • ULO3: Implement natural language processing applications using common tools and libraries used in industry.
  • ULO4: Design natural language processing applications using advanced deep learning techniques.
  • ULO5: Apply natural language processing methods and techniques to industry applications using real data.
  • ULO6: Apply good practice in the development, monitoring, and deployment of natural language processing systems

General Assessment Information

This unit has three take-home assessments. You will submit the solutions to the assessments via iLearn by the due dates. There is no final examination.

Late Submission Policy

  • 5% penalty per day: If you submit your assessment late, 5% of the total possible marks will be deducted for each day (including weekends), up to 7 days.

    • Example 1 (out of 100): If you score 85/100 but submit 20 hours late, you will lose 5 marks and receive 80/100.

    • Example 2 (out of 30): If you score 27/30 but submit 1 day late, you will lose 1.5 marks and receive 25.5/30.

  • After 7 days: Submissions more than 7 days late will receive a mark of 0.

  • Extensions:

    • Automatic short extension: Some assessments are eligible for automatic short extension. If so, you can only apply for an automatic short extension before the due date.

    • Special Consideration: If you need more time due to serious issues and for any assessments that are not eligible for Short Extension, you must apply for Special Consideration.

Special Consideration Policy

The Special Consideration Policy aims to support students who have been impacted by short-term circumstances or events that are serious, unavoidable and significantly disruptive, and which may affect their performance in assessment. If you experience circumstances or events that affect your ability to complete the assessments in this unit on time, please inform the convenor and submit a Special Consideration request through ask.mq.edu.au.

Need help? Review the Special Consideration page HERE.

Assignments Release Dates

The assignments will be released no later than the dates listed below.

  • Assignment 1: Natural Language Processing - 27/02/2026

  • Assignment 2: Large Language Modeling - 06/03/2026

  • Assignment 3: Practice-based Group Project - 01/05/2026

Requirements to Pass this Unit

To pass this unit, you must achieve a total mark equal or greater than 50%. This unit does not have hurdle assessments.

Assessment Tasks

Name Weighting Hurdle Due Groupwork/Individual Short Extension AI Approach
Summative Project 40% No 19/06/2026 Individual and Group No Open
Deep Learning Assignment 30% No 17/04/2026 Individual Yes Open
Natural Language Processing Assignment 30% No 20/03/2026 Individual No Open

Summative Project

Assessment Type 1: Creative task
Indicative Time on Task 2: 35 hours
Due: 19/06/2026
Weighting: 40%
Groupwork/Individual: Individual and Group
Short extension 3: No
AI Approach: Open

You will design, implement, deploy, evaluate, and monitor an industrial-grade natural language processing application that uses realistic data and requires advanced deep learning techniques.


On successful completion you will be able to:
  • Compare and evaluate the key natural language processing applications that meet the current and emerging industry needs.
  • Explain the main techniques that are used to develop and implement natural language processing applications.
  • Implement natural language processing applications using common tools and libraries used in industry.
  • Design natural language processing applications using advanced deep learning techniques.
  • Apply natural language processing methods and techniques to industry applications using real data.
  • Apply good practice in the development, monitoring, and deployment of natural language processing systems

Deep Learning Assignment

Assessment Type 1: Creative task
Indicative Time on Task 2: 25 hours
Due: 17/04/2026
Weighting: 30%
Groupwork/Individual: Individual
Short extension 3: Yes
AI Approach: Open

You will implement a practical natural language processing application using deep learning techniques.


On successful completion you will be able to:
  • Explain the main techniques that are used to develop and implement natural language processing applications.
  • Implement natural language processing applications using common tools and libraries used in industry.
  • Apply natural language processing methods and techniques to industry applications using real data.

Natural Language Processing Assignment

Assessment Type 1: Experiential task
Indicative Time on Task 2: 25 hours
Due: 20/03/2026
Weighting: 30%
Groupwork/Individual: Individual
Short extension 3: No
AI Approach: Open

You will implement a natural language processing application using industry tools.


On successful completion you will be able to:
  • Explain the main techniques that are used to develop and implement natural language processing applications.
  • Implement natural language processing applications using common tools and libraries used in industry.

1 If you need help with your assignment, please contact:

  • the academic teaching staff in your unit for guidance in understanding or completing this type of assessment
  • Academic Success for academic skills support.

2 Indicative time-on-task is an estimate of the time required for completion of the assessment task and is subject to individual variation.

3 An automatic short extension is available for some assessments. Apply through the Service Connect Portal.

Delivery and Resources

Delivery Schedule and Modes

  • Lectures: One 2-hour lecture per week for 13 weeks.

  • Workshops: One 2-hour workshop per week for 13 weeks.

Lectures and practicals start on Week 1.

All lectures and workshops are delivered on campus. The lectures will also be recorded and recordings of the lectures will be available via iLearn. There will not be recordings of the workshop sessions.

 

Assessment Components

There are three assignments for this unit.

  • Assignments 1 and 2: Students must complete two assignments using NLP and large lanaguage models for NLP applications.

  • Assignment 3 - Main Project: Students will develop problem-based applications in a group, culminating in a presentation and a technical report.

 

Methods of Communication

We will communicate with you via your university email and through announcements in iLearn. Queries to convenors can be made via the Contact tool in iLearn or sent to longbing.cao@mq.edu.au from your university email address.

 

Textbooks

  • Natural Language Processing with Transformers, Revised Edition by Lewis Tunstall, Leandro von Werra, Thomas Wolf. Publisher: O'Reilly Media, Inc. ISBN: 9781098136796 https://www.oreilly.com/library/view/natural-language-processing/9781098136789/

  • Hands-On Large Language Models, by Jay Alammar, Maarten Grootendorst, O'Reilly Media, Inc. ISBN 9781098150969 https://learning.oreilly.com/library/view/hands-on-large-language/9781098150952/

Policies and Procedures

Macquarie University policies and procedures are accessible from Policy Central (https://policies.mq.edu.au). Students should be aware of the following policies in particular with regard to Learning and Teaching:

Students seeking more policy resources can visit Student Policies (https://students.mq.edu.au/support/study/policies). It is your one-stop-shop for the key policies you need to know about throughout your undergraduate student journey.

To find other policies relating to Teaching and Learning, visit Policy Central (https://policies.mq.edu.au) and use the search tool.

Student Code of Conduct

Macquarie University students have a responsibility to be familiar with the Student Code of Conduct: https://students.mq.edu.au/admin/other-resources/student-conduct

Results

Results published on platform other than eStudent, (eg. iLearn, Coursera etc.) or released directly by your Unit Convenor, are not confirmed as they are subject to final approval by the University. Once approved, final results will be sent to your student email address and will be made available in eStudent. For more information visit connect.mq.edu.au or if you are a Global MBA student contact globalmba.support@mq.edu.au

Academic Integrity

At Macquarie, we believe academic integrity – honesty, respect, trust, responsibility, fairness and courage – is at the core of learning, teaching and research. We recognise that meeting the expectations required to complete your assessments can be challenging. So, we offer you a range of resources and services to help you reach your potential, including free online writing and maths support, academic skills development and wellbeing consultations.

Student Support

Macquarie University provides a range of support services for students. For details, visit http://students.mq.edu.au/support/

Academic Success

Academic Success provides resources to develop your English language proficiency, academic writing, and communication skills.

The Library provides online and face to face support to help you find and use relevant information resources. 

Student Services and Support

Macquarie University offers a range of Student Support Services including:

Student Enquiries

Got a question? Ask us via the Service Connect Portal, or contact Service Connect.

IT Help

For help with University computer systems and technology, visit http://www.mq.edu.au/about_us/offices_and_units/information_technology/help/

When using the University's IT, you must adhere to the Acceptable Use of IT Resources Policy. The policy applies to all who connect to the MQ network including students.

Changes from Previous Offering

This unit has incorporated some lessons, and observations from previous offerings for continuous adjustment and optimization.

  • Improved lecture organization and structure following a more connected and structured knowedge map of advanced NLP/LLMs.
  • Highlighting LLMs in the lectures and assignments, and practice-based problem-solving.
  • Improved statement in Assignments, including more specific description, added use cases, and specific rubric etc. to enhance practice and experience.

Unit information based on version 2026.02 of the Handbook