Students

STAT878 – Modern Computational Statistical Methods

2017 – S1 External

General Information

Download as PDF
Unit convenor and teaching staff Unit convenor and teaching staff Unit Convenor
Jun Ma
Contact via jun.ma@mq.edu.au
Room 5.26, 12 Wally's Walk
Wed 5 - 6pm
Credit points Credit points
4
Prerequisites Prerequisites
Corequisites Corequisites
((Admission to MAppStat or GradDipAppStat or MActPrac) and (STAT806 or STAT810)) or (admission to MSc or MInfoTech)
Co-badged status Co-badged status
Unit description Unit description
This unit offers students the opportunity to study some modern computational methods in statistics. The first half of the unit covers maximum likelihood computations, Bayesian computations using Monte Carlo methods, missing data and the EM algorithm. The second half considers Kernel density estimation, Kernel regression, quantile regression and inferences using Monte-Carlo and bootstrapping methods. The computing software MATLAB, R and WinBUGS are used.

Important Academic Dates

Information about important academic dates including deadlines for withdrawing from units are available at https://www.mq.edu.au/study/calendar-of-dates

Learning Outcomes

On successful completion of this unit, you will be able to:

  • Ability to compute maximum likelihood and Bayesian estimates
  • Ability to make inferences using these estimates
  • Know how to deal with missing data and use the EM algorithm
  • Compute nonparametric estimators of probability density function
  • Compute nonparametric estimators of regression function and smoothed quantile regression
  • Understand Monte-Carlo inferential statistics and understand bootstrappping estimates of bias, variance and CI computations
  • Gain proficiency in Matlab and R

Assessment Tasks

Name Weighting Hurdle Due
Assignment 1 20% No week 6 lecture
Assignment 2 20% No week 13 lecture
Take home exam 30% No 10am, June 12
Written exam 30% No TBA

Assignment 1

Due: week 6 lecture
Weighting: 20%

 

This assignment covers weeks 1 - 6 materials. Assignments comprise a major part of the learning process. Late submissions without approval will be penalized at a rate of 20% deduction per day. Assignments must be each student’s own work. Discussions are allowed but the final work must be your personal effort. We prefer that assignments are word-processed.


On successful completion you will be able to:
  • Ability to compute maximum likelihood and Bayesian estimates
  • Ability to make inferences using these estimates
  • Know how to deal with missing data and use the EM algorithm
  • Understand Monte-Carlo inferential statistics and understand bootstrappping estimates of bias, variance and CI computations
  • Gain proficiency in Matlab and R

Assignment 2

Due: week 13 lecture
Weighting: 20%

This assignment covers weeks 7 - 12 materials. For policy on later submission and other issues please see the Assignment 1 description.


On successful completion you will be able to:
  • Compute nonparametric estimators of probability density function
  • Compute nonparametric estimators of regression function and smoothed quantile regression
  • Understand Monte-Carlo inferential statistics and understand bootstrappping estimates of bias, variance and CI computations
  • Gain proficiency in Matlab and R

Take home exam

Due: 10am, June 12
Weighting: 30%

This take home exam covers the teaching materials from week 1 to week 13 and it will be available on iLearn from 10am on Friday 9 June 2017. Your answers to this exam must be submitted electronically (by email) to A/Prof Jun Ma by 10am Monday 12 June 2017. Your answers should be word processed. Matlab/R and WinBUGS codes written to answer the exam questions should also be included as an attachment. This take home exam must be submitted on time. Any later submissions without prior approval will NOT be accepted.


On successful completion you will be able to:
  • Ability to compute maximum likelihood and Bayesian estimates
  • Ability to make inferences using these estimates
  • Know how to deal with missing data and use the EM algorithm
  • Compute nonparametric estimators of probability density function
  • Compute nonparametric estimators of regression function and smoothed quantile regression
  • Understand Monte-Carlo inferential statistics and understand bootstrappping estimates of bias, variance and CI computations
  • Gain proficiency in Matlab and R

Written exam

Due: TBA
Weighting: 30%

This is a 2-hour supervised exam and it will cover the lecture materials from week 1 to week 13. Its date will be within the university Examination Period. 


On successful completion you will be able to:
  • Ability to compute maximum likelihood and Bayesian estimates
  • Ability to make inferences using these estimates
  • Know how to deal with missing data and use the EM algorithm
  • Compute nonparametric estimators of probability density function
  • Compute nonparametric estimators of regression function and smoothed quantile regression
  • Understand Monte-Carlo inferential statistics and understand bootstrappping estimates of bias, variance and CI computations
  • Gain proficiency in Matlab and R

Delivery and Resources

 LECTURES

You are required to attend a 3-hour lecture (and practice) each week; the time and room are:

                       Wednesday             6.00 – 9.00pm          E4B 306 Faculty PC Lab

Prescribed texts

Students should obtain the lecture overheads from iLearn prior to the lecture. The lecture overheads are available module by module.

The following are recommended reading books for this unit

  • Computational Statistics Handbook with MATLAB®, W. L. Martinez and A. R. Martinez, Chapman & Hall. (QA276.4.M272)
  • Local regression and likelihood, C. Loader, Springer-Verlag, 1999. QA276.8 .L6/1999.
  • Quantile Regression, Roger Koenker, Cambridge University Press 2005, 

Unit webpage

Unit webpage is located on Moodle at https://ilearn.mq.edu.au.

You can only access the material on Moodle if you are enrolled in the unit. All lecturing materials are available at this webpage.

Teaching and Learning Strategy

The unit is taught in both traditional mode and external mode. In traditional mode, students are on campus in standard semesters with weekly lectures. In external mode, students access all teaching material from iLearn and do not attend lectures on campus.

Students are expected to

·         attend all the lectures if enrolled internally;

·         have read through the material to be covered using the lecture notes provided on iLearn;

·         submit assignments due in weeks 6 and 12 to the appropriate lecturer;

·         contact the unit convenor in advance if for any reason, you cannot hand in your assessment tasks on time;

·         collect their marked assessment from the lecturer during the lecture if enrolled internally. External students will have their marked assessment sent to them.

Refer to end of this handout for a week-by-week list of topics to be covered in this unit.  

EXAMINATIONS

If you notify the University of your disruption to studies for your final examination, you must make yourself available for the week of July 24 – 28, 2017.  If you are not available at that time, there is no guarantee an additional examination time will be offered. Specific examination dates and times will be determined at a later date.  

SOFTWARE USED IN TEACHING

We are using MATLAB (or R) and WinBUGS in teaching this unit. R and WinBUGS are free software and are widely used nowadays by statisticians. More information about R can be found at http://www.r-project.org/, and WinBUGS at “http://www.mrc-bsu.cam.ac.uk/bugs/”.  

CHANGES FROM PREVIOUS OFFERINGS

None

Technologies used and required

None

Unit Schedule

 

Unit Schedule

 

Week      

Topic

Software

Assignment

 

 

 

Out

Due

1

Likelihood and maximum likelihood estimates (MLE)

Matlab

 

 

2

Iterative methods for computing MLE

Matlab

 

 

3

Iterative methods for computing MLE (cont.)

Prior and posterior distributions

Matlab

 

 

4

Prior and posterior distributions (cont.)

Bayesian estimates

Bayesian computation: posterior mean

Bayesian computation: posterior mode WinBUGS

Matlab, WinBUGS

Ass 1

 

5

Asymptotic distribution: MLE

Asymptotic distribution: posterior mode

Matlab

 

 

6

Missing data mechanism

Complete data and incomplete data

Inference based on incomplete data

The EM algorithm

Matlab

 

Ass 1

7

Histogram & density estimation

 

Matlab

 

 

 

 

       

8 

Kernel density estimation

 

 

 

9

Kernel regression

 

 

 

10

11

Quantile regression

Monte-Carlo method for inferential statistics Basic procedure Monte-Carlo hypothesis testing

 

 

 Ass 2

 

12

 

 

Bootstrap methods

Bootstrap method of bias Bootstrap estimate of variance Bootstrap confidence intervals

Review

 

 

 

 13

 

 

 

 Ass 2

           

 

Students should read the lecture notes, which will be available at the unit web page, before the lecture.

Policies and Procedures

Macquarie University policies and procedures are accessible from Policy Central. Students should be aware of the following policies in particular with regard to Learning and Teaching:

Academic Honesty Policy http://mq.edu.au/policy/docs/academic_honesty/policy.html

Assessment Policy http://mq.edu.au/policy/docs/assessment/policy_2016.html

Grade Appeal Policy http://mq.edu.au/policy/docs/gradeappeal/policy.html

Complaint Management Procedure for Students and Members of the Public http://www.mq.edu.au/policy/docs/complaint_management/procedure.html​

Disruption to Studies Policy (in effect until Dec 4th, 2017): http://www.mq.edu.au/policy/docs/disruption_studies/policy.html

Special Consideration Policy (in effect from Dec 4th, 2017): https://staff.mq.edu.au/work/strategy-planning-and-governance/university-policies-and-procedures/policies/special-consideration

In addition, a number of other policies can be found in the Learning and Teaching Category of Policy Central.

Student Code of Conduct

Macquarie University students have a responsibility to be familiar with the Student Code of Conduct: https://students.mq.edu.au/support/student_conduct/

Results

Results shown in iLearn, or released directly by your Unit Convenor, are not confirmed as they are subject to final approval by the University. Once approved, final results will be sent to your student email address and will be made available in eStudent. For more information visit ask.mq.edu.au.

Student Support

Macquarie University provides a range of support services for students. For details, visit http://students.mq.edu.au/support/

Learning Skills

Learning Skills (mq.edu.au/learningskills) provides academic writing resources and study strategies to improve your marks and take control of your study.

Student Services and Support

Students with a disability are encouraged to contact the Disability Service who can provide appropriate help with any issues that arise during their studies.

Student Enquiries

For all student enquiries, visit Student Connect at ask.mq.edu.au

IT Help

For help with University computer systems and technology, visit http://www.mq.edu.au/about_us/offices_and_units/information_technology/help/

When using the University's IT, you must adhere to the Acceptable Use of IT Resources Policy. The policy applies to all who connect to the MQ network including students.

Graduate Capabilities

PG - Discipline Knowledge and Skills

Our postgraduates will be able to demonstrate a significantly enhanced depth and breadth of knowledge, scholarly understanding, and specific subject content knowledge in their chosen fields.

This graduate capability is supported by:

Learning outcomes

  • Ability to compute maximum likelihood and Bayesian estimates
  • Ability to make inferences using these estimates
  • Know how to deal with missing data and use the EM algorithm
  • Compute nonparametric estimators of probability density function
  • Compute nonparametric estimators of regression function and smoothed quantile regression
  • Understand Monte-Carlo inferential statistics and understand bootstrappping estimates of bias, variance and CI computations
  • Gain proficiency in Matlab and R

Assessment tasks

  • Assignment 1
  • Assignment 2
  • Take home exam
  • Written exam

PG - Critical, Analytical and Integrative Thinking

Our postgraduates will be capable of utilising and reflecting on prior knowledge and experience, of applying higher level critical thinking skills, and of integrating and synthesising learning and knowledge from a range of sources and environments. A characteristic of this form of thinking is the generation of new, professionally oriented knowledge through personal or group-based critique of practice and theory.

This graduate capability is supported by:

Learning outcomes

  • Ability to compute maximum likelihood and Bayesian estimates
  • Ability to make inferences using these estimates
  • Know how to deal with missing data and use the EM algorithm
  • Compute nonparametric estimators of probability density function
  • Compute nonparametric estimators of regression function and smoothed quantile regression
  • Understand Monte-Carlo inferential statistics and understand bootstrappping estimates of bias, variance and CI computations
  • Gain proficiency in Matlab and R

Assessment tasks

  • Assignment 1
  • Assignment 2
  • Take home exam
  • Written exam

PG - Research and Problem Solving Capability

Our postgraduates will be capable of systematic enquiry; able to use research skills to create new knowledge that can be applied to real world issues, or contribute to a field of study or practice to enhance society. They will be capable of creative questioning, problem finding and problem solving.

This graduate capability is supported by:

Learning outcomes

  • Ability to compute maximum likelihood and Bayesian estimates
  • Ability to make inferences using these estimates
  • Know how to deal with missing data and use the EM algorithm
  • Compute nonparametric estimators of probability density function
  • Compute nonparametric estimators of regression function and smoothed quantile regression
  • Understand Monte-Carlo inferential statistics and understand bootstrappping estimates of bias, variance and CI computations
  • Gain proficiency in Matlab and R

Assessment tasks

  • Assignment 1
  • Assignment 2
  • Take home exam
  • Written exam

PG - Effective Communication

Our postgraduates will be able to communicate effectively and convey their views to different social, cultural, and professional audiences. They will be able to use a variety of technologically supported media to communicate with empathy using a range of written, spoken or visual formats.

This graduate capability is supported by:

Assessment tasks

  • Assignment 1
  • Assignment 2
  • Take home exam