Description

The objectives of this course are:
1. Developing student skills in Machine Learning and Pattern Classification and Recognition
2. Developing skilled manpower for handling cyber-security projects through machine learning

Contents (Tentative):
===============
Basics and Introduction to Python/Julia
Machine learning basics
Classification and Regression Models: Support Vector Machines, Neural Networks, Random Forests and XGBoost Classifiers
Feature Analysis and Visualization
Clustering
Design of machine learning experiments
Learning Problems: Anomaly Detection, Active Learning
Deep learning
Learning over text and structured data
Semi-supervised and weakly-supervised learning
Ranking, Recommender Systems

Evaluation (tentative)
===============
30% Marks for Final
40% Class Project (in groups)
15% x1 Mid-term
15% Assignments and Quizzes [3 Assignments, 2 Quizzes]
Bonus

General Information

Class Timings
Monday 0930-1100HRS
Friday 1340HRS-1510HRS

Room: B-215
Office Hours
Monday 1100-1130HRS
Friday: 1510-1540HRS
Room: B-216
Or by appointment.

Announcements

Final Exam Structure
5/23/19 11:23 AM

Total Marks: 50

Project marks: 25 (Based on previous project evaluation). However, students will need to answer questions related to projects in the final exam to be given these marks.

Course exam marks: 25 (10 for Neural Networks, 15 for other).

Time: 1.5 hours

Good luck.

Neural Networks (upto sld. 63) has been added to class homepage under Resources
5/23/19 11:02 AM

The teaching staff has posted a new general resource.

Title: Neural Networks (upto sld. 63)
http://www.piazza.com/class_profile/get_resource/jr04f20wksv6ca/jw090jeyz6p51p


You can view it on the course page: https://piazza.com/pieas.edu.pk/spring2019/cis597/resources

Battling unknown malware with machine learning
5/19/19 4:27 AM

I have been looking for commercial cybsec software that utilize ML. Here is one. You can View the talk at: https://www.brighttalk.com/webcast/13507/247091/battling-unknown-malware-with-machine-learning

Your course feedback
5/17/19 10:39 PM

Please provide your feedback at: https://forms.gle/sVKfrN9xTbspNHje8

Thank you.

-F

#pin
Questions in today's class
5/17/19 10:30 PM

  1. What factors control the amount of weight update of a neural network?
  2. What factors can forestall the optimization of a neural network? How can you remedy it?
  3. What is the vanishing gradient problem?
  4. How is a deeper model more efficient for function approximation in comparison to a shallow network?
  5. If deep models are efficient, why do we need GPUs to learn from them?
  6. Why is the optimization of a neural network with a non-convex loss activation function more difficult?
  7. What are the hyper-parameters associated with a neural network? What is the role of each?
  8. How is the addition of multiple layers in a neural network related to the following concepts:
    • Feature transformations
    • Folding of the feature space
    • change of distance metric
    • change of kernel
Tentative Pre-Final Grades
5/16/19 7:36 AM

Here are your grades for the sessional. If there is any discrepancy in your marks, please discuss it with me ASAP and no later than 1100HRS today (Thursday, May 16, 2019). You may want to check the posted grades for different assignments and quizzes etc. to make sure that they have been correctly added in this list. The project will constitute 25% marks in the final as well for a total of 40% of the course as outlined in the initial marks distribution. Please note that these marks are only tentative at this time.

NameMid-termProjectA1A1 BonusA2A3Q1Q2QuestionsTotal BonusSESSIONAL TOTAL
MAX5010010010010010020017850
Weight15155552.52.55
Adiba Yaseen3894100280858595242643
Ali Raza31931000718575100222240
Ameer Abdullah1282902656855110242631
Aqsa Yousuf4676100497919015515916349
Arslan Ahmed3861100479207012514514938
Asfand Yaar349510028180751050241
Earum Mushtaq226050059126075333326
Ezza Ali4480100381819015012612947
Faiza Babar Khan388470069847010515415443
Farooq Rasheed21691003796560110899235
HAFIZ HAMZA JAVED19821000826055100404034
Hafiz Saud Arshad41831002838560140454743
Maria Siddiqua4470100374847513017517846
Muhammad Abdullah Ajmal31806009596095818138
Muhammad Arsalan Paracha2282500088708512112133
Muhammad Bilal169210022370601356832
Muhammad Jehanzaib Hafeez37871002767080115666842
Muhammad Mohsin Zafar311001004647360140596342
Muhammad Shahbaz16931000656980125212135
Muhammad Sheeraz16824007683607513713734
Nasir Ali3173700637155145101034
Noureen Zafar186740035750700022
Tahira Shehzadi2776100360798013512412739
Umm-e-Hani309280080887011517417444
Usama Ahsan3897800757665150121242
Wamiq Rahman1170800805645750027
#pin
Questions in Projects
5/16/19 6:18 AM

These questions may be included in the final examination for project grade assignment as discussed in the class.

  1. What is Homomorphic Encryption? How is it useful for machine learning?
  2. What is super-resolution imaging? What are its applications?
  3. What is neural voice cloning?
  4. What is meant by tf-idf?
  5. What is "Learning with Rejection"?
  6. What is Reinforcement Learning?
  7. How can a pre-trained neural network be used for feature extraction?
  8. How can you classify attacks in network traffic?
  9. How can template matching be used for object detection in images?
  10. How can you classify software into benign and malware?
  11. What is the role of iid assumption in cross-validation?
  12. What is meant by static and dynamic analysis?
  13. What is a quantum computer?
  14. How can one extract features from textual data?

Project Grades
5/16/19 6:04 AM

Great work everyone! It was difficult to assign top grades. Please complete your outstanding work if any so we can conclude the project. The grades are pretty much final. However, if you feel there is a major discrepancy, please discuss it with me by 1100HRS today (Thursday May 16, 2019).

NameProject IDTech. ConsultationWorkPresentationAttendanceQuestionsTotalFINAL SCALED)Peer-ReviewTo-Do
Weight106020551001000
Adiba Yaseen110010070100089943.8
Ali Raza2100907010010088933.8Discuss results with Sadaf. Submit project folder. See if writing paper is possible.
Ameer Abdullah31007080919077.05823.5Submit Ipython notebook & Project folder.
Aqsa Yousuf4100708070071.5763.8Eval. Sheet not submitted
Arslan Ahmed5205575826057.1613.5Submit project folder.
Asfand Yaar610090851007089.5954.1
Earum Mushtaq770556570056.5602.3Eval. Sheet not submitted. Submit project folder.
Ezza Ali410070801005075.5803.8Submit results over 4X, 8X. Submit project folder. See if writing paper is possible.
Faiza Babar Khan8100858045079.25843.8Redo ROC curves. Show testing over real files. Submit project folder. Discuss combining with Mohsin et al.
Farooq Rasheed56065601007065.5693.5Submit project folder.
HAFIZ HAMZA JAVED91007880100077.8824.5Submit project folder. Show scores for real test files of saud.
Hafiz Saud Arshad310080607310078.65833.5Submit project folder.
Maria Siddiqua570707070066.5703.5Eval. Sheet not submitted
Muhammad Abdullah Ajmal10708085502075.5803.5
Muhammad Arsalan Paracha118075801007077.5823.5Check iid assumption. Show testing over real files. Submit project folder.
Muhammad Bilal1210085851007086.5924.4
Muhammad Jehanzaib Hafeez91008580100082874.5Submit project folder. Show scores for real test files of saud.
Muhammad Mohsin Zafar1310095100829095.61004.5Submit project folder. Show scores for real test files. Discuss combining with Faiza & Hani.
Muhammad Shahbaz9100858510010088934.5Submit project folder. Show scores for real test files of saud.
Muhammad Sheeraz118075801007077.5823.5Check iid assumption. Show testing over real files. Submit project folder.
Nasir Ali13707560100069734.5Submit project folder. Show scores for real test files. Discuss combining with Faiza & Hani.
Noureen Zafar77060653610062.8672.3Submit project folder.
Tahira Shehzadi41007075100072763.8Submit results over 4X, 8X. Submit project folder. See if writing paper is possible.
Umm-e-Hani8100858010010087923.8Redo ROC curves. Show testing over real files. Submit project folder. Discuss combining with Mohsin et al.
Usama Ahsan1410095801007591.75974.8
Wamiq Rahman135070601005066.5704.5Submit project folder. Show scores for real test files. Discuss combining with Faiza & Hani.
Staff Office Hours
NameOffice Hours
Dr. Fayyaz ul Amir Afsar Minhas
When?
Where?
Amina Asif
When?
Where?
Sadaf Gull
When?
Where?

Homework

Homework
Due Date

Homework Solutions

Lecture Notes