Schedule - UCSD CSE150A / CSE250A – AI :Probabilistic Models

Assessment Overview

Assessment Type	Due When
6 Homework Assignments	Mondays, Weeks 2-7
2 Tests	Weeks 4 & 8
1 Mini-Project	Mon, Nov 17, Week 8
1 Final Project	Thu, Dec 11, at 5:59 PM PT _{3 milestones due weekly on Mondays Weeks 8-10}

Week 0¶

Week of Sep 22

📖 Lectures

Day	Lecture	Topic	Optional Resources
Thu, Sep 25	Lecture 1 pdf	Admin, Course Overview, Review of Probability	ThinkBayesCh1

Day

Lecture

Topic

Optional Resources

Thu, Sep 25

Lecture 1

pdf

Admin, Course Overview, Review of Probability

ThinkBayesCh1

📝 Assessments

No assessments this week.

Week 1¶

Week of Sep 29

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Sep 30	Lecture 2 pdf annotated pdf	Review of Probability contd.	Poole & Mackworth: 9.1, 9.2
Thu, Oct 2	Lecture 3 pdf annotated pdf	Belief Networks: from Probabilities to Graphs	Poole & Mackworth: 9.3

📝 Assessments

Released	Due	Assignment
Tue, Sep 30	Mon, Oct 6 by 11:59PM Pacific Time	HW 1
Thu, Oct 2	Discussion pertaining to HW 1 (Video recording, Passcode: *12ywyG9)	Discussion 1

Week 2¶

Week of Oct 6

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Oct 7	Lecture 4 pdf d-sep notes annotated pdf	Conditional independence, D-Separation	Poole and Mackworth 11.1.2, Pearl, Scheines, 📹 D-sep Examples: Video 1, Video 2
Thu, Oct 9	Lecture 5 pdf annotated pdf	Exact Inference - Variable Elimination	Poole and Mackworth 9.5, Murphy - PML: Advanced Topics, Ch9.5, Russell & Norvig AIMA, Ch 13.3 📹 VE Examples: Video

📝 Assessments

Released	Due	Assignment
Tue, Oct 7	Mon, Oct 13 by 11:59PM Pacific Time	HW 2
Wed, Oct 8	Discussion pertaining to HW 2 (Video recording, Passcode: x=L7zAC%)	Discussion 2

Week 3¶

Week of Oct 13

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Oct 14	Lecture 6 pdf	Approximate Inference - Rejection Sampling, Likelihood Weighting	Poole and Mackworth 9.7 📹 Sampling
Thu, Oct 16	Lecture 7	Approximate Inference - MCMC	Poole and Mackworth 9.7.7 📹 Gibbs Example

Day

Lecture

Topic

Optional Resources

Tue, Oct 14

Lecture 6

pdf

Approximate Inference - Rejection Sampling, Likelihood Weighting

Poole and Mackworth 9.7
📹 Sampling

Thu, Oct 16

Lecture 7

Approximate Inference - MCMC

Poole and Mackworth 9.7.7
📹 Gibbs Example

📝 Assessments

Released	Due	Assignment
Mon, Oct 13	Mon, Oct 20 by 11:59PM Pacific Time	HW 3

Week 4¶

Week of Oct 20

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Oct 21	Lecture 8	Learning in Bayes Nets - Maximum Likelihood Estimation
Thu, Oct 23	Lecture 9	Latent variable models - Expectation Maximization, EM Example

Day

Lecture

Topic

Optional Resources

Tue, Oct 21

Lecture 8

Learning in Bayes Nets - Maximum Likelihood Estimation

Thu, Oct 23

Lecture 9

Latent variable models - Expectation Maximization, EM Example

📝 Assessments

Released	Due	Assignment
Tue, Oct 21	Mon, Oct 27 by 11:59PM Pacific Time	HW 4

Week 5¶

Week of Oct 27

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Oct 28	Lecture 10	EM Application, Estimating Noisy-OR parameters with EM
Thu, Oct 30	Lecture 11	Hidden Markov Models (HMMs), Viterbi

Day

Lecture

Topic

Optional Resources

Tue, Oct 28

Lecture 10

EM Application, Estimating Noisy-OR parameters with EM

Thu, Oct 30

Lecture 11

Hidden Markov Models (HMMs), Viterbi

📝 Assessments

Released	Due	Assignment
Tue, Oct 28	Mon, Nov 3 by 11:59PM Pacific Time	HW 5

Week 6¶

Week of Nov 3

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Nov 4	Lecture 12	HMMs - Forward, Forward-Backward
Thu, Nov 6	Lecture 13	HMMs - Learning

Day

Lecture

Topic

Optional Resources

Tue, Nov 4

Lecture 12

HMMs - Forward, Forward-Backward

Thu, Nov 6

Lecture 13

HMMs - Learning

📝 Assessments

Released	Due	Assignment
Tue, Nov 4	Mon, Nov 10 by 11:59PM Pacific Time	HW 6
Tue, Nov 4	Mon, Nov 17 by 11:59PM Pacific Time	Mini-Project

Released

Due

Assignment

Tue, Nov 4

Mon, Nov 10 by 11:59PM Pacific Time

HW 6

Tue, Nov 4

Mon, Nov 17 by 11:59PM Pacific Time

Mini-Project

Week 7¶

Week of Nov 10

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Nov 11		NO CLASS - Veteran’s Day
Thu, Nov 13	Lecture 14	Reinforcement Learning (RL), Markov Decision Processes

Day

Lecture

Topic

Optional Resources

Tue, Nov 11

NO CLASS - Veteran’s Day

Thu, Nov 13

Lecture 14

Reinforcement Learning (RL), Markov Decision Processes

📝 Assessments

Released	Due	Assignment
Mon, Nov 10	Milestone 1: Mon, Nov 17 by 11:59PM Pacific Time Milestone 2: Mon, Nov 24 by 11:59PM Pacific Time Milestone 3: Mon, Dec 1 by 11:59PM Pacific Time Final: Thu, Dec 11 by 5:59PM Pacific Time	Final Project

Released

Due

Assignment

Mon, Nov 10

Milestone 1: Mon, Nov 17 by 11:59PM Pacific Time

Milestone 2: Mon, Nov 24 by 11:59PM Pacific Time

Milestone 3: Mon, Dec 1 by 11:59PM Pacific Time

Final: Thu, Dec 11 by 5:59PM Pacific Time

Final Project

Week 8¶

Week of Nov 17

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Nov 18	Lecture 15	Value Functions, Policy Evaluation, Improvement
Thu, Nov 20	Lecture 16	Planning in MDPs, Policy Iteration, Value Iteration

Day

Lecture

Topic

Optional Resources

Tue, Nov 18

Lecture 15

Value Functions, Policy Evaluation, Improvement

Thu, Nov 20

Lecture 16

Planning in MDPs, Policy Iteration, Value Iteration

📝 Assessments

Released	Due	Assignment
Mon, Nov 10	Mon, Nov 17 by 11:59PM Pacific Time	Project Milestone 1 Due

Week 9¶

Week of Nov 24

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Nov 25	Lecture 17	RL - Temporal Difference Learning
Thu, Nov 27		NO CLASS - Thanksgiving

Day

Lecture

Topic

Optional Resources

Tue, Nov 25

Lecture 17

RL - Temporal Difference Learning

Thu, Nov 27

NO CLASS - Thanksgiving

📝 Assessments

Released	Due	Assignment
Mon, Nov 10	Mon, Nov 24 by 11:59PM Pacific Time	Project Milestone 2 Due

Week 10¶

Week of Dec 1

📖 Lectures

Day	Lecture	Topic	Optional Resources
Tue, Dec 2	Lecture 18	RL - Q-learning
Thu, Dec 4	Lecture 19	Wrap Up

Day

Lecture

Topic

Optional Resources

Tue, Dec 2

Lecture 18

RL - Q-learning

Thu, Dec 4

Lecture 19

Wrap Up

📝 Assessments

Released	Due	Assignment
Mon, Nov 10	Mon, Dec 1 by 11:59PM Pacific Time	Project Milestone 3 Due

Finals Week¶

Week of Dec 8

CSE150A / CSE250A

Syllabus