INE6105 Stochastic ModelsBahçeşehir UniversityDegree Programs COMPUTER ENGINEERING (ENGLISH, THESIS)General Information For StudentsDiploma SupplementErasmus Policy StatementNational QualificationsBologna Commission
COMPUTER ENGINEERING (ENGLISH, THESIS)
Master TR-NQF-HE: Level 7 QF-EHEA: Second Cycle EQF-LLL: Level 7

Course Introduction and Application Information

Course Code Course Name Semester Theoretical Practical Credit ECTS
INE6105 Stochastic Models Fall
Spring
3 0 3 9
This catalog is for information purposes. Course status is determined by the relevant department at the beginning of semester.

Basic information

Language of instruction: English
Type of course: Departmental Elective
Course Level:
Mode of Delivery: Face to face
Course Coordinator : Dr. Öğr. Üyesi ETHEM ÇANAKOĞLU
Course Lecturer(s): Dr. Öğr. Üyesi ETHEM ÇANAKOĞLU
Recommended Optional Program Components: In the INE undergraduate curriculum, there is a must course named “MATH 3024 Probability and Random Variables” where the fundamental concepts of probability theory and probability distributions are given. In the INE master curriculum, there is a must course named “INE5110 Probabilistic Models and Applications” where the basic and fundamental knowledge of stochastic processes, their types and characteristics and application areas are given. This course will follow up INE5110 and will cover more advanced topics in stochastic models.
Course Objectives: The objective of this course is to develop and extend the knowledge of mathematical techniques underlying the application of probability theory to well known engineering and operations research problems. This PhD level course is intended to cover advanced stochastic models such as Markov processes, Poisson and renewal processes, queueing systems, reliability theory, Brownian motion and stationary processes.

Learning Outcomes

The students who have succeeded in this course;
I. Identify the nature of stochastic models.
II. Develop a model for a probabilistic real-life problem.
III. Solve a constructed stochastic model analytically.
IV. Analyze stochastic processes in real-life.

Course Content

This course is a follow up course on stochastic processes. The predecessor, “IE5110 Probabilistic Models and Applications” is offered in the Industrial Engineering master curriculum as a must course where the basic and fundamental knowledge of stochastic processes are given. This course is also offered as a must course of Industrial Engineering PhD curriculum and is intended to focus on more advanced topics in stochastic models. After gaining knowledge of these topics, the students will be able to explore research and to do PhD theses related with both the theory and applications of the stochastic processes covered in this course.

Weekly Detailed Course Contents

Week Subject Related Preparation
1) Introduction and Review of Basic Processes
2) Stochastic Processes
3) Markov Chains
4) Markov Processes
5) Markov Decision Processes
6) Markov Decision Processes
7) Midterm
8) Introduction to stochastic programming
9) Introduction to stochastic programming
10) Formulating the deterministic equivalent of stochastic programs
11) İki Aşamalı Problem
12) Introduction to Reinforcement Learning
13) Monte Carlo Control
14) Presentations

Sources

Course Notes / Textbooks: Introduction to Probability Models, 10th ed. Sheldon M. Ross. Academic Press, 2010 978-0-12-375686-2

Introduction to Stochastic Processes, Erhan Cinlar, Dover Publications; Reprint edition 2013. 978-0486497976
References: Stochastic Processes, 2nd ed. Sheldon M. Ross. Wiley, 1996 0-471-12062-6

Evaluation System

Semester Requirements Number of Activities Level of Contribution
Attendance 10 % 5
Quizzes 2 % 20
Homework Assignments 5 % 15
Midterms 1 % 25
Final 1 % 35
Total % 100
PERCENTAGE OF SEMESTER WORK % 65
PERCENTAGE OF FINAL WORK % 35
Total % 100

ECTS / Workload Table

Activities Number of Activities Workload
Course Hours 13 37
Study Hours Out of Class 15 104
Homework Assignments 5 40
Quizzes 2 2
Midterms 1 3
Final 1 3
Total Workload 189

Contribution of Learning Outcomes to Programme Outcomes

No Effect 1 Lowest 2 Low 3 Average 4 High 5 Highest
           
Program Outcomes Level of Contribution