Language of instruction: |
English |
Type of course: |
Non-Departmental Elective |
Course Level: |
Bachelor’s Degree (First Cycle)
|
Mode of Delivery: |
|
Course Coordinator : |
Assoc. Prof. SAEID KARAMZADEH |
Course Lecturer(s): |
Assoc. Prof. ALKAN SOYSAL
|
Recommended Optional Program Components: |
none.......... |
Course Objectives: |
The aim of this course is to understand, in detail, basic information theory and coding theory arguments. Information theoretic analysis covers entropy/mutual information, source and channel coding. Coding theory analysis covers code construction, linear codes, cyclic and convolutional codes, near capacity codes. |
Week |
Subject |
Related Preparation |
1) |
Introduction to basic concepts of information transfer |
|
2) |
Define concepts of entropy, relative entropy, conditional entropy |
|
3) |
Definition of mutual information and its calculation for different scenarios. |
|
4) |
Source coding theorem |
|
5) |
Applications of source coding theorem: Shannon codes, Huffman codes |
|
6) |
Channel coding theorem |
|
7) |
Differential entropy |
|
8) |
Capacity calculations for different channel models. Midterm |
|
9) |
The Gaussian channel and its capacity |
|
10) |
Basics of code construction, Error detection and correction |
|
11) |
Linear block codes |
|
12) |
Cyclic codes |
|
13) |
Convolutional codes |
|
14) |
Near capacity codes |
|
|
Program Outcomes |
Level of Contribution |
1) |
Have sufficient background in mathematics, science and artificial intelligence engineering. |
|
2) |
Use theoretical and applied knowledge in the fields of mathematics, science and artificial intelligence engineering together for engineering solutions. |
|
3) |
Identify, define, formulate and solve engineering problems, select and apply appropriate analytical methods and modeling techniques for this purpose. |
|
4) |
Analyse a system, system component or process and design it under realistic constraints to meet desired requirements; apply modern design methods in this direction. |
|
5) |
Select and use modern techniques and tools necessary for engineering applications. |
|
6) |
Design and conduct experiments, collect data, and analyse and interpret results. |
|
7) |
Work effectively both as an individual and as a multi-disciplinary team member. |
|
8) |
Access information via conducting literature research, using databases and other resources |
|
9) |
Follow the developments in science and technology and constantly update themself with an awareness of the necessity of lifelong learning. |
|
10) |
Use information and communication technologies together with computer software with at least the European Computer License Advanced Level required by their field. |
|
11) |
Communicate effectively, both verbal and written; know a foreign language at least at the European Language Portfolio B1 General Level. |
|
12) |
Have an awareness of the universal and social impacts of engineering solutions and applications; know about entrepreneurship and innovation; and have an awareness of the problems of the age. |
|
13) |
Have a sense of professional and ethical responsibility. |
|
14) |
Have an awareness of project management, workplace practices, employee health, environment and work safety; know the legal consequences of engineering practices. |
|