EEE5600 Introduction to Information and Coding TheoryBahçeşehir UniversityDegree Programs MEDICINEGeneral Information For StudentsDiploma SupplementErasmus Policy StatementNational QualificationsBologna Commission
MEDICINE
Bachelor TR-NQF-HE: Level 6 QF-EHEA: First Cycle EQF-LLL: Level 6

Course Introduction and Application Information

Course Code Course Name Semester Theoretical Practical Credit ECTS
EEE5600 Introduction to Information and Coding Theory Spring 3 0 3 12
This catalog is for information purposes. Course status is determined by the relevant department at the beginning of semester.

Basic information

Language of instruction: English
Type of course: Non-Departmental Elective
Course Level: Bachelor’s Degree (First Cycle)
Mode of Delivery:
Course Coordinator : Assoc. Prof. SAEID KARAMZADEH
Course Lecturer(s): Assoc. Prof. ALKAN SOYSAL
Recommended Optional Program Components: none..........
Course Objectives: The aim of this course is to understand, in detail, basic information theory and coding theory arguments. Information theoretic analysis covers entropy/mutual information, source and channel coding. Coding theory analysis covers code construction, linear codes, cyclic and convolutional codes, near capacity codes.

Learning Outcomes

The students who have succeeded in this course;
1. Understand basic concepts and definitions of information theory
2. Know and apply source and channel coding theorems
3. Gain knowledge on code constructions
4. Understand basic concepts of coding theory
5. Apply modern error correcting codes

Course Content

This course covers basics of information theory and coding theory. The course starts with definitions of information theoretic quantities such as entropy, mutual information, etc. It covers Shannon's source coding theorem and explains Shannon codes and Huffman codes. Then Shannon's channel coding theorem is analyzed and capacity values of several channels are calculated. In the second half of the course, basic code construction methods are explained. Linear codes, cyclic codes, convolutional codes are introduced.

Weekly Detailed Course Contents

Week Subject Related Preparation
1) Introduction to basic concepts of information transfer
2) Define concepts of entropy, relative entropy, conditional entropy
3) Definition of mutual information and its calculation for different scenarios.
4) Source coding theorem
5) Applications of source coding theorem: Shannon codes, Huffman codes
6) Channel coding theorem
7) Differential entropy
8) Capacity calculations for different channel models. Midterm
9) The Gaussian channel and its capacity
10) Basics of code construction, Error detection and correction
11) Linear block codes
12) Cyclic codes
13) Convolutional codes
14) Near capacity codes

Sources

Course Notes / Textbooks: Thomas and Cover, "Elements of Information Theory", 2nd Edition, Wiley.
References: none..........

Evaluation System

Semester Requirements Number of Activities Level of Contribution
Project 1 % 30
Midterms 1 % 30
Final 1 % 40
Total % 100
PERCENTAGE OF SEMESTER WORK % 30
PERCENTAGE OF FINAL WORK % 70
Total % 100

ECTS / Workload Table

Activities Number of Activities Workload
Course Hours 14 42
Project 4 50
Midterms 8 60
Final 4 48
Total Workload 200

Contribution of Learning Outcomes to Programme Outcomes

No Effect 1 Lowest 2 Low 3 Average 4 High 5 Highest
           
Program Outcomes Level of Contribution
1) Integrates the knowledge, skills and attitudes acquired from basic and clinical medical sciences, behavioral sciences and social sciences, and uses them in health service delivery.
2) In patient management, shows a biopsychosocial approach that takes into account the socio-demographic and sociocultural background of the individual, regardless of language, religion, race and gender.
3) In the provision of health services, prioritizes the protection and development of the health of individuals and society.
4) Taking into account the individual, societal, social and environmental factors affecting health; does the necessary work to maintain and improve the state of health.
5) By recognizing the characteristics, needs and expectations of the target audience, provides health education to healthy/sick individuals and their relatives and other healthcare professionals.
6) Shows a safe, rational and effective approach in health service delivery, prevention, diagnosis, treatment, follow-up and rehabilitation processes.
7) Performs invasive and/or non-invasive procedures in diagnosis, treatment, follow-up and rehabilitation processes in a safe and effective way for the patient.
8) Provides health services by considering patient and employee health and safety.
9) In the provision of health services, takes into account the changes in the physical and socioeconomic environment on a regional and global scale, as well as the changes in the individual characteristics and behaviors of the people who apply to it.
10) Takes good medical practice into account while carrying out his/her profession.
11) Fulfills its duties and obligations within the framework of ethical principles, rights and legal responsibilities required by its profession.
12) Demonstrates decisive behavior in providing high-quality health care, taking into account the integrity of the patient.
13) Evaluates his/her performance in his/her professional practice by considering his/her emotions and cognitive characteristics.
14) Advocates improving the provision of health services by considering the concepts of social reliability and social responsibility for the protection and development of public health.
15) Can plan and carry out service delivery, training and consultancy processes related to individual and community health in cooperation with all components for the protection and development of health.
16) Evaluates the impact of health policies and practices on individual and community health indicators and advocates increasing the quality of health services.
17) The physician attaches importance to the protection of his/her own physical, mental and social health, and does what is necessary for this
18) Shows exemplary behavior and leads the healthcare team during service delivery.
19) Uses resources cost-effectively, for the benefit of society and in accordance with the legislation, in the planning, implementation and evaluation processes of health services in the health institution he/she is the manager of.
20) Establishes positive communication within the health team it serves and assumes different team roles when necessary.
21) Is aware of the duties and responsibilities of the health workers in the health team and acts accordingly.
22) In the professional practices, works in harmony and effectively with the colleagues and other professional groups.
23) Communicates effectively with patients, their relatives, healthcare professionals, other professional groups, institutions and organizations.
24) Communicates effectively with individuals and groups that require a special approach and have different socio-cultural characteristics.
25) In the diagnosis, treatment, follow-up and rehabilitation processes, shows a patient-centered approach that associates the patient with the decision-making mechanisms.
26) Plans and implements scientific research, when necessary, for the population it serves, and uses the results and/or the results of other research for the benefit of the society.
27) Reaches and critically evaluates current literature knowledge about his/her profession.
28) Applies the principles of evidence-based medicine in clinical decision making.
29) Uses information technologies to increase the effectiveness of its work on health care, research and education.
30) Effectively manages individual work processes and career development.
31) Demonstrates skills in acquiring and evaluating new knowledge, integrating it with existing knowledge, applying it to professional situations and adapting to changing conditions throughout professional life.
32) Selects the right learning resources to improve the quality of the health service it offers, organizes its own learning process