Skip to main content
Till KTH:s startsida

DT2140 Multimodal Interaction and Interfaces 7.5 credits

Humans are using multimodality extensively to communicate with each other, either simultaneously (in face-to-face conversations) or alternatively (using speech, writing, gestures, touch). The communication with computers has on the other hand traditionally employed few modalities: the user provides input with keyboard or mouse and the computer responds visually, in the form of text or icons.

This course gives an introduction to new interfaces that can improve the experience or the efficiency of the interaction with computers (such as voice control, sound interaction, gesture recognition, touch screens, haptic feedback, augmented reality).

Information per course offering

Termin

Information for Autumn 2024 mintint programme students

Course location

KTH Campus

Duration
28 Oct 2024 - 13 Jan 2025
Periods
P2 (7.5 hp)
Pace of study

50%

Application code

50270

Form of study

Normal Daytime

Language of instruction

English

Course memo
Course memo is not published
Number of places

Places are not limited

Target group

Open for all programs from year 3, and for students admitted to a master's program, provided that the course can be included in the program.

Planned modular schedule
[object Object]
Part of programme

Contact

Examiner
No information inserted
Course coordinator
No information inserted
Teachers
No information inserted
Contact

Gabriel Skantze, e-post: gabriel@speech.kth.se

Course syllabus as PDF

Please note: all information from the Course syllabus is available on this page in an accessible format.

Course syllabus DT2140 (Autumn 2024–)
Headings with content from the Course syllabus DT2140 (Autumn 2024–) are denoted with an asterisk ( )

Content and learning outcomes

Course contents

The course gives the students theoretical and practical introductions to multi-modal communication and different HCI techniques.

The main focus of the course is on technologies for the transfer of information

- from the user, such as speech recognition, touch screens or tracking of eyes and gestures, and

- from the computer, such as unconventional visual representations, speech synthesis, rendered sounds and haptic feedback.

Particularly, the effects of combining different modalities are considered.

Intended learning outcomes

After passing the course, the student should be able to:

  • describe how alternative or multi-modal HCI interfaces work, that utilise the latest technology
  • evaluate strengths and weaknesses of multi-modal interfaces
  • implement HCI interfaces that use new interaction technologies, for limited tasks
  • suggest efficient design solutions for new interfaces that use different modalities

in order to be able to

  • deepen her/his knowledge of new modalities of interaction in advanced courses
  • exploit multimodality in applied projects
  • choose an appropriate interface for a given task, from HCI and technical perspectives.

Literature and preparations

Specific prerequisites

Knowledge and skills in programming, 6 credtis, corresponding to completed course DD1337/DD1310-DD1319/DD1321/DD1331/DD100N/ID1018.

Recommended prerequisites

Proficiency in human-computer interaction and good programming skills (corresponding e.g. to DD1341 Introduction to Computer Science).

Equipment

No information inserted

Literature

No information inserted

Examination and completion

If the course is discontinued, students may request to be examined during the following two academic years.

Grading scale

A, B, C, D, E, FX, F

Examination

  • INLA - Assignments, 1.5 credits, grading scale: A, B, C, D, E, FX, F
  • LABA - Laboratory Assignments, 1.5 credits, grading scale: P, F
  • PROA - Project, 4.5 credits, grading scale: A, B, C, D, E, FX, F

Based on recommendation from KTH’s coordinator for disabilities, the examiner will decide how to adapt an examination for students with documented disability.

The examiner may apply another examination format when re-examining individual students.

Opportunity to complete the requirements via supplementary examination

No information inserted

Opportunity to raise an approved grade via renewed examination

No information inserted

Examiner

Ethical approach

  • All members of a group are responsible for the group's work.
  • In any assessment, every student shall honestly disclose any help received and sources used.
  • In an oral assessment, every student shall be able to present and answer questions about the entire assignment and solution.

Further information

Course room in Canvas

Registered students find further information about the implementation of the course in the course room in Canvas. A link to the course room can be found under the tab Studies in the Personal menu at the start of the course.

Offered by

Main field of study

Computer Science and Engineering

Education cycle

Second cycle

Add-on studies

  •  DH2323 Computer Graphics and Interaction
  •  DT2112 Speech Technology
  •  DT2300 Sound in Interaction
  •  DT2213 Musical Communication and Music Technology
  •  DH2660 Haptics

Contact

Gabriel Skantze, e-post: gabriel@speech.kth.se

Supplementary information

In this course, the EECS code of honor applies, see:
http://www.kth.se/en/eecs/utbildning/hederskodex