Daily Note: Intelligent User Interfaces (IUIs)

These notes are a summary of concepts presented in “Intelligent user interfaces: an introduction.”

Mark Maybury. 1998. Intelligent user interfaces: an introduction. In Proceedings of the 4th international conference on Intelligent user interfaces (IUI ’99). Association for Computing Machinery, New York, NY, USA, 3–4. https://doi.org/10.1145/291080.291081

  1. Core Characteristics of Intelligent User Interfaces (IUIs)
    • Contextual sensitivity
      • Adapts to varying contexts, tasks, and users
    • Adaptivity and task assistance
      • Supports semi or fully automated task completion
    • Learnability, Usability, and Transparency
      • Ensures interfaces are intuitive, accessible, and transparent
  2. Input and Output Processing
    • Input analysis
      • Handles imprecise, ambiguous, or partial multimodal input (e.g., gestures, keystrokes, expressions)
    • Output generation
      • Creates cohesive, coordinated multimodal presentations (e.g., text, graphics, speech)
  3. Interaction Management
    • Represents reasoning and exploits models
      • User: Explicit user models for tailored interactions
      • Domain and Task: Context-aware and goal-driven interactions
      • Discourse: Semantic and pragmatic interpretation of multimodal communication
      • Media: Integrated processing of human senses (vision, audition, touch)
  4. Model-Based Design
    • Declarative interface specifications
      • Enables portability, evolution, and automated design critique
    • Knowledge representation
      • Graphical presentation knowledge
      • Reasoning about user expertise, tasks, and context for tailored presentations
  5. Human-Machine Communication
    • Multimodal input and output
      • Parses multimedia input and generates coordinated, coherent multimedia output
      • Maintains consistency across modalities (e.g., spoken language, gesture, gaze)
    • Co-constraining processes
      • Aligns communicative intent, content selection, structuring, and layout
  6. Application Areas and Efficiency Goals
    • Application areas
      • Decision support
      • Training
      • Task coordination
      • Information access/creation
    • Efficiency and effectiveness
      • Faster task completion with reduced effort
      • Context-sensitive interaction tailored to the user and task
      • Supports natural communication modes (spoken, written, gestural)
  7. Agent-Based Interaction
    • Roles of agents
      • Reduce task complexity
      • Provide expert critiquing and task completion
      • Create natural and user-friendly interaction environments
  8. Multimodal Communication
    • Media and modality
      • Modes: Human sensory processing (vision, hearing, touch)
      • Medium: Input/output devices enabling interaction
    • Verbalization and visualization
      • Transformation between text and graphics for improved communication synergy
  9. Evaluation and Adaptation
    • Interaction analysis
      • Evaluates conversational syntax, dialog structure, and emotional intonation
    • User and task models
      • Exploits explicit models for adaptive interaction and tailored content delivery