|
Information Visualization
|
| Preamble |
Information Visualization (often abbreviated to InfoVis or IV) is concerned with the development of interactive visual
representations of abstract, multidimensional data, information and knowledge
to help users gain a deeper understanding of the contents of a domain by revealing, for example, new insights,
previously unknown facts and relationships or explanations for complex situations.
|
| Definitions |
"The use of computer-supported, interactive, visual representations of abstract data to
amplify cognition" [Card et al, 1998].
"Visual representations of the semantics, or meaning, of information.
In contrast to scientific visualization, information visualization typically deals with
non-numeric, non-spatial, and high-dimensional data" [Chen, 2005].
"A method of presenting data or information in non-traditional, interactive graphical
forms. By using 2-D or 3-D color graphics and animation, these visualizations can show the
structure of information, allow one to navigate through it, and modify it with graphical
interactions." [University of Illinois at Urbana-Champaign Digital Libraries Initiative, Glossary]

"The study of how to effectively present information visually. Much of the work
in this field focuses on creating innovative graphical displays for complicated datasets,
such as census results, scientific data, and databases. An example problem would be
deciding how to display the pages on a website or the files on a hard disk. Visualization
techniques include selective hiding of data, layering data, taking advantage of 3-dimensional
space, using scaling techniques to provide more space for more important information
(e.g. Fisheye views), and taking advantage of psychological principles of layout, such
as proximity, alignment, and shared visual properties (e.g. color)."
[Usability First, 2003]
|
| Information Visualization and healthcare applications |
Growing use of modern information technologies
in clinical care is increasing both the amount
and complexity of information and data accessible to health professionals.
Information Visualization, by providing interactive visual representations of data and information
aims to deepen exploration of the "information space", support optimal use of data and information - and help avoid overload.
Chittaro [Chittaro, 2001
] summarises some of the goals of InfoVis technologies for healthcare:
- To allow "users to explore available data at various levls of abstraction"
- To give "users a greater sense of engagement with data"
- To give "users a deeper understanding of data"
- To encourage "the discovery of details and relations which would be difficult to notice otherwise"
- To support "the recognition of relevant patterns by exploiting the visual recognition capabilities
of users."
Visualization tools have been used in the medical domain for some years. The majority
of applications have been in the field of scientific visualization, for example 3D volume
visualization tasks, x-rays, computer tomography visualizations.
Tasks involving abstract data (such as
patient data, treatment data or lab results) or computerised guideline plans have
however not been targeted by InfoVis researchers until quite recently.
|
| Current work |
Current research into the use of Information Visualization in
guideline-based care focuses on support for the knowledge acquisition process
(the authoring of computer-interpretable guidelines and protocols)
and on ways to help explore plans and monitor and communicate plan execution (over time).
Other work is centred on the
visualization of data, particularly temporal data.
A number of research groups developing guideline authoring and execution
methods are working on visualization tools (see below) designed to
facilitate and extend use of their technologies and highlight their potential benefits.
For example, the Technical University of Vienna is working on a range of tools
designed to make Asbru more accessible to physicians who would typically have had no training in formal methods.
AsbruView, for example, is a tool based on visual metaphors designed to give a user
an overview of an Asbru plan hierarchy and to help
make Asbru concepts understandable to physicians.
Information visualisation projects for healthcare include:
- KNAVE (Knowledge-based Navigation of Abstractions for Visualization and Explanation): KNAVE II is a tool that supports the visualization, summarising, (intelligent) interpretation, explanation and context-sensitive navigation of time-oriented raw clinical data sets and higher-level concepts abstracted from time-oriented data.
- DeGeL (Digital electronic Guideline Library) - VisiGuide guideline browsing and visualisation tool
- AsbruView - provides a 3D visualization of Asbru guideline plans over time; supports the development of guidelines and protocols
- CareVis (Interactive visualization methods to support protocol-based care) - supports visualization of Asbru plan execution and monitoring
- AsbruFlow (part of CareVis) - tool to help communicate the content and logic of Asbru treatment plans to medical domain experts.
- TimeViz: Interactive information visualization to explore temporal data
- Midgaard: Connecting Time-Oriented Data and Information to a Coherent Interactive Visualization
- Gravi++ (in2vis project - Interactive Information Visualization) - supports patient data visualization
- The GLARE knowledge acquisition tool; the Guide Editor; Protégé - support for the development of guidelines and protocols
|
| Issues |
- Performance - very large datasets
- Scalability
- Usability
- Defining methods for and undertaking evaluation studies
- Heterogenous data
- Uncertainty
- Missing and/or noisy data
- Combining analytical and visual methods
- Creating computerised visual methaphors
|
| references: general |
|
Card, S. and Mackinlay, J. and Shneiderman, B. (1998). Readings in Information Visualization: Using Vision to Think, Morgan Kaufmann.
Chen, C. Information Visualization - Beyond the Horizon, Springer, 2004.
Spence, R. Information Visualization, ACM Press, 2000.
Ware, C. Information Visualization - Perception for Design, Morgan Kaufmann, 2004.

Chen, C. Top 10 Unsolved Information Visualization Problems, IEEE Computer Graphics and Applications, 25(4):12-16, July-Aug. 2005.
[]
[]
|
"
The top 10 unsolved problems list described in this article is a revised and extended version of information visualization problems. These problems are not necessarily imposed by technical barriers, rather, they are problems that might hinder the growth of information visualization as a field. The first three problems highlight issues from a user-centered perspective. The fifth, sixth, and seventh problems are technical challenges in nature. The last three are the ones that need tackling at the disciplinary level. The author broadly defines information visualization as visual representations of the semantics, or meaning, of information. In contrast to scientific visualization, information visualization typically deals with nonnumeric, nonspatial, and high-dimensional data.
"
|
Schneiderman B.
The eys have it: a task by data type taxonomy for information visualizations.
In: Proc IEEE Symposium on Visual Languages 96. Los Alamitos: IEEE Computer Society Press pp336-343, 1996.
]
[]
|
"
"
|
|
| References: Information Visualization in healthcare |
Chittaro L.
Information visualization and its application to medicine.
Artif Intell Med. 2001 May;22(2):81-8.
[PubMed]
[]
|
"
This paper provides an introduction to the field of information visualization (IV) and a discussion of its application to medical systems. More specifically, it aims at: (i) defining what IV is and what are its goals (ii) highlighting the similarities and differences between IV and traditional medical imaging (iii) illustrating the potential of IV for medical applications by examining several examples of implemented systems and (iv) giving some general indications about the purposes and the effective exploitation of an IV component into a medical system.
"
|
Shahar Y, Goren-Bar D, Boaz D, Tahan G.
Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data and their abstractions.
Artif Intell Med. 2005 Dec 9;
[PubMed]
[]
|
"
OBJECTIVES: We present KNAVE-II, an intelligent interface to a distributed architecture specific to the tasks of query, knowledge-based interpretation, summarization, visualization, interactive exploration of large numbers of distributed time-oriented clinical data, and dynamic sensitivity analysis of these data. KNAVE-II main contributions to the fields of temporal reasoning and intelligent user interfaces are: (1) the capability for interactive computation and visualization of domain specific temporal abstractions, supported by ALMA - a computational engine that applies the domain knowledge base to the clinical time-oriented database. (2) Semantic (ontology-based) navigation and exploration of the data, knowledge, and temporal abstractions, supported by the IDAN mediator, a distributed architecture that enables runtime access to domain-specific knowledge bases that are maintained by expert physicians. METHODS AND MATERIALS: KNAVE-II was designed according to 12 requirements that were defined through iterative cycles of design and user-centered evaluation. The complete architecture has been implemented and evaluated in a cross-over study design that compared the KNAVE-II module versus two existing methods: paper charts and an Excel electronic spreadsheet. A small group of clinicians answered the same queries, using the domain of oncology and a set of 1000 patients followed after bone-marrow transplantation. RESULTS: The results show that users are able to perform medium to hard difficulty level queries faster and more accurately by using KNAVE-II than paper charts and Excel. Moreover, KNAVE-II was ranked first in preference by all users, along all usability dimensions. CONCLUSIONS: Initial evaluation of KNAVE-II and its supporting knowledge based temporal-mediation architecture, by applying it to a large data base of patients monitored several years after bone marrow transplantation (BMT), has produced highly encouraging results.
"
|
| Shahar Y, Boaz D, Tahan G et al.
A Web-Based system for interactive visualization and exploration of time-oriented clinical data and their abstractions.
AMIA Annu Symp Proc. 2003;:1073.
[PubMed]
[]
|
"
In this theater-style demonstration, the speakers will demonstrate KNAVE-II, a Web-based distributed system for interactive visualization and exploration of large amounts of time-oriented clinical data from multiple sources, and of clinically meaningful concepts (abstractions) derivable from these data. The KNAVE-II system and its complete underlying architecture provide a solution to the data overload problem.
" |
|
Shahar Y, Goren-Bar D, Galperin M, Boaz D, and Tahan G.
KNAVE-II: A distributed architecture for interactive visualization
and intelligent exploration of time-oriented clinical data.
The 7th International Workshop on Intelligent Data Analysis in Medicine and Pharmacology
(IDAMAP-2003), pp. 103-110, Protaras, Cyprus, Oct. 2003.
[BGU]
[]
|
Abstract "
Interpretation and exploration of longitudinal clinical data is a major part of diagnosis, therapy, quality
assessment, and clinical research, particularly for chronic patients. KNAVE-II is an intelligent interface
to a distributed architecture specific to the tasks of query, knowledge-based interpretation, summarization,
visualization, interactive exploration of large numbers of distributed time-oriented clinical data and
dynamic sensitivity analysis of these data. The web-based architecture enables users (e.g., physicians) to
query, visualize and explore clinical time-oriented databases. Both, the generation of context-sensitive
interpretations (abstractions) of the time-stamped data, as well as the dynamic visual exploration of the
raw data and the multiple levels of concepts abstracted from these data, are supported by runtime access to
domain-specific knowledge bases, maintained by domain experts. KNAVE-II was designed according to a
set of well-defined desiderata. The architecture enables exploration along both absolute (calendar-based)
and relative (clinically meaningful) time-lines. The underlying architecture uses standardized vocabularies
(such as a controlled dictionary for laboratory tests and physical observations), and predefined mappings
to local data sources, for communication among its various components. Thus, the new framework enables
users to access and explore multiple remote heterogeneous databases, without explicitly knowing their
local structure and vocabulary, through a filter of a set of task-specific knowledge bases. The complete
architecture has been implemented and is currently evaluated by expert clinicians in several medical
domains, such as oncology, involving monitoring of chronic patients.
" |
Shahar Y, Cheng C.
Intelligent visualization and exploration of time-oriented clinical data.
Top Health Inf Manage. 1999 Nov;20(2):15-31.
[PubMed]
[]
|
"
Physicians and other care providers often need to quickly browse and interpret large numbers of time-oriented clinical data.
Reducing the information overload involving such tasks is a major goal for medical information systems. We describe a
conceptual architecture and software implementation specific to the task of interpretation, summarization, visualization,
explanation, and interactive exploration of time-oriented clinical data and the multiple levels of meaningful concepts that
can be derived from these data. We build on our work on abstraction of time-oriented clinical data using a knowledge base,
acquired from expert physicians, of temporal properties of the data.
The core module of the new framework is called KNAVE (Knowledge-based Navigation of Abstractions for Visualization and
Explanation). Health care providers can manipulate the display though several visualization and exploration operators.
These operators have semantics that are domain independent but that are customized automatically for the application by access
to the domain-specific knowledge base. The display, which reflects data and derived interpretations in the patient's database,
changes when the user explores key relations (e.g., the dependency hierarchy) in the knowledge base of the relevant clinical domain. Preliminary assessment of the initial prototype with several clinical users has been encouraging. The KNAVE methodology has broad ramifications for reducing the load that large numbers of time-oriented clinical data put on care providers.
"
|
Lanzenberger, M, Miksch, S, and Pohl, M. (2003). The Stardinates - Visualizing Highly Structured Data.
In: Proceedings of the IV03, 7th International Conference on Information Visualization, July 16-18, 2003, London, UK, IEEE Computer Science Society, pp. 47-52
[]
[IEEE]
|
"
The Stardinates are a novel interactive Information Visualization (InfoVis) technique which aims at visualizing highly structured data. They represent some Gestalt principles very well, especially the principles of Closure and ’Prägnanz’. As a consequence, Stardinates form very distinct and memorable patterns which make abstraction and aggregation much easier. We give a formal description of the Stardinates as a basis for implementation. Furthermore, we show an application by visualizing psychotherapeutic data derived from a clinical study on anorectic girls.
"
|
Aigner W, Miksch S.
CareVis: Integrated Visualization of Computerized Protocols and Temporal Patient Data.
Journal of Artificial Intelligence in Medicine, to appear 2006.
[]
[]
|
"
Currently, visualization support for patient data analysis
is mostly limited to the representation of directly measured
data. Contextual information on performed treatment steps
is an important source for finding reasons and explanations
for certain phenomena in the measured patient data. But this
kind of information is mostly spared out in the analysis process.
We describe the development of CareVis – interactive visualization
methods to integrate and combine classical data
visualization with the visualization of treatment information
in terms of logic and temporal aspects. We provide multiple
simultaneous views to cover different aspects of a complex
underlying data structure of treatment plans and patient
data. The tightly coupled views use visualization methods
well-known to domain experts and are designed to facilitate
users’ tasks. The views are based on the concepts of clinical
algorithm maps and LifeLines which have been extended
in order to cope with the powerful and expressive plan representation
language Asbru.
The user-centered development approach applied for
these interactive visualization methods has been guided by
user input gathered via a user study, design reviews, and prototype
evaluations.
"
|
Hinum, K, Miksch, S, Aigner et al (2005).
Gravi++: Interactive Information Visualization to Explore Highly Structured Temporal Data.
Journal of Universal Computer Science, 11:1792–1805.
[]
[]
|
"
Tracking and comparing psychotherapeutic data
derived from questionnaires involves a large
number of highly structured, time-oriented parameters.
Descriptive and other statistical methods
are only suited for partial analysis. Therefore,
we invented a spring-based interactive Information
Visualization method for analysing
these data more in-depth. With our method the
user is able to find new predictors for a positive
or negative course of the therapy due to the combination
of various visualization and interaction
methods.
"
|
Aigner W, Miksch S.
Communicating the logic of a treatment plan formulated in Asbru to domain experts.
Stud Health Technol Inform. 2004;101:1-15.
[PubMed]
[]
|
"
This paper presents an interactive visualization for medical treatment plans that are formulated in the plan representation language Asbru. So far, most attention of the protocol-based care community was focused towards formal guideline representation and authoring partly supported by graphical tools. The intention of this work is to go the opposite way and communicate the logic of a computerized treatment plan to physicians, nursing-, and other medical personnel visually. The visualization is based on the idea of flow-chart algorithms widely used in medical education and practice. This concept has been extended in order to cope with the powerful and expressive guideline representation language Asbru. Furthermore, a number of interactive navigational and overview extensions are used to intuitively support the understanding of the logic of plans. The user-centered development approach applied for these interactive visualization methods has been guided by user input gathered via a user study, design reviews, and prototype evaluations as described in this document.
"
|
Bade, R, Schlechtweg, S, and Miksch, S. (2004).
Connecting Time-oriented Data and Information to a Coherent Interactive Visualization.
In Proceedings of the 2004 Conference on Human Factors in Computing Systems (CHI04), pages 105-112. ACM Press.
[]
[]
|
"
In modern intensive care units (ICUs), the medical staff has to monitor a huge amount of high-dimensional and time-oriented data, which needs to be visualized user- and task-specifically to ease diagnosis and treatment planning. Available visual representations, like diagrams or charts neglect the implicit information as well as a-priory or associated knowledge about the data and its meaning (for example, 38.5°C (101.3°F) is moderate fever and 41°C (105.8°F) is critical fever). Another challenge is to provide appropriate interaction techniques to explore and navigate the data and its temporal dimensions. In this context one major challenge is to connect time-oriented data and information to a coherent interactive visualization. In this paper we present different interactive visualization techniques which enable the users to reveal the data at several levels of detail and abstraction, ranging from a broad overview to the fine structure. We will also introduce a time visualization and navigation technique that connects overview+detail, pan+zoom, and focus+context features to one powerful time-browser.
"
|
W. Aigner, S. Miksch: "Supporting Protocol-Based Care in Medicine via
Multiple Coordinated Views"; Presentation: CMV: 2nd International
Conference on Coordinated and Multiple Views in Exploratory Visualization,
IEEE, London, UK; 07-13-2004; in: "Proceedings International Conference on
Coordinated and Multiple Views in Exploratory Visualization (CMV 2004)",
IEEE, (2004), ISBN 0-7695-2179-7; 118 - 129.
[]
[Vienna University of Technology]
|
"
Computer supported protocol-based care aims to aid physicians in the treatment process. The main focus of current research is directed towards the formal methods and representations used “behind the scenes” of such systems. This work on the contrary, is situated at the human end of the human-machine chain.
We describe the development of interactive visualization methods to support protocol-based care. We provide multiple simultaneous views to cover different aspects of a complex underlying data structure of treatment plans and patient data. The tightly coupled views use visualization methods well-known to domain experts and are designed to facilitate users’ tasks. The views are based on the concepts of clinical algorithm maps and LifeLines which have been extended in order to cope with the powerful and expressive plan representation language Asbru.
The user-centered development approach applied for these interactive visualization methods has been guided by user input gathered via a user study, design reviews, and prototype evaluations.
"
|
Kosara R, Miksch S.
Visualization methods for data analysis and planning in medical applications.
Int J Med Inform. 2002 Dec 18;68(1-3):141-53.
[PubMed]
[]
|
"
Time plays an important role in medicine, both the past and the future. The medical history of a patient represents the past, which needs to be understood by the physician to make the right decisions. The past contains two different kinds of information: measured data (such as blood pressure) and incidents (such as seizures). Planning therapies, on the other hand, requires looking into the future to a certain extent. Visual representations exist for both the past and the future, and they are very useful for getting a better understanding of data or a plan. This paper surveys visualization techniques for both data analysis and planning, and compares them based on a number of criteria.
"
|
| Kosara R, Miksch S. Metaphors of Movement:
A Visualization and User Interface for Time-Oriented, Skeletal
Plans, Artificial Intelligence in Medicine, Special Issue:
Information Visualization in Medicine, pp. 111-131, 22(2), 2001.
[PubMed]
[paper
- AIM]
[U
Vienna - Paper] |
" Therapy planning plays an increasingly important
role in the everyday work of physicians. Clinical protocols
or guidelines are typically represented using flow-charts, decision
tables, or plain text. These representations are badly suited,
however, for complex medical procedures.One representation method
that overcomes these problems is the language Asbru. But because
Asbru has a LISP-like syntax (and also incorporates many concepts
from computer science), it is not suitable for physicians.Therefore,
we developed a visualization and user interface to deal with
treatment plans expressed in Asbru. We use graphical metaphors
to make the underlying concepts easier to grasp, employ glyphs
to communicate complex temporal information and colors to make
it possible to understand the connection between the two views
(Topological View and Temporal View) available in the system.In
this paper, we present the design ideas behind AsbruView, and
discuss its usefulness based on the results of a usability study
we performed with six physicians. "
|
Kosara R, Miksch S.
Visualizing complex notions of time.
Medinfo. 2001;10(Pt 1):211-5.
[PubMed]
[kosara.net]
|
"
Time plays an important role in medicine. Conditions are not just evaluated at single instances in time, but traced over periods. Medications must be administered within specified temporal limits, and their effects observed with regard to time. When planning treatments, the temporal aspect becomes even more complicated. The planner has to deal with uncertainty and allowable intervals. A visual representation of the information would be helpful, but there are few visualizations of time that are powerful enough. We present a visualization that graphically represents a complex notion of time, and has also been implemented in a program that allows users to directly specify this information. The results of a small user study are reported.
"
|
Miksch, S. and Kosara, R. (1999).
Communicating Time-Oriented, Skeletal Plans to Domain Experts Lucidly.
In Bench-Capon, T, Soda, G, and A.M, T, editors, Database and Expert Systems Applications, Proceedings of the 10th International Conference of Database and Expert Systems Applications (DEXA99), pages 1041–1051, Berlin. Springer.
[]
[]
|
"
Practical planning systems for real-world environments imply a striking challenge, because the planning and visualization
techniques available are not that straightforwardly applicable. Skeletal plans
are an effective way to reuse existing domain-speciic procedural knowledge, but leave room for execution-time
flexibility. However, the basic
concepts of skeletal plans are not sufficient in our medical domain. First,
the temporal dimensions and variability of plans have to be modelled explicitly.
Second, the compositions and the interdependencies of different
plans are not lucid to medical domain experts. The aim of our paper is to
overcome these limitations and to present an intuitive user interface to
the plan-representation language Asbru. We explored different representations and developed a
powerful plan visualization, called AsbruView.
AsbruView consists of two views, a topological view, which utilizes
the metaphor graphics of running tracks and traffic and, second, a
temporal view, which utilizes the idea of LifeLines.
"
|
Kosara, R. and Miksch, S. (1999).
Visualization Techniques for Time-Oriented, Skeletal Plans in Medical Therapy Planning.
In Horn W, Shahar, Y, Lindberg, G, Andreassen, S, and Wyatt, J, editors,
Proceedings of the Joint European Conference on Artificial Intelligence in Medicine and Medical Decision Making (AIMDM’99), pages 291–300, Aalborg, Denmark. Springer Verlag.
[]
[]
|
"
In order to utilize elaborate tools and techniques (like verification) for use with clinical protocols,
these must be represented in an
appropriate way. Protocols are typically represented by means of formal
languages (e.g., Asbru), which are very hard to understand for medical
experts and lead to many problems in practical use. Therefore, a powerful
user interface is needed. We identify the key problems the user-interface
designer is faced with, and present a number of classic solutions and
their shortcomings - which led to our own solution called AsbruView.
Its two different views (Topological View and Temporal View) are presented.
"
|
Plaisant C, Mushlin R, Snyder A, Li J, Heller D, Shneiderman B.
LifeLines: using visualization to enhance navigation and analysis of patient records.
Proc AMIA Symp. 1998;:76-80.
[PubMed]
[]
|
"
LifeLines provide a general visualization environment for personal histories. We explore its use for clinical patient records. A Java user interface is described, which presents a one-screen overview of a computerized patient record using timelines. Problems, diagnoses, test results or medications can be represented as dots or horizontal lines. Zooming provides more details; line color and thickness illustrate relationships or significance. The visual display acts as a giant menu, giving direct access to the data.
"
|
|
| links - general |
|
|
|
| links - information visualisation and healthcare |
|
|
|
| acknowledgements |
| Wolfgang Aigner, Institute of Software Technology and Interactive Systems,
Vienna University of Technology; Department of Information & Knowledge Engineering, Danube University
Krems, Austria. |
| page history |
Entry on OpenClinical (v0.1): 14 May 2006
Last main update: 11 June 2006 |
|
|