OpenClinical logo

Information Visualization

Information Visualization

Preamble
Information Visualization (often abbreviated to InfoVis or IV) is concerned with the development of interactive visual representations of abstract, multidimensional data, information and knowledge to help users gain a deeper understanding of the contents of a domain by revealing, for example, new insights, previously unknown facts and relationships or explanations for complex situations.
Definitions

"The use of computer-supported, interactive, visual representations of abstract data to amplify cognition" [Card et al, 1998].

spacer

"Visual representations of the semantics, or meaning, of information. In contrast to scientific visualization, information visualization typically deals with non-numeric, non-spatial, and high-dimensional data" [Chen, 2005].

spacer

"A method of presenting data or information in non-traditional, interactive graphical forms. By using 2-D or 3-D color graphics and animation, these visualizations can show the structure of information, allow one to navigate through it, and modify it with graphical interactions." [University of Illinois at Urbana-Champaign Digital Libraries Initiative, Glossary]

spacer

"The study of how to effectively present information visually. Much of the work in this field focuses on creating innovative graphical displays for complicated datasets, such as census results, scientific data, and databases. An example problem would be deciding how to display the pages on a website or the files on a hard disk. Visualization techniques include selective hiding of data, layering data, taking advantage of 3-dimensional space, using scaling techniques to provide more space for more important information (e.g. Fisheye views), and taking advantage of psychological principles of layout, such as proximity, alignment, and shared visual properties (e.g. color)." [Usability First, 2003]

Information Visualization and healthcare applications

Growing use of modern information technologies in clinical care is increasing both the amount and complexity of information and data accessible to health professionals. Information Visualization, by providing interactive visual representations of data and information aims to deepen exploration of the "information space", support optimal use of data and information - and help avoid overload.

Chittaro [Chittaro, 2001 ] summarises some of the goals of InfoVis technologies for healthcare:
  1. To allow "users to explore available data at various levls of abstraction"
  2. To give "users a greater sense of engagement with data"
  3. To give "users a deeper understanding of data"
  4. To encourage "the discovery of details and relations which would be difficult to notice otherwise"
  5. To support "the recognition of relevant patterns by exploiting the visual recognition capabilities of users."

Visualization tools have been used in the medical domain for some years. The majority of applications have been in the field of scientific visualization, for example 3D volume visualization tasks, x-rays, computer tomography visualizations. Tasks involving abstract data (such as patient data, treatment data or lab results) or computerised guideline plans have however not been targeted by InfoVis researchers until quite recently.

Current work

Current research into the use of Information Visualization in guideline-based care focuses on support for the knowledge acquisition process (the authoring of computer-interpretable guidelines and protocols) and on ways to help explore plans and monitor and communicate plan execution (over time).

Other work is centred on the visualization of data, particularly temporal data.

A number of research groups developing guideline authoring and execution methods are working on visualization tools (see below) designed to facilitate and extend use of their technologies and highlight their potential benefits. For example, the Technical University of Vienna is working on a range of tools designed to make Asbru more accessible to physicians who would typically have had no training in formal methods. AsbruView, for example, is a tool based on visual metaphors designed to give a user an overview of an Asbru plan hierarchy and to help make Asbru concepts understandable to physicians.

Information visualisation projects for healthcare include:
  • KNAVE (Knowledge-based Navigation of Abstractions for Visualization and Explanation): KNAVE II is a tool that supports the visualization, summarising, (intelligent) interpretation, explanation and context-sensitive navigation of time-oriented raw clinical data sets and higher-level concepts abstracted from time-oriented data.
  • DeGeL (Digital electronic Guideline Library) - VisiGuide guideline browsing and visualisation tool
  • AsbruView - provides a 3D visualization of Asbru guideline plans over time; supports the development of guidelines and protocols
  • CareVis (Interactive visualization methods to support protocol-based care) - supports visualization of Asbru plan execution and monitoring
  • AsbruFlow (part of CareVis) - tool to help communicate the content and logic of Asbru treatment plans to medical domain experts.
  • TimeViz: Interactive information visualization to explore temporal data
  • Midgaard: Connecting Time-Oriented Data and Information to a Coherent Interactive Visualization
  • Gravi++ (in2vis project - Interactive Information Visualization) - supports patient data visualization

  • The GLARE knowledge acquisition tool; the Guide Editor; Protégé - support for the development of guidelines and protocols
Issues
  • Performance - very large datasets
  • Scalability
  • Usability
  • Defining methods for and undertaking evaluation studies
  • Heterogenous data
  • Uncertainty
  • Missing and/or noisy data
  • Combining analytical and visual methods
  • Creating computerised visual methaphors
references: general

Card, S. and Mackinlay, J. and Shneiderman, B. (1998). Readings in Information Visualization: Using Vision to Think, Morgan Kaufmann.

Chen, C. Information Visualization - Beyond the Horizon, Springer, 2004.

Spence, R. Information Visualization, ACM Press, 2000.

Ware, C. Information Visualization - Perception for Design, Morgan Kaufmann, 2004.

spacer

Chen, C. Top 10 Unsolved Information Visualization Problems, IEEE Computer Graphics and Applications, 25(4):12-16, July-Aug. 2005.

[]   []

" The top 10 unsolved problems list described in this article is a revised and extended version of information visualization problems. These problems are not necessarily imposed by technical barriers, rather, they are problems that might hinder the growth of information visualization as a field. The first three problems highlight issues from a user-centered perspective. The fifth, sixth, and seventh problems are technical challenges in nature. The last three are the ones that need tackling at the disciplinary level. The author broadly defines information visualization as visual representations of the semantics, or meaning, of information. In contrast to scientific visualization, information visualization typically deals with nonnumeric, nonspatial, and high-dimensional data. "

Schneiderman B. The eys have it: a task by data type taxonomy for information visualizations. In: Proc IEEE Symposium on Visual Languages 96. Los Alamitos: IEEE Computer Society Press pp336-343, 1996.

]   []

" "

References: Information Visualization in healthcare

Chittaro L. Information visualization and its application to medicine. Artif Intell Med. 2001 May;22(2):81-8.

[PubMed]   []

" This paper provides an introduction to the field of information visualization (IV) and a discussion of its application to medical systems. More specifically, it aims at: (i) defining what IV is and what are its goals (ii) highlighting the similarities and differences between IV and traditional medical imaging (iii) illustrating the potential of IV for medical applications by examining several examples of implemented systems and (iv) giving some general indications about the purposes and the effective exploitation of an IV component into a medical system. "

Shahar Y, Goren-Bar D, Boaz D, Tahan G. Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data and their abstractions. Artif Intell Med. 2005 Dec 9;

[PubMed]   []

" OBJECTIVES: We present KNAVE-II, an intelligent interface to a distributed architecture specific to the tasks of query, knowledge-based interpretation, summarization, visualization, interactive exploration of large numbers of distributed time-oriented clinical data, and dynamic sensitivity analysis of these data. KNAVE-II main contributions to the fields of temporal reasoning and intelligent user interfaces are: (1) the capability for interactive computation and visualization of domain specific temporal abstractions, supported by ALMA - a computational engine that applies the domain knowledge base to the clinical time-oriented database. (2) Semantic (ontology-based) navigation and exploration of the data, knowledge, and temporal abstractions, supported by the IDAN mediator, a distributed architecture that enables runtime access to domain-specific knowledge bases that are maintained by expert physicians. METHODS AND MATERIALS: KNAVE-II was designed according to 12 requirements that were defined through iterative cycles of design and user-centered evaluation. The complete architecture has been implemented and evaluated in a cross-over study design that compared the KNAVE-II module versus two existing methods: paper charts and an Excel electronic spreadsheet. A small group of clinicians answered the same queries, using the domain of oncology and a set of 1000 patients followed after bone-marrow transplantation. RESULTS: The results show that users are able to perform medium to hard difficulty level queries faster and more accurately by using KNAVE-II than paper charts and Excel. Moreover, KNAVE-II was ranked first in preference by all users, along all usability dimensions. CONCLUSIONS: Initial evaluation of KNAVE-II and its supporting knowledge based temporal-mediation architecture, by applying it to a large data base of patients monitored several years after bone marrow transplantation (BMT), has produced highly encouraging results. "

Shahar Y, Boaz D, Tahan G et al. A Web-Based system for interactive visualization and exploration of time-oriented clinical data and their abstractions. AMIA Annu Symp Proc. 2003;:1073.

[PubMed]   []

" In this theater-style demonstration, the speakers will demonstrate KNAVE-II, a Web-based distributed system for interactive visualization and exploration of large amounts of time-oriented clinical data from multiple sources, and of clinically meaningful concepts (abstractions) derivable from these data. The KNAVE-II system and its complete underlying architecture provide a solution to the data overload problem. "

Shahar Y, Goren-Bar D, Galperin M, Boaz D, and Tahan G. KNAVE-II: A distributed architecture for interactive visualization and intelligent exploration of time-oriented clinical data. The 7th International Workshop on Intelligent Data Analysis in Medicine and Pharmacology (IDAMAP-2003), pp. 103-110, Protaras, Cyprus, Oct. 2003.

[BGU]   []

Abstract " Interpretation and exploration of longitudinal clinical data is a major part of diagnosis, therapy, quality assessment, and clinical research, particularly for chronic patients. KNAVE-II is an intelligent interface to a distributed architecture specific to the tasks of query, knowledge-based interpretation, summarization, visualization, interactive exploration of large numbers of distributed time-oriented clinical data and dynamic sensitivity analysis of these data. The web-based architecture enables users (e.g., physicians) to query, visualize and explore clinical time-oriented databases. Both, the generation of context-sensitive interpretations (abstractions) of the time-stamped data, as well as the dynamic visual exploration of the raw data and the multiple levels of concepts abstracted from these data, are supported by runtime access to domain-specific knowledge bases, maintained by domain experts. KNAVE-II was designed according to a set of well-defined desiderata. The architecture enables exploration along both absolute (calendar-based) and relative (clinically meaningful) time-lines. The underlying architecture uses standardized vocabularies (such as a controlled dictionary for laboratory tests and physical observations), and predefined mappings to local data sources, for communication among its various components. Thus, the new framework enables users to access and explore multiple remote heterogeneous databases, without explicitly knowing their local structure and vocabulary, through a filter of a set of task-specific knowledge bases. The complete architecture has been implemented and is currently evaluated by expert clinicians in several medical domains, such as oncology, involving monitoring of chronic patients. "

Shahar Y, Cheng C. Intelligent visualization and exploration of time-oriented clinical data. Top Health Inf Manage. 1999 Nov;20(2):15-31.

[PubMed]   []

" Physicians and other care providers often need to quickly browse and interpret large numbers of time-oriented clinical data. Reducing the information overload involving such tasks is a major goal for medical information systems. We describe a conceptual architecture and software implementation specific to the task of interpretation, summarization, visualization, explanation, and interactive exploration of time-oriented clinical data and the multiple levels of meaningful concepts that can be derived from these data. We build on our work on abstraction of time-oriented clinical data using a knowledge base, acquired from expert physicians, of temporal properties of the data. The core module of the new framework is called KNAVE (Knowledge-based Navigation of Abstractions for Visualization and Explanation). Health care providers can manipulate the display though several visualization and exploration operators. These operators have semantics that are domain independent but that are customized automatically for the application by access to the domain-specific knowledge base. The display, which reflects data and derived interpretations in the patient's database, changes when the user explores key relations (e.g., the dependency hierarchy) in the knowledge base of the relevant clinical domain. Preliminary assessment of the initial prototype with several clinical users has been encouraging. The KNAVE methodology has broad ramifications for reducing the load that large numbers of time-oriented clinical data put on care providers. "

Lanzenberger, M, Miksch, S, and Pohl, M. (2003). The Stardinates - Visualizing Highly Structured Data. In: Proceedings of the IV03, 7th International Conference on Information Visualization, July 16-18, 2003, London, UK, IEEE Computer Science Society, pp. 47-52

[]   [IEEE]

" The Stardinates are a novel interactive Information Visualization (InfoVis) technique which aims at visualizing highly structured data. They represent some Gestalt principles very well, especially the principles of Closure and ’Prägnanz’. As a consequence, Stardinates form very distinct and memorable patterns which make abstraction and aggregation much easier. We give a formal description of the Stardinates as a basis for implementation. Furthermore, we show an application by visualizing psychotherapeutic data derived from a clinical study on anorectic girls. "

Aigner W, Miksch S. CareVis: Integrated Visualization of Computerized Protocols and Temporal Patient Data. Journal of Artificial Intelligence in Medicine, to appear 2006.

[]   []

" Currently, visualization support for patient data analysis is mostly limited to the representation of directly measured data. Contextual information on performed treatment steps is an important source for finding reasons and explanations for certain phenomena in the measured patient data. But this kind of information is mostly spared out in the analysis process. We describe the development of CareVis – interactive visualization methods to integrate and combine classical data visualization with the visualization of treatment information in terms of logic and temporal aspects. We provide multiple simultaneous views to cover different aspects of a complex underlying data structure of treatment plans and patient data. The tightly coupled views use visualization methods well-known to domain experts and are designed to facilitate users’ tasks. The views are based on the concepts of clinical algorithm maps and LifeLines which have been extended in order to cope with the powerful and expressive plan representation language Asbru. The user-centered development approach applied for these interactive visualization methods has been guided by user input gathered via a user study, design reviews, and prototype evaluations. "

Hinum, K, Miksch, S, Aigner et al (2005). Gravi++: Interactive Information Visualization to Explore Highly Structured Temporal Data. Journal of Universal Computer Science, 11:1792–1805.

[]   []

" Tracking and comparing psychotherapeutic data derived from questionnaires involves a large number of highly structured, time-oriented parameters. Descriptive and other statistical methods are only suited for partial analysis. Therefore, we invented a spring-based interactive Information Visualization method for analysing these data more in-depth. With our method the user is able to find new predictors for a positive or negative course of the therapy due to the combination of various visualization and interaction methods. "

Aigner W, Miksch S. Communicating the logic of a treatment plan formulated in Asbru to domain experts. Stud Health Technol Inform. 2004;101:1-15.

[PubMed]   []

" This paper presents an interactive visualization for medical treatment plans that are formulated in the plan representation language Asbru. So far, most attention of the protocol-based care community was focused towards formal guideline representation and authoring partly supported by graphical tools. The intention of this work is to go the opposite way and communicate the logic of a computerized treatment plan to physicians, nursing-, and other medical personnel visually. The visualization is based on the idea of flow-chart algorithms widely used in medical education and practice. This concept has been extended in order to cope with the powerful and expressive guideline representation language Asbru. Furthermore, a number of interactive navigational and overview extensions are used to intuitively support the understanding of the logic of plans. The user-centered development approach applied for these interactive visualization methods has been guided by user input gathered via a user study, design reviews, and prototype evaluations as described in this document. "

Bade, R, Schlechtweg, S, and Miksch, S. (2004). Connecting Time-oriented Data and Information to a Coherent Interactive Visualization. In Proceedings of the 2004 Conference on Human Factors in Computing Systems (CHI04), pages 105-112. ACM Press.

[]   []

" In modern intensive care units (ICUs), the medical staff has to monitor a huge amount of high-dimensional and time-oriented data, which needs to be visualized user- and task-specifically to ease diagnosis and treatment planning. Available visual representations, like diagrams or charts neglect the implicit information as well as a-priory or associated knowledge about the data and its meaning (for example, 38.5°C (101.3°F) is moderate fever and 41°C (105.8°F) is critical fever). Another challenge is to provide appropriate interaction techniques to explore and navigate the data and its temporal dimensions. In this context one major challenge is to connect time-oriented data and information to a coherent interactive visualization. In this paper we present different interactive visualization techniques which enable the users to reveal the data at several levels of detail and abstraction, ranging from a broad overview to the fine structure. We will also introduce a time visualization and navigation technique that connects overview+detail, pan+zoom, and focus+context features to one powerful time-browser. "

W. Aigner, S. Miksch: "Supporting Protocol-Based Care in Medicine via Multiple Coordinated Views"; Presentation: CMV: 2nd International Conference on Coordinated and Multiple Views in Exploratory Visualization, IEEE, London, UK; 07-13-2004; in: "Proceedings International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2004)", IEEE, (2004), ISBN 0-7695-2179-7; 118 - 129.

[]   [Vienna University of Technology]

" Computer supported protocol-based care aims to aid physicians in the treatment process. The main focus of current research is directed towards the formal methods and representations used “behind the scenes” of such systems. This work on the contrary, is situated at the human end of the human-machine chain. We describe the development of interactive visualization methods to support protocol-based care. We provide multiple simultaneous views to cover different aspects of a complex underlying data structure of treatment plans and patient data. The tightly coupled views use visualization methods well-known to domain experts and are designed to facilitate users’ tasks. The views are based on the concepts of clinical algorithm maps and LifeLines which have been extended in order to cope with the powerful and expressive plan representation language Asbru. The user-centered development approach applied for these interactive visualization methods has been guided by user input gathered via a user study, design reviews, and prototype evaluations. "

Kosara R, Miksch S. Visualization methods for data analysis and planning in medical applications. Int J Med Inform. 2002 Dec 18;68(1-3):141-53.

[PubMed]   []

" Time plays an important role in medicine, both the past and the future. The medical history of a patient represents the past, which needs to be understood by the physician to make the right decisions. The past contains two different kinds of information: measured data (such as blood pressure) and incidents (such as seizures). Planning therapies, on the other hand, requires looking into the future to a certain extent. Visual representations exist for both the past and the future, and they are very useful for getting a better understanding of data or a plan. This paper surveys visualization techniques for both data analysis and planning, and compares them based on a number of criteria. "

Kosara R, Miksch S. Metaphors of Movement: A Visualization and User Interface for Time-Oriented, Skeletal Plans, Artificial Intelligence in Medicine, Special Issue: Information Visualization in Medicine, pp. 111-131, 22(2), 2001.

[PubMed]

[paper - AIM]
[U Vienna - Paper]

" Therapy planning plays an increasingly important role in the everyday work of physicians. Clinical protocols or guidelines are typically represented using flow-charts, decision tables, or plain text. These representations are badly suited, however, for complex medical procedures.One representation method that overcomes these problems is the language Asbru. But because Asbru has a LISP-like syntax (and also incorporates many concepts from computer science), it is not suitable for physicians.Therefore, we developed a visualization and user interface to deal with treatment plans expressed in Asbru. We use graphical metaphors to make the underlying concepts easier to grasp, employ glyphs to communicate complex temporal information and colors to make it possible to understand the connection between the two views (Topological View and Temporal View) available in the system.In this paper, we present the design ideas behind AsbruView, and discuss its usefulness based on the results of a usability study we performed with six physicians. "

Kosara R, Miksch S. Visualizing complex notions of time. Medinfo. 2001;10(Pt 1):211-5.

[PubMed]   [kosara.net]

" Time plays an important role in medicine. Conditions are not just evaluated at single instances in time, but traced over periods. Medications must be administered within specified temporal limits, and their effects observed with regard to time. When planning treatments, the temporal aspect becomes even more complicated. The planner has to deal with uncertainty and allowable intervals. A visual representation of the information would be helpful, but there are few visualizations of time that are powerful enough. We present a visualization that graphically represents a complex notion of time, and has also been implemented in a program that allows users to directly specify this information. The results of a small user study are reported. "

Miksch, S. and Kosara, R. (1999). Communicating Time-Oriented, Skeletal Plans to Domain Experts Lucidly. In Bench-Capon, T, Soda, G, and A.M, T, editors, Database and  Expert Systems Applications, Proceedings of the 10th International Conference of Database and Expert  Systems Applications (DEXA99), pages 1041–1051, Berlin. Springer.

[]   []

" Practical planning systems for real-world environments imply a striking challenge, because the planning and visualization techniques available are not that straightforwardly applicable. Skeletal plans are an effective way to reuse existing domain-speciic procedural knowledge, but leave room for execution-time flexibility. However, the basic concepts of skeletal plans are not sufficient in our medical domain. First, the temporal dimensions and variability of plans have to be modelled explicitly. Second, the compositions and the interdependencies of different plans are not lucid to medical domain experts. The aim of our paper is to overcome these limitations and to present an intuitive user interface to the plan-representation language Asbru. We explored different representations and developed a powerful plan visualization, called AsbruView. AsbruView consists of two views, a topological view, which utilizes the metaphor graphics of running tracks and traffic and, second, a temporal view, which utilizes the idea of LifeLines. "

Kosara, R. and Miksch, S. (1999). Visualization Techniques for Time-Oriented, Skeletal Plans in Medical Therapy Planning. In Horn W, Shahar, Y, Lindberg, G, Andreassen, S, and Wyatt, J, editors, Proceedings of the Joint European Conference on Artificial Intelligence in Medicine and Medical Decision Making (AIMDM’99), pages 291–300, Aalborg, Denmark. Springer  Verlag.

[]   []

" In order to utilize elaborate tools and techniques (like verification) for use with clinical protocols, these must be represented in an appropriate way. Protocols are typically represented by means of formal languages (e.g., Asbru), which are very hard to understand for medical experts and lead to many problems in practical use. Therefore, a powerful user interface is needed. We identify the key problems the user-interface designer is faced with, and present a number of classic solutions and their shortcomings - which led to our own solution called AsbruView. Its two different views (Topological View and Temporal View) are presented. "

Plaisant C, Mushlin R, Snyder A, Li J, Heller D, Shneiderman B. LifeLines: using visualization to enhance navigation and analysis of patient records. Proc AMIA Symp. 1998;:76-80.

[PubMed]   []

" LifeLines provide a general visualization environment for personal histories. We explore its use for clinical patient records. A Java user interface is described, which presents a one-screen overview of a computerized patient record using timelines. Problems, diagnoses, test results or medications can be represented as dots or horizontal lines. Zooming provides more details; line color and thickness illustrate relationships or significance. The visual display acts as a giant menu, giving direct access to the data. "

links - general
 bullet  InfoVis:Wiki - the Information Visualization community platform  bullet  infovis.org - Information Visualization Resources  bullet  InfoVis.net - featuring the Digital Magazine Inf@Vis!  bullet  Information Visualization resources at dmoz, the Open Directory
links - information visualisation and healthcare
 bullet  Asbru [OC]  bullet  AsbruView [OC]  bullet  CareVis [OC]  bullet  in2vis project (Interactive Information Visualization) [OC]  bullet  GLARE [OC]  bullet  GUIDE [OC]  bullet  DeGeL (Digital electronic Guideline Library) - includes VisiGuide guideline browsing and visualisation tool [OC]  bullet  KNAVE project [OC]  bullet  Protégé [OC]  bullet  TimeViz (Vienna University of Technology)  bullet  Guideline Overview Tool (Vienna University of Technology)  bullet  MIDGAARD (Vienna University of Technology)
acknowledgements
Wolfgang Aigner, Institute of Software Technology and Interactive Systems, Vienna University of Technology; Department of Information & Knowledge Engineering, Danube University Krems, Austria.
page history
Entry on OpenClinical (v0.1): 14 May 2006
Last main update: 11 June 2006




Search this site
 

Privacy policy User agreement Copyright Feedback

Last modified:
© Copyright OpenClinical 2001-2007