面向大数据的信息可视化设计方法研究

项目来源

国家自然科学基金(NSFC)

项目主持人

薛澄岐

项目受资助机构

东南大学

立项年度

2014

立项时间

未公开

项目编号

71471037

项目级别

国家级

研究期限

未知 / 未知

受资助金额

60.00万元

学科

管理科学-管理科学与工程-工业工程与质量管理

学科代码

G-G01-G0108

基金类别

面上项目

关键词

感知分层 ; 信息可视化 ; 人机交互 ; 空间复杂网络 ; 大数据 ; big data ; space complex network ; information visualization ; human-computer interaction ; perception layering

参与者

李雪松;顾兴中;牛亚峰;吴晓莉;周小舟;吴闻宇;邵将;贾木超;李安

参与机构

南京理工大学;中国矿业大学

项目标书摘要:随着计算机技术的发展,以及巨量数据的出现,人类信息感知已经进入"大数据时代"。大数据经过分析和挖掘的黑箱处理,最终会通过计算机终端的数字界面呈现给用户。大数据信息系统最核心价值体现,在于帮助用户建立准确信息感知并高效进行信息交互,对巨量复杂信息分层、快速过滤并高效决策。本项目拟从大数据信息的空间复杂网络结构出发,开展大数据环境下的信息可视化设计方法研究,研究大数据信息流和感知分层的信息过滤方法,获取高维信息的空间复杂结构和信息可视化的设计策略,建立高维信息的可视化结构模型,探讨用户在复杂高维信息交互过程中的生理反应与行为间的内在联系机制和映射关系,保证大数据信息系统性能的全面发挥和精准实施。项目成果对提高大数据信息系统信息设计水平和交互效率,具有重要的战略意义和现实意义,同时也推动和促进了设计科学、思维科学、信息科学、人机工效学与认知神经学科间的交叉融合,具有重大的理论意义和学术价值。

Application Abstract: With the development of computer technology,as well as the emergence of mass information,human information perception has entered the"era of big data."Big data analyze and excavate the data through the big black box,will eventually presented to the user through digital interface of computer terminal.The core value embodiment of big data information system is to help users to establish accurate information perception and efficient information interaction,make fast and efficient decisions by layering and filtering the huge amount of complex information.This project starts from the complex network structure of information space to carry out research on information visualization design method for large data environment,study the big data stream and filtering method of information perception layer to obtain space complex structure of high dimensional information and design strategy for information visualization,set up visual structure model of high dimensional information,explore the intrinsic relationship and mapping relation between physiological response and action mechanism of user in the process of interaction with the high dimensional complex information,will finally ensure comprehensive and accurate implementation of big data information system performance.Deliverables will improve the design level and interactive efficiency of big data information system which has important strategic and realistic meaning,at the same time promote and accelerate the integration between science of design,science of thinking,science of information,human-computer ergonomics and cognitive neuroscience which has important theoretical significance and academic value.

项目受资助省

江苏省

项目结题报告(全文)

项目主要完成了下述工作,并取得了相应研究成果:1、基于图像复杂度的认知机理与设计优化策略研究方向的缺失,提出从大数据认知的源头——视觉复杂度来解决信息可视化设计优化问题。综合研究了信息可视化中“人—机—环”信息传递过程中的内在复杂性机理,提出了认知复杂度的全局概念。分层解析整个认知过程中的复杂度,从信息对象、分层感知加工次序、信息架构网络等多个角度,逐一梳理人—机—环信息加工中所有认知复杂性因素及认知机制。基于认知加工次序分别探讨了:呈现复杂度、语义复杂度、解码复杂度、记忆复杂度,并结合信息编码提出了认知复杂度的分层感知优化策略,系统性地建立了大数据可视化过程中的图像认知复杂度优化方法。2、根据高维数据的实体属性和关联属性,以及界面信息编码维度,编排优化组织形式及层次关系,通过同质聚类界面视觉元素、信息分层过滤及布局、多通道交互式呈现等,达到降维的目的。基于图形认知有效性的研究,对多视觉变量之间的固有干扰对常见的可视化任务(视觉搜索、视觉比较、量级估计)的影响进行系统的实证研究。构建高维特征和可视化任务双因素驱动下的视觉变量组合模型,分析三者之间的内在联系及映射关系,提出高维数据可视化信息排布和信息呈现的优化策略。结合实例,合理应用到典型高维时空数据可视化系统中,如智能交通系统等。3、对界面信息区块的约束条件进行数学表征,生成布局方案的可行解,研究不同信息区块的布局约束。综合研究视觉感知和人的生理、行为反应,在大数据可视化信息呈现的宏观视角上对信息图元关系进行分类描述,探讨图元关系和信息维度之间的关系;在微观视角上阐述了定序和分类的维度表征及双维度的整合—分离规律,结合信息元的关联结构提出以时效熵和质效熵来评价的可视化信息结构的有序度。通过从语义映射的角度对大数据图示信息的进行语义提取,并基于语义内容进行分类,建立可视化的语义空间。4、在分析大数据特征和人的认知行为特征的基础上,提出大数据可视化人机协同作业复杂认知模型。获取大量大数据可视化监控、搜索、决策、操控各类任务行为下的眼动凝视、扫视、眨眼等行为数据以及脑事件相关电位中的不同波幅和潜伏期等生理数据,构建了可用性评价体系,并且首次提出视觉动量这个以眼动追踪数据为基础的复合虚拟指标,实现了对交互式大数据可视化的量化评价分析。

  • 排序方式:
  • 5
  • /
  • 1.Construction Method of User Mental Model in Interaction Design

    • 关键词:
    • Computer programming;Construction method;Emergency monitoring;Emotional design;Information architectures;Interaction design;Mental model construction;Optimization design;Three-layer theories
    • Yang, Bingqing;Wang, Haiyan;Shao, Junkai
    • 《4th International Conference on Intelligent Human Systems Integration, IHSI 2021》
    • 2021年
    • February 22, 2021 - February 24, 2021
    • Palermo, Italy
    • 会议

    Through the analysis of user research methods and the combination of user research methods and the three-layer theory of emotional design, this paper proposes a new mental model construction method, namely the Hierarchical Elicitation Approach. Taking the information architecture design of the emergency monitoring platform as an example, this paper uses the Hierarchical Elicitation Approach to measure the performance rules of users’ minds in the emergency monitoring platform, designs the construction experiments of the macro-mental model and meta-mental model of the system, and optimizes the design according to the experimental results. Moreover, Cogtool is used to analyze the effect of optimization design and verify the application value of the Hierarchical Elicitation Approach in the study of user’s mind.
    © 2021, The Author(s), under exclusive license to Springer Nature Switzerland AG.

    ...
  • 2.Visual Perception Based on Gestalt Theory

    • 关键词:
    • Vision;Dynamic changes;Gestalt psychologies;High application value;Human visual perception;Interface designs;Visual perception;Visual variables;Visualization research
    • Ye, Zhiyuan;Xue, Chenqi;Lin, Yun
    • 《4th International Conference on Intelligent Human Systems Integration, IHSI 2021》
    • 2021年
    • February 22, 2021 - February 24, 2021
    • Palermo, Italy
    • 会议

    Gestalt psychology puts forward the laws of similarity, proximity and common destiny. These laws all point out that visual stimuli work together to form a similar pattern organization, which results in the visual elements conforming to the same rules to be regarded as a group by the observer. However, the attributes of visual elements are now more diverse, including the dynamic changes of visual elements. In this paper, based on Bertin’s five visual variables, we will explore the impact of the coordinated changes of these visual variables on human visual perception. The experiment produced the ranking of visual variables on the strength of grouping ability. In practical application, the relative grouping strength of these visual elements has high application value for interface design and data visualization research.
    © 2021, The Author(s), under exclusive license to Springer Nature Switzerland AG.

    ...
  • 3.Study on Ergonomic Digital Evaluation System for the Naval Shipborne Command Cabin Based on Extended JACK

    • 关键词:
    • Warships;Man machine systems;Delphi method;Design improvements;Design standard;Evaluation modules;Human Machine Interface;Human-machine interface design;Jack softwares;Qualitative evaluations
    • Wu, Jinchun;Xue, Chengqi;Du, Xiaoxi;Tong, Mu;Miao, Xinyue
    • 《2020 5th International Seminar on Computer Technology, Mechanical and Electrical Engineering, ISCME 2020》
    • 2021年
    • October 30, 2020 - November 1, 2020
    • Shenyang, Virtual, China
    • 会议

    The naval ship command cabin(NSCC) is an important part and the nerve centre of the whole ship. In order to achieve better evaluation and design improvements of the human-machine interface(HMI) of the naval shipborne command cabin in the design phase, we preliminarily expounded the ergonomic digital evaluation system of the NSCC based on extended JACK. The NSCC human-machine interface evaluation index system was constructed by using the improved Delphi method, and the quantitative and qualitative evaluation method was studied. The ergonomic digital evaluation system for the naval shipborne command cabin was developed by extending the JACK software, in which the mannequin module, human-machine interface design module, evaluation module and design standards module were integrated. Finally, the feasibility and applicability of the proposed ergonomic digital evaluation system were verified by an illustrated example.
    © Published under licence by IOP Publishing Ltd.

    ...
  • 4.Research on the Influence of Icon Shape Complexity and Composition on Visual Search Based on Military Geographic Intelligence System

    • 关键词:
    • Geographic information systems;Complexity levels;Experimental conditions;Geographical intelligence;Intelligence systems;Scientific references;Search efficiency;Search performance;Shape complexity
    • Li, Xian;Wang, Haiyan;Shao, Junkai
    • 《5th IEEE International Conference on Image, Vision and Computing, ICIVC 2020》
    • 2020年
    • July 10, 2020 - July 12, 2020
    • Beijing, China
    • 会议

    This article discusses the influence of icon shape complexity and composition on icon search in military geographical intelligence system. We designed an experiment to explore the influence of icon shape complexity and composition on icon search efficiency in military geographic intelligence system (GIS). The reaction time and accuracy are used in the experiment to reflect people's search efficiency under different experimental conditions. The experimental results provide a scientific reference for the design of military GIS interface by analyzing the effect of different icon shapes and icon presentation on the visual search performance of military GIS interface. Through experiments, it is found that when the icon shape complexity level is the highest or the lowest, it shows poor search performance; when the complexity level is H3, it shows the best search performance; the icon composition does not affect the search performance of the icon on the map background. Significant, but when the complexity level is H2 and H4, there is interaction between different icon composition. This design will provide a reference for the design of GIS interface icons. The experimental results provide a scientific reference for the design of military GIS interface. © 2020 IEEE.

    ...
  • 5.Evaluation of Complex Network Layout Based on User Cognition

    • 关键词:
    • Regression analysis;Cognitive information;Cognitive performance;Evaluation metrics;Information acquisitions;Multiple regression model;Network layout;User research;User response time
    • Luo, Zijing;Xue, Chengqi;Chen, Xiaojiao
    • 《4th IEEE Information Technology, Networking, Electronic and Automation Control Conference, ITNEC 2020》
    • 2020年
    • June 12, 2020 - June 14, 2020
    • Chongqing, China
    • 会议

    Although evaluation metrics for complex network layouts have been studied by many authors, it is still unclear whether these metrics can effectively evaluate cognitive performance of information. Therefore, we conducted user research on the cognition of nodes information of complex networks. Based on user response time and accuracy of the information, the paper makes a multiple regression model to sieve effective metrics and evaluate the layout. The results of model show that the screening metrics can effectively evaluate the response time and accuracy of the cognitive information in complex network layout. According to the results, we designed and developed a visual tool to help us better evaluate and optimize complex network layout algorithms from the perspective of users, and improve the efficiency of users' information acquisition. © 2020 IEEE.

    ...
  • 6.ERP Research on Semantic Matching of Audio-visual Information in Interfaces in Quiet-Noise Situations

    • 关键词:
    • Brain mapping;Audio acoustics;User interfaces;Human computer interaction;Audio-visual information;Audiovisual interfaces;Auditory user interfaces;Environmental influences;Human computer interaction interface;Mapping relationships;Physiological indicators;Visual user interfaces
    • Hu, Lingling;Xue, Chengqi;Shao, Junkai
    • 《2020 Information Communication Technologies Conference, ICTC 2020》
    • 2020年
    • May 29, 2020 - May 31, 2020
    • Nanjing, China
    • 会议

    This study analyzes the information elements of visual user interface and auditory user interface. Taking alarm information as an example, using behavioral data and brain physiological indicators to explore the cognitive rules of audiovisual interface information in quiet and noisy situations, and establish a mapping relationship between audiovisual information and cognitive. Hoping to build a more efficient human-computer interaction interface. The results show that the performance of the \mathbf{Icon}\times\mathbf{Earcon} combination under noisy environment is significantly lower than that in a quiet environment; and there is no significant difference between \mathbf{Text}\times\mathbf{Earcon},\mathbf{Color}\times\mathbf{Earcon} in different environments. This means that the combination of \mathbf{Icon}\times\mathbf{Earcon} is extremely susceptible to environmental influences, while the combination of \mathbf{Text}\times\mathbf{Earcon},\mathbf{Color}\times\mathbf{Earcon} is just the opposite. © 2020 IEEE.

    ...
  • 7.Experimental Research on Geographic Information System Interface Map Information Layout

    • 关键词:
    • Information management;Urban transportation;Information systems;Information use;Experimental research;Interface layout;Pop-up windows;Urban planning managements
    • Ren, Jiapei;Wang, Haiyan;Shao, Junkai
    • 《2020 Information Communication Technologies Conference, ICTC 2020》
    • 2020年
    • May 29, 2020 - May 31, 2020
    • Nanjing, China
    • 会议

    The Geographic Information System (GIS) has played an important role in urban planning management, transportation, military and other fields. In order to explore the effective method of GIS interface layout, this paper conducts an experimental study on the pop-up window layout of detailed information of GIS interface targets, and analyzes the reaction time of the participants. At the same time, a questionnaire was issued to collect subjective feeling data. The research in this article shows that when a pop-up window appears in the interface, it should be displayed in the center of the interface or around the click position. Secondly, you can choose to display it in the right half of the interface, and try not to display it in the bottom-left of the interface. In addition, if the information in the pop-up is two columns, and the information can be divided into two categories, the left-right distribution is better than the up-down distribution. © 2020 IEEE.

    ...
  • 8.Shopping website accessibility study based on users’ mental models

    • 关键词:
    • Cognitive systems;Accessibility;Experimental demonstrations;Interface interaction;Mental model;Principles;Shopping websites;Website accessibility;Website interface designs
    • Wu, Zhen;Xue, Chengqi;Zhu, Yanfei;Zhai, Binhong;Zhang, Chi
    • 《3rd International Conference on Intelligent Human Systems Integration, IHSI 2020》
    • 2020年
    • February 19, 2020 - February 21, 2020
    • Modena, Italy
    • 会议

    The arrival of the Internet information age promotes the development of electronic and information platform - website. A website is a provider of information and a platform for users to communicate and interact. Website interface design must consider human cognitive factors, emotional factors, so the website interface design and interaction design is particularly important. Through experimental demonstration and research, this paper takes shopping website as the research object to analyze the mental model of users in website interface design and the influence of different users’ occupations on the mental model. According to the conclusion of the analysis, firstly, the change process of user mental model in interface interaction is proposed. Secondly, based on the user mental model, this paper summarizes the design principles of the website. Finally, this paper provides a new way of thinking for the study of website accessibility.
    © Springer Nature Switzerland AG 2020.

    ...
  • 9.A variety of visual-speech matching ERP studies in quiet-noise scenarios

    • 关键词:
    • Human computer interaction;User interfaces;Auditory user interfaces;Behavioral performance;ERP technologies;Human computer interaction interface;N2 component;Nl component;Visual speech;Visual user interfaces
    • Hu, Lingling;Xue, Chengqi;Shao, Junkai
    • 《3rd International Conference on Intelligent Human Systems Integration, IHSI 2020》
    • 2020年
    • February 19, 2020 - February 21, 2020
    • Modena, Italy
    • 会议

    In this study, the visual user interface elements and the auditory user interface information elements are analyzed. From the information elements of the visual interface and the speech elements of the auditory interface as the entry point, it is hoped to construct a more efficient audio-visual human-computer interaction interface. Taking the alarm information as an example, this paper studied the cognitive rules of the user on the audiovisual interface in the quiet-noise environment through the behavioral performance evaluation and the measurement method of the brainwave physiological index evaluation, and establishes the mapping relationship between "audiovisual-cognition".
    © Springer Nature Switzerland AG 2020.

    ...
  • 10.Experimental study on dynamic map information layout based on eye tracking

    • 关键词:
    • Eye tracking;Cognitive experiments;Dynamic layout;Interface designs;Interface size;ON dynamics;Search efficiency;Search performance;Target trajectory
    • Ren, Jiapei;Wang, Haiyan;Shao, Junkai
    • 《3rd International Conference on Intelligent Human Systems Integration, IHSI 2020》
    • 2020年
    • February 19, 2020 - February 21, 2020
    • Modena, Italy
    • 会议

    In the GIS system interface, the map module occupies more than 90% of the interface size, which is the focus of the GIS interface design. There are a large number of targets, target signs, target trajectories and other information on the map. The layout of various information is crowded and overlapped, making it difficult for users to search and identify information. The purpose of this paper is to explore the impact of different presentation forms of target signs on user search efficiency. This paper used 8 kinds of overlap and 4 kinds of target sign layout display to design the experiment. This paper analyzed the search performance of subjects, and gaze plot based on eye tracking data.
    © Springer Nature Switzerland AG 2020.

    ...
  • 排序方式:
  • 5
  • /