面向大数据的信息可视化设计方法研究

项目来源

国家自然科学基金(NSFC)

项目主持人

薛澄岐

项目受资助机构

东南大学

立项年度

2014

立项时间

未公开

项目编号

71471037

研究期限

未知 / 未知

项目级别

国家级

受资助金额

60.00万元

学科

管理科学-管理科学与工程-工业工程与质量管理

学科代码

G-G01-G0108

基金类别

面上项目

关键词

感知分层 ; 信息可视化 ; 人机交互 ; 空间复杂网络 ; 大数据 ; big data ; space complex network ; information visualization ; human-computer interaction ; perception layering

参与者

李雪松;顾兴中;牛亚峰;吴晓莉;周小舟;吴闻宇;邵将;贾木超;李安

参与机构

南京理工大学;中国矿业大学

项目标书摘要:随着计算机技术的发展,以及巨量数据的出现,人类信息感知已经进入"大数据时代"。大数据经过分析和挖掘的黑箱处理,最终会通过计算机终端的数字界面呈现给用户。大数据信息系统最核心价值体现,在于帮助用户建立准确信息感知并高效进行信息交互,对巨量复杂信息分层、快速过滤并高效决策。本项目拟从大数据信息的空间复杂网络结构出发,开展大数据环境下的信息可视化设计方法研究,研究大数据信息流和感知分层的信息过滤方法,获取高维信息的空间复杂结构和信息可视化的设计策略,建立高维信息的可视化结构模型,探讨用户在复杂高维信息交互过程中的生理反应与行为间的内在联系机制和映射关系,保证大数据信息系统性能的全面发挥和精准实施。项目成果对提高大数据信息系统信息设计水平和交互效率,具有重要的战略意义和现实意义,同时也推动和促进了设计科学、思维科学、信息科学、人机工效学与认知神经学科间的交叉融合,具有重大的理论意义和学术价值。

Application Abstract: With the development of computer technology,as well as the emergence of mass information,human information perception has entered the"era of big data."Big data analyze and excavate the data through the big black box,will eventually presented to the user through digital interface of computer terminal.The core value embodiment of big data information system is to help users to establish accurate information perception and efficient information interaction,make fast and efficient decisions by layering and filtering the huge amount of complex information.This project starts from the complex network structure of information space to carry out research on information visualization design method for large data environment,study the big data stream and filtering method of information perception layer to obtain space complex structure of high dimensional information and design strategy for information visualization,set up visual structure model of high dimensional information,explore the intrinsic relationship and mapping relation between physiological response and action mechanism of user in the process of interaction with the high dimensional complex information,will finally ensure comprehensive and accurate implementation of big data information system performance.Deliverables will improve the design level and interactive efficiency of big data information system which has important strategic and realistic meaning,at the same time promote and accelerate the integration between science of design,science of thinking,science of information,human-computer ergonomics and cognitive neuroscience which has important theoretical significance and academic value.

项目受资助省

江苏省

项目结题报告(全文)

项目主要完成了下述工作,并取得了相应研究成果:1、基于图像复杂度的认知机理与设计优化策略研究方向的缺失,提出从大数据认知的源头——视觉复杂度来解决信息可视化设计优化问题。综合研究了信息可视化中“人—机—环”信息传递过程中的内在复杂性机理,提出了认知复杂度的全局概念。分层解析整个认知过程中的复杂度,从信息对象、分层感知加工次序、信息架构网络等多个角度,逐一梳理人—机—环信息加工中所有认知复杂性因素及认知机制。基于认知加工次序分别探讨了:呈现复杂度、语义复杂度、解码复杂度、记忆复杂度,并结合信息编码提出了认知复杂度的分层感知优化策略,系统性地建立了大数据可视化过程中的图像认知复杂度优化方法。2、根据高维数据的实体属性和关联属性,以及界面信息编码维度,编排优化组织形式及层次关系,通过同质聚类界面视觉元素、信息分层过滤及布局、多通道交互式呈现等,达到降维的目的。基于图形认知有效性的研究,对多视觉变量之间的固有干扰对常见的可视化任务(视觉搜索、视觉比较、量级估计)的影响进行系统的实证研究。构建高维特征和可视化任务双因素驱动下的视觉变量组合模型,分析三者之间的内在联系及映射关系,提出高维数据可视化信息排布和信息呈现的优化策略。结合实例,合理应用到典型高维时空数据可视化系统中,如智能交通系统等。3、对界面信息区块的约束条件进行数学表征,生成布局方案的可行解,研究不同信息区块的布局约束。综合研究视觉感知和人的生理、行为反应,在大数据可视化信息呈现的宏观视角上对信息图元关系进行分类描述,探讨图元关系和信息维度之间的关系;在微观视角上阐述了定序和分类的维度表征及双维度的整合—分离规律,结合信息元的关联结构提出以时效熵和质效熵来评价的可视化信息结构的有序度。通过从语义映射的角度对大数据图示信息的进行语义提取,并基于语义内容进行分类,建立可视化的语义空间。4、在分析大数据特征和人的认知行为特征的基础上,提出大数据可视化人机协同作业复杂认知模型。获取大量大数据可视化监控、搜索、决策、操控各类任务行为下的眼动凝视、扫视、眨眼等行为数据以及脑事件相关电位中的不同波幅和潜伏期等生理数据,构建了可用性评价体系,并且首次提出视觉动量这个以眼动追踪数据为基础的复合虚拟指标,实现了对交互式大数据可视化的量化评价分析。

  • 排序方式:
  • 8
  • /
  • 2.The Study of Presentation Characteristics of the Warning Information and Its Influence on User's Cognitive Process Based on Eye Tracking

    • Lin, Yun;Xue, Chengqi;Guo, Qi;Zhang, Jing;Peng, Ningyue;Niu, Yafeng
    • 《ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS: COGNITION AND DESIGN, EPCE 2017, PT II》
    • 2017年
    • 10276卷
    • 期刊

    This research has adopted eye movement technique to study the influence of warning character on the information processing, which involves in two experiments. With our study, we have made our focus of research on the warning position, warning icon and warning border as a visual stimulus means. In our investigation, we have been keeping on with such commonly-made eye-movement recording parameters, such as the Fixation Count, the First Fixation and Duration by using an Eye Link II eye tracker, which is in a position to reflect the subject's attention and conversion of the attentions. What is more, we have done a single factor variance analysis (ANOVA) in hoping to work out the experimental data due to the kinds of eye movement parameters, and the following conclusions were drawn: (1) The warning position on the warning interface affects the machining process of the warning. When the warning is embedded in text, the warning is more noticeable and the perceived hazard level is higher. (2) Consistent with the results of the relevant studies on warnings on product labels, there are also icon effects on the warning interface, and the icon can improve the salience of the warning itself and the level of perceived danger. (3) There are also border effects on the warning interface. The appearance of the border makes the warning more significant and the perceived hazard level can be improved. The research results of this paper can also be adopted as the warning message design reference, which has had a great significance in improving the identification of warning message and reducing the rate of visual accidents on interface.

    ...
  • 4.Neural mechanisms behind semantic congruity of construction safety signs: An EEG investigation on construction workers

    • 关键词:
    • Electrophysiology;Law enforcement;Occupational risks;Semantics;Surveys;Condition;Construction workers;Design semantics;Positive potential;Safety sign comprehension;Safety signs;Sign design;TFA;Warning signs;Word-pairs
    • Wu, Jinchun;Du, Xiaoxi;Tong, Mu;Guo, Qi;Shao, Junkai;Chabebe, Annette;Xue, Chengqi
    • 《Human Factors and Ergonomics In Manufacturing》
    • 2023年
    • 33卷
    • 3期
    • 期刊

    Accurate comprehension of safety signs plays a critical part in warning construction workers of potential work hazards. However, existing studies have rarely investigated construction workers' comprehension of safety signs at construction sites. Moreover, existing evaluation methods are generally based on subjective behavior tests, questionnaires, and interviews. Therefore, this study examined the effects of semantic congruity on the comprehension of safety signs, including two sign types (prohibition vs. warning signs) and two conditions (semantic congruence vs. incongruence), combining event-related potentials and time-frequency analysis measurements. Adopting the S1-S2 paradigm, electroencephalogram data were recorded when participants decided whether S1 and S2 were semantically congruent or not. Results showed that the semantically incongruent safety sign-word pairs elicited larger N400 amplitudes and increased theta (3–8 Hz) power in 300–420 ms. The amplitude of N400 in the semantically incongruent condition of the warning sign-word pairs was more negative than that for the prohibition sign-word pairs, while there were no significant differences between the prohibition and warning sign-word pairs in the semantically congruent condition. A greater late positive potential (LPP) (550–750 ms) was also elicited in the semantically incongruent safety sign-word pairs, which was different from previous studies that observed larger LPP in congruent conditions. These results suggest complicated cognitive mechanisms of safety sign comprehension in construction workers. This study extends safety sign comprehension research by using electrophysiological approaches and provides useful indicators for researchers or safety engineers to measure the semantic congruity of proposed sign designs. © 2022 Wiley Periodicals LLC.

    ...
  • 5.Effects of bath chairs on the behavior, muscle workload, and experience in independent bathing of the elderly: A Chinese case study

    • 关键词:
    • Elderly; Bath chairs; Bathing behavior; Bathing experience; Muscleworkload;ELECTROMYOGRAPHIC EVALUATION; OLDER PERSONS; LOW-BACK; DISABILITY;FATIGUE; TRUNK; ENVIRONMENTS; PEOPLE; PELVIS; MODEL
    • Liu, Yixuan;Wu, Jinchun;Zhang, Xinyu;Zhu, Yanfei;Cui, Tianjian;Xue, Chengqi
    • 《INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS》
    • 2023年
    • 94卷
    • 期刊

    It is important to use a bath chair for reducing the injury risk in elderly independent bathing and for improving the elderly bathing experience. This study aimed to investigate the elderly independent bathing process and the effect of bath chairs on the elderly. We investigated the bath scenarios of elderly Chinese people through a questionnaire and behavior observation. Then, based on the survey results, we designed an experiment to evaluate the muscle workload and subjective experience in twelve bathing tasks. Twelve elderly participants were recruited to complete the bathing task in two scenarios: with a chair and without a chair. We found Showering was the dominant bathing style for elderly Chinese people. The rectus-femoris and the lumbar-erector workload change differed significantly between the two scenarios when cleaning the lower body, and the subjective experience with a chair was significantly better than that without a chair. The amplitude of the basic motions of the static-work joints significantly affects the workload of corresponding muscles and the bathing experience. The bath chair effectively reduced the workload of the rectus femoris and the lumbar-erector, reducing the risk of falls and improving the subjective experience of the elderly when cleaning the lower body. However, the bath chair had limited improvement in the workload of the rectus femoris and the lumbarerector during some bathing tasks, which was the main direction of the bath-chair optimization. This study helps to evaluate the elderly bathing experience, and optimizes bath-chair design.

    ...
  • 6.高维数据可视化的多重视觉变量有效性研究

    • 关键词:
    • 高维数据可视化 多重视觉变量 视觉感知 可交互视觉变量 认知特性 基金资助:国家自然科学基金项目(No.71871056,71471037); 专辑:信息科技 专题:计算机软件及计算机应用 DOI:10.27014/d.cnki.gdnau.2019.003007 分类号:TP311.13 导师:薛澄岐 手机阅读
    • 期刊

    随着计算机科学和云计算的不断发展,数据也越趋于复杂,其中不乏很多高维数据。对高维数据进行有效的可视化处理是降低用户认知负荷与提高数据传输效率的重要方法,可视化处理方式主要是对数据进行视觉编码,视觉变量作为视觉呈现的媒介,对信息传递具有重要意义。由于视觉变量多为成对使用,而目前大部分的视觉变量研究都仅仅关注于独立视觉变量,不利于提高视觉编码效率,因此,本文着重对基于高维数据可视化的独立变量与多重变量进行系统性的研究,梳理视觉变量与高维数据特征的表征关系,结合用户的认知特性,利用视觉感知实验探究多重视觉变量有效性并根据实验所得规律指导案例设计。本文首先结合高维数据的静动态属性特点与用户的认知特性,对静动态视觉变量进行深入剖析,同时依据高维数据的可视化特征提出视觉变量分类新方案。其次,基于可视化界面的认知特性及认知负荷理论基础,分析多重视觉变量的认知特性及视觉感知效果,从多重视觉变量的“联想—分离”特性出发探究差别变量与等级变量多种组合形式带来的视觉感知特征,并在充实的理论铺垫下,提出多重视觉变量视觉感知的序列性概念,同时基于此概念研究多重视觉变量的编码策略。视觉变量不仅运用在视觉呈现上,本文对可交互式视觉变量编码的分析拓展了视觉变量的运用领域。再次,运用心物学理论的视觉感知实验方法研究多重视觉变量有效性,将背景色纳入实验因素之内。使用JavaScript搭建一个实验系统,实验在此系统界面上进行。运用spss和excel对实验结果数据进行分析,最终得出提高可视化视觉编码有效性的参考性建议。最后,选用基于时空数据的人口迁徙案例作为设计对象,将实验所得规律与设计实践相结合。

    ...
  • 8.How dynamic information layout in GIS interface affects users' search performance: integrating visual motion cognition into map information design

    • 关键词:
    • GIS interface; map information layout; visual motion cognition;eye-tracking; behaviour performance;SELECTIVE ATTENTION; EYE-MOVEMENTS; PERCEPTION; BEHAVIOR; SYSTEM; MEMORY
    • Shao, Junkai;Wu, Jinchun;Tang, Wenzhe;Xue, Chengqi
    • 《BEHAVIOUR & INFORMATION TECHNOLOGY》
    • 2022年
    • 期刊

    Given that the unreasonable layout caused by the surge of map information will dramatically reduce the user's operation performance, this paper proposed a 3 V layout method based on human visual motion cognition. According to the visual flow method, two visual search experiments were designed to study the influence of label layouts and graphic overlap rates on users' search efficiency. By testing users' reaction time and gaze behaviour, it was found that L-LR layouts arranged in a vertically symmetrical way had the best search performance among the four layouts. The overall performance of L-LR and L-TB layouts arranged in a unidirectional and symmetrical way was better than that of L-UG and L-EP layouts in the graphic and number search task. However, L-UG and L-EP layouts performed better than L-LR and L-TB ones in the graphic search under lower overlap rates. Moreover, it is also worth noting that the performance of graphic search was significantly higher than that of number search, indicating that users distinguished the location-based information represented by graphics better than that by text. The results provide a certain theoretical basis and application value for the map information layout of the GIS interface.

    ...
  • 9.Inhibition Effect of Audio-Visual Semantic Interference in Chinese Interface: An ERP Study of Concrete Icons and Chinese Characters

    • 关键词:
    • Audio-visual information; semantic interference; inhibition effect; N400;COGNITIVE INTEGRATION; OLDER-ADULTS; INFORMATION; LANGUAGE; STROOP;EXPERIENCE; COMPONENT; SELECTION; TASK
    • Shao, Junkai;Xue, Chengqi
    • 《INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE》
    • 2021年
    • 35卷
    • 11期
    • 期刊

    In this study, event-related potential (ERP) was used to examine whether the brain has an inhibition effect on the interference of audio-visual information in the Chinese interface. Concrete icons (flame and snowflake) or Chinese characters ((sic) and (sic)) with opposite semantics were used as target carriers, and colors (red and blue) and speeches ((sic) and (sic)) were used as audio-visual intervention stimuli. In the experiment, target carrier and audio-visual intervention were presented in a random combination, and the subjects needed to determine whether the semantics of the two matched quickly. By comparing the overall cognitive performance of two carriers, it was found that the brain had a more significant inhibition effect on audio-visual intervention stimuli with different semantics (SBH/LBH and SRC/LRC) relative to the same semantics (SRH/LRH). The semantic mismatch caused significant N400, indicating that semantic interference in the interface information would trigger the brain's inhibition effect. Therefore, the more complex the semantic matching of interface information was, the higher the amplitude of N400 became. The results confirmed that the semantic relationship between target carrier and audio-visual intervention was the key factor affecting the cognitive inhibition effect. Moreover, under different intervention stimuli, the ERP's negative activity caused by Chinese characters in frontal and parietal-occipital regions was more evident than that by concrete icons, indicating that concrete icons had a lower inhibition effect than Chinese characters. Therefore, we considered that this inhibition effect was based on the semantic constraints of the target carrier itself, which might come from the knowledge learning and intuitive experience stored in the human brain.

    ...
  • 10.Improving accuracy of gaze-control tools: Design recommendations for optimum position, sizes, and spacing of interactive objects

    • 关键词:
    • NASA;Application fields;Design recommendations;Interaction efficiency;Interactive objects;Optimum position;Recommended values;Task completion time;Vertical distributions
    • Niu, Ya-feng;Zuo, Hong-rui;Yang, Xin;Xue, Cheng-qi;Peng, Ning-yue;Zhou, Lei;Zhou, Xiao-zhou;Jin, Tao
    • 《Human Factors and Ergonomics In Manufacturing》
    • 2021年
    • 31卷
    • 3期
    • 期刊

    To investigate a suitable design of interactive objects in the fixation-triggered eye-control interface, this study conducted two ergonomic experiments based on the location of an object, area of the object, and distance between adjacent objects. Experiment 1 investigated the priority distribution of different regions and recommended values of object sizes in different regions. The results showed that middle-middle (MM) area is the optimal area, while middle-left (ML) area, middle-right (MR) area, and upper-left (UL) area are suboptimal areas, and the remaining are general areas. The recommended minimum sizes for the optimal area, suboptimal area, and general area are 2.636° (200 px on the screen of a 1920 px × 1080 px 14 inch monitor), 2.978° (225 px on the screen of a 1920 px × 1080 px 14 inch monitor) and 3.322° (250 px on the screen of a 1920 px × 1080 px 14-inch monitor), respectively. Experiment 2 conducted ergonomic experiments of different distances between adjacent objects in horizontal and vertical distributions. The results showed that the appropriate setting of the distribution and size of the objects showed no significant difference between different levels of spacing on the trigger accuracy rate and task completion time. Further, 1.032° (75 px on the screen of a 1920 px × 1080 px 14-inch monitor) could be recommended as the most suitable spacing. According to the conclusions of Experiments 1 and 2, an optimized eye-control interface and the NASA-TLX scale were used to verify the validity and scientificity of the experimental results. The conclusions can be employed to improve the interaction efficiency of the eye-control system and user experience and expand the application field of eye control.
    © 2021 Wiley Periodicals LLC

    ...
  • 排序方式:
  • 8
  • /