基于数字全息显微(DHM)技术重建签名三维动态特征的个体识别新方法

项目来源

国家自然科学基金(NSFC)

项目主持人

陈晓红

项目受资助机构

司法鉴定科学研究院

立项年度

2016

立项时间

未公开

项目编号

61605132

研究期限

未知 / 未知

项目级别

国家级

受资助金额

20.00万元

学科

信息科学-光学和光电子学-交叉学科中的光学问题

学科代码

F-F05-F0516

基金类别

青年科学基金项目

关键词

贝叶斯分析 ; 数字全息显微技术 ; 签名笔迹 ; 三维动态特征 ; 生物特征识别 ; digital holographic microscopy technology ; signature handwriting ; bayesian analysis ; three-dimensional and dynamic feature ; biometric recognition

参与者

杨旭;卢启萌;王雅晨;王楠;高圣亚;李进喜

参与机构

司法部司法鉴定科学技术研究所

项目标书摘要:本项目在国内外创新性的提出笔迹三维动态的属性,运用数字全息显微技术实现签名的个体识别,有望推动笔迹个体识别向4D方向发展。目前,笔迹个体识别是基于二维静态图像的测量进行的,存在较大的局限。本项目以个体识别的应用需求为导向,以数字全息显微技术和贝叶斯分析方法为研究策略,探索构建签名笔迹三维动态特征的个体识别新方法。项目运用数字全息显微技术重建签名的三维动态特征;运用统计学分析验证三维动态特征的特异性;在构建不少于302000个的签名数据库的基础上,运用贝叶斯分析方法实现签名的个体识别。项目着眼于增强笔迹个体识别理论基础,探索将光学数字全息技术、计算机图像处理技术、统计学方法和法庭科学技术相结合,拟解决签名三维动态特征的提取、特异性验证以及个体识别系统的稳定性和可重复性等关键问题。本项目的实施,有助于推动多学科的交叉研究,有助于深化笔迹特征的多维度认识,为个体识别提供新理论、新技术和新方法。

Application Abstract: This project creatively proposes the three-dimensional and dynamic attributions of handwriting in home and abroad,applies digital holography microscopy technology to realize the handwriting biometric recognition,and it’s expected to push handwriting biometric recognition forward into the development of four-dimensional direction.At present,the researches of handwriting biometric recognition are based on the measurements from static images which has big limitation.This project is based on the application requirement of biometric recognition,having the research strategy of digital holographic microscopy and Bayesian analysis,to explore the new method of individual identification of the three-dimensional and dynamic features of signature handwriting.This project is going to obtain the three-dimensional and dynamic features of signatures by digital holographic microscopy;to verify the specificity of three-dimensional and dynamic data with the application of statistical analysis methods;to realize the signature of individual identification with the employment of Bayesian analysis based on the construction of a database of 302000 signatures.This project focus to strengthen the theoretical basis of individual handwriting identification,to explore the combination of optical holographic technology,computer image processing techniques,statistical methods and forensic science,and intends to solve the key issues:extraction and the specificity validation of the three-dimensional and dynamic features of signatures,and stability and repeatability of individual identification system.The implementation of this project will contribute to promotion of interdisciplinary research and is helpful to deepen the understanding of multiple dimensions in handwriting features,moreover,it provides new theories,new technologies and new methodologies for biometric recognition.

项目受资助省

上海市

项目结题报告(全文)

关于司法笔迹鉴定的争论已持续了几十年。目前笔迹识别研究总是聚焦于容易伪造的笔迹二维静态特征。本项目的研究解释离线笔迹的三维动态属性。运用三维和白光同步成像和图像处理,从304,200个签名数据库中获得三维和伪动态特征,数据库包括真实签名、代签签名、临摹签名和套摹签名,图像处理用来获得书写轨迹,从白光图像获得诸如笔画宽度、笔画弧度、骨架灰度和笔画灰度分布、骨架高度和笔画高度分布等伪动态特征;得益于三维图像和白光图像是同位同步成像,从三维图像上按照书写轨迹测量高度数据。三维伪动态特征的可视化和统计学分析探索笔迹形态学背后隐藏的与书写人无关的发现,帮助了解笔迹变化和个性的基本规律。相关系数用于表征笔迹之间的相似性,基于签名之间三维伪动态特征的比较测量带来了一些不同角度的观察。基于签名数据库中所有签名相对测量的ggpairs图显示稳定、显著的真实签名之间的相似性和真实签名与伪造签名之间的差异性。主成分分析的二维核密度图显示不同组签名(不同签名:不同的书写人,签名文本不同)的密度分布非常稳定。这不仅意味着本项目的签名数据库可以用作真实案例的背景数据,而且即便只有少量样本的真实案例,也可以使用这种方法。着眼于法庭科学应用,从签名数据库中随机选组一组签名,剩余的各组签名用来作为背景数据。评分似然比用来评估签名证据力度,性能评估显示等错误率0.000006,认定结论的错误率为0.000076,否定结论的错误率为0.000181。司法鉴定能力验证案例和真实案例的盲测验证了本项目方法的稳定性和可重复性。

  • 排序方式:
  • 4
  • /
  • 1.Date determination using a combination of Raman and video spectroscopy for the examination of forged documents containing pre-inked stamp impressions

    • 关键词:
    • Questioned document examination; Stamp impressions; Method combinations;SEALS; TONER
    • Hao, Yu-yu;Wang, Ya-chen;Zhou, Guang-lei;Zhao, Ya-wen;Xu, Jing-yuan;Chen, Xiao-hong
    • 《FORENSIC SCIENCE INTERNATIONAL》
    • 2025年
    • 368卷
    • 期刊

    The examination of stamp impressions is a routine task for questioned document examiners (QDEs) in determining the authenticity of disputed documents. Some studies have provided methods for date determination of stamp impressions, but each single method has its own limitations, so date determination of stamp impressions remains a challenge in case work. This study reports on the real case of a forged contract, in which pre-inked stamp impressions were made on blank paper without the knowledge of the stamp owner. The combination of Raman and video spectroscopy is demonstrated to be a novel method for the date determination of these impressions. In addition to conventional morphological examination methods, video spectroscopy (VS) images were combined with Raman spectroscopy to identify ink components and the distribution of pre-inked impressions. These characteristics vary with the time of stamping, especially after re-inking, and can thus be used to date forged documents. Specifically, spectral analysis of the ink provided a regular representation of temporal variations based on reference stamp samples, which were mutually confirmed by morphological analysis. This approach combines multiple analysis methods to provide diverse evidence for characterizing the tampering and dating the impressions. The results suggest the included stamp impressions were genuine and made on a blank sheet of paper prior to printing the content of the agreement. The five questioned impressions were not entirely consistent in terms of generation time, and none of them were stamped on the nominated date.

    ...
  • 2.Inkjet printer prediction under complicated printing conditions based on microscopic image features

    • 关键词:
    • Questioned document examination; Statistical analysis; Discriminantanalysis; Machine learning
    • Liu, Yan-ling;Jiang, Zi-feng;Zhou, Guang-lei;Zhao, Ya-wen;Hao, Yu-yu;Xu, Jing-yuan;Yang, Xu;Chen, Xiao-hong
    • 《SCIENCE & JUSTICE》
    • 2024年
    • 64卷
    • 3期
    • 期刊

    A novel technique is introduced to predict the printer model used to produce a given document. Samples containing only a few letters printed under varying conditions (i.e., different printing modes, letter types, fonts) were collected to establish a dataset of 41 inkjet printer models from common manufacturers, such as HP, Canon, and Epson. Morphological features were analyzed by extraction of image features using several algorithms in a series of microscopic images and a Wilcoxon test was used to measure the significance of variations between printed samples. Significant differences between various printing conditions might post potential challenge to questioned document examination. Discriminant analysis and the k-nearest neighbor (KNN) algorithm were also employed for source printer prediction under varying printing condition on 30% images with the rest images as training dataset. The results of a validation experiment demonstrated that while quadratic discriminant analysis (QDA) achieved an accuracy of 96.3%, a combination of KNN and QDA reached 98.6%. As such, this technique could aid in the forensic examination of printed documents.

    ...
  • 3.Assessment of high-quality counterfeit stamp impressions generated by inkjet printers via texture analysis and likelihood ratio

    • 关键词:
    • Questioned document examination; Image processing; Statistical analysis;Bayesian interpretation; Stamp impression;HANDWRITING EVIDENCE; IDENTIFICATION
    • Tao, Yi-Min;Tang, Hao;Yang, Xu;Chen, Xiao-Hong
    • 《FORENSIC SCIENCE INTERNATIONAL》
    • 2023年
    • 344卷
    • 期刊

    High-quality counterfeit stamp impressions made by inkjet printers remain challenging in questioned document examination and forensic analyses. A dataset comprised of various printed stamp impressions, using ten options of conditions and materials, and hand stamped impressions was generated. In this paper, we report printed impressions in pure color and high-quality printing mode are very similar to hand stamped impressions in terms of their microscopic characteristics. These similarities may lead to incorrect conclusions via traditional identification methods. Here, we proposed a method for identifying counterfeit stamp impressions via texture features and image quality parameters extracted from impressions. First, the statistical analysis methods were used to verify a significant difference between the printed and hand stamped impressions. Principal component analysis (PCA) was used to show the variation between the impressions, and the differences between printed and hand stamped impressions were obvious in the three-dimensional plot. After filtering the background of the stamp impressions, image processing analysis was introduced to extract features of gray level co-occurrence matrix (GLCM), segmentation-based fractal texture analysis (SFTA), local binary pattern (LBP), and image quality metrics (IQM), which were used to characterize the stamp impressions. Finally, specific cases were simulated by random selection, based on the dataset of stamp impressions, and an evaluation system for stamp evidence was established to calculate the likelihood ratios (LRs) under two alternative hypotheses. The likelihood ratio interprets calibrated evaluations on the strength of stamp impressions as evidence. We can also balance these LRs against the rates of misleading evidence with a reasonable performance (equal error rate = 0.048). This paper provides a system to differentiate high-quality printed and hand stamped impressions with reasonable performance.(c) 2023 Elsevier B.V. All rights reserved.

    ...
  • 4.Ink source prediction and assessment based on direct analysis in real-time mass spectrometry via the likelihood ratio

    • 关键词:
    • Bayesian analysis; chemometrics; forensic science; ink analysis;RAMAN-SPECTROSCOPY; PEN INKS; HANDWRITING EVIDENCE; FORENSIC ANALYSIS;PRINTER INKS; RED INK; LASER; PERFORMANCE; MS; DIFFERENTIATION
    • Chen, Xiaohong;Yang, Xu;Zhang, Jing-wei;Tang, Hao;Zhang, Qing-hua;Wang, Ya-chen;Jiang, Zi-feng;Liu, Yan-ling
    • 《JOURNAL OF CHEMOMETRICS》
    • 2023年
    • 期刊

    Ink classification is the ability to distinguish unknown inks into different groups, and ink source prediction is the ability to predict the manufacturer or model of an unknown ink. These are regular tasks in forensic analysis. The latter is more challenging than the former, as ink source prediction has expanded beyond ink classification. In this work, we reported on an approach to predict the source of black inks based on direct analysis in real time mass spectrometry and assess the strength of black ink source prediction conclusion via the likelihood ratio, using a dataset that included 39 inks from three manufacturers with a high market share. Most of these inks contain similar or identical chemical components. Dimensionality reduction based on the principal component analysis and unified manifold approximation and projection algorithms was implemented, and subsequently, the distribution plots illustrated the variations between and within the inks. Unified manifold approximation and projection showed significant priority in avoiding overcrowding of cluster representation versus principal component analysis, with results as high as 99.83% for the prediction of the ink source using 41,432 spectra data (70% data for training and 30% data for testing) after dimensionality reduction. A likelihood ratio was used to evaluate the strength of ink evidence, and the pool-adjacent-violators algorithm and logistic algorithms were used to calibrate the likelihood ratio. The results showed that the pool-adjacent-violators algorithm and logistic algorithms both had an excellent equal error rate of 0.004 but slightly different results in the rates of misleading evidence in favor of the prosecutor's hypothesis, rates of misleading evidence in favor of the defense's hypothesis, log likelihood ratio costs after calibration (Cllrcal$$ {C}_{\mathrm{llr}}<^>{\mathrm{cal}} $$), and minimum log likelihood ratio costs (Cllrmin$$ {C}_{\mathrm{llr}}<^>{\mathrm{min}} $$). A blind test validated the robustness of the methods.

    ...
  • 5.对不同条件下签名笔迹动态特征变化的量化分析

    • 关键词:
    • 签名笔迹;动态特征;书写条件;量化
    • 李思绮
    • 指导老师:华东政法大学 杜志淳
    • 学位论文

    书写活动的完成有赖于一定的书写条件,而条件变化对于笔迹的影响具有客观性。在不利的条件下,书写人书写活动会受到干扰或阻碍,而使笔迹发生变化。基于签名笔迹字数少,特征有限的特点,如何确定签名的差异是由条件变化引起的非本质性差异还是因书写人改变导致的本质性差异,一直是笔迹鉴定的难点。对于动态特征进行量化研究,有助于我们从签名中挖掘出更多的隐含信息,为传统的笔迹检验提供一种新的思路和支撑,有助于攻克难点,提高签名笔迹鉴定的客观性和科学性。本文与国家自然科学基金项目(U1736102,61605132)和中央级科研院所公益研究基金(GY2019D-1)相结合,研究的主要方法参照上述课题,是对已有的方法所展开的新的应用探索。以离线签名笔迹为研究对象,主要通过3D形状轮廓测量仪,扫描获取离线签名的三维图像和相关动态特征数据,并运用计算机图像处理技术和统计学分析等方法,来探索签名的动态特征在不同书写条件下的变化规律,并尝试运用动态特征初步区分条件变化笔迹和临摹笔迹。在对条件变化笔迹的实验研究中,共设计4种不同的书写条件,固定其中一种为对照组,改变相应的书写条件形成实验组,通过对照组与实验组的比较分析,探索同一书写人在相同条件下的签名动态特征的稳定性和在不同条件下的变化规律。另,由6个书写人对3组签名摹本进行临摹,形成6组临摹组,探究临摹签名的动态特征变化情况,比较与不同条件下的签名动态特征变化之间的区别。实验的结论如下:(1)在宽度特征上:同一书写人在相同和在不同的书写条件下,签名笔画宽度的变化情况总体相似,反映出书写人固有的书写习惯;随着书写条件发生变化,签名的整体宽度和宽度特征的稳定性会受到一定的影响,但各条件下的签名整体宽度有明显的大小区分;摹本签名与临摹签名的宽度曲线变化和平均宽度情况存在明显的差异;(2)在弧度特征上:同一书写人在同一书写条件和在不同的书写条件下,签名笔画弧度的变化情况总体相似;书写条件的变化对整体弧度和弧度特征的稳定性影响小,且摹本签名与临摹签名的弧度变化不存在明显的区别;(3)在灰度特征上:同一书写人的签名在各条件下的变化情况相似,但是与宽度特征相比,具有更强的多样性和随机性;书写条件的变化会对签名整体灰度和灰度特征的稳定性产生影响,但各条件下书写的签名在整体灰度上仍有明显的大小区分;摹本签名与临摹签名的灰度曲线变化和平均灰度情况有较为明显的差异。

    ...
  • 6.盖印条件对光敏印章印文特征的影响探究

    • 关键词:
    • 光敏印章 盖印条件 固定特征 可变性特征 基金资助:国家自然科学基金(61605132、U1736102); 上海市领军人才计划(202079); 财政部公益专项(GY2019D-1); 中央科研院所公益专项(GY2020G-5); 上海市司法鉴定专业技术服务平台资助项目; 专辑:社会科学Ⅰ辑 专题:公安 分类号:D918.92 手机阅读
    • 陆延;吕晨;王长亮;周光磊;李彪
    • 期刊

    目的 研究不同盖印条件对光敏印文特征造成的具体影响及其程度,总结印文特征变化规律和特点。方法 以盖印压力、印油量、印面与纸张接触时间长短、连续多次盖印这四个盖印条件作为研究因素,采用控制变量法进行实验。结果 在盖印压力大、印油浓重、印面与纸张接触时间长的情况下,章面上的固定特征能较好地反映在印文上,可变性特征较为明显;在盖印压力小、印油浅淡、印面与纸张接触时间短的情况下,印文上曝光疵点、缺陷磨损等章面固定特征反映程度相对较差,且变化性特征较少。结论 印油量减少是影响连续盖印印文特征的主要因素,缺陷特征及附着物特征保持相对稳定。

    ...
  • 7.Inkjet ink classification and source prediction based on direct analysis in real-time mass spectrometry (DART-MS) via mass imaging and convolutional neural network (CNN)

    • 关键词:
    • Questioned document examination; Ink analysis; Machine learning; Massspectrometry imaging; Dimensionality reduction;FORENSIC ANALYSIS; RAMAN-SPECTROSCOPY; PRINTER INKS; LASER; DOCUMENTS;BLUE; SOFTWARE; LINES
    • Zhang, Jing-Wei;Yang, Zhong-Hao;Tang, Hao;Zhang, Qing-Hua;Wang, Ya-Chen;Yang, Xu;Chen, Xiao-Hong
    • 《INTERNATIONAL JOURNAL OF MASS SPECTROMETRY》
    • 2022年
    • 481卷
    • 期刊

    This paper presents mass spectrometry imaging (MSI) as an intuitive method of showing the differences between inks, and provides a novel method of ink source prediction based on direct analysis in real-time mass spectrometry (DART-MS) spectral analysis. The ink database comprised 106 types of ink from three brands (Canon, Epson, and HP) with high market share. High-dimensionality reduction methods, such as principal component analysis (PCA), non-negative matrix factorization (NMF), and probabilistic latent semantic analysis (pLSA), were used to reduce the dimensions of the mass spectral data. Characteristics and statistical descriptions of the mass spectra of each ink are given in this paper. Then, MSI was used to visualize the results after PCA, NMF, and pLSA. Finally, a convolutional neural network (CNN) was applied to the data after high-dimensionality reductions, which helped predict the ink source. Results showed efficient and excellent performance of machine-learning analysis in ink source prediction using one pixel in MSI (100% for black, magenta, and yellow inks; 99.6% for cyan ink). In addition, a blind test was used to validate the performance of the CNN model, with results showing that the more pixels used, the more accurate the results. Therefore, we strongly recommend wide-area detection of ink to ensure accurate results. (c) 2022 Elsevier B.V. All rights reserved.

    ...
  • 8.不同盖印条件对光敏印章印文线条宽度的影响

    • 关键词:
    • 光敏印章;盖印条件;控制变量;印文线条宽度
    • 陆延;吕晨;王长亮;包清;周光磊;陈晓红
    • 《刑事技术》
    • 2022年
    • 4期
    • 期刊

    目的探究不同盖印条件下光敏印章印文线条宽度的变化规律,为印章印文检验鉴定提供指导性建议。方法实验通过控制变量,在不同盖印条件下盖印印文样本并测量印文线条宽度,采用平均指标和变异指标相结合的统计方法,对实验数据进行统计分析

    ...
  • 9.电子邮件司法鉴定技术及相关安全问题新探

    • 关键词:
    • 电子邮件;真实性鉴定;网络安全治理;数据安全;电子数据取证
    • 卢启萌
    • 《网络空间安全》
    • 2022年
    • 04期
    • 期刊

    [目的/意义]电子邮件是一种互联网基础通讯工具,电子邮件的真实性是电子邮件可以作为证据被采信的前提条件。[方法/过程]首先,对电子邮件真实性鉴定的现有研究进行总结;其次,对真实性鉴定的时间信息、发件人信息、隐藏信息、结果评断等检验角度进行分析;最后,结合电子邮件真实性鉴定相关的发展和趋势情况,对电子邮件安全问题提出建议。[结果/结论]在后疫情时代,电子邮件这一重要的基础互联网交流工具,需要弥补投递链路中多个协议之间衔接薄弱这一短板,才能更好地维护网络空间安全。

    ...
  • 10.时间因素对显微法判定书写字迹朱墨时序影响的研究

    • 关键词:
    • 显微法;时间因素;书写字迹;朱墨时序
    • 王长亮;吕晨;陆延;刘笑影;顾瑜卿;周光磊;李彪
    • 《中国司法鉴定》
    • 2022年
    • 03期
    • 期刊

    目的 朱墨时序鉴别是文件检验领域的难题之一,其判定受色料组合等多种因素影响。本文旨在研究书写字迹与印文形成交叉后,时间因素对显微法检验结果存在的影响,为朱墨时序鉴别提供理论支撑。方法 对光敏印文、原子印文、印泥印文与书写字迹形成不同组合的朱墨时序上的同一个交叉部位进行两次显微检验,前后间隔30个月,研究前后两次检验图片间的变化。结果 光敏印文、原子印文、印泥印文与黑色签字笔、蓝色圆珠笔、蓝黑钢笔、衬垫式复写纸书写字迹形成不同组合的朱墨时序,除蓝黑钢笔书写字迹的颜色加深、变黑以及印泥印文常伴有极少部分脱落外,两次检验图片无较明显变化;光敏印文、原子印文、印泥印文与无碳复写纸书写字迹形成不同组合的朱墨时序,两次检验图片发生较大变化,无碳复写字迹变淡或消失。结论 光敏印文、原子印文、印泥印文与黑色签字笔、蓝色圆珠笔、蓝黑钢笔、衬垫式复写纸、无碳复写纸书写字迹形成不同组合的朱墨时序样本中,除无碳复写字迹与印泥油形成不同组合的朱墨时序有显著变化外,其他组合均无明显变化,对朱墨时序判定影响较小;无碳复写字迹与印泥油形成不同组合的朱墨时序前后两次检验变化显著,在无碳复写字迹变淡或消失的第二次检验时更无法判定其先后顺序,对朱墨时序的判定影响较大。

    ...
  • 排序方式:
  • 4
  • /