动态人脸表情识别技术研究

  • 格式:pdf
  • 大小:2.75 MB
  • 文档页数:75

湖南大学硕士学位论文动态人脸表情识别技术研究姓名:应伟申请学位级别:硕士专业:通信与信息系统指导教师:邹北骥20050508硕士学位论文摘要新一代人机交互界面的设计和情感智能是两项国际前沿性研究课题,在这两项课题中,一个关键的技术是如何获取人的内心情感。表情作为人的内心情感的主要表现方式,蕴涵了大量有关人的内心状态变化的信息。人脸表情自动识别技术因而受到了研究者们的广泛关注。结合心理学研究成果,本文首先建立了一个含840段视频序列的基本人脸表情数据库,其次针对表情的动态性特点,确定了两个表情识别平台接口,然后对目前比较成熟的表情区域定位方法、特征提取方法以及信息分类方法进行合理的选择构建了一个表情识别系统实例,最后在基本表情数据库上对其中四种基本表情进行测试,综合识别率达到了91.7%。测试结果说明平台运行正常,可以为后续的表情识别系统的开发和改进提供良好的实验环境,并且构建的系统实例接近实际应用的要求,为将来表情识别系统应用化打下了一个基础。表情特征提取是系统中比较核心的问题,由于应用环境的复杂性,如何得到稳定的、能够反映表情变化本质的信息是亟待解决的难题。本文对表情特征的有效归一化和合理描述两个部分进行了深入的分析,并将分析结果应用在了构建的系统实例中。几何归一化处理对于表情特征信息的有效提取具有重要意义,常用的归一化方法由于基准特征的不稳定性容易造成误差。本文定量地分析了归一化误差对表情特征提取的影响,并提出加权优化匹配算法进行误差的矫正。算法以传统模板匹配原理为基础,根据各象素点的运动剧烈程度分配相应的匹配权值,实验证明误差得到有效地矫正,提取的表情特征信息更加真实。利用主成分分析技术建立本征空间,在满足均方误差最小的情况下对表情信息进行重新描述,表情信息之间的相互关系能够得到更好的体现,特征数据维度也大大减少。常用的本征空间基的选择尺度是本征向量对应的贡献率,但是从表情识别的角度来讲,所选择的本征向量反映表情之间易于区分的、有代表性的特征信息才是关键。本文详细地分析了面部运动单元与本征向量的对应关系,对按照贡献率得到的本征向量进行再次筛选,使得各类基本表情之间的区分度更好,数据压缩效率也更高。

关键词:表情识别;特征提取;归一化;误差矫正;主成分分析;本征向量运动单元;动态人脸表情识别技术研究ABSTRACTThedesignoftheinterfaceofhuman—computerinteractionofnewgenerationandaffectiveintelligencearetwointernationalresearchfrontiers.Inthese

two

frontiers,akey

technologyishowtoobtainpeople’shiddenfeeling.Thefacialexpressioncontainsabundantinformationrelatedtothechangeofthestatesofheartasthemainbehaviorwayof

people’s

hiddenfeeling.Thereforetheautomaticrecognitiontechnology

offacialexpressionhas

receivedtheresearchers’extensiveconcern.

Combiningthepsychologicalresearchresults,inthisthesis,wehavesetuponebasicfacialexpressiondatabasewhichincludes840videosequencesatfirst,secondly,we

confirm

twointerfacesusedtostructuretheplatformoffacialexpressionrecognitionconsideringthe

dynamiccharacteristic,thenmakinguse

ofthewell—knownalgorithmsaboutfacialregions

location,featureextractionandclassification,webuildoneinstanceofthesystemoffacialexpressionrecognition,finally,theinstancehasbeentestedusingfourkindsofbasicfacialexpressioninthecompleteddatabaseandthegeneralrecognitionrateis91.7%.Theresultprovestheplatformrunsnormallyandcallofferthegoodexperimentalenvironmentfor

developmentandimprovementofthefollow-upexpressionrecognitionsystem,atthesametime,theinstanceisclosetodemandofpracticalapplication,andlaysafoundationfurfuture

application.Expressionalfeatureextractionisamorecentralquestioninthesystem.becauseofthe

complexityoftheapplicationalenvironment,howtogetthesteadyinformationwhichcan

reflectthefacialexpressionessentiallyisadifficultproblemurgentlytobesolved.Wecarry

oildeep

analysisabouttheeffectivenormalizationanddescribingrationallyoftheexpression

feature,andhasappliedtheanalysisresulttotheinstancestructured.

Generallythegeometricalnormalizationprocessisimportanttotheextractionoffacialexpressionfeature.Incommonlyusednormalizationmethods,theunstabilityofthefiducialfeaturesalwayscausesnormalizationerror.Weanalyzequantitatively

theseriousinfluenceto

featureextractioncausedbynormalizationerror,andproposetheweighiedoptimal

matching

algorithmtosolveit.Thealgorithmisfoundedonthebasisoftemplatematchingtheory,and

assignscorrespondingweighttothepointbyitsmotivedegreewhencarryingon

the

calculationofcorrelativecoefficient.ExperimentalresultsshowthatthealgorithmCall

restrainthedisturbancethatnormalizationerrorproduces,andthefacialexpressionfeature

canbeextractedmoreaccurately.

Afterbuildingtheeigenspaceusingtheprinciplecomponentanalysisandreprocessing

II硕士学位论文thefacialfeaturewiththeleastMSE.theinterrelationoffacial

expressionscan

beshown

better,andthedatadimensionalsodecreases.Generallythecontributionratioofeigenvectors

isregardedastheruleofselectionofeigenspacebases,butfromthefacialexpression

recognition’Spointofview,selectingtheeigenvectorswhichcanreflectthe

easily-differentiatedandrepresentativefeaturesisthekey.Weanalyzetherelationship

betweentheactionunits(AUs)andeigenvectorsandre—selecttheeigenspacebases.The

resultsshowthatthebasicfacialexpressionrecognitionimprovesandthedatacompressibility

increases.

KeyWords:humanfacialexpressionrecognition;feature

extraction;normalization;

error-correction;PCA;eigenvector;AU

1II