G. Towards a computational model of melody identification in polyphonic music

结合数据平衡和注意力机制的CNN+LSTM 的自然语音情感识别①陈　港1, 张石清2, 赵小明1,21(浙江理工大学 机械与自动控制学院, 杭州 310018)2(台州学院 智能信息处理研究所, 台州 318000)通讯作者: 赵小明摘　要: 为了解决语音情感识别中数据集样本分布不平衡的问题, 提出一种结合数据平衡和注意力机制的卷积神经网络(CNN)和长短时记忆单元(LSTM)的语音情感识别方法. 该方法首先对语音情感数据集中的语音样本提取对数梅尔频谱图, 并根据样本分布特点对进行分段处理, 以便实现数据平衡处理, 通过在分段的梅尔频谱数据集中微调预训练好的CNN 模型, 用于学习高层次的片段语音特征. 随后, 考虑到语音中不同片段区域在情感识别作用的差异性, 将学习到的分段CNN 特征输入到带有注意力机制的LSTM 中, 用于学习判别性特征, 并结合LSTM 和Softmax 层从而实现语音情感的分类. 在BAUM-1s 和CHEAVD2.0数据集中的实验结果表明, 本文提出的语音情感识别方法能有效地提高语音情感识别性能.关键词: 卷积神经网络; 长短时记忆单元; 注意力机制; 语音情感识别引用格式: 陈港,张石清,赵小明.结合数据平衡和注意力机制的CNN+LSTM 的自然语音情感识别.计算机系统应用,2021,30(5):269–275./1003-3254/7917.htmlNatural Speech Emotion Recognition by Integrating Data Balance and Attention Mechanism Based on CNN+LSTMCHEN Gang 1, ZHANG Shi-Qing 2, ZHAO Xiao-Ming 1,21(Faculty of Mechanical Engineering & Automation, Zhejiang Sci-Tech University, Hangzhou 310018, China)2(Institute of Intelligent Information Processing, Taizhou University, Taizhou 318000, China)Abstract : In order to solve the problem of unbalanced sample distribution in a dataset in Speech Emotion Recognition (SER), this study proposes a SER method combining a Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) units with data balance and an attention mechanism. This method first extracts the log-Mel spectrogram from the samples in a speech emotion dataset and devides the sample distribution into segments according to sample distribution for balance. Then, this method fine-tunes the pre-trained CNN model in the segmented Mel-spectrum dataset to learn high-level speech segments. Next, given the differences in the emotion recognition of different segments in speech, the learned segmented CNN features are input into the LSTM with an attention mechanism for learning discriminative features, and speech emotions are classified with LSTM and Softmax layers. The experimental results in the BAUM-1s and CHEAVD2.0 datasets show that the method proposed in this study has much better performance than conventional methods.Key words : Convolutional Neural Network (CNN); Long Short-Term Memory (LSTM) unit; attention mechanism; speech emotion recognition计算机系统应用 ISSN 1003-3254, CODEN CSAOBNE-mail: Computer Systems & Applications,2021,30(5):269−275 [doi: 10.15888/ki.csa.007917] ©中国科学院软件研究所版权所有.Tel: +86-10-62661041① 基金项目: 国家自然科学基金 (61976149); 浙江省自然科学基金 (LZ20F020002)Foundation item: National Natural Science Foundation of China (61976149); Natural Science Foundation of Zhejiang Province (LZ20F020002)收稿时间: 2020-09-23; 修改时间: 2020-10-21; 采用时间: 2020-10-28; csa 在线出版时间: 2021-04-28269人类的语言不仅包含了丰富的文本信息, 同时也携带着包含人们情绪表达的音频信息, 如语音的高低、强弱、抑扬顿挫等变化. 如何让计算机从语音信号中自动识别出说话人的情感状态, 即所谓的“语音情感识别”方面的研究, 已成为人工智能、模式识别、情感计算等领域中的一个热点研究课题. 该研究旨在让计算机通过分析说话人的语音信号对用户的情感信息进行获取、识别和响应, 从而实现用户与计算机之间的交互更加和谐与自然. 该研究在智能人机交互、电话客服中心、机器人等方面具有重要的应用价值.目前, 在语音情感识别领域中, 大量的前期工作[1–4]主要是针对模拟情感而进行的, 因为这种模拟情感数据库的建立相对自然情感而言, 要容易得多. 近年来,针对实际环境下的自然语音情感识别方面的研究备受研究者的关注, 因为它更接近实际, 而且比模拟情感的识别要困难得多.语音情感特征提取, 是语音情感识别中的一个关键步骤, 其目的是从情感语音信号中提取能够反映说话人情感表达信息的特征参数. 目前, 大量语音情感识别文献[5–10]采用手工设计的特征用于情感识别, 如韵律特征(基频、振幅、发音持续时间)、音质特征(共振峰、频谱能量分布、谐波噪声比), 谱特征(梅尔频率倒谱系数(Mel Frequency Cepstrum Coefficient, MFCC))等. 近年来, 也出现了一些代表性的包含几千个手工设计特征的声学特征集, 如Interspeech-2010特征集[11], ComParE特征集[12], AVEC-2013特征集[13]以及GeMAPS特征集[14]. 尽管这些手工设计的特征参数已经取得了较好的语音情感识别性能, 但它们是低层次的, 对于情感的判别力还不够高, 与人类理解的情感标签还存在“语义鸿沟”问题.为了解决这个问题, 近年来新出现的深度学习技术[15]可能提供了线索. 近年来, 一些代表性的深度学习方法, 如深度信念网络(Deep Belief Network, DBN)[15]、卷积神经网络(Convolutional Neural Networks, CNN)[16]和长短时记忆单元(Long Short-Term Memory, LSTM)[17]都已经用于语音情感识别. 当使用深度学习方法时, 其输入一般为手工设计的声学特征参数, 或者原始的语音频谱. 例如, 文献[18]采用DBN直接从提取的MFCC 等声学特征参数中提取高层次的属性特征, 然后使用极限学习机(Extreme Learning Machine, ELM)实现情感的分类任务. 文献[19–22]也开始成功使用CNN从原始的语音频谱中提取出合适的特征参数用于语音情感识别. 例如, 文献[19]采用稀疏自动编码器和1层CNN结构的方法从原始的语音频谱中学习情感语音特征.值得指出的是, 文献[19–21]采用样本数量非常有限的情感语音数据集来训练自己的浅层CNN模型(1或2个卷积层). 然而, 在计算机视觉领域, 利用已训练好的深度CNN模型, 如AlexNet[16], 在目标图像数据集进行迁移学习往往取得比浅层CNN模型更好的性能. 主要原因是, 深度CNN模型可以通过采用多层的卷积和池化操作来捕获图像的高层属性特征. 为了充分发挥深度CNN模型的优势, 我们之前的一个工作[22]提出将一维的情感语音信号转换成类似于RGB图像的三通道语音频谱片段作为深度CNN模型的输入, 然后将在ImageNet图像数据集已训练好的AlexNet模型在目标语音情感数据集进行跨模态的迁移学习, 取得了比浅层CNN模型更好的语音情感识别性能. 此外,文献[23]提出一种多尺度的CNN+LSTM的混合深度学习模型, 获得了较好的语音情感性能.然而, 现有基于深度学习方法的语音情感识别研究存在一些问题:(1)没有考虑语音数据集客观存在的情感类别不平衡问题, 即数据集中各种情感类型的样本数量极不均衡. 在这种数据类别不平衡的情况下, 深度学习方法训练时对样本少的情感类型容易出现过拟合的现象.(2)语音信号是一种时间序列信号, 但不同时间上的片段区域对情感识别的作用大小是不一样的. 现有文献大都忽略了一句语音中不同片段区域在情感识别方面作用的差异性, 从而限制了深度学习方法的特征表征能力. 因此, 有必要将人类视觉注意力机制(attention mechanism)与深度学习方法相结合[24,25], 用于语音情感识别的特征学习.针对上述问题, 本文提出一种结合数据平衡和注意力机制的CNN+LSTM的语音情感识别方法, 并且用于自然语音情感类型的识别. 首先, 采用欠采样和过采样的方式实现情感语音数据集中的样本片段数量的类别平衡. 所谓欠采样是在多数类中的语音样本进行部分采样, 而过采样是在少数类中的语音样本进行部分重复采样. 其次, 采用在大规模音频数据集上已训练好的VGGish[26]模型在目标语音情感数据集上进行迁移学习. 最后, 通过对VGGish学习到的一句语音中不计算机系统应用2021 年 第 30 卷 第 5 期270同的片段特征区域, 生成时间分布上的权重, 然后和特征图进行加权求和运算, 从而监督双向LSTM 网络(Bi-LSTM)的学习, 以便给一句语音中不同片段特征区域分配不同的注意力权重值. 这样, 该方法能够聚焦于一句语音中对情感识别起作用的目标片段区域的特征学习, 从而改善深度神经网络的特征表征能力, 进一步提高语音情感识别性能.在自然情感语音数据库BAUM-1s [27]和CHEAVD-2.0[28]的试验结果表明, 本文方法取得的语音情感识别性能优于其它方法.1 提出的方法图1给出了结合数据平衡和注意力机制的CNN+LSTM 的语音情感识别方法的系统流程图. 由图1所示, 该方法包括4个步骤: (1)对数梅尔频谱(Log Mel-spectrogram)的创建和数据平衡(data balance); (2)基于CNN 的深度片段特征学习; (3)基于注意力机制的Bi-LSTM 的情感分类. 图1中每个步骤的实现, 具体如下所述.帧数滤波器组数据注意力层情感类别情感类别全连接层SoftmaxConv1Conv2Pool1Pool2FC Layer 平衡对数梅尔频谱图………VGGish ModelBi-LSTMLSTMLSTM数据平衡生气高兴厌恶悲伤害怕惊奇图1 结合数据平衡和注意力机制的CNN+LSTM 的语音情感识别方法1.1 对数梅尔频谱的创建和数据平衡对原始的一维情感语音信号重采样为16 kHz 的单声道格式, 然后采用帧移为10 ms, 时长为25 ms 的汉宁窗进行短时傅里叶变换, 计算出整句语音信号的声谱图. 将声谱图映射到64阶Mel 滤波器组(Filter banks)中计算出Mel 声谱并取对数, 得到稳定的对数Mel 频谱.考虑到用于后续特征学习的VGGish [26]模型输入的片段大小是96×64, 其时长为0.96 s (含96帧, 每帧0.01 s), 因此需要通过控制时长进行欠采样或重采样, 以便实现训练数据的平衡. 图2和图3分别给出了BAUM-1s 和CHEAVD2.0上的数据平衡示意图.高兴, 悲伤生气, 厌恶害怕, 惊奇时长<0.96 s0.96 s0.96 s0.96 s0.48 s0.24 s0.75 s 0.75 s数据平衡 (BAYM-1s)图2 BAUM-1s 数据集上的数据平衡中性生气, 高兴,悲伤, 担心厌恶, 惊奇焦虑时长<0.96 s0.96 s0.96 s 0.96 s 0.48 s0.24 s0.75 s 0.75 s0.96 s0.96 s 0.96 s数据平衡 (CHEA VD2.0)图3 CHEAVD2.0数据集上的数据平衡如图2, 图3所示, 由于数据集中的每个语音样本的时长是不同的, 然而模型的输入大小是固定的, 因此使用数据平衡方法对输入的语音样本进行规范化处理,数据平衡的实现分为3种情况: (1)对于时长小于0.96 s (时长<0.96 s)的语音样本, 在其后面进行重复补值为零的帧, 从而得到一个时长为0.96 s 的片段, 即含有96帧的对数梅尔频谱图; (2)对于时长大于0.96 s 的语音样本, 会根据其所属类别的样本总数占数据集总样本数的比例的多少进行欠采样或重采样. 例如, 对于BAUM-1s 上类别样本数量较多的高兴(Joy)和悲伤(Sadness)的语音样本采用欠采样方式减少片段数,即只在它们的首尾段处各取一个0.96 s 的片段, 而对于样本数量不多的语音样本采用重采样方式进行片段数的放大. 对于样本数最少的害怕(Fear)和惊奇(Surprise)语音样本, 片段重叠长度为0.24 s, 而样本数较少的生气(Anger)和厌恶(Disgust), 其片段重叠长度为0.48 s. 数据平衡中产生的片段样本的类别等于其所在整句语音的情感类别. 表1和表2分别列出了采用数据平衡前后在BAUM-1s 和CHEAVD2.0训练数据集上的各种情感类型的样本片段数量的对比. 由表1和表2可知, 在数据平衡之前, 每个类别的样本数量差异较大, 如害怕(Fear)和惊奇(Surprise)类别的语音样本数量, 与其他类别的样本数量相差较大, 在数据平衡之后, 数据集中的每个类别的样本数量达到一种近似的数据平衡状态, 从而能训练出更具鲁棒性的网络模型. 作为举例, 由于BAUM-1s2021 年 第 30 卷 第 5 期计算机系统应用271包含30人, 实验时采用5次交叉验证方法, 即所有数据平均分成5组, 使用其中一组用于测试, 剩下的4组用于训练, 共循环5次, 最后取5次的平均结果作为最终的结果. 因此, 表1只列出了第一次交叉验证时的数据平衡前后结果, 其中测试数据包含随机选择的6人(S03、S19、S20、S24、S28、S29).表1 BAUM-1s 数据平衡前后的训练数据样本片段数量比较数据平衡生气厌恶害怕高兴悲伤惊奇平衡前1442689349148783平衡后314522326405345309表2 CHEAVD2.0数据平衡前后的训练数据样本片段数量比较数据平衡生气焦虑厌恶高兴中性悲伤惊奇担心平衡前309617984702597523324334682345平衡后309633521663259727772433158023451.2 基于CNN 的深度片段特征学习目前, 在计算机视觉领域, 文献[29,30]已经证明在目标数据集上对预先训练好的CNN 模型进行微调(Fine-tuning), 是一种有效的减轻数据不足的方法. 具体的实现方式为首先通过一个大型的数据集来训练网络模型, 由于网络模型的参数初始化对于模型的训练是至关重要的, 因此由大型数据集训练完成保存的模型参数可用于初始化目标任务的模型参数. 如文献[30]首先使用Imagenet 数据集训练网络模型, 完成训练后,将模型的最后一个全连接层之前的所有参数迁移到目标任务中的模型, 以此进行目标任务模型的参数初始化. 为此, 采用在大规模音频数据集上已训练好的VGGish [26]模型在目标语音情感数据集上进行迁移学习.VGGish 是由Google 的语音理解技术团队于2017年3月发布的一个在大规模音频数据集训练得到类似于VGG 的模型, 旨在为音频事件检测提供常见的大规模评估任务. 该模型包括6个卷积层(Conv1,Conv2,···, Conv6)、4个最大池化层(Pool1, Pool2,Pool2, Pool3, Pool4)和4个全连接层(FC1, FC2, FC3,FC4). VGGish 的训练数据来自于包括600多个音频事件类的本体的200万个人标记的10 s YouTube 视频音轨组成的数据集. VGGish 能够从原始的语音信号片段96×64中提取高层次的128-D 大小的特征向量.a i 给定第i 个输入片段数据及其对应的情感类别y i , 对预训练好的VGGish 网络(V )进行微调, 则相当于求解下面的最优化问题:ΥV (a i ;θV )V θV W V 式中, 表示网络的最后一个全连接层的输出特征, 表示网络V 的网络参数, 表示网络V 的Softmax 层的权重参数. 损失函数L 则表示为:y j y V j 式中, 表示第j 个语音片段样本真实的类别号, 表示网络V 的Softmax 层所预测的第j 个样本类别号,t 表示情感类别数目.1.3 基于注意力机制的Bi-LSTM 的情感分类为了获取一句语音的长时间动态信息, 采用基于注意力机制的双向长短时记忆网络(Bi-LSTM)对CNN 在不同语音频谱片段上学习到的128-D 特征序列进行时间上的动态信息建模, 并输出整句语音样本的情感识别结果.(p 1,p 2,···,p T )给定一个时间长度为T 的输入序列(x 1, x 2, ···x T ),Bi-LSTM 旨在通过计算网络节点激活函数的输出,将输入序列(x 1, x 2, ···x T )映射到一个输出序列,如下所示:i t f t c t σt h t x t h t t W αβαβW xi x t i t b ασσ(x )=1/(1+e −x )式中, 、、、、分别是LSTM 模型中的输入门、忘记门、细胞存储单元和输出门的激活输出向量.和分别表示第个时间步长的输入向量和隐层向量.表示和之间的权重矩阵. 例如, 是从输入到输入门的权重矩阵. 是的偏置值, 表示Sigmoid 激活函数.为了采用视觉注意力机制获取需要聚焦的重点语音片段区域, 并抑制其他无用的信息, 拟在 Bi-LSTM 的基础上添加一个注意力层(attention layer). 该注意力层首先采用式(8), 计算出不同时间序列片段特征的权重参数, 然后采用式(9)对不同片段特征进行加权求计算机系统应用2021 年 第 30 卷 第 5 期272µ和, 得到整句语音的特征表示, 紧接着就可以采用2 实验与结果分析为了检验所提出方法的自然语音情感识别性能,采用自然情感语音数据集BAUM-1s[27]和CHEAVD2.0[28]进行自然语音情感识别的实验测试.2.1 数据集BAUM-1s[27]数据集是一个在2016年建立的音视频情感数据集. 它包括1222个视频样本, 来自于30个土耳其人. 实验中拟采用6种基本情感进行测试, 即生气(Anger)、厌恶(Disgust)、害怕(Fear)、高兴(Joy)、悲伤(Sadness)和惊奇(Surprise). 这样, 最终收集到520个情感语音样本用于实验测试.CHEAVD2.0[28]是中科院自动化所在2017年为多模态情感识别竞赛时提供的音视频情感数据集. 它包含8种情感类型: 生气(Anger)、厌恶(Disgust)、害怕(Fear)、高兴(Joy)、悲伤(Sadness)、惊奇(Surprise)、担心(Worry)和焦虑(Anxiety). 该数据集共有7030个样本, 分为3部分: 训练集(4917个样本)、验证集(707个样本)和测试集(1406个样本). 本文使用训练集和验证集来检验所提出方法的自然语音情感识别性能, 因为测试集只对参加竞赛者开放和获取.2.2 结果分析表3和表4分别列出了本文方法采用数据平衡前后的试验结果的比较. 从表3和表4可见:(1)不管是否采用数据平衡策略, 本文采用的带注意力机制方法(VGGish+LSTM+Attention)取得的语音情感识别性能, 都要优于未带注意力机制方法(VGGish+ LSTM). 这表明采用注意力机制能够改善LSTM的特征表征能力, 因为注意力机制能够聚焦于一句语音中对情感识别起作用的目标片段区域的特征学习.(2)做数据平衡之后, 所有方法取得的识别性能都要明显高于数据平衡之前的结果. 在数据平衡之前, 本文方法(VGGish+LSTM+Attention)在BAUM-1s和CHEAVD2.0数据集分别取得了44.09%和41.73%. 然而, 在数据平衡之后, 本文方法则分别在BAUM-1s和CHEAVD2.0数据集上提高了3.18%和2.05%. 这说明采用数据平衡策略能够进一步改善深度学习方法的特征学习能力.表3 数据平衡之前的语音情感识别性能(%)方法BAUM-1s CHEAVD2.0 VGGish+LSTM43.1439.89 VGGish+LSTM+注意力44.0941.37表4 数据平衡之后的语音情感识别性能(%)方法BAUM-1s CHEAVD2.0 VGGish+LSTM45.7842.29 VGGish+LSTM+注意力47.2743.42为了进一步给出每种情感类型的具体正确识别率,图4和图5分别列出了本文方法(VGGish+LSTM+ Attention)在数据平衡之后的两个数据集上识别结果的模糊矩阵. 由图4可知, 在数据平衡之后的BAUM-1s数据集上, 高兴(Joy)和悲伤(Sadness)的正确识别率分别达到了64.53%和61.19%, 而其它4种情感类别的识别性能较差, 不足40%. 由图5可知, 在数据平衡之后的CHEAVD2.0数据集上, 生气(Anger)和中性(Neutral)的正确识别率分别达到了65.62%和64.5%,而其它6种情感类型的正确识别率都不足45%. 主要原因可能是这些情感类型学习到的特征表征区分度不高, 导致它们相互之间容易混淆.35.717.505.4111.0510.454.8810.7125.008.116.986.724.881.792.5016.221.742.992.4421.4330.0035.1464.5314.1839.0230.3628.7535.1410.4761.1926.830.006.250.005.234.4821.95预测标签生气生气厌恶害怕高兴悲伤惊奇605040302010图4 本文方法在数据平衡之后的BAUM-1s数据集上识别结果的模糊矩阵为了进一步说明本文方法的优越性, 表5列出了本文方法取得的识别结果与其它现有文献报道结果之间的比较. 从表5可知, 本文方法不仅优于一些采用手工特征的方法, 如MFCC[27], GeMAPS ADDIN EN.2021 年 第 30 卷 第 5 期计算机系统应用273CITE.DATA [28– 31], 也优于一些基于深度卷积神经网络CNN 的方法, 如采用AlexNet 的跨模态迁移方法[22,32]. 以及与含有20层的ResNet 网络的自训练网络方法[33]获得的准确率相近.68.7542.4242.8621.8516.0013.4340.0018.523.1216.670.001.681.001.494.006.170.001.520.000.841.000.04.001.23 3.9112.1223.8136.1311.504.4812.0013.5811.7212.1223.8126.8956.0022.3920.0022.227.811.520.003.362.0043.280.007.41 1.561.524.762.521.502.998.03.703.1212.124.766.7211.0011.9412.027.16生气生气焦虑厌恶高兴中性悲伤惊奇担心厌恶焦虑高兴中性担心悲伤惊奇预测标签6050403020100图5 本文方法在数据平衡之后的CHEAVD2.0数据集上识别结果的模糊矩阵表5 与现有文献报道的结果比较数据集文献特征识别率(%)BAUM-1sZhalehpour S [27]MFCC 29.41Zhang S [22]CNN42.46Ma Y [32]CNN42.38本文方法CNN+LSTM+注意力+数据平衡47.27CHEAVD2.0Li Y [28]GeMAPS 39.90Xi YX[33]CNN(ResNet)43.96Miao HT[31]GeMAPS40.31本文方法CNN+LSTM+注意力+数据平衡43.423 结论与展望本文提出了一种结合数据平衡和注意力机制的卷积神经网络(CNN)和长短时记忆单元(LSTM)的语音情感识别方法, 采用数据平衡方法对语音情感数据集中每个类别的样本进行相应的预处理, 再采用预训练好的VGGish 网络在目标数据集上进行微调, 从而学习出分段语音特征, 再通过带有注意力机制的LSTM 从分段语音特征中学习对应的高阶判别性特征, 最后通过Softmax 层进行情感分类. 本文在两个自然语音情感数据集BAUM-1s 和CHEAVD2.0中的实验证明了提出的语音情感识别方法有较好的识别性能. 由于本文提出的网络模型的训练方式并不是端到端的训练方式, 因此, 在未来的工作中, 希望能以端到端的方式训练网络模型; 由于高阶注意力生成的全局性特征更具表达力, 并能辅助网络模型对语音信息长范围的相关性进行建模, 因此, 在未来的工作中, 希望能将二阶注意力机制或更高阶的注意力机制与现有的网络模型进行结合, 以学习出更具判别性的语音情感特征.参考文献韩文静, 李海峰, 阮华斌, 等. 语音情感识别研究进展综述. 软件学报, 2014, 25(1): 37–50. [doi: 10.13328/ki.jos.004497]1张石清, 李乐民, 赵知劲. 人机交互中的语音情感识别研究进展. 电路与系统学报, 2013, 18(2): 440–451, 434.2Schuller BW. Speech emotion recognition: Two decades in a nutshell, benchmarks, and ongoing trends. Communications of the ACM, 2018, 61(5): 90–99. [doi: 10.1145/3129340]3Akçay MB, Oğuz K. Speech emotion recognition: Emotional models, databases, features, preprocessing methods,supporting modalities, and classifiers. Speech Communication, 2020, 116: 56–76. [doi: 10.1016/j.specom.2019.12.001]4Song P. Transfer linear subspace learning for cross-corpusspeech emotion recognition. IEEE Transactions on Affective Computing, 2019, 10(2): 265–275. [doi: 10.1109/TAFFC.2017.2705696]5Demircan S, Kahramanli H. Application of fuzzy C-means clustering algorithm to spectral features for emotion classification from speech. Neural Computing and Applications, 2018, 29(8): 59–66. [doi: 10.1007/s00521-016-2712-y ]6Zhao XM, Zhang SQ. Spoken emotion recognition via locality-constrained kernel sparse representation. Neural Computing and Applications, 2015, 26(3): 735–744. [doi: 10.1007/s00521-014-1755-1]7Gharavian D, Sheikhan M, Nazerieh A, et al . Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network. Neural Computing and Applications, 2012, 21(8): 2115–2126.8Zhang ZX, Coutinho E, Deng J, et al . Cooperative learning and its application to emotion recognition from speech.IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015, 23(1): 115–126.9朱菊霞, 吴小培, 吕钊. 基于SVM 的语音情感识别算法. 计算机系统应用, 2011, 20(5): 87–91. [doi: 10.3969/j.issn.1003-3254.2011.05.019]10Kayaoglu M, Eroglu Erdem C. Affect recognition using key frame selection based on minimum sparse reconstruction.Proceedings of the 2015 ACM on International Conference11计算机系统应用2021 年 第 30 卷 第 5 期274on Multimodal Interaction. Seattle, WA, USA. 2015.519–524.Schuller B, Steidl S, Batliner A, et al . The INTERSPEECH 2013 computational paralinguistics challenge: Social signals,conflict, emotion, autism. INTERSPEECH 2013: 14th Annual Conference of the International Speech Communication Association. Lyon, France. 2013. 148–152.12Valstar M, Schuller B, Smith K, et al . AVEC 2013: The continuous audio/visual emotion and depression recognition challenge. Proceedings of the 3rd ACM International Workshop on Audio/Visual Emotion Challenge. Barcelona,Spain. 2013. 3–10.13Eyben F, Scherer KR, Schuller BW, et al . The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing. IEEE Transactions on Affective Computing, 2016, 7(2): 190–202. [doi: 10.1109/TAFFC.2015.2457417]14Hinton GE, Salakhutdinov RR. Reducing the dimensionality of data with neural networks. Science, 2006, 313(5786):504–507. [doi: 10.1126/science.1127647]15Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks.Proceedings of the 25th International Conference on Neural Information Processing Systems. Siem Reap, Cambodia.2012. 1097–1105.16Hochreiter S, Schmidhuber J. Long short-term memory.Neural Computation, 1997, 9(8): 1735–1780. [doi: 10.1162/neco.1997.9.8.1735]17Han K, Yu D, Tashev I. Speech emotion recognition using deep neural network and extreme learning machine. 15th Annual Conference of the International Speech Communication Association. Singapore. 2014. 223–227.18Mao QR, Dong M, Huang ZW, et al . Learning salient features for speech emotion recognition using convolutional neural networks. IEEE Transactions on Multimedia, 2014,16(8): 2203–2213. [doi: 10.1109/TMM.2014.2360798]19Trigeorgis G, Ringeval F, Brueckner R, et al . Adieu features?End-to-end speech emotion recognition using a deep convolutional recurrent network. 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Shanghai, China. 2016. 5200–5204.20Huang CW, Narayanan SS. Deep convolutional recurrent neural network with attention mechanism for robust speech emotion recognition. 2017 IEEE International Conference on Multimedia and Expo (ICME). Hong Kong, China. 2017.583–588.21Zhang SQ, Zhang SL, Huang TJ, et al . Learning affective features with a hybrid deep model for audio-visual emotion22recognition. IEEE Transactions on Circuits and Systems for Video Technology, 2018, 28(10): 3030–3043. [doi: 10.1109/TCSVT.2017.2719043]Zhang SQ, Zhao XM, Tian Q. Spontaneous speech emotion recognition using multiscale deep convolutional LSTM.IEEE Transactions on Affective Computing, 2019. [doi:10.1109/TAFFC.2019.2947464]23黎万义, 王鹏, 乔红. 引入视觉注意机制的目标跟踪方法综述. 自动化学报, 2014, 40(4): 561–576.24孙小婉, 王英, 王鑫, 等. 面向双注意力网络的特定方面情感分析模型. 计算机研究与发展, 2019, 56(11): 2384–2395.[doi: 10.7544/issn1000-1239.2019.20180823]25Hershey S, Chaudhuri S, Ellis DP, et al . CNN architectures for large-scale audio classification. 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). New Orleans, LA, USA. 2017. 131–135.26Zhalehpour S, Onder O, Akhtar Z, et al . BAUM-1: A spontaneous audio-visual face database of affective and mental states. IEEE Transactions on Affective Computing,2017, 8(3): 300–313. [doi: 10.1109/TAFFC.2016.2553038]27Li Y, Tao JH, Schuller B, et al . MEC 2017: Multimodal emotion recognition challenge. 2018 First Asian Conference on Affective Computing and Intelligent Interaction (AC ⅡAsia). Beijing, China. 2018. 1–5.28Campos V, Jou B, Giró-i-Nieto X. From pixels to sentiment:Fine-tuning CNNs for visual sentiment prediction. Image and Vision Computing, 2017, 65: 15–22. [doi: 10.1016/j.imavis.2017.01.011]29Oquab M, Bottou L, Laptev I, et al . Learning and transferring mid-level image representations using convolutional neural networks. Proceedings of the 2014IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA. 2014. 1717–1724.30Miao HT, Zhang YF, Li WP, et al . Chinese multimodal emotion recognition in deep and traditional machine leaming approaches. 2018 First Asian Conference on Affective Computing and Intelligent Interaction (AC Ⅱ Asia). Beijing,China. 2018. 1–6.31Ma YX, Hao YX, Chen M, et al . Audio-visual emotion fusion (AVEF): A deep efficient weighted rmation Fusion, 2019, 46: 184–192. [doi: 10.1016/j.inffus.2018.06.003]32Xi YX, Li PC, Song Y, et al . Speaker to emotion: Domain adaptation for speech emotion recognition with residual adapters. 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). Lanzhou, China. 2019. 513–518.332021 年 第 30 卷 第 5 期计算机系统应用275。

1999年年全真试题PartⅠClozeTestDirections：Foreachnumberedblankinthefollowingpassage,therearefourchoicesmarked［A］,［B］,［C］and ［D］.ChoosethebestoneandmarkyouransweronANSWERSHEET1byblackeningthecorrespondingletterinthebr acketswithapencil.(10points)panies1lowaccidentratesplantheirsafetyprograms,workhardtoorgani zethem,andcontinueworkingtokeepthem2andactive.Whentheworkiswelldone,a3ofaccidentfreeoperationsisestablished4timelostduetoinjuriesiskeptataminimum.Successfulsafetyprogramsmay5greatlyintheemphasisplacedoncertainaspectsoftheprogram.Someplacegreat emphasisonmechanicalguarding.Othersstresssafeworkpracticesby6rulesorregulations.7othersdependonanemotio nalappealtotheworker.But,therearecertainbasicideasthatmustbeusedineveryprogramifmaximumresultsaretobeobt ained.Therecanbenoquestionaboutthevalueofasafetyprogram.Fromafinancialstandpointalone,safety8.Thefewerth einjury9,thebettertheworkman’sinsurancerate.Thismaymeanthedifferencebetweenoperatingat10orataloss.1.［A］at ［B］in ［C］on ［D］with2.［A］alive ［B］vivid ［C］mobile ［D］diverse3.［A］regulation ［B］climate ［C］circumstance ［D］requirement4.［A］where ［B］how ［C］what ［D］unless5.［A］alter ［B］differ ［C］shift ［D］distinguish6.［A］constituting ［B］aggravating ［C］observing ［D］justifying7.［A］Some ［B］Many ［C］Even ［D］Still8.［A］comesoff ［B］turnsup ［C］paysoff ［D］holdsup9.［A］claims ［B］reports ［C］declarations ［D］proclamations10.［A］anadvantage ［B］abenefit ［C］aninterest ［D］aprofitPartⅡReadingComprehensionDirections:Eachofthepassagesbelowisfollowedbysomequestions.Foreachquestiontherearefouranswersmarked［A］,［B］,［C］and［D］.Readthepassagescarefullyandchoosethebestanswertoeachofthequestions.ThenmarkyouransweronANSW ERSHEET1byblackeningthecorrespondingletterinthebracketswithapencil.(40points)Passage1It’saroughworldoutthere.Stepoutsideandyoucouldbreakalegslippingonyourdoormat.Lightupthestoveandyou couldburndownthehouse.Luckily,ifthedoormatorstovefailedtowarnofcomingdisaster,asuccessfullawsuitmightco mpensateyouforyourtroubles.Orsothethinkinghasgonesincetheearly1980s,whenjuriesbeganholdingmorecompani esliablefortheircustomers’misfortunes.Feelingthreatened,companiesrespondedbywritingeverlongerwarninglabels,tryingtoanticipateeverypossibleaccident.Today,stepladderscarrylabelsseveralincheslongtha twarn,amongotherthings,thatyoumight—surprise!—falloff.Thelabelon achild’sBatmancapecautionsthatthetoy“doesnotenableusertofly”.Whilewarningsareoftenappropriateandnecessary—thedangersofdruginteractions,forexample—andmanyare requiredbystateorfederal regulations,itisn’tclearthattheyactuallyprotectthemanufacturersandsellersfromliabilityif acustomerisinjured.About50percentofthecompanieslosewheninjuredcustomerstakethemtocourt.Nowthetideappearstobeturning.Aspersonalinjuryclaimscontinueasbefore,somecourtsarebeginningtosidewit hdefendants,especiallyincaseswhereawarninglabelprobablywouldn’thavechangedanything.InMay,JulieNimmon s,presidentofSchuttSportsinIllinois,successfullyfoughtalawsuitinvolvingafootballplayerwhowasparalyzedinaga mewhilewearingaSchutthelmet.“We’rereallysorryhehasbecomeparalyzed,buthelmetsaren’tdesignedtopreventtho sekindsofinjuries,”saysNimmons.Thejuryagreedthatthenatureofthegame,notthehelmet,wasthereasonfortheathlet e’sinjury.Atthesametime,theAmericanLawInstitute—agroupofjudges,lawyers,andacademicswhoserecommendat ionscarrysubstantialweight—issuednewguidelinesfortortlawstatingthatcompaniesneednotwarncustomersofobvio usdangersorbombardthemwithalengthylistofpossibleones.“Importantinformationcangetburiedinaseaoftrivialities ,”saysalawprofessoratCornellL awSchoolwhohelpeddraftthenewguidelines.Ifthemoderateendofthelegalcommuni tyhasitsway,theinformationonproductsmightactuallybeprovidedforthebenefitofcustomersandnotasprotectionagai nstlegalliability.11.Whatwerethingslikein1980swhenaccidentshappened?［A］Customersmightberelievedoftheirdisastersthroughlawsuits.［B］Injuredcustomerscouldexpectprotectionfromthelegalsystem.［C］Companieswouldavoidbeingsuedbyprovidingnewwarnings.［D］Juriestendedtofindfaultwiththecompensationscompaniespromised.12.Manufacturersasmentionedinthepassagetendto.［A］satisfycustomersbywritinglongwarningsonproducts［B］becomehonestindescribingtheinadequaciesoftheirproducts［C］makethebestuseoflabelstoavoidlegalliability［D］feelobligedtoviewcustomers’safetyastheirfirstconcern13.ThecaseofSchutthelmetdemonstratedthat.［A］someinjuryclaimswerenolongersupportedbylaw［B］helmetswerenotdesignedtopreventinjuries［C］productlabelswouldeventuallybediscarded［D］somesportsgamesmightlosepopularitywithathletes14.Theauthor’sattitudetowardstheissueseemstobe.［A］biased ［B］indifferent ［C］puzzling ［D］objectivePassage2InthefirstyearorsoofWebbusiness,mostoftheactionhasrevolvedaroundeffortstotaptheconsumermarket.Morer ecently,astheWebprovedtobemorethanafashion,companieshavestartedtobuyandsellproductsandserviceswithonea nother.Suchbusiness to businesssalesmakesensebecausebusinesspeopletypicallyknowwhatproductthey’relookingfor.Nonetheless,manycompaniesstillhesitatetousetheWebbecauseofdoubtsaboutitsreliability.“Businessesneedt ofeeltheycantrustthepathwaybetweenthema ndthesupplier,”sayssenioranalystBlaneErwinofForresterResearch.So mecompaniesarelimitingtheriskbyconductingonlinetransactionsonlywithestablishedbusinesspartnerswhoaregive naccesstothecompany’sprivateintranet.AnothermajorshiftinthemodelforInternetcommerceconcernsthetechnologyavailableformarketing.Untilrece ntly,Internetmarketingactivitieshavefocusedonstrategiesto“pull”customersintosites.Inthepastyear,however,softw arecompanieshavedevelopedtoolsthatallowcompaniesto“push”informationdirectlyouttoconsumers,transmitt ing marketingmessagesdirectlytotargetedcustomers.Mostnotably,thePointcastNetworkusesascreensavertodeliveracontinuallyupdatedstreamofnewsandadvertisementstosubscribers’computermonitors.Subscriberscancustomizethei nformationtheywanttoreceiveandproceeddirectlyt oacompany’paniessuchasVirtualVineyardsareal readystartingtousesimilartechnologiestopushmessagestocustomersaboutspecialsales,productofferings,orotherev ents.ButpushtechnologyhasearnedthecontemptofmanyWebusers.Onlineculturethinkshighlyofthenotionthattheinf ormationflowingontothescreencomestherebyspecificrequest.Oncecommercialpromotionbeginstofillthescreenuni nvited,thedistinctionbetweentheWebandtelevisionfades.That’saprospectthathorrifiesNetpurists.ButitishardlyinevitablethatcompaniesontheWebwillneedtoresorttopushstrategiestomakemoney.Theexampl esofVirtualVineyards,,andotherpioneersshowthataWebsitesellingtherightkindofproductswiththerig htmixofinteractivity,hospitality,andsecuritywillattractonlinecustomers.Andthecostofcomputingpowercontinuest ofreefall,whichisagoodsignforanyenterprisesettingupshopinsilicon.Peoplelookingback5or10yearsfromnowmay wellwonderwhysofewcompaniestooktheonlineplunge.15.WelearnfromthebeginningofthepassagethatWebbusiness.［A］hasbeenstrivingtoexpanditsmarket［B］intendedtofollowafancifulfashion［C］triedbutinvaintocontrolthemarket［D］hasbeenboomingforoneyearorso16.Speakingoftheonlinetechnologyavailableformarketing,theauthorimpliesthat.［A］thetechnologyispopularwithmanyWebusers［B］businesseshavefaithinthereliabilityofonlinetransactions［C］thereisaradicalchangeinstrategy［D］itisaccessiblelimitedlytoestablishedpartners17.IntheviewofNetpurists,.［A］thereshouldbenomarketingmessagesinonlineculture［B］moneymakingshouldbegivenprioritytoontheWeb［C］theWebshouldbeabletofunctionasthetelevisionset［D］thereshouldbenoonlinecommercialinformationwithoutrequests18.Welearnfromthelastparagraphthat.［A］pushinginformationontheWebisessentialtoInternetcommerce［B］interactivity,hospitalityandsecurityareimportanttoonlinecustomers［C］leadingcompaniesbegantotaketheonlineplungedecadesago［D］settingupshopsinsiliconisindependentofthecostofcomputingpowerPassage3Aninvisibleborderdividesthosearguingforcomputersintheclassroomonthebehalfofstudents’careerprospectsa ndthosearguingforcomputersintheclassroomforbroaderreasonsofradicaleducationalreform.Veryfewwritersonthes ubjecthaveexploredthisdistinction—indeed,contradiction—whichgoestotheheartofwhatiswrongwiththecampaig ntoputcomputersintheclassroom.Aneducationthataimsatgettingastudentacertainkindofjobisatechnicaleducation,justifiedforreasonsradicallyd ifferentfromwhyeducationisuniversallyrequiredbylaw.Itisnotsimplytoraiseeveryone’sjobprospectsthatallchildre narelegallyrequiredtoattendschoolintotheirteens.Rather,wehaveacertainconceptionoftheAmericancitizen,acharac terwhoisincompleteifhecannotcompetentlyassesshowhislivelihoodandhappinessareaffectedbythingsoutsideofhi mself.Butthiswasnotalwaysthecase;beforeitwaslegallyrequiredforallchildrentoattendschooluntilacertainage,itwa swidelyacceptedthatsomewerejustnotequippedbynaturetopursuethiskindofeducation.Withoptimismcharacteristi cofallindustrializedcountries,putereducationadvocatesforsakethisoptimisticnotionforapessimismthatbetraystheirotherwisecheeryoutlook.Bankingontheconfusionbetweeneducationalandvocationalreasonsforbringingcomputersintoschools,computeredadvocates oftenemphasizethejobprospectsofgraduatesovertheireducationalachievement.Therearesomegoodargumentsforatechnicaleducationgiventherightkindofstudent.ManyEuropeanschoolsintr oducetheconceptofprofessionaltrainingearlyoninordertomakesurechildrenareproperlyequippedfortheprofessions theywanttojoin.Itis,however,presumptuoustoinsistthattherewillonlybesomanyjobsforsomanyscientists,somanyb usinessmen,somanyaccountants.Besides,thisisunlikelytoproducetheneedednumberofeverykindofprofessionalina countryaslargeasoursandwheretheeconomyisspreadoversomanystatesandinvolvessomanyinternationalcorporatio ns.But,forasmallgroupofstudents,professionaltrainingmightbethewaytogosincewelldevelopedskills,allotherfactorsbeingequal,canbethedifferencebetweenhavingajobandnot.Ofcourse,thebasicsofus inganycomputerthesedaysareverysimple.Itdoesnottakealifelongacquaintancetopickupvarioussoftwareprograms.I fonewantedtobecomeacomputerengineer,thatis,ofcourse,anentirelydifferentstory.Basiccomputerskillstake—atth everylongest—acoupleofmonthstolearn.Inanycase,basiccomputerskillsareonlycomplementarytothehostofrealski llsthatarenecessarytobecominganykindofprofessional.Itshouldbeobserved,ofcourse,thatnoschool,vocationalorno t,ishelpedbyaconfusionoveritspurpose.19.Theauthorthinksthepresentrushtoputcomputersintheclassroomis.［A］far reaching ［B］dubiouslyoriented［C］self contradictory ［D］radicallyreformatory20.Thebeliefthateducationisindispensabletoallchildren.［A］isindicativeofapessimismindisguise［B］cameintobeingalongwiththearrivalofcomputers［C］isdeeplyrootedinthemindsofcomputer edadvocates［D］originatedfromtheoptimisticattitudeofindustrializedcountries21.Itcouldbeinferredfromthepassagethatintheauthor’scountrythe Europeanmodelofprofessionaltrainingis.［A］dependentuponthestartingageofcandidates［B］worthtryinginvarioussocialsections［C］oflittlepracticalvalue［D］attractivetoeverykindofprofessional22.Accordingtotheauthor,basiccomputerskillsshouldbe.［A］includedasanauxiliarycourseinschool［B］highlightedinacquisitionofprofessionalqualifications［C］masteredthroughalife longcourse［D］equallyemphasizedbyanyschool,vocationalorotherwisePassage4WhenaScottishresearchteamstartledtheworldbyrevealing3monthsagothatithadclonedanadultsheep,Presiden tClintonmovedswiftly.Declaringthathewasopposedtousingthisunusualanimalhusbandrytechniquetoclonehumans ,heorderedthatfederalfundsnotbeusedforsuchanexperiment—althoughnoonehadproposedtodoso—andaskedanin dependentpanelofexpertschairedbyPrincetonPresidentHaroldShapirotoreportbacktotheWhiteHousein90dayswit hrecommendationsforanationalpolicyonhumancloning.Thatgroup—theNationalBioethicsAdvisoryCommission(NBAC)—hasbeenworkingfeverishlytoputitswisdomonpaper,andatameetingon17May,membersagreedonanearfinaldraftoftheirrecommendations.NBACwillaskthatClinton’s90daybanonfederalfundsforhumancloningbeextendedindefinitely,andpossiblythatitbemadelaw.ButNBACmembersareplanningtowordtherecommendationnarrowlytoavoidnewrestrictionsonresearchthatinvolvesthecloningofhuma nDNAorcells—routineinmolecularbiology.Thepanelhasnotyetreachedagreementonacrucialquestion,however,wh ethertorecommendlegislationthatwouldmakeitacrimeforprivatefundingtobeusedforhumancloning.Inadraftprefacetotherecommendations,discussedatthe17Maymeeting,Shapirosuggestedthatthepanelhadfoun dabroadconsensusthatitwouldbe“morallyunacceptabletoattempttocreateahumanchildbyadultnuclearcloning.”Sha piroexplainedduringthemeetingthatthemoraldoubtstemsmainlyfromfearsabouttherisktothehealthofthechild.Thep aneltheninformallyacceptedseveralgeneralconclusions,althoughsomedetailshavenotbeensettled.NBACplanstocallforacontinuedbanonfederalgovernmentfundingforanyattempttoclonebodycellnucleitocrea teachild.Becausecurrentfederallawalreadyforbidstheuseoffederalfundstocreateembryos(theearlieststageofhuman offspringbeforebirth)forresearchortoknowinglyendangeranembryo’slife,NBACwillremainsilentonembryoresear ch.NBACmembersalsoindicatedthattheywouldappealtoprivatelyfundedresearchersandclinicsnottotrytocloneh umansbybodycellnucleartransfer.Buttheyweredividedonwhethertogofurtherbycallingforafederallawthatwouldim poseacompletebanonhumancloning.Shapiroandmostmembersfavoredanappealforsuchlegislation,butinaphoneint erview,hesaidthisissuewasstill“upintheair”.23.Wecanlearnfromthefirstparagraphthat.［A］federalfundshavebeenusedinaprojecttoclonehumans［B］theWhiteHouserespondedstronglytothenewsofcloning［C］NBACwasauthorizedtocontrolthemisuseofcloningtechnique［D］theWhiteHousehasgotthepanel’srecommendationsoncloning24.Thepanelagreedonallofthefollowingexceptthat.［A］thebanonfederalfundsforhumancloningshouldbemadealaw［B］thecloningofhumanDNAisnottobeputundermorecontrol［C］itiscriminaltouseprivatefundingforhumancloning［D］itwouldbeagainstethicalvaluestocloneahumanbeing25.NBACwillleavetheissueofembryoresearchundiscussedbecause.［A］embryoresearchisjustacurrentdevelopmentofcloning［B］thehealthofthechildisnotthemainconcernofembryoresearch［C］anembryo’slifewillnotbeendangeredinembryoresearch［D］theissueisexplicitlystatedandsettledinthelaw26.Itcanbeinferredfromthelastparagraphthat.［A］someNBACmembershesitatetobanhumancloningcompletely［B］alawbanninghumancloningistobepassedinnotime［C］privatelyfundedresearcherswillrespondpositivelytoNBAC’sappeal［D］theissueofhumancloningwillsoonbesettledPassage5Science,inpractice,dependsfarlessontheexperimentsitpreparesthanonthepreparednessofthemindsofthemenw howatchtheexperiments.SirIsaacNewtonsupposedlydiscoveredgravitythroughthefallofanapple.Appleshadbeenfa llinginmanyplacesforcenturiesandthousandsofpeoplehadseenthemfall.ButNewtonforyearshadbeencuriousaboutt hecauseoftheorbitalmotionofthemoonandplanets.Whatkepttheminplace?Whydidn’ttheyfalloutofthesky?Thefactt hattheapplefelldowntowardtheearthandnotupintothetreeansweredthequestionhehadbeenaskinghimselfaboutthose largerfruitsoftheheavens,themoonandtheplanets.Howmanymenwouldhaveconsideredthepossibilityofanapplefallingupintothetree?Newtondidbecausehewas nottryingtopredictanything.Hewasjustwondering.Hismindwasreadyfortheunpredictable.Unpredictabilityispartoftheessentialnatureofresea rch.Ifyoudon’thaveunpredictablethings,youdon’thaveresearch.Scientiststendtoforgetthi swhenwritingtheircutanddriedreportsforthetechnicaljournals,buthistoryisfilledwithexamplesofit.Intalkingtosomescientists,particularlyyoungerones,youmightgathertheimpression thattheyfindthe“scientific method”asubstituteforimaginativethought.I’veattendedresearchconferenceswhereascientisthasbeenaskedwhathe thinksabouttheadvisabilityofcontinuingacertainexperiment.Thescientisthasfrowned,lookedatthegraphs,andsaid,“thedataarestillinco nclusive.”“Weknowthat,”themenfromthebudgetofficehavesaid,“butwhatdoyouthink?Isitwort hwhilegoingon?Whatdoyouthinkwemightexpect?”Thescientisthasbeenshockedathavingevenbeenaskedtospecula te.Whatthisamountsto,ofcourse,isthatthescientisthasbecomethevictimofhisownwritings.Hehasputforwardunq uestionedclaimssoconsistentlythathenotonlybelievesthemhimself,buthasconvincedindustrialandbusinessmanage mentthattheyaretrue.Ifexperimentsareplannedandcarriedoutaccordingtoplanasfaithfullyasthereportsinthesciencej ournalsindicate,thenitisperfectlylogicalformanagementtoexpectresearchtoproduceresultsmeasurableindollarsand cents.Itisentirelyreasonableforauditorstobelievethatscientistswhoknowexactlywheretheyaregoingandhowtheywi llgetthereshouldnotbedistractedbythenecessityofkeepingoneeyeonthecashregisterwhiletheothereyeisonthemicros cope.Nor,ifregularityandconformitytoastandardpatternareasdesirabletothescientistasthewritingofhispaperswould appeartoreflect,ismanagementtobeblamedfordiscriminatingagainstthe“oddballs”amongresearchersinfavorofm or econventionalthinkerswho“workwellwiththeteam”.27.TheauthorwantstoprovewiththeexampleofIsaacNewtonthat.［A］inquiringmindsaremoreimportantthanscientificexperiments［B］scienceadvanceswhenfruitfulresearchesareconducted［C］scientistsseldomforgettheessentialnatureofresearch［D］unpredictabilityweighslessthanpredictioninscientificresearch28.Theauthorassertsthatscientists.［A］shouldn’treplace“scientificmethod”withimaginativethought［B］shouldn’tneglecttospeculateonunpredictablethings［C］shouldwritemoreconcisereportsfortechnicaljournals［D］shouldbeconfidentabouttheirresearchfindings29.Itseemsthatsomeyoungscientists.［A］haveakeeninterestinprediction［B］oftenspeculateonthefuture［C］thinkhighlyofcreativethinking［D］stickto“scientificmethod”30.Theauthorimpliesthattheresultsofscientificresearch.［A］maynotbeasprofitableastheyareexpected［B］canbemeasuredindollarsandcents［C］relyonconformitytoastandardpattern［D］aremostlyunderestimatedbymanagementPartⅢEnglish ChineseTranslationDirections:ReadthefollowingpassagecarefullyandthentranslatetheunderlinedsegmentsintoChinese.Yourtranslationmus tbewrittenclearlyonANSWERSHEET2.(15points)31）Whiletherearealmostasmanydefinitionsofhistoryastherearehistorians,modernpracticemostcloselyconformstoonet hatseeshistoryastheattempttorecreateandexplainthesignificanteventsofthepast.Caughtinthewebofitsowntimeandplace,eachgenerationofhistoriansdeterminesanewwhatissignificantforitinthepast.Inthissearchtheevidencefoundisa lwaysincompleteandscattered;itisalsofrequentlypartialorpartisan.Theironyofthehi storian’scraftisthatitspractition ersalwaysknowthattheireffortsarebutcontributionstoanunendingprocess.32）Interestinhistoricalmethodshasarisenlessthroughexternalchallengetothevalidityofhistoryasanintellectualdisciplin eandmorefrominternalquarrelsamonghistoriansthemselves.Whilehistoryoncerevereditsaffinitytoliteratureandphi losophy,theemergingsocialsciencesseemedtoaffordgreateropportunitiesforaskingnewquestionsandprovidingrew ardingapproachestoanunderstandingofthepast.Socialsciencemethodologieshadtobeadaptedtoadisciplinegoverne dbytheprimacyofhistoricalsourcesratherthantheimperativesofthecontemporaryworld.33）Duringthistransfer,traditionalhistoricalmethodswereaugmentedbyadditionalmethodologiesdesignedtointerpretth enewformsofevidenceinthehistoricalstudy.Methodologyisatermthatremainsinherentlyambiguousinthehistoricalprofession.34）Thereisnoagreementwhethermethodologyreferstotheconceptspeculiartohistoricalworkingeneralortotheresearcht echniquesappropriatetothevariousbranchesofhistoricalinquiry.Historians,especiallythosesoblindedbytheirresearc hintereststhattheyhavebeenaccusedof“tunnelmethod,”frequentlyfallvictimtothe“technicalfallacy.”Alsocommoni nthenaturalsciences,thetechnicistfallacymistakenlyidentifiesthedisciplineasawholewithcertainpartsofitstechnical implementation.35）Itappliesequallytotraditionalhistorianswhoviewhistoryasonlytheexternalandinternalcriticismofsources,andtosoci alsciencehistorianswhoequatetheiractivitywithspecifictechniques.SectionⅣWriting(15points)36.Directions:A.Studythefollowinggraphscarefullyandwriteanessayinatlessthan150words.B.YouressaymustbewrittenclearlyontheANSWERSHEET2.C.Youressayshouldcoverthreepoints:a.effectofthecountry’sgrowinghumanpopulationonitswildlife,b.possiblereasonsfortheeffect,c.yoursuggestionforwildlifeprotection试题精解PartⅠClozeTest一、文章总体分析本文是围绕安全生产这个话题的一篇论证性文章。

Section ⅠUse of EnglishDirections:Read the following text. Choose the best word(s) for each numbered blank and mark A, B,C or D on the ANSWER SHEET. (10 points)Even if families don't sit down to eat together as frequently as before, millions of Britons will nonetheless have got a share this weekend of one of that nation’ s great traditions:the Sunday roast. 1 a cold winter's day, few culinary pleasures can 2 it. Yet as we report now, the food police are determined that this 3 should be rendered yet another guilty pleasure 4 to damage our health.The Food Standards Authority (FSA) has 5 a public warning about the risks of a compound called acrylamide that forms in some foods cooked 6 high temperatures. This means that people should 7 crisping their roast potatoes, reject thin-crust pizzas and only 8 toast their bread.But where is the evidence to support such alarmist advice? 9 studies have shown that acrylamide can cause neurological damage in mice, there is no 10 evidence that it causes cancer in humans.Scientists say the compound is 11 to cause cancer but have no hard scientific proof. 12 the precautionary principle, it could be argued that it is 13 to follow the FSA advice. 14 , it was rumoured that smoking caused cancer for years before the evidence was found to prove a 15 .Doubtless a piece of boiled beef can always be 16 up on Sunday alongside some steamed vegetables, without the Yorkshire pudding and no wine. But would life be worth living? 17 , the FSA says it is not telling people to cut out roast foods18 ,but to reduce their lifetime intake. However, their 19 risks cominga cross as being pushy and overprotective.Constant health scares just 20 with no one listening.1.[A] In [B] Towards [C] On [D]Till2.[A] match [B] express [C] satisfy [D] influence3.[A] patience4.[A] intensified5.[A] issued [B] enjoyment[B] privileged[B] received[C] surprise[C] compelled[C] compelled[D] concern[D] guaranteed[D] guaranteed6. [A] under [B] at [C] for [D] by7. [A] forget [B] regret [C] finish [D] avoid8. [A] partially [B] regular [C] easily [D] initially9.[A] Unless [B] Since [C] If [D] While10.[A] secondary [B] external [C] conclusive [D] negative11.[A] insufficient [B] bound [C] likely [D] slow12.[A] On the basis of [B] At the cost of [C] In addition to [D] In contrast to13.[A] interesting [B] advisable [C] urgent [D] fortunate14.[A] As usual [B] In particular [C] By definition [D] After all15.[A] resemblance [B] combination [C] connection [D] pattern16.[A] made [B] served [C] saved [D] used17.[A] To be fair [B] For instance [C] To be brief [D] In general18.[A] reluctantly [B] entirely [C] gradually [D] carefully19.[A] promise [B] experience [C]campaign [D] competition20.[A] follow up [B] pick up [C]open up [D] end upPart A Directions:Read the following four texts. Answer the questions after each text by choosing A, B, C or D. Mark your answers on the ANSWER SHEET. (40 points)Text 1A group of Labour MPs, among them Yvette Cooper, are bringing in the new year with a call to institute a UK “town of culture” award. The proposal is that it should sit alongside the existing city of culture title, which was held by Hull in 2017, and has been awarded to Coventry for 2021. Cooper and her colleagues argue that the success of the crown for Hull, where it brought in £220m of investment and an avalanche of arts, ought not to be confined to cities. Britain’s towns, it is true, are not prevented from applying, but they generally lack the resources to put together a bid to beat their bigger competitors. A town of culture award could, it is argued, become an annual event, attracting funding and creating jobs.Some might see the proposal as a boo by prize for the fact that Britain is no longer able to apply for the much more prestigious title of European capital of culture, a sought-after award bagged by Glasgow in 1990 and Liverpool in 2008. A cynic might speculate that the UK is on the verge of disappearing into an endless fever of self-celebration in its desperation to reinvent itself for the post-Brexit world: after town of culture, who knows what will follow----village of culture? Suburb of culture? Hamlet of culture?It is also wise to recall that such titles are not a cure-all. A badly run “year of culture” washes in and washes out of a place like the tide, bringing prominence for a spell but leaving no lasting benefits to the community. The really successful holders of such titles are those that do a great deal more than fill hotel bedrooms and bring in high-profile arts events and good press for a year. They transform the aspirations of the people who live there; they nudge the self-image of the city into a bolder and more optimistic light. It is hard to get right, and requires a remarkable degree of vision, as well as cooperation between city authorities, the private sector, community groups and cultural organisations. But it can be done: Glasgow's year as European capital of culture can certainly be seen as one of a complex series of factors that have turned the city into the powerhouse of art, music and theatre that it remains today.s peculiarities —helping sustain its high street, supporting local facilities and above all celebrating its people. Jeremy Wright, the culture secretary, should welcome this positive, hope-filled proposal, and turn it into action.21. Cooper and her colleagues argue that a “town of culture” award could[A] consolidate the town-city ties in Britain.[B] promote cooperation-among Britain’s towns.[C] increase the economic strength of Britain’s towns.[D] focus Britain’s limited resources on cultural events.22. According to Paragraph 2, the proposal might be regarded by some as[A] a sensible compromise.[B] a self-deceiving attempt.[C] an eye-catching bonus.[D] an inaccessible target.23. The author suggests that a title holder is successful only if it[A] endeavours to maintain its image.[B] meets the aspiration of its people.[C] brings its local arts to prominence.[D] commits to its long-term growth.24. Glasgow is mentioned in Paragraph 3 to present[A] a contrasting case.[B]a supporting example.[D] a related topic.25.What is the author’s attitude towards the proposal?[A]Skeptical.[B]Objective.[C]Favourable.[D]Critical.Text 2Scientific publishing has long been a licence to print money. Scientists need journals in which to publish their research, so they will supply the articles without monetary reward. Other scientists perform the specialised work of peer review also for free, because it is a central element in the acquisition of status and the production of scientific knowledge.With the content of papers secured for free, the publisher needs only find a market for its journal. Until this century, university libraries were not very price sensitive. Scientific publishers routinely report profit margins approaching 40% on their operations at a time when the rest of the publishing industry is in an existential crisis.The Dutch giant Elsevier, which claims to publish 25% of the scientific papers produced in the world, made profits of more than £900m last year, while UK universities alone spent more than £210m in 2016 to enable researchers to access their own publicly funded research; both figures seem to rise unstoppably despite increasingly desperate efforts to change them.The most drastic, an thoroughly illegal, reaction has been the emergence of Sci-Hub, a kind of global photocopier for scientific papers, set up in 2012, which now claims to offer access to every paywalled article published since 2015. The success of Sci-Hub, which relies on researchers passing on copies they have themselvesmust be transformed so that it works for all participants.In Britain the move towards open access publishing has been driven by funding bodies. In some ways it has been very successful. More than half of all British scientific research is now published under open access terms: either freely available from the moment of publication, or paywalled for a year or more so that the publishers can make a profit before being placed on general release.Yet the new system has not yet worked out any cheaper for the universities. Publishers have responded to the demand that they make their product free to readers by charging their writers fees to cover the costs of prep ring an article. These range from around £500to $5,000, and apparently the work gets more expensive the more that publishers do it. A report last year pointed out that the costs both of subscriptions and of these “article preparation costs” had been steadily rising at a rate above inflation.In some ways the scientific publishing model resembles the economy of the social internet: labour is provided free in exchange for the hope of status, while huge profits are made by a few big firms who run the market places. In both cases, we need a rebalancing of power.26.Scientific publishing is seen as “a licence to print money” partly because[A]its funding has enjoyed a steady increase.[B]its marketing strategy has been successful.[C]its payment for peer review is reduced.[D]its content acquisition costs nothing.27.According to Paragraphs 2 and 3, scientific publishers Elsevier have[A]thrived mainly on university libraries.[B]gone through an existential crisis.[C]revived the publishing industry.28.How does the author feel about the success of Sci-Hub?[A]Relieved.[B]Puzzled.[C]Concerned.[D]Encouraged.29.It can be learned from Paragraphs 5 and 6 that open access terms[A]allow publishers some room to make money.[B]render publishing much easier for scientists.[C]reduce the cost of publication substantially.[D]free universities from financial burdens.30.Which of the following characterizes the scientific publishing model?[A]Trial subscription is offered.[B]Labour triumphs over status.[C]Costs are well controlled.[D]The few feed on the many.Text 3Progressives often support diversity mandates as a path to equality and a way to level the playing field. But all too often such policies are an insincere form of virtue-signaling that benefits only the most privileged and does little to help average people.Speaker Pro Tempore Patricia Haddad, to ensure “gender parity” on boards and commissions, provide a case in point.Haddad and Lewis are concerned that more than half the state-government boards are less than 40 percent female. In order to ensure that elite women have more such opportunities, they have proposed imposing government quotas. If the bills become law, state boards and commissions will be required to set aside 50 percent of board seats for women by 2022.The bills are similar to a measure recently adopted in California, which last year became the first state to require gender quotas for private companies. In signing the measure, California Governor Jerry Brown admitted that the law, which expressly classifies people on the basis of sex, is probably unconstitutional.The US Supreme Court frowns on sex-based classifications unless they are designed to address an “important” policy interest, Because the California law applies to all boards, even where there is no history of prior discrimination, courts are likely to rule that the law violates the constitutional guarantee of“equal protection”.But are such government mandates even necessary? Female participation on corporate boards may not currently mirror the percentage of women in the general population, but so what?The number of women on corporate boards has been steadily increasing without government interference. According to a study by Catalyst, between 2010 and 2015 the share of women on the boards of global corporations increased by 54 percent.Requiring companies to make gender the primary qualification for board membership will inevitably lead to less experienced private sector boards. That is exactly what happened when Norway adopted a nationwide corporate gender quota.Writing in The New Republic, Alice Lee notes that increasing the number of opportunities for board membership without increasing the pool of qualified women to serve on such boards has led to a “golden skirt” phenomenon, where the same elite women scoop up multiple seats on a variety of boards.remember that such policies are largely self-serving measures that make their sponsors feel good but do little to help average women.31.T he author believes that the bills sponsored by Lewis and Haddad will[A]help little to reduce gender bias.[B]pose a threat to the state government.[C]raise women’s position in politics.[D]greatly broaden career options.32.Which of the following is true of the California measure?[A]It has irritated private business owners.[B]It is welcomed by the Supreme Court.[C]It may go against the Constitution.[D]It will settle the prior controversies.33.The author mentions the study by Catalyst to illustrate[A]the harm from arbitrary board decision.[B]the importance of constitutional guarantees.[C]the pressure on women in global corporations.[D]the needlessness of government interventions.34.Norway’s adoption of a nationwide corporate gender quota has led to[A]the underestimation of elite women’s role.[B]the objection to female participation on boards.[D] the growing tension between labor and management.35.Which of the following can be inferred from the text?[A]Women’s need in employment should be considered.[B]Feasibility should be a prime concern in policymaking.[C]Everyone should try hard to promote social justice.[D]Major social issues should be the focus of legislation.Text 4Last Thursday, the French Senate passed a digital services tax, which would impose an entirely new tax on large multinationals that provide digital services to consumers or users in France. Digital services include everything from providing a platform for selling goods and services online to targeting advertising based on user data, and the tax applies to gross revenue from such services. Many French politicians and media outlets have referred to this as a “ GAFA tax,” meaning that it is designed to apply primarily to companies such as Google, Apple, Facebook and Amazon—in other words, multinational tech companies based in the United States.The digital services tax now awaits the signature of President Emmanuel Macron, who has expressed support for the measure, and it could go into effect within the next few weeks. But it has already sparked significant controversy, with the United States trade representative opening an investigation into whether the tax discriminates against American companies, which in tum could lead to trade sanctions against France.The French tax is not just a unilateral move by one country in need of revenue.Instead, the digital services tax is part of a much larger trend, with countries over the past few years proposing or putting in place an alphabet soup of new international tax provisions. They have included Britain’s DPT. (diverted profits tax), Australia’s MAAL (multinational anti-avoidance law), and India’s SEP (significant economic presence) test, to name but a few. At the same time, the Europeandigital services taxes.These unilateral developments differ in their specifics, but they are all designed to tax multinationals on income and revenue that countries believe they should have a right to tax, even if international tax rules do not grant them that right. In other words, they all share a view that the international tax system has failed to keep up with the current economy.In response to these many unilateral measures, the Organization for Economic Cooperation and Development (OECD) is currently working with 131 countries to reach a consensus by the end of 2020 on an international solution. Both France and the United States are involved in the organization's work, but France's digital services tax and the American response raise questions about what the future holds for the international tax system.France’s planned tax is a clear warning: Unless a broad consensus can be reached on reforming the international tax system, other nations are likely to follow suit, and American companies will face a cascade of different taxes from dozens of nations that will prove burdensome and costly.36.T he French Senate has passed a bill to[A]regulate digital services platforms.[B]protect French companies’ interests.[C]impose a levy on tech multinationals.[D]curb the influence of advertising.37.It can be learned from Paragraph 2 that the digital services tax[A]may trigger countermeasures against France.[B]is apt to arouse criticism at home and abroad.[C]aims to ease international trade tensions.38.The countries adopting the unilateral measures share the opinion that[A]redistribution of tech giants’ revenue must be ensured.[B]the current international tax system needs upgrading.[C]tech multinationals’ monopoly should be prevented.[D]all countries ought to enjoy equal taxing rights.39.It can be learned from Paragraph 5 that the OECD’s current work[A]is being resisted by US companies.[B]needs to be readjusted immediately.[C]is faced with uncertain prospects.[D]needs to in involve more countries.40.Which of the following might be the best title for this text?[A]France Is Confronted with Trade Sanctions[B]France leads the charge on Digital Tax[C]France Says “ NO ” to Tech Multinationals[D]France Demands a Role in the Digital EconomyPart BDirections:Read the following text and answer the questions by choosing the most suitable subheading from the list A-G for each of the numbered paragraphs (41-45). There are two extra subheadings. Mark your answers on the ANSWER SHEET. (10 points)[B] Too much eye contact is instinctively felt to be rude[C]Eye contact can be a friendly social signal[D] Personality can affect how a person reacts to eye contact[E] Biological factors behind eye contact are being investigated[F] Most people are not comfortable holding eye contact with strangers[G] Eye contact can also be aggressive.In a social situation, eye contact with another person can show that you are paying attention in a friendly way. But it can also be antagonistic such as when a political candidate turns toward their competitor during a debate and makes eye contact that signals hostility.Here’s what hard science reveals about eye contact:We know that a typical infant will instinctively gaze into its mother’s eyes, and she will look back. This mutual gaze is a major part of the attachment between mother and child. In adulthood, looking someone else in a pleasant way can be a complimentary sign of paying attention. It can catch someone’s attention in a crowded room, “Eye contact and smile” can signal availability and confidence, a common-sense notion supported in studies by psychologist Monica Moore.Neuroscientist Bonnie Auyeung found that the hormone oxytocin increased the amount of eye contact from men toward the interviewer during a brief interview when the direction of their gaze was recorded. This was also found in high-functioning men with some autistic spectrum symptoms, who may tend to avoid eye contact. Specificusing advanced methods of brain scanning.With the use of eye-tracking technology, Julia Minson of the Harvard Kennedy School of Government concluded that eye contact can signal very different kinds of messages, depending on the situation. While eye contact may be a sign of connection or trust in friendly situations, it’s more likely to be associated with dominance or intimidation in adversarial situations.“Whether you’re a politician ora parent, it might be helpful to keep in mind that trying to maintain eye contact may backfire if you’re trying to convince someone who has a different set of beliefs than you,” said Minson.When we look at a face or a picture, our eyes pause on one spot at a time, often on the eyes or mouth. These pauses typically occur at about three per second, and the eyes then jump to another spot, until several important points in the image are registered like a series of snapshots. How the whole image is then assembled and perceived is still a mystery although it is the subject of current research.In people who score high in a test of neuroticism, a personality dimension associated with self-consciousness and anxiety, eye contact triggered more activity associated with avoidance,according to the Finnish researcher Jari Hietanen and colleagues “Our findings indicate that people do not only feel different when they are the centre of attention but that their brain reactions also differ.” A more direct finding is that people who scored highly for negative emotions like anxiety looked at others for shorter periods of time and reported more comfortable feelings when others did not look directly at them.Read the following text carefully and then translate the underlined segments into Chinese. Your translation should be written neatly on the ANSWER SHEET. (10 points)Following the explosion of creativity in Florence during the 14th century known as the Renaissance, the modern world saw a departure from what it had once known. It turned from God and the authority of the Roman Catholic Church and instead favoured a more humanistic approach to being. Renaissance ideas had spread throughout Europe well into the 17th century,with the arts and sciences flourishing extraordinarily among those with a more logical disposition. (46) with the Church’s teachings and ways of thinking eclipsed by the Renaissance,the gap between the Medieval and modern periods had been bridged leading to new and unexplored intellectual territories.During the Renaissance, the great minds of Nicolaus Copernicus, Johannes Kepler and Galileo Galilei demonstrated the power of scientific study and discovery. (47) Before each of their revelations many thinkers at the time had sustained more ancient ways of thinking, including the geocentric view that the Earth was at the centre of our universe. Copernicus theorized in 1543 that all of the planets that we knew of revolved not around the Earth, but the Sun, a system that was later upheld by Galileo at his own expense. Offering up such a theory during a time of high tension between scientific and religious minds was branded as heresy and any such heretics that continued to spread these lies were to be punished by imprisonment or even death.(48) Despite attempts by the Church to suppress. this new generation of logicians and rationalists, more explanations for how the universe functioned were being made at a rate that the people could no longer ignore.It was with these great revelations that a new kind of philosophy founded in reason was born.The Church’s long-standing dogma was losing the great battle for truth to rationalists and scientists. This very fact embodied the new ways of thinking that swept through Europe during most of 17th century. (49) As many took on the duty of trying to integrate reasoning and scientific philosophies into the world, the Renaissance was over and it was time for a new era - the Age of Reason.The 17th and 18th centuries were times of radical change and curiosity, Scientific method, reductionism and the questioning of Church ideals was to be encouraged, as were ideas of liberty, tolerance and progress. (50) Such actions to seek knowledge‘sapere aude’ or ‘dare to know’,after Immanuel Kant used it in his essay An Answer to the Question: What is Enlightenment?. It was the purpose and responsibility of great minds to go forth and seek out the truth, which they believed to be founded in knowledge.Section III WritingPart A51.Directions:The Students Union of your university has assigned you to inform the international students about an upcoming singing contest. Write a notice in about 100 words.Write your answer on the ANSWER SHEET.Do not use your own name in the notice. (10 points)Part B52.Directions:Write an essay of 160-200 words based on the picture below. In your essay, you should1)describe the picture briefly,2)interpret the implied meaning, and3)give your comments.You should write neatly on the ANSWER SHEET. (20 points)Section Ⅰ Use of English1.选 C。

收稿日期：２０２１０８１４；修回日期：２０２１１００８ 基金项目：国家自然科学基金面上项目（６１６７２２６３）作者简介：谢旭康（１９９８），男，湖南邵阳人，硕士研究生，主要研究方向为语音识别、机器学习等；陈戈（１９９６），女，河南信阳人，硕士研究生，主要研究方向为语音识别、语音增强等；孙俊（１９７１），男（通信作者），江苏无锡人，教授，博导，博士，主要研究方向为人工智能、计算智能、机器学习、大数据分析、生物信息学等（ｊｕｎｓｕｎ＠ｊｉａｎｇｎａｎ．ｅｄｕ．ｃｎ）；陈祺东（１９９２），男，浙江湖州人，博士，主要研究方向为演化计算、机器学习等．

ＴＣＮＴｒａｎｓｆｏｒｍｅｒＣＴＣ的端到端语音识别谢旭康，陈　戈，孙　俊，陈祺东（江南大学人工智能与计算机学院，江苏无锡２１４１２２）

摘　要：基于Ｔｒａｎｓｆｏｒｍｅｒ的端到端语音识别系统获得广泛的普及，但Ｔｒａｎｓｆｏｒｍｅｒ中的多头自注意力机制对输入序列的位置信息不敏感，同时它灵活的对齐方式在面对带噪语音时泛化性能较差。针对以上问题，首先提出使用时序卷积神经网络（ＴＣＮ）来加强神经网络模型对位置信息的捕捉，其次在上述基础上融合连接时序分类（ＣＴＣ），提出ＴＣＮＴｒａｎｓｆｏｒｍｅｒＣＴＣ模型。在不使用任何语言模型的情况下，在中文普通话开源语音数据库ＡＩＳＨＥＬＬ１上的实验结果表明，ＴＣＮＴｒａｎｓｆｏｒｍｅｒＣＴＣ相较于Ｔｒａｎｓｆｏｒｍｅｒ字错误率相对降低了１０．９１％，模型最终字错误率降低至５．３１％，验证了提出的模型具有一定的先进性。关键词：端到端语音识别；Ｔｒａｎｓｆｏｒｍｅｒ；时序卷积神经网络；连接时序分类中图分类号：ＴＮ９１２３４ 文献标志码：Ａ 文章编号：１００１３６９５（２０２２）０３００９０６９９０５ｄｏｉ：１０．１９７３４／ｊ．ｉｓｓｎ．１００１３６９５．２０２１．０８．０３２３

ＴＣＮＴｒａｎｓｆｏｒｍｅｒＣＴＣｆｏｒｅｎｄｔｏｅｎｄｓｐｅｅｃｈｒｅｃｏｇｎｉｔｉｏｎＸｉｅＸｕｋａｎｇ，ＣｈｅｎＧｅ，ＳｕｎＪｕｎ，ＣｈｅｎＱｉｄｏｎｇ（ＳｃｈｏｏｌｏｆＡｒｔｉｆｉｃｉａｌＩｎｔｅｌｌｉｇｅｎｃｅ＆ＣｏｍｐｕｔｅｒＳｃｉｅｎｃｅ，ＪｉａｎｇｎａｎＵｎｉｖｅｒｓｉｔｙ，ＷｕｘｉＪｉａｎｇｓｕ２１４１２２，Ｃｈｉｎａ）