互动视窗

        图像、声音等媒体识别技术的发展与应用正在悄然地给人们生活带来变革。互动视窗针对博物馆文物展示等类似应用场合，以对参观者手势、意念行为、语音等信息的识别和处理为技术基础，设计一个方便、自然和人性化的嵌入式互动平台。

        作品在EC5-1719CLDNA上，针对展品和参观者行为扩展了摄像头、拾声器、可控展品台等硬件装置；研究了手势识别与跟踪、人脸检测与跟踪、非特定人中英文连续语音识别等可用于人机交互的新方法和算法；研究并改进了基于手形结构特征的识别算法，建立了手势缺陷图的判断方法；在Linux上实现了具有物品展示、多媒体评论、娱乐等功能的互动平台。

        作品还针对平台双核的特点，对识别算法进行并行化处理。图像识别使用多线程的方式，对手势识别、人脸检测进行并行处理；手势识别的手势分割和识别过程采用了OpenMP优化计算，有效地提高了系统的运行速度。

        全息物品展示功能可以理解参观者意图，让参观者立体而真实的观看所展物品，随心所欲的观看每个细节；多媒体评论功能获取参观者的音频和绘制的图像，为参观者提供了交流平台；对展示物品的手势拼图游戏丰富了物品展示的功能，增加了娱乐性。

        互动视窗中所实现的基于音、视频识别的多种人机交互方式还可以有更广阔的应用。

The development and application of image, voice and other media recognition technology are quietly to bring changes to people's lives. The production is designed for museum and some similar places. We have designed a convenient, natural and customized embedded platform based on the recognition and analyze of the gesture, behavior and voice of the visitors.
Camera, microphone, controllable platform and other hardware are added to EC5-1719CLDNA. Gesture identification and tracking, face detection and tracking, human-independent English and Chinese continuous speech recognition have been researched; improved the recognition algorithm of hand-shaped structure, gesture concave map judgments; achieved features like display of items, multimedia reviews, entertainment on Linux.

To the characteristics of dual-core platform, we optimized the recognition algorithm for parallel processing. The gesture recognition, face detection are paralleled; the gesture division and identification process of gesture recognition are optimized by OpenMP, which effectively improved the speed of system.

Holographic display feature is capable to understand the visitor’s idea and show what they want to watch; multimedia feature achieve comment on the voice and drawing, providing a platform for communication; Puzzle Game that play by hand gesture enriched the system and added entertainment.

The multi-channel interaction which implemented by image and voice recognition is able to be used in more application.

linux操作系统文章专题:linux操作系统详解（linux不再难懂）