当前位置: 首页 > 文章 > 基于Kinect的虚拟果树交互式修剪研究 农机化研究 2016 (10) 187-192
Position: Home > Articles > Interactive Pruning Operation on Virtual Fruit Tree Based on Kinect Journal of Agricultural Mechanization Research 2016 (10) 187-192

基于Kinect的虚拟果树交互式修剪研究

作  者:
王丹;邵小宁;胡少军;何东健
单  位:
西北农林科技大学
关键词:
果树;修剪;Kinect;人机交互;虚拟现实
摘  要:
为解决果树修剪技术推广难的问题,提出了基于手势交互的虚拟果树修剪方法。在已有三维果树模型的基础上,通过创建帧缓冲区对象,构建虚拟屏幕,实现果树枝条的快速拾取和修剪;建立了虚拟果树修剪控制手势集,利用Kinect获取骨骼信息,采用状态机匹配识别手势类型,将手部关节点坐标转换至鼠标绝对坐标系,建立不同手势与鼠标和键盘事件之间的映射关系,实现手势交互代替鼠标和键盘交互。实验结果表明:该方法手势识别准确率高,交互实时性好,能够满足虚拟果树修剪应用需求,为果树修剪技术的学习提供了新的途径。
译  名:
Interactive Pruning Operation on Virtual Fruit Tree Based on Kinect
作  者:
Wang Dan;Shao Xiaoning;Hu Shaojun;He Dongjian;College of Mechanical and Electronic Engineering,Northwest A&F University;College of Information Engineering,Northwest A&F University;
关键词:
fruit tree;;pruning;;kinect;;human-computer interaction;;virtual reality
摘  要:
A virtual fruit tree pruning method based on hand gesture interaction is proposed to address the challenge of fruit tree pruning technology extension. Based on the existing 3D fruit tree model,a rapid virtual fruit tree stem picking and pruning method realized by creating a virtual screen using frame buffer object. The control hand gestures of virtual fruit tree pruning were defined. The state machine matching was used to recognize types of hand gestures based on skeleton information got by the kinect sensor. The hand joint was transformed from the skeleton coordinate system to the mouse absolute coordinate system. Finally,a mapping relation among hand gestures,mouse events and keyboard events was found to replace the mouse and keyboard interaction with hand gesture interaction. The skeleton smoothing and object snap was used to solve the problem of mouse cursor jitter. The gesture recognition rate was 97%. Experimental results show that the proposed method has the merits of high recognition rate,good real- time performance,and is suitable for the applications of virtual fruit tree pruning. It can provide a new approach for the study of fruit tree pruning technology.

相似文章

计量
文章访问数: 9
HTML全文浏览量: 0
PDF下载量: 0

所属期刊

推荐期刊