标题:Big Data Analyzing for Control Valve Using the Spark Cluster Computing Engine
作者:Wang, Longhui ;Wang, Yong ;Xie, Yudong
作者机构:[Wang, L] College of Mechanical Engineering, Shandong University, Jinan, China;[ Wang, Y] College of Mechanical Engineering, Shandong University, Jina 更多
会议名称:2018 Chinese Automation Congress, CAC 2018
会议日期:30 November 2018 through 2 December 2018
来源:Proceedings 2018 Chinese Automation Congress, CAC 2018
出版年:2019
页码:429-434
DOI:10.1109/CAC.2018.8623101
关键词:Big Data; parallel SDP; Spark MapReduce; t-SNE
摘要:Control valve plays an important role in modern industry, where the production depends on distributing and controlling fluid accurately. With the development of automation and Internet technology, control valves can collect real-time signals and store large amount of historical data, which is difficult to analyze and utilize. In this paper, we use the Spark cluster computing engine (Spark) to realize a fault diagnosis approach based on big data for control valve. Firstly, we use the data visualizing algorithm t-Distributed Stochastic Neighbor Embedding (t-SNE) to observe the distribution of control valve data. Then we implement a parallel Searching Density Peaks (SDP) cluster algorithm combined with Spark MapReduce for fault detection. Experimental results demonstrate that the parallel algorithm based on Spark can process big data fast and efficiently. © 2018 IEEE.
收录类别:EI;SCOPUS
资源类型:会议论文;期刊论文
原文链接:https://www.scopus.com/inward/record.uri?eid=2-s2.0-85062802492&doi=10.1109%2fCAC.2018.8623101&partnerID=40&md5=8c4740875104ffb51e02766e63a9f799
TOP