基于Python + Selenium的选煤厂生产数据集成研究与系统开发

    Research and system development of production data integration for coal preparation plants based on Python + Selenium

    • 摘要: 为解决选煤厂多源异构数据整合难、传统人工数据管理模式效率低、数据孤岛突出的问题,提升生产管理效率与数据应用价值,基于Python + Selenium开发了一套选煤厂生产数据集成系统。该系统包括数据采集、数据处理、数据存储与数据应用四层架构,通过自动化登录、网页数据抓取、截图识别等方式,采集网页直接显示数据与ActiveX控件显示数据,经时序化处理、解析去重、OCR识别与处理等操作实现数据结构化存储。选煤厂生产数据集成系统实现了生产数据分段对比、生产数据提醒与异常报警、生产时序数据可视化分析和跨系统自动推送功能。该技术方案成功实现了跨系统异构工业数据的整合和初步分析应用,有效破解了传统生产管理系统中的数据孤岛难题,可为老旧信息系统数据集成提供可行路径,为选煤行业生产数据深度挖掘、工业知识协同应用及数字化转型提供实践范例。

       

      Abstract: To address the challenges in coal preparation plants, including the difficulty of integrating multi-source heterogeneous data, the low efficiency of traditional manual data management, and significant data silos, a production data integration system was developed based on Python and Selenium to enhance production management efficiency and data application value. The system adopts a four-layer architecture encompassing data acquisition, processing, storage, and application. It collects both directly displayed webpage data and data displayed within ActiveX controls through automated login, web scraping, and screenshot recognition. The acquired data then undergoes time-series processing, parsing, deduplication, and OCR (Optical Character Recognition) identification to achieve structured storage. This system implements functionalities such as segmented production data comparison, data alerts and anomaly alarms, visual analysis of time-series production data, and cross-system automatic data pushing. This technical solution has successfully achieved the integration and preliminary analytical application of heterogeneous industrial data across different systems, effectively resolving the problem of data silos inherent in traditional production management systems. It provides a feasible path for data integration in legacy information systems and serves as a practical example for the coal preparation industry in deep data mining, collaborative application of industrial knowledge, and digital transformation.

       

    /

    返回文章
    返回