EN
A VIRTUAL EXPERIMENT DESIGN APPROACH FOR BIG DATA BASED ON CONTAINERS AND PYTHON LANGUAGE
Abstract
Abstract
Given the inconsistency between the experimental environment and the production environment, the high hardware cost of the big data production environment which is difficult for ordinary universities to bear, and the complicated installation of software related to the big data field which is not easy to reproduce and other practical teaching problems in the current stage of big data experimental teaching, the advantages and disadvantages of the existing solutions are analyzed and a virtualization method is proposed to virtualize hundreds of thousands of virtual The design method of Big Data virtual experiments based on containers and Python language is proposed to meet the practical teaching needs of undergraduate Big Data courses by virtualizing hundreds of virtual servers on several physical servers to construct a private cloud of Big Data experiment servers within the university. By optimizing the design for a small-scale server cluster environment in universities, the redundant modules are streamlined, and only teaching experiment-related modules are retained, geared towards teaching simulation, saving the limited funds of ordinary universities and revitalizing state-owned assets; at the same time, open-source software is used to avoid intellectual property costs in future teaching sessions.
Keywords
Supporting Institution
Shenyang University of Chemical Technology Education and Training Project, Ministry of Education, Department of Higher Education, Collaborative Education Project with University-Industry Cooperation
Project Number
No. 35, 201902233001
References
- AlexanderPoth, MarkWerner, XinyanLei, AlexanderPoth, MarkWerner, & XinyanLei, et al. (2018). How to deliver faster with ci/cd integrated testing services?. Springer, Cham.
- Anderson, & Charles. (2015). Docker [software engineering]. IEEE Software, 32(3), 102-c3.
- Beloglazov, A. , & Buyya, R. . (2015). Openstack neat: a framework for dynamic and energy‐efficient consolidation of virtual machines in openstack clouds. Concurrency & Computation Practice & Experience, 27(5), 1310-1333.
- Cegielski, C. G. , Jones-Farmer, L. A. , Yun, W. , & Hazen, B. T. . (2012). Adoption of cloud computing technologies in supply chains. The International Journal of Logistics Management, volume 23(2), 184-211(28).
Details
Primary Language
English
Subjects
Other Fields of Education
Journal Section
Research Article
Publication Date
December 31, 2021
Submission Date
November 1, 2021
Acceptance Date
December 29, 2021
Published in Issue
Year 2021 Volume: 7 Number: 21
EndNote
Li D, Gao W (December 1, 2021) A VIRTUAL EXPERIMENT DESIGN APPROACH FOR BIG DATA BASED ON CONTAINERS AND PYTHON LANGUAGE. IJAEDU- International E-Journal of Advances in Education 7 21 212–215.
Cited By
Development of GIS-based Box Model Tool for Air Quality Mapping with Python and ArcGIS Pro in Kirkuk City, Iraq
International Journal of Engineering and Geosciences
https://doi.org/10.26833/ijeg.1710723