Research Article
BibTex RIS Cite

A VIRTUAL EXPERIMENT DESIGN APPROACH FOR BIG DATA BASED ON CONTAINERS AND PYTHON LANGUAGE

Year 2021, , 212 - 215, 31.12.2021
https://doi.org/10.18768/ijaedu.1017145

Abstract

Abstract
Given the inconsistency between the experimental environment and the production environment, the high hardware cost of the big data production environment which is difficult for ordinary universities to bear, and the complicated installation of software related to the big data field which is not easy to reproduce and other practical teaching problems in the current stage of big data experimental teaching, the advantages and disadvantages of the existing solutions are analyzed and a virtualization method is proposed to virtualize hundreds of thousands of virtual The design method of Big Data virtual experiments based on containers and Python language is proposed to meet the practical teaching needs of undergraduate Big Data courses by virtualizing hundreds of virtual servers on several physical servers to construct a private cloud of Big Data experiment servers within the university. By optimizing the design for a small-scale server cluster environment in universities, the redundant modules are streamlined, and only teaching experiment-related modules are retained, geared towards teaching simulation, saving the limited funds of ordinary universities and revitalizing state-owned assets; at the same time, open-source software is used to avoid intellectual property costs in future teaching sessions.

Supporting Institution

Shenyang University of Chemical Technology Education and Training Project, Ministry of Education, Department of Higher Education, Collaborative Education Project with University-Industry Cooperation

Project Number

No. 35, 201902233001

References

  • AlexanderPoth, MarkWerner, XinyanLei, AlexanderPoth, MarkWerner, & XinyanLei, et al. (2018). How to deliver faster with ci/cd integrated testing services?. Springer, Cham.
  • Anderson, & Charles. (2015). Docker [software engineering]. IEEE Software, 32(3), 102-c3.
  • Beloglazov, A. , & Buyya, R. . (2015). Openstack neat: a framework for dynamic and energy‐efficient consolidation of virtual machines in openstack clouds. Concurrency & Computation Practice & Experience, 27(5), 1310-1333.
  • Cegielski, C. G. , Jones-Farmer, L. A. , Yun, W. , & Hazen, B. T. . (2012). Adoption of cloud computing technologies in supply chains. The International Journal of Logistics Management, volume 23(2), 184-211(28).
Year 2021, , 212 - 215, 31.12.2021
https://doi.org/10.18768/ijaedu.1017145

Abstract

Project Number

No. 35, 201902233001

References

  • AlexanderPoth, MarkWerner, XinyanLei, AlexanderPoth, MarkWerner, & XinyanLei, et al. (2018). How to deliver faster with ci/cd integrated testing services?. Springer, Cham.
  • Anderson, & Charles. (2015). Docker [software engineering]. IEEE Software, 32(3), 102-c3.
  • Beloglazov, A. , & Buyya, R. . (2015). Openstack neat: a framework for dynamic and energy‐efficient consolidation of virtual machines in openstack clouds. Concurrency & Computation Practice & Experience, 27(5), 1310-1333.
  • Cegielski, C. G. , Jones-Farmer, L. A. , Yun, W. , & Hazen, B. T. . (2012). Adoption of cloud computing technologies in supply chains. The International Journal of Logistics Management, volume 23(2), 184-211(28).
There are 4 citations in total.

Details

Primary Language English
Subjects Other Fields of Education
Journal Section Articles
Authors

Dazhou Li

Wei Gao

Project Number No. 35, 201902233001
Publication Date December 31, 2021
Submission Date November 1, 2021
Published in Issue Year 2021

Cite

EndNote Li D, Gao W (December 1, 2021) A VIRTUAL EXPERIMENT DESIGN APPROACH FOR BIG DATA BASED ON CONTAINERS AND PYTHON LANGUAGE. IJAEDU- International E-Journal of Advances in Education 7 21 212–215.

 Published and Sponsored by OCERINT International © 2015 - 2023

Contact: ijaedujournal@hotmail.com

Creative Commons License

International E-Journal of Advances in Education by IJAEDU is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. Permissions beyond the scope of this license may be available at http://ijaedu.ocerintjournals.org