Cloud High-Performance Computing, Cloud HPC differs from on-premise HPC significantly. Cloud service brings high scalability and flexibility to High-Performance Computing. However, most HPC users are not familiar with building and maintaining HPC services on the cloud.
In order to make it super easy to start and manage HPC workloads on the cloud, we have been developing this project and named it as HPC-NOW. NOW represents:
- Start HPC journey on the cloud immediately, in minutes.
- (almost) No Operation Workload.
Currently, the HPC-NOW platform supports the cloud services as below:
- Alibaba Cloud, HPC-NOW Internal Code: CLOUD_A
- Tencent Cloud, HPC-NOW Internal Code: CLOUD_B
- Amazon Web Services, HPC-NOW Internal Code: CLOUD_C
- Huawei Cloud, HPC-NOW Internal Code: CLOUD_D
- Baidu BCE, HPC-NOW Internal Code: CLOUD_E
- Microsoft Azure, HPC-NOW Internal Code: CLOUD_F
- Google Cloud Platform, HPC-NOW Internal Code: CLOUD_G
Thanks to the Terraform, a great cloud Infrastructure-as-Code platform, which makes it possible to orchestrate cloud resources in a unified and simple way.
In this project, we developed components as below:
- installer : HPC-NOW service installer, which requires administrator or root privilege to run.
- hpcopr : HPC Operator. The main component that manages the HPC clusters, users, jobs, data, monitoring, usage, etc.
- now-crypto : A cryptography module that encrypts and decrypts the files containing sensitive information.
- hpcmgr : A utility running in every cluster to communicate with the operator.
- infra-as-code : Infrastructure codes in HCL format
- scripts : Shell scripts to initialize the clusters, install applications, etc.
The HPC-NOW platform is very easy to build, run, and use. It is also cross-platform, which means you can run the HPC-NOW on Windows, GNU/Linux, or macOS. Note: Currently only x86_64 platform is supported.
For more information, please refer to Docs/UserManual-EN.pdf
Please submit issues to this repo. Or mailto: [email protected] | wangzhenrong@hpc-now | [email protected]