RocketCE for Power

 View Only
Back to discussions
Expand all | Collapse all

Releasing RocketCE OnnxRuntime v1.7.2 with OpenCE v 1.4.1

  • 1.  Releasing RocketCE OnnxRuntime v1.7.2 with OpenCE v 1.4.1

    ROCKETEER
    Posted 07-18-2022 08:31

    Overview 

    ONNX Runtime is a cross-platform inference and training machine-learning accelerator. 

    ONNX Runtime is an accelerator for machine learning models with multi-platform support and a flexible interface to integrate with hardware-specific libraries. ONNX Runtime can be used with models from PyTorch, Tensorflow/Keras, TFLite, scikit-learn, and other frameworks.  

    This release of RocketCE is based on Release OpenCE v1.4.1 and it includes ONNX Runtime v1.7.2. 

    These packages are supported for both Power 9 and Power 10 Systems of IBM with linux-ppc64le. 

     

    CPU Support 

    RocketCE includes CPU only variant of ONNX Runtime which is built without GPU support. This inclusion allows for training and inferencing to be done on Power 9 and Power 10 systems that do not have GPUs, or on systems where you want to train and inference without using the GPUs. 

    GPU Support 

    This version of Tensorflow will have support for GPU based operations. This can be used in Power 9 systems.

     

    Installation instructions 

    CPU Variant 

    To install CPU only variant of ONNX Runtime, run one of the following commands according to the python versions you have:

    • conda install -c rocketce onnxruntime=1.7.2=h3fbc0cb_cpu_py37_pb3.14_3
    • conda install -c rocketce onnxruntime=1.7.2=h3fbc0cb_cpu_py38_pb3.14_3
    • conda install -c rocketce onnxruntime=1.7.2=h3fbc0cb_cpu_py39_pb3.14_3

     Once the installation is success, validate the installation by running the following command which lists the package onnxruntime which was pulled from rocketce channel  

    • Conda list onnxruntime 

    GPU Variant 

    To install GPU variant of ONNX Runtime, run one of the following commands according to the python versions you have:

    • conda install -c rocketce onnxruntime=1.7.2=hd9ed934_cuda11.2_py37_pb3.14_3
    • conda install -c rocketce onnxruntime=1.7.2=hd9ed934_cuda11.2_py38_pb3.14_3
    • conda install -c rocketce onnxruntime=1.7.2=hd9ed934_cuda11.2_py39_pb3.14_3

     Once the installation is success, validate the installation by running the following command which lists the package onnxruntime which was pulled from rocketce channel  

    • Conda list onnxruntime 


    ------------------------------
    Uvaise Ahamed
    Rocket Internal - All Brands
    ------------------------------