RocketCE for Power

 View Only
  • 1.  Getting Started with ONNX Runtime

    ROCKETEER
    Posted 11-11-2021 09:56

    Overview 

    ONNX Runtime is a cross-platform inference and training machine-learning accelerator. 

    ONNX Runtime is an accelerator for machine learning models with multi-platform support and a flexible interface to integrate with hardware-specific libraries. ONNX Runtime can be used with models from PyTorch, Tensorflow/Keras, TFLite, scikit-learn, and other frameworks.  

    This release of RocketCE is based on Release OpenCE v1.3.1 and it includes ONNX Runtime v1.7.2

    These packages are supported for both Power 9 and Power 10 Systems of IBM with linux-ppc64le. 

     

    CPU Support 

    RocketCE includes CPU only variant of ONNX Runtime which is built without GPU support. 

    GPU Support 

    This version of Tensorflow will not support GPU variant. Support of GPU variant will be provided in coming releases. For more information, refer main page of OpenCE 

     

    Installation instructions 

    CPU Variant 

    To install CPU only variant of ONNX Runtime, run the following command: 

    • conda install -c rocketce onnxruntime 

     Once the installation is success, validate the installation by running the following command which lists the package onnxruntime which was pulled from rocketce channel  

    • Conda list onnxruntime 


    ------------------------------
    Rajesh Nukala
    Rocket Internal - All Brands
    ------------------------------


  • 2.  RE: Getting Started with ONNX Runtime

    Posted 03-09-2022 18:37
    One update - there is newer onnxruntime versions available, and doing 'conda install -c rocketce onnxruntime' results in version 1.10 installed from conda forge, NOT the 1.7.2 from rocketce. (at least, that's what happened to me).

    fix is to do 'conda install -c rocketce onnxruntime=1.7.2' to insure you get the ppc64le version from rocketce.

    .bri.

    ------------------------------
    Brian Horton
    Rocket Forum Shared Account
    ------------------------------