RocketCE for Power

 View Only
  • 1.  Getting Started with Pytorch

    ROCKETEER
    Posted 11-11-2021 09:57

    Overview 

    RocketCE Pytorch includes support for IBM's Distributed Deep Learning (DDL).  

    This version of Pytorch will have the support of matrix-multiply assist (MMA) which was introduced in Power 10. 

    This release of RocketCE is based on Release OpenCE v1.3.1 and it includes Pytorch 1.8.1. 

    These packages are supported for both Power 9 and Power 10 Systems of IBM with linux-ppc64le. 

     

     CPU Support 

    The CPU-only variant of Pytorch is built without GPU and CUDA support. It has a smaller installation size, and omits features that would require a GPU. It does not include support for DDL, LMS, or NVIDIA's Apex. 

     

    GPU Support 

    This version of Pytorch will not support GPU variant. Support of GPU variant will be provided in coming releases. For more information, refer main page of OpenCE 

      

    Installation instructions 

    CPU Variant 

    To install pytorch built for CPU support run the following command: 

    • conda install -c rocketce pytorch  

     Once the installation is success, validate the installation by running the following command which lists the package pytorch which was pulled from rocketce channel  

    • Conda list pytorch 

     

    Pytorch conda packages 

    Pytorch package from RocketCE also includes the following conda packages 

    1. pytorch-cpu 
    2. pytorch-base 
    3. Sentencepiece 
    4. torchtext 
    5. torchvision-base 

    The package-base packages come with CPU variants, and include CPU in the build string. 

      

    More information
    This conda package is using the Power 10 MMA capabilities. More information is available in Matrix-multiply assist (MMA) capabilities.

     



    ------------------------------
    Rajesh Nukala
    Rocket Internal - All Brands
    ------------------------------


  • 2.  RE: Getting Started with Pytorch

    Posted 12-03-2021 07:58
     Other than architecture change, is there any other difference between this pytorch package and regular package?

    ------------------------------
    Madhu Sudhana Rao Balaji
    Rocket Forum Shared Account
    ------------------------------



  • 3.  RE: Getting Started with Pytorch

    ROCKETEER
    Posted 12-06-2021 06:32

    This version of Pytorch package will support ppc64le architecture on Power machines. Power 10 architecture has enhancements for the Matrix-Multiply Assist (MMA) capability, and these packages are build using openblas package which will utilize the MMA capability by which we can see better performance than regular packages.



    ------------------------------
    Rajesh Nukala
    Rocket Internal - All Brands
    ------------------------------