Issue Hit error when simply import transformer_engine_extensions: ImportError: /usr/local/lib/python3.8/dist-packages/transformer_engine_extensions.cpython-38-x86_64-linux-gnu.so: undefined symbol: nvte_layernorm_bwd Seems some necessary...
Description This PR Splits the jax/cpp_extensions.py into multiple files by category. New files are now in the jax/cpp_extensions/ dir. All cpp extension functions are now imported as a part of th...