Handles tensor sharding logic for various neural network operations during distributed model parallelization. Use this when implementing custom parallelization strategies for deep learning models.
# Source: https://github.com/hpcaitech/ColossalAI | License: Apache-2.0 | Copyright 2021- HPC-AI Technology Inc. All rights reserved # Provided via justclaw.it.com; keep this notice with the code. from .addmm_handler import ADDMMFunctionHandler from .batch_norm_handler import BatchNormModuleHandler from .binary_elementwise_handler import BinaryElementwiseHandler from .bmm_handler import AddBMMFunctionHandler, BMMFunctionHandler from .conv_handler import ConvFunctionHandler, ConvModuleHandler from .default_reshape_handler import DefaultReshapeHandler from .embedding_handler import EmbeddingFunctionHandler, EmbeddingModuleHandler from .getattr_handler import GetattrHandler from .getitem_handler import GetItemHandler from .layer_norm_handler import LayerNormModuleHandler from .linear_handler ... (truncated -- full source via MCP)
See the full source, get the GitHub permalink, and search for more like it.
Get a free API key