Models API Reference

Complete model architectures built with SHC components.

SHCTransformer

The main transformer model with sparse orthogonal routing.

SHCTransformerConfig

Configuration dataclass for SHCTransformer.

SSMStudent

State Space Model for O(L) inference.

SSMConfig

Configuration for SSMStudent.

Utility Functions

get_config

Embedding Layers

TokenEmbedding

PositionalEmbedding

RMSNorm