MLCompilerBridge
Tools for streamlining communication with ML models for compiler optimizations.
|
▼Ncompilerinterface | |
▼NBaseCompilerInterface | |
CBaseCompilerInterface | This base class specifies methods for communication with compiler |
▼NGrpcCompilerInterface | |
CGrpcCompilerInterface | This class implements methods for communication with compiler using gRPC |
▼Nlog_reader | |
CTensorSpec | |
CTensorValue | |
▼NPipeCompilerInterface | |
CPipeCompilerInterface | This class implements methods for communication with compiler using pipes |
▼NSerDes | |
CSerDes | Class for serialization and deserialization in various formats for communication |
Nfetch_version | |
▼NMLBridge | |
NMLConfig | |
CAgent | Agent is a wrapper around the ONNXModel class, interfaces with the Environment class to support ML/RL model inference via ONNXModel |
CBaseSerDes | |
CBitstreamSerDes | BitstreamSerDes - Bitstream Serialization/Deserialization which sends header information followed by the raw data |
CEnvironment | |
CgRPCModelRunner | This class is used to create the grpc model runner object |
CJsonSerDes | JsonSerDes - Json Serialization/Deserialization using LLVM's json library |
CMLModelRunner | MLModelRunner - The main interface for interacting with the ML models |
CNoopSavedModelImpl | A mock class satisfying the interface expected by ReleaseModeModelRunner for its TGen parameter |
CONNXModelRunner | ONNXModelRunner is the main user facing class that interfaces with the Environment and Agent classes to support ML/RL model inference via ONNXModel |
CPipeModelRunner | A MLModelRunner that asks for advice from an external agent, or host |
CProtobufSerDes | ProtobufSerDes - Protobuf Serialization/Deserialization to support gRPC communication |
CTensorflowSerDes | TensorflowSerDes - Serialization/Deserialization to support TF AOT models |
CTensorSpec | |
CTFModelRunner | TFModelRunner - TF Compiled model implementation of the MLModelRunner |
NOrt |