MLCompilerBridge
Tools for streamlining communication with ML models for compiler optimizations.
|
CMLBridge::Agent | Agent is a wrapper around the ONNXModel class, interfaces with the Environment class to support ML/RL model inference via ONNXModel |
▼CMLBridge::BaseSerDes | |
CMLBridge::BitstreamSerDes | BitstreamSerDes - Bitstream Serialization/Deserialization which sends header information followed by the raw data |
CMLBridge::JsonSerDes | JsonSerDes - Json Serialization/Deserialization using LLVM's json library |
CMLBridge::ProtobufSerDes | ProtobufSerDes - Protobuf Serialization/Deserialization to support gRPC communication |
CMLBridge::TensorflowSerDes | TensorflowSerDes - Serialization/Deserialization to support TF AOT models |
CEnvironment | |
CMLBridge::Environment | |
▼CMLBridge::MLModelRunner | MLModelRunner - The main interface for interacting with the ML models |
CMLBridge::ONNXModelRunner | ONNXModelRunner is the main user facing class that interfaces with the Environment and Agent classes to support ML/RL model inference via ONNXModel |
CMLBridge::PipeModelRunner | A MLModelRunner that asks for advice from an external agent, or host |
CMLBridge::TFModelRunner< TGen > | TFModelRunner - TF Compiled model implementation of the MLModelRunner |
CMLBridge::gRPCModelRunner< Client, Stub, Request, Response > | This class is used to create the grpc model runner object |
CMLBridge::NoopSavedModelImpl | A mock class satisfying the interface expected by ReleaseModeModelRunner for its TGen parameter |
CONNXModel | |
CONNXModelRunner | |
CPipeModelRunnerWrapper | |
Ccompilerinterface.SerDes.SerDes | Class for serialization and deserialization in various formats for communication |
Ccompilerinterface.log_reader.TensorSpec | |
CMLBridge::TensorSpec | |
Ccompilerinterface.log_reader.TensorValue | |
▼CABC | |
▼Ccompilerinterface.BaseCompilerInterface.BaseCompilerInterface | This base class specifies methods for communication with compiler |
Ccompilerinterface.GrpcCompilerInterface.GrpcCompilerInterface | This class implements methods for communication with compiler using gRPC |
Ccompilerinterface.PipeCompilerInterface.PipeCompilerInterface | This class implements methods for communication with compiler using pipes |