|
MLCompilerBridge
Tools for streamlining communication with ML models for compiler optimizations.
|
| CMLBridge::Agent | Agent is a wrapper around the ONNXModel class, interfaces with the Environment class to support ML/RL model inference via ONNXModel |
| ▼CMLBridge::BaseSerDes | |
| CMLBridge::BitstreamSerDes | BitstreamSerDes - Bitstream Serialization/Deserialization which sends header information followed by the raw data |
| CMLBridge::JsonSerDes | JsonSerDes - Json Serialization/Deserialization using LLVM's json library |
| CMLBridge::ProtobufSerDes | ProtobufSerDes - Protobuf Serialization/Deserialization to support gRPC communication |
| CMLBridge::TensorflowSerDes | TensorflowSerDes - Serialization/Deserialization to support TF AOT models |
| CEnvironment | |
| CMLBridge::Environment | |
| ▼CMLBridge::MLModelRunner | MLModelRunner - The main interface for interacting with the ML models |
| CMLBridge::ONNXModelRunner | ONNXModelRunner is the main user facing class that interfaces with the Environment and Agent classes to support ML/RL model inference via ONNXModel |
| CMLBridge::PipeModelRunner | A MLModelRunner that asks for advice from an external agent, or host |
| CMLBridge::TFModelRunner< TGen > | TFModelRunner - TF Compiled model implementation of the MLModelRunner |
| CMLBridge::gRPCModelRunner< Client, Stub, Request, Response > | This class is used to create the grpc model runner object |
| CMLBridge::NoopSavedModelImpl | A mock class satisfying the interface expected by ReleaseModeModelRunner for its TGen parameter |
| CONNXModel | |
| CONNXModelRunner | |
| CPipeModelRunnerWrapper | |
| Ccompilerinterface.SerDes.SerDes | Class for serialization and deserialization in various formats for communication |
| Ccompilerinterface.log_reader.TensorSpec | |
| CMLBridge::TensorSpec | |
| Ccompilerinterface.log_reader.TensorValue | |
| ▼CABC | |
| ▼Ccompilerinterface.BaseCompilerInterface.BaseCompilerInterface | This base class specifies methods for communication with compiler |
| Ccompilerinterface.GrpcCompilerInterface.GrpcCompilerInterface | This class implements methods for communication with compiler using gRPC |
| Ccompilerinterface.PipeCompilerInterface.PipeCompilerInterface | This class implements methods for communication with compiler using pipes |