|
MLCompilerBridge
Tools for streamlining communication with ML models for compiler optimizations.
|
| ▼Ncompilerinterface | |
| ▼NBaseCompilerInterface | |
| CBaseCompilerInterface | This base class specifies methods for communication with compiler |
| ▼NGrpcCompilerInterface | |
| CGrpcCompilerInterface | This class implements methods for communication with compiler using gRPC |
| ▼Nlog_reader | |
| CTensorSpec | |
| CTensorValue | |
| ▼NPipeCompilerInterface | |
| CPipeCompilerInterface | This class implements methods for communication with compiler using pipes |
| ▼NSerDes | |
| CSerDes | Class for serialization and deserialization in various formats for communication |
| Nfetch_version | |
| ▼NMLBridge | |
| NMLConfig | |
| CAgent | Agent is a wrapper around the ONNXModel class, interfaces with the Environment class to support ML/RL model inference via ONNXModel |
| CBaseSerDes | |
| CBitstreamSerDes | BitstreamSerDes - Bitstream Serialization/Deserialization which sends header information followed by the raw data |
| CEnvironment | |
| CgRPCModelRunner | This class is used to create the grpc model runner object |
| CJsonSerDes | JsonSerDes - Json Serialization/Deserialization using LLVM's json library |
| CMLModelRunner | MLModelRunner - The main interface for interacting with the ML models |
| CNoopSavedModelImpl | A mock class satisfying the interface expected by ReleaseModeModelRunner for its TGen parameter |
| CONNXModelRunner | ONNXModelRunner is the main user facing class that interfaces with the Environment and Agent classes to support ML/RL model inference via ONNXModel |
| CPipeModelRunner | A MLModelRunner that asks for advice from an external agent, or host |
| CProtobufSerDes | ProtobufSerDes - Protobuf Serialization/Deserialization to support gRPC communication |
| CTensorflowSerDes | TensorflowSerDes - Serialization/Deserialization to support TF AOT models |
| CTensorSpec | |
| CTFModelRunner | TFModelRunner - TF Compiled model implementation of the MLModelRunner |
| NOrt |