PipeModelRunner.h File Reference

PipeModelRunner class supporting communication via OS pipes between the compiler and an external ML agent. More...

#include "MLModelRunner/MLModelRunner.h"
#include "SerDes/TensorSpec.h"
#include "SerDes/baseSerDes.h"
#include "llvm/Support/FileSystem.h"
#include <fstream>
#include <memory>
#include <system_error>

Include dependency graph for PipeModelRunner.h:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
class	MLBridge::PipeModelRunner
	A MLModelRunner that asks for advice from an external agent, or host. More...

Namespaces
namespace	MLBridge

Detailed Description

PipeModelRunner class supporting communication via OS pipes between the compiler and an external ML agent.

Usage:

1. Create a PipeModelRunner object with the names of the pipes, and the serialization technique.
2. Populate the features to be sent to the model.
3. Call evaluate() to get the result back from the model.

This supports both training and inference. Supports interleaved communication.

Definition in file PipeModelRunner.h.