class ReleaseModeModelRunner

Declaration

template <class TGen>
class ReleaseModeModelRunner : public MLModelRunner { /* full declaration omitted */ };

Description

ReleaseModeModelRunner - production mode implementation of the MLModelRunner. It uses an AOT-compiled SavedModel for efficient execution.

Declared at: llvm/include/llvm/Analysis/ReleaseModeModelRunner.h:29

Inherits from: MLModelRunner

Templates

TGen

Member Variables

private int32_t ResultIndex = -1

private std::unique_ptr<TGen> CompiledModel

Inherited from MLModelRunner:

protected Ctx

protected Type

Method Overview

• public template <class FType> ReleaseModeModelRunner<TGen>(llvm::LLVMContext & Ctx, const FType & InputSpec, llvm::StringRef DecisionName, llvm::StringRef FeedPrefix = "feed_", llvm::StringRef FetchPrefix = "fetch_")
• public static bool classof(const llvm::MLModelRunner * R)
• private void * evaluateUntyped()
• public virtual ~ReleaseModeModelRunner<TGen>()

Inherited from MLModelRunner:

• public evaluate
• protected evaluateUntyped
• public getKind
• public getTensor
• public getTensor
• public getTensorUntyped
• public getTensorUntyped
• protected setUpBufferForTensor

Methods

¶template <class FType>
ReleaseModeModelRunner<TGen>(
    llvm::LLVMContext& Ctx,
    const FType& InputSpec,
    llvm::StringRef DecisionName,
    llvm::StringRef FeedPrefix = "feed_",
    llvm::StringRef FetchPrefix = "fetch_")

Description

FeatureNames' type should be an indexed collection of std::string, like std::array or std::vector, that has a size() method.

Declared at: llvm/include/llvm/Analysis/ReleaseModeModelRunner.h:34

Templates

FType

Parameters

llvm::LLVMContext& Ctx

const FType& InputSpec

llvm::StringRef DecisionName

llvm::StringRef FeedPrefix = "feed_"

llvm::StringRef FetchPrefix = "fetch_"

¶static bool classof(const llvm::MLModelRunner* R)

Declared at: llvm/include/llvm/Analysis/ReleaseModeModelRunner.h:57

Parameters

const llvm::MLModelRunner* R

¶void* evaluateUntyped()

Declared at: llvm/include/llvm/Analysis/ReleaseModeModelRunner.h:62

¶virtual ~ReleaseModeModelRunner<TGen>()

Declared at: llvm/include/llvm/Analysis/ReleaseModeModelRunner.h:55