class OnnxRuntime::IoBinding

Overview

IoBinding class provides zero-copy inference and advanced input/output binding. This is a placeholder for future implementation.

Defined in:

onnxruntime/io_binding.cr

Constructors

Instance Method Summary

Constructor Detail

def self.new(session : InferenceSession) #

Creates a new IoBinding instance.


[View source]

Instance Method Detail

def bind_input(name : String, tensor_ptr : Pointer(LibOnnxRuntime::OrtValue)) #

Bind input to a tensor


[View source]
def bind_output(name : String, tensor_ptr : Pointer(LibOnnxRuntime::OrtValue)) #

Bind output to a tensor


[View source]
def finalize #

Finalizer to release resources


[View source]
def release #

Explicitly release resources


[View source]
def to_unsafe : Pointer(OnnxRuntime::LibOnnxRuntime::OrtIoBinding) #

Get the underlying OrtIoBinding pointer


[View source]