class OnnxRuntime::InferenceSession

• OnnxRuntime::InferenceSession
• Reference
• Object

Defined in:

onnxruntime/inference_session.cr

Constructors

• .new(path_or_bytes, provider : Provider | Nil = nil, **session_options)

Class Method Summary

• .release_env

  Class method to explicitly release the environment This method is now a wrapper around OrtEnvironment.instance.release

Instance Method Summary

• #allocator : Pointer(LibOnnxRuntime::OrtAllocator)
• #check_status(status)

  Make check_status public so it can be used by SparseTensor

• #create_api
• #finalize

  Finalizer only releases session-specific resources Environment is managed separately and should be released explicitly by the user

• #inputs : Array(TensorInfo)
• #metadata

  Get model metadata

• #outputs : Array(TensorInfo)
• #release_allocator

  Method to explicitly release the allocator Note: Default allocator may not need to be released, so commented out

• #release_session

  Method to explicitly release the session

• #run(input_feed, output_names = nil, run_options : RunOptions | Nil = nil, **options)
• #session : Pointer(LibOnnxRuntime::OrtSession)

  Use OrtEnvironment singleton for environment management

Constructor Detail

Class Method Detail

Instance Method Detail