class Llama::DecodeError

Overview

Raised by checked decode operations when llama.cpp does not accept a batch.

Context#decode retains its compatibility behavior, including returning positive native status codes. Context#decode! raises this error for every non-zero native status so higher-level code cannot continue with stale logits.

Defined in:

llama/error.cr

Constructors

Class Method Summary

Instance Method Summary

Class methods inherited from class Llama::Error

error_message(code : Int32) : String error_message, format_error(message : String, code : Int32 | Nil = nil, context : String | Nil = nil) : String format_error

Constructor Detail

def self.new(operation : String, native_code : Int32, reason : Reason, batch_size : Int32) #

[View source]

Class Method Detail

def self.reason_for(code : Int32) : Reason #

[View source]

Instance Method Detail

def batch_size : Int32 #

[View source]
def native_code : Int32 #

[View source]
def operation : String #

[View source]
def reason : Reason #

[View source]