class Llama::GenerationOptions

• Llama::GenerationOptions
• Reference
• Object

Defined in:

llama/options.cr

Constructors

• .new(max_tokens : Int32 = 256, stop : Array(String) = [] of String, sampling : Sampling::Plan = Sampling.default, include_stop : Bool = false, cancellation : Cancellation | Nil = nil)

Instance Method Summary

• #cancellation : Cancellation | Nil
• #include_stop : Bool
• #max_tokens : Int32
• #sampling : Sampling::Plan
• #stop : Array(String)

Constructor Detail

Instance Method Detail