class OpenAI::CreateTextCompletion

Overview

POST https://api.openai.com/v1/completions

Included Modules

Extended Modules

Defined in:

open_ai/models/text_completion.cr

Constructors

Instance Method Summary

Constructor Detail

def self.new(pull : JSON::PullParser) #

[View source]

Instance Method Detail

def best_of : Int32 #

Generates best_of completions server-side and returns the "best" (the one with the highest log probability per token). Results cannot be streamed. best_of must be greater than num_completions


[View source]
def best_of=(best_of : Int32) #

Generates best_of completions server-side and returns the "best" (the one with the highest log probability per token). Results cannot be streamed. best_of must be greater than num_completions


[View source]
def echo : Bool #

Echo back the prompt in addition to the completion


[View source]
def echo=(echo : Bool) #

Echo back the prompt in addition to the completion


[View source]
def frequency_penalty : Float64 #

Number between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim.


[View source]
def frequency_penalty=(frequency_penalty : Float64) #

Number between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim.


[View source]
def logit_bias : Hash(String, Float64) | Nil #

Modify the likelihood of specified tokens appearing in the completion. You can use this tokenizer tool (which works for both GPT-2 and GPT-3) to convert text to token IDs


[View source]
def logit_bias=(logit_bias : Hash(String, Float64) | Nil) #

Modify the likelihood of specified tokens appearing in the completion. You can use this tokenizer tool (which works for both GPT-2 and GPT-3) to convert text to token IDs


[View source]
def logprobs : Int32 | Nil #

Include the log probabilities on the logprobs most likely tokens, as well the chosen tokens.


[View source]
def logprobs=(logprobs : Int32 | Nil) #

Include the log probabilities on the logprobs most likely tokens, as well the chosen tokens.


[View source]
def max_tokens : Int32 #

The maximum number of tokens to generate in the completion. Most models have a context length of 2048 tokens (except for the newest models, which support 4096). The token count of your prompt plus max_tokens cannot exceed the model's context length.


[View source]
def max_tokens=(max_tokens : Int32) #

The maximum number of tokens to generate in the completion. Most models have a context length of 2048 tokens (except for the newest models, which support 4096). The token count of your prompt plus max_tokens cannot exceed the model's context length.


[View source]
def model : String #

the model id


[View source]
def model=(model : String) #

the model id


[View source]
def num_completions : Int32 #

How many completions to generate for each prompt.


[View source]
def num_completions=(num_completions : Int32) #

How many completions to generate for each prompt.


[View source]
def presence_penalty : Float64 #

Number between -2.0 and 2.0. Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics.


[View source]
def presence_penalty=(presence_penalty : Float64) #

Number between -2.0 and 2.0. Positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics.


[View source]
def prompt : String | Array(String) | Nil #

The prompt(s) to generate completions for


[View source]
def prompt=(prompt : String | Array(String) | Nil) #

The prompt(s) to generate completions for


[View source]
def stop : String | Array(String) | Nil #

Up to 4 sequences where the API will stop generating further tokens. The returned text will not contain the stop sequence.


[View source]
def stop=(stop : String | Array(String) | Nil) #

Up to 4 sequences where the API will stop generating further tokens. The returned text will not contain the stop sequence.


[View source]
def stream : Bool #

Whether to stream back partial progress.


[View source]
def stream=(stream : Bool) #

Whether to stream back partial progress.


[View source]
def suffix : String | Nil #

The suffix that comes after a completion of inserted text.


[View source]
def suffix=(suffix : String | Nil) #

The suffix that comes after a completion of inserted text.


[View source]
def temperature : Float64 #

What sampling temperature to use, between 0 and 2. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic.


[View source]
def temperature=(temperature : Float64) #

What sampling temperature to use, between 0 and 2. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic.


[View source]
def top_p : Float64 #

An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. Alter this or temperature but not both.


[View source]
def top_p=(top_p : Float64) #

An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. Alter this or temperature but not both.


[View source]
def user : String | Nil #

A unique identifier representing your end-user, which can help OpenAI to monitor and detect abuse.


[View source]
def user=(user : String | Nil) #

A unique identifier representing your end-user, which can help OpenAI to monitor and detect abuse.


[View source]