Generation Task Properties

Required Properties

prompt
string

The input prompt for generation.

model
string

The model to use for generation.

Allowed values:

  • "gpt-4": GPT-4 model
  • "gpt-4o-mini": GPT-4O Mini model
api_key
string

API key for authentication.

Optional Properties

max_epochs
integer
default: "100"

Maximum number of epochs for reference free generation.

response_format
string

Desired format of the response. Reference the type_id present in the types section of the schema.

OpenAI API Properties

In addition to the above properties, the generation task supports all OpenAI API call properties. Some commonly used properties include:

temperature
float

Controls randomness in output (0.0 to 2.0).

max_tokens
integer

Maximum number of tokens to generate.

top_p
float

Controls diversity via nucleus sampling.

frequency_penalty
float

Reduces repetition of token sequences.

presence_penalty
float

Encourages the model to talk about new topics.

stop
string or array

Sequences where the API will stop generating further tokens.

For a complete list of OpenAI API properties, please refer to the OpenAI API documentation.

Usage Examples

It’s currently work in progress. If there something else you’d like to see, we’d love to know.