Datasets are the core of Cyyrus. They are the data that you generate and publish.

Datasets

Cyyrus

Transform Unstructured Data into Usable Datasets

Introduction

Wanna help? Awesome! There are many ways you can contribute.

Contributing

Wanna know what's coming up? Check out our roadmap.

Roadmap

There's a new sheriff in town. And it's called the CLI.

Tasks help you generate data. Think of them like recipes for generating data.

Tasks

Types are like blueprints for your data. They define the structure of your data and how it can be interacted with.

Types

Columns are like the building blocks of your dataset.

Columns

Schema outlines entire workflow. Think of it as poor man's HCL.

Schema

Versioning is important. Here's how you can manage it.

Version

Unf*ck unstructured data. Nothing more, nothing less.

Parsing

Tap into latent space of Language Models to generate data. And more.

Generation

Seed your data from an existing dataset. Be it a CSV, JSON, or a something else.

Extraction

Scrape it like you mean it. Because you do.

Scraping

Labelling

Documentation

GitHub

Examples

Spaces

Guides

Glossary

Installation

Cyyrus doesn't need a manual, but here's one anyway.

Configuration

Publishing

Task ID is a unique identifier for a task. Think of it as a primary key.

Task ID

Task inputs are the data that a task needs to run. We'll show you how to define them.

Task Inputs

You know, the basics. Strings, numbers, booleans, and null.

Primitive Types

Object types are used to define a collection of key-value pairs. They are the most versatile type in the schema.

Object Types

Array types are used to define a list of items of a specific type. Nothing more, nothing less.

Overview

Quickstart

Concepts

Schema

Tasks

Datasets