Processing
Transform, filter, and reshape data as it moves through a flow.
Alter Metadata
Adds/Removes Metadata Dictionary on inputs
| Input | Type | Required |
|---|---|---|
| Input | other | No |
| Metadata | NestedDict | Yes |
| Fields to Remove | str | No |
| User Text | str | No |
| Output | Type |
|---|---|
| JSON | JSON |
| Table | Table |
Combine Data
Combines data using different operations
| Input | Type | Required |
|---|---|---|
| Data Inputs | other | Yes |
| Operation Type | str | No |
| Output | Type |
|---|---|
| Table | Table |
Combine Text
Concatenate two text sources into a single text chunk using a specified delimiter.
| Input | Type | Required |
|---|---|---|
| Delimiter | str | No |
| First Text | str | No |
| Second Text | str | No |
| Output | Type |
|---|---|
| Combined Text | Message |
Create Data
Dynamically create a Data with a specified number of fields.
| Input | Type | Required |
|---|---|---|
| Number of Fields | int | No |
Advanced options: Text Key, Text Key Validator
| Output | Type |
|---|---|
| JSON | JSON |
Create List
Creates a list of texts.
| Input | Type | Required |
|---|---|---|
| Texts | str | No |
| Output | Type |
|---|---|
| JSON List | JSON |
| Table | Table |
Data to Message
Convert Data objects into Messages using any {field_name} from input data.
| Input | Type | Required |
|---|---|---|
| JSON | other | Yes |
| Template | str | Yes |
Advanced options: Separator
| Output | Type |
|---|---|
| Message | Message |
| JSON List | JSON |
Data → DataFrame
Converts one or multiple Data objects into a DataFrame. Each Data object corresponds to one row. Fields from .data become columns, and the .text (if present) is placed in a 'text' column.
| Input | Type | Required |
|---|---|---|
| Data or Data List | other | No |
| Output | Type |
|---|---|
| Table | Table |
Dynamic Create Data
Dynamically create a Data with a specified number of fields.
| Input | Type | Required |
|---|---|---|
| Input Configuration | table | No |
Advanced options: Include Metadata
| Output | Type |
|---|---|
| JSON | JSON |
| Message | Message |
Extract Key
Extract a specific key from a Data object or a list of Data objects and return the extracted value(s) as Data object(s).
| Input | Type | Required |
|---|---|---|
| Data Input | other | No |
| Key to Extract | str | No |
| Output | Type |
|---|---|
| Extracted Data | JSON |
Filter Data
Filters a Data object based on a list of keys.
| Input | Type | Required |
|---|---|---|
| JSON | other | No |
| Filter Criteria | str | No |
| Output | Type |
|---|---|
| Filtered Data | JSON |
Filter Values
Filter a list of data items based on a specified key, filter value, and comparison operator. Check advanced options to select match comparision.
| Input | Type | Required |
|---|---|---|
| Input Data | other | No |
| Filter Key | str | No |
| Filter Value | str | No |
Advanced options: Comparison Operator
| Output | Type |
|---|---|
| Filtered Data | JSON |
JSON Cleaner
Cleans the messy and sometimes incorrect JSON strings produced by LLMs so that they are fully compliant with the JSON spec.
| Input | Type | Required |
|---|---|---|
| JSON String | str | Yes |
| Normalize Unicode | bool | No |
| Remove Control Characters | bool | No |
| Validate JSON | bool | No |
| Output | Type |
|---|---|
| Cleaned JSON String | Message |
JSON Operations
Perform various operations on a JSON object.
| Input | Type | Required |
|---|---|---|
| JSON | other | Yes |
| Append or Update | dict | No |
| Filter Key | str | No |
| Filter Values | dict | No |
| JSON to Map | str | No |
| Operations | sortableList | No |
| Comparison Operator | str | No |
| JQ Expression | str | No |
| Remove Keys | str | No |
| Rename Keys | dict | No |
| Select Keys | str | No |
| Select Path | str | No |
| Output | Type |
|---|---|
| JSON | JSON |
Message Store
Stores a chat message or text into ottom8 tables or an external memory.
| Input | Type | Required |
|---|---|---|
| External Memory | other | No |
| Message | str | Yes |
Advanced options: Sender, Sender Name, Session ID
| Output | Type |
|---|---|
| Stored Messages | Message |
Message to Data
Convert a Message object to a Data object
| Input | Type | Required |
|---|---|---|
| Message | str | No |
| Output | Type |
|---|---|
| JSON | JSON |
Output Parser
Transforms the output of an LLM into a specified format.
| Input | Type | Required |
|---|---|---|
| Parser | str | No |
| Output | Type |
|---|---|
| Format Instructions | Message |
| Output Parser | OutputParser |
Parse DataFrame
Convert a DataFrame into plain text following a specified template. Each column in the DataFrame is treated as a possible template key, e.g. {col_name}.
| Input | Type | Required |
|---|---|---|
| Table | other | No |
| Template | str | No |
Advanced options: Separator
| Output | Type |
|---|---|
| Text | Message |
Parse JSON
Convert and extract JSON fields.
| Input | Type | Required |
|---|---|---|
| Input | other | Yes |
| JQ Query | str | Yes |
| Output | Type |
|---|---|
| Filtered Data | JSON |
Parser
Extracts text using a template.
| Input | Type | Required |
|---|---|---|
| JSON or Table | other | Yes |
| Mode | tab | No |
| Template | str | Yes |
Advanced options: Separator
| Output | Type |
|---|---|
| Parsed Text | Message |
Regex Extractor
Extract patterns from text using regular expressions.
| Input | Type | Required |
|---|---|---|
| Input Text | str | Yes |
| Regex Pattern | str | Yes |
| Output | Type |
|---|---|
| JSON | JSON |
| Message | Message |
Select Data
Select a single data from a list of data.
| Input | Type | Required |
|---|---|---|
| JSON List | other | No |
| Data Index | int | No |
| Output | Type |
|---|---|
| Selected Data | JSON |
Split Text
Split text into chunks based on specified criteria.
| Input | Type | Required |
|---|---|---|
| Input | other | Yes |
| Chunk Overlap | int | No |
| Chunk Size | int | No |
| Separator | str | No |
Advanced options: Clean Output, Keep Separator, Text Key
| Output | Type |
|---|---|
| Chunks | Table |
Table Operations
Perform various operations on a Table.
| Input | Type | Required |
|---|---|---|
| Table | other | Yes |
| Left Table | other | No |
| Right Table | other | No |
| Sort Ascending | bool | No |
| Column Name | str | No |
| Columns to Select | str | No |
| Filter Operator | str | No |
| Filter Value | str | No |
| Merge Type | str | No |
| Merge On Column | str | No |
| New Column Name | str | No |
| New Column Value | str | No |
| Number of Rows | int | No |
| Operation | sortableList | No |
| Value to Replace | str | No |
| Replacement Value | str | No |
| Output | Type |
|---|---|
| Table | Table |
Text Operations
Perform various text processing operations including text-to-DataFrame conversion.
| Input | Type | Required |
|---|---|---|
| Case Type | str | No |
| Extract Pattern | str | No |
| Characters from Start | int | No |
| Max Matches | int | No |
| Operation | sortableList | No |
| Remove Empty Lines | bool | No |
| Remove Extra Spaces | bool | No |
| Remove Special Characters | bool | No |
| Replacement Text | str | No |
| Search Pattern | str | No |
| Characters to Strip | str | No |
| Strip Mode | str | No |
| Table Separator | str | No |
| Characters from End | int | No |
| Text Input | str | Yes |
| Second Text Input | str | No |
| Use Regex | bool | No |
Advanced options: Count Characters, Count Lines, Count Words, Has Header
Type Convert
Convert between different types (Message, JSON, Table)
| Input | Type | Required |
|---|---|---|
| Input | other | Yes |
| Output Type | tab | No |
Advanced options: Auto Parse
| Output | Type |
|---|---|
| Message Output | Message |
| JSON Output | JSON |
| Table Output | Table |
Update Data
Dynamically update or append data with the specified fields.
| Input | Type | Required |
|---|---|---|
| JSON | other | Yes |
| Number of Fields | int | No |
Advanced options: Text Key, Text Key Validator
| Output | Type |
|---|---|
| JSON | JSON |