Data Extraction Commands

extract_data

Extract data from the page using a defined dataset.

Parameter	Type	Required	Description
dataset	string	✅	Name of the dataset to extract
output_filename	string	❌	File path for output (if not using triggers)
append	boolean	❌	Append to existing output file
output_variable	string	❌	Store extracted data in a runtime variable
filter_condition	string	❌	JavaScript filter expression (e.g., item.URL && item.URL.includes(item.Domain))

Example:

dataset: products
output_variable: product_data
filter_condition: item.price > 10

get_text

Get the text content of an element and store it in a variable.

Parameter	Type	Required	Description
selector	string	✅	Element selector
output_variable	string	❌	Variable name to store the text
iframe	string	❌	Iframe selector
timeout	number	❌	Max wait time

get_attribute

Get an HTML attribute of an element.

Parameter	Type	Required	Description
selector	string	✅	Element selector
attribute	string	✅	Attribute name (e.g., href, src, data-id)
output_variable	string	❌	Variable name to store the value
iframe	string	❌	Iframe selector
timeout	number	❌	Max wait time

get_property

Get a JavaScript property of an element.

Parameter	Type	Required	Description
selector	string	✅	Element selector
property	string	✅	Property name (e.g., value, checked, innerText)
output_variable	string	❌	Variable name to store the value
iframe	string	❌	Iframe selector
timeout	number	❌	Max wait time

is_visible

Check if an element is visible and store the result.

Parameter	Type	Required	Description
selector	string	✅	Element selector
output_variable	string	❌	Variable name to store true/false
iframe	string	❌	Iframe selector
timeout	number	❌	Max wait time