A dataset is the structured, query-ready table or view that Business Intelligence works with directly — the output produced once a pipeline finishes joining, transforming, and loading data from a connected Data Source.
Every dataset carries a fixed schema — field names, data types, and semantic types — along with the storage type and write mode chosen in Step 5 – Output Dataset when its source pipeline was created.
Once a dataset exists, it can be used the same way as any other dataset — for dashboard development, KPI tracking, report building, and further analysis — regardless of whether its pipeline used a Full Load or Incremental Load.
Navigate to: Business Intelligence → Dataset List.
Dataset List
Once a pipeline has run successfully, its output dataset appears as a row in the Dataset List, under Business Intelligence → Dataset List.
Four summary cards at the top show Total datasets, Active datasets, Total rows (across all datasets), and Last refresh (the most recent refresh time across all datasets). The Pipeline button links to the Create Pipelines form.
Actions
• View dataset (eye icon) – opens the Dataset Detail page (7.14).
• Open pipeline (icon) – opens the Pipeline Detail page (7.12) for the pipeline that produced this dataset.
• Refresh now (green icon) – runs the source pipeline immediately, the same as clicking Run in the Pipelines list.
• Delete (red ×) – removes the dataset.
Note: Deleting a dataset here removes the output dataset only, not the pipeline that produces it. To stop the pipeline from running altogether, deactivate or delete the pipeline itself from the Pipelines list or Pipeline Detail page. |
Opened from Dataset List via the View dataset action or by clicking a Dataset Name, this page has four tabs — Overview, Schema, Preview, and Run History — each with its own bookmarkable URL (e.g. .../dataset_detail/5#schema), so a specific tab can be linked or shared directly. A toggle, Refresh now button, and Delete button appear in the top-right corner.
Overview tab
• Basic Information – Physical name, Dataset type, Source pipeline (link), and Refresh mode.
• Statistics – current Rows and Fields counts, plus Last refresh and Created at timestamps.
Schema tab
Lists every field in the dataset:
Column | Description |
Field Name | The output field name (matches the bi_alias / Target set in Field Mapping). |
Source Field | The original table__column the field came from. Shows “–” for calculated fields, such as days_to_due, which are not sourced directly from a table column. |
Data type | The underlying database type, e.g. BIGINT, DATETIME, DECIMAL, LONGTEXT. |
Semantic type | How the BI platform interprets the field for display and charting, e.g. Number, Date, Currency, String. |
Sample value | An example value currently in that field. |
Preview tab
A read-only grid of the dataset's actual current rows and columns — the same shape as Data Preview in Output Dataset (Step 5), but always reflecting the latest refreshed data rather than a one-time preview:
Run History tab
A log of every time the source pipeline has run and written to this dataset:
Column | Description |
Started At / Finished At | When the run began and completed. |
Status | Success or a failure status for that run. |
Rows Inserted | How many rows were written to the dataset during that run. |
Execution Time (s) | How long the run took. |
Run Mode | Manual (triggered via Run / Refresh now) or Scheduled (triggered automatically per Step 6). |
