Register BigQuery Node

R

Data/DataFusion/Databases

Register BigQuery

Register a Google BigQuery table or query result into a DataFusion session. Takes a GcpProvider for authentication — pair it with the GCP Provider node.

df_register_bigquerydata

Inputs13

Outputs5

Security exposure4/10

Packagedata

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.

4/10Medium

PrivacyPotential sensitivity of processed data.

5/10Medium

PerformanceRuntime or resource pressure.

3/10High

GovernancePolicy, audit, or compliance impact.

2/10High

ReliabilityOperational stability considerations.

2/10High

CostExternal or compute cost impact.

4/10Medium

Input Pins

13

Input

Execution

exec_in

Trigger execution

Session

Struct

session

DataFusion session to register the table into

SchemaDataFusionSessionDataFusionSessionDataFusionSession1 fields

cache_keystringrequired

Provider

Struct

provider

GCP provider with authentication (from the GCP Provider node)

SchemaGcpProviderGcpProviderGcpProvider6 fields

auth_modestringrequired

default_project_idstring | null

readonlybooleanrequired

service_account_jsonstring | null

service_account_fileanyOf (2)

variant 1FlowPathvariant

pathstringrequired

store_refstringrequired

cache_store_refstring | null

variant 2nullvariant

access_tokenstring | null

Schema enforced

Project ID

String

project_id

GCP project ID for billing/job routing. Falls back to the provider's default_project_id when empty.

Registration Mode

String

registration_mode

How to select the data: 'table' (register a full BigQuery table) or 'query' (register the result of a Standard SQL query)

Default table

tablequery

Dataset

String

dataset

BigQuery dataset (only used when registration_mode is 'table')

Source Table

String

source_table

BigQuery table name (only used when registration_mode is 'table')

Row Limit

Integer

row_limit

Optional LIMIT applied in 'table' mode. 0 means no limit.

Default 0

Table Name

String

table_name

Name to register the result as in DataFusion

Location

String

location

BigQuery location for the job (e.g. 'US', 'EU', 'europe-west1')

Default US

Page Size

Integer

page_size

Max rows per page when paginating results. 0 lets BigQuery pick (10 MB cap).

Default 0

Use Query Cache

Boolean

use_query_cache

Allow BigQuery to serve the result from its query cache when available

Default true

Max Bytes Billed

Integer

max_bytes_billed

Cap on bytes billed for this query. 0 means use project default.

Default 0

Output Pins

5

Done

Execution

exec_out

Table registered

Session

Struct

session_out

DataFusion session

SchemaDataFusionSessionDataFusionSessionDataFusionSession1 fields

cache_keystringrequired

Registered As

String

registered_as

Final table name registered in the DataFusion session

Row Count

Integer

row_count

Number of rows materialised into the DataFusion session

Job Stats

Struct

job_stats

BigQuery job statistics (job id, bytes processed, cache hit)

SchemaBigQueryJobStatsBigQueryJobStatsBigQueryJobStats5 fields

job_idstring | null

locationstring | null

bytes_processedinteger | null

format int64

total_rowsinteger | null

format int64

cache_hitboolean | null

Node Info

Internal name

df_register_bigquery

Category

Data/DataFusion/Databases