Skip to content

Buffered CSV Reader

Purpose of the Node

The Buffered CSV Reader node is designed to read a CSV file from a specified path and process it in chunks. This is useful for handling large CSV files that might not fit into memory all at once. The node allows you to specify the delimiter and chunk size, making it versatile for various CSV file formats.

Pins

Pin NamePin DescriptionPin TypeValue Type
StartInitiates the execution of the nodeExecutionN/A
CSVThe path to the CSV file to be readStructFlowPath
Chunk SizeThe number of records per chunkIntegerN/A
DelimiterThe delimiter character used in the CSV fileStringN/A
For ChunkExecution pin that fires for each chunkExecutionN/A
ChunkOutput pin containing the current chunk of recordsStructArray
EndSignals the completion of the node executionExecutionN/A

This node is particularly useful in scenarios where you need to process large CSV files efficiently, ensuring that memory usage remains manageable by processing the file in manageable chunks.