As plain JSON, 100,000 orders form one array that cannot be appended to or read in part, and that a torn write ruins. The fix is a convention, one JSON value per line, called JSON Lines (.jsonl) or NDJSON (.ndjson, application/x-ndjson). Spark 129 , DuckDB 61,228 , BigQuery 1 and most log shippers read it. RFC 7464's rarer JSON text sequences (application/json-seq) instead prefix each value with an ASCII Record Separator (0x1E).
MENU
JSON Lines
JSON Lines and Newline-Delimited JSON