Posted by Esteban A. Maringolo on Jul 26, 2017; 3:45pm
URL: https://forum.world.st/NeoCSV-on-Irregular-Files-tp4956850p4956856.html

There is no way to perform this with NeoJSON or any other CSV
framework I'm aware of.

I had to deal with that kind of "format" (which is likely an export
format), and the way to deal with it was to process each "segment"
using a different instance of the CSV reader, the segments where
scanned in the stream using the delimiting heuristics of your choice
(headers, blank lines, etc.), and then each segment was extracted and
passed as argument to the reader of that segment.

The drawback was that if the file was big there was no way to have "a
stream over a stream" (like a window function), so passing the segment
to the reader implied copying its string contents within the segment
delimiters.

It's something I already put some thought into, but never had the will
to code and share publicly.

Regards,

Esteban A. Maringolo


2017-07-26 12:02 GMT-03:00 Sean P. DeNigris <[hidden email]>: