We're updating the issue view to help you get more done. 

Make ParserConfig an interface to allow parser-specific config options

Description

NQuads was originally developed for large and unruly real web data sets (billion triples challenge, YARS2). For these data sets it is sometimes necessary to make pragmatic decisions to truncate literals or drop literals that have unreasonable size (multi-megabyte or larger files).

I would like to suggest that the RDF parser options should be encapsulated as an interface and extended to allow configuration of the maximum size for literals and for whether large literals should be truncated or dropped (which is cleaner). This is in the spirit of pragmatic use cases for which the NQuads format was designed.

Environment

None

Status

Assignee

Peter Ansell

Reporter

Bryan Thompson

Labels

None

Components

Fix versions

Priority

Major