Bug #1189
closedadd full support for EML2 comple textFormat in EML ingestor
0%
Description
need to be able to read data files that are described by the complex textFormat
fields in EML2. right now the ingestor only uses the simpleDelimited fields for
parsing. See dataTable/physical/dataFormat/textFormat/complex.
Related issues
Updated by Chad Berkley almost 20 years ago
I think matt has made some of these changes and jing is now in charge of the
eml/ecogrid integration in kepler
Updated by Chad Berkley almost 20 years ago
- Bug 1343 has been marked as a duplicate of this bug. ***
Updated by Jing Tao about 19 years ago
We need the feature that to support eml201 too.
Updated by Jing Tao about 19 years ago
Create two classes - TextWidthFixedDataFormat and TextDelimitedDataFormat to
store the data format information. And in EML2Parser, to add code to get complex
format information and store them into above objects. And create
TextComplexFormatDataReader to read the complex data file to rowVectors. In
DBTableGenerator class, we add a new constructor to handle data file inputstream
rather than data vector array. Also in EMl2DataSource actor, to add code to
handle complex format data file.
Now kepler can handle complex data format and output it as all fields or part
fields(by sql query command).
Complex data format can be handled in both eml200 and eml201.