@@ -1751,6 +1751,33 @@ at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:608)
1751
1751
A: Update hadoop dll to version 3.2.2 or newer.
1752
1752
1753
1753
## Changelog
1754
+ - #### 2.7.0 released 8 April 2024.
1755
+ - [ #666 ] ( https://github.com/AbsaOSS/cobrix/issues/666 ) Added support for record length value mapping.
1756
+ ``` scala
1757
+ .option(" record_format" , " F" )
1758
+ .option(" record_length_field" , " FIELD_STR" )
1759
+ .option(" record_length_map" , """ {"SEG1":100,"SEG2":200}""" )
1760
+ ```
1761
+ - [# 669 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 669 ) Allow 'V' to be at the end of scaled PICs .
1762
+ ```cobol
1763
+ 10 SCALED - DECIMAL - FIELD PIC S9PPPV DISPLAY .
1764
+ ```
1765
+ - [# 672 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 672 ) Add the ability to parse copybooks with options normally passed to the `spark-cobol` Spark data source.
1766
+ ```scala
1767
+ // Same options that you use for spark.read.format("cobol").option()
1768
+ val options = Map (" schema_retention_policy" -> " keep_original" )
1769
+
1770
+ val cobolSchema = CobolSchema .fromSparkOptions(Seq (copybook), options)
1771
+ val sparkSchema = cobolSchema.getSparkSchema.toString()
1772
+
1773
+ println(sparkSchema)
1774
+ ```
1775
+ - [# 674 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 674 ) Extended the usage of indexes for variable record length files with a record length field.
1776
+ ```scala
1777
+ .option(" record_length_field" , " RECORD-LENGTH" )
1778
+ .option(" enable_indexes" , " true" ) // true by default so can me omitted
1779
+ ```
1780
+
1754
1781
- #### 2.6.11 released 8 April 2024 .
1755
1782
- [# 659 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 659 ) Fixed record length option when record id generation is turned on.
1756
1783
@@ -1810,6 +1837,9 @@ A: Update hadoop dll to version 3.2.2 or newer.
1810
1837
- [# 521 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 521 ) Fixed index generation and improved performance of variable
1811
1838
block length files processing (record_format= 'VB ' ).
1812
1839
1840
+ <details ><summary >Older versions</summary >
1841
+ <p >
1842
+
1813
1843
- #### 2.5.1 released 24 August 2022 .
1814
1844
- [# 510 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 510 ) Fixed dropping of FILLER fields in Spack Schema if the FILLER has OCCURS of GROUPS .
1815
1845
@@ -1823,9 +1853,6 @@ A: Update hadoop dll to version 3.2.2 or newer.
1823
1853
- [# 501 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 501 ) Fixed decimal field null detection when 'improved_null_detection ' is turned on.
1824
1854
- [# 502 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 502 ) Fixed parsing of scaled decimals that have a pattern similar to `SVP9(5)`.
1825
1855
1826
- <details ><summary >Older versions</summary >
1827
- <p >
1828
-
1829
1856
- #### 2.4.10 released 8 April 2022 .
1830
1857
- [# 481 ](https:// github.com/ AbsaOSS / cobrix/ issues/ 481 ) ASCII control characters are now ignored instead of being replaced with spaces.
1831
1858
A new string trimming policy (`keep_all`) allows keeping all control characters in strings (including `0x00`).
0 commit comments