Skip to content

Commit d90e279

Browse files
committed
Add release notes for Cobrix 2.7.0
1 parent 6342ad9 commit d90e279

File tree

1 file changed

+30
-3
lines changed

1 file changed

+30
-3
lines changed

README.md

Lines changed: 30 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1751,6 +1751,33 @@ at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:608)
17511751
A: Update hadoop dll to version 3.2.2 or newer.
17521752

17531753
## Changelog
1754+
- #### 2.7.0 released 8 April 2024.
1755+
- [#666](https://github.com/AbsaOSS/cobrix/issues/666) Added support for record length value mapping.
1756+
```scala
1757+
.option("record_format", "F")
1758+
.option("record_length_field", "FIELD_STR")
1759+
.option("record_length_map", """{"SEG1":100,"SEG2":200}""")
1760+
```
1761+
- [#669](https://github.com/AbsaOSS/cobrix/issues/669) Allow 'V' to be at the end of scaled PICs.
1762+
```cobol
1763+
10 SCALED-DECIMAL-FIELD PIC S9PPPV DISPLAY.
1764+
```
1765+
- [#672](https://github.com/AbsaOSS/cobrix/issues/672) Add the ability to parse copybooks with options normally passed to the `spark-cobol` Spark data source.
1766+
```scala
1767+
// Same options that you use for spark.read.format("cobol").option()
1768+
val options = Map("schema_retention_policy" -> "keep_original")
1769+
1770+
val cobolSchema = CobolSchema.fromSparkOptions(Seq(copybook), options)
1771+
val sparkSchema = cobolSchema.getSparkSchema.toString()
1772+
1773+
println(sparkSchema)
1774+
```
1775+
- [#674](https://github.com/AbsaOSS/cobrix/issues/674) Extended the usage of indexes for variable record length files with a record length field.
1776+
```scala
1777+
.option("record_length_field", "RECORD-LENGTH")
1778+
.option("enable_indexes", "true") // true by default so can me omitted
1779+
```
1780+
17541781
- #### 2.6.11 released 8 April 2024.
17551782
- [#659](https://github.com/AbsaOSS/cobrix/issues/659) Fixed record length option when record id generation is turned on.
17561783

@@ -1810,6 +1837,9 @@ A: Update hadoop dll to version 3.2.2 or newer.
18101837
- [#521](https://github.com/AbsaOSS/cobrix/issues/521) Fixed index generation and improved performance of variable
18111838
block length files processing (record_format='VB').
18121839

1840+
<details><summary>Older versions</summary>
1841+
<p>
1842+
18131843
- #### 2.5.1 released 24 August 2022.
18141844
- [#510](https://github.com/AbsaOSS/cobrix/issues/510) Fixed dropping of FILLER fields in Spack Schema if the FILLER has OCCURS of GROUPS.
18151845

@@ -1823,9 +1853,6 @@ A: Update hadoop dll to version 3.2.2 or newer.
18231853
- [#501](https://github.com/AbsaOSS/cobrix/issues/501) Fixed decimal field null detection when 'improved_null_detection' is turned on.
18241854
- [#502](https://github.com/AbsaOSS/cobrix/issues/502) Fixed parsing of scaled decimals that have a pattern similar to `SVP9(5)`.
18251855

1826-
<details><summary>Older versions</summary>
1827-
<p>
1828-
18291856
- #### 2.4.10 released 8 April 2022.
18301857
- [#481](https://github.com/AbsaOSS/cobrix/issues/481) ASCII control characters are now ignored instead of being replaced with spaces.
18311858
A new string trimming policy (`keep_all`) allows keeping all control characters in strings (including `0x00`).

0 commit comments

Comments
 (0)