|
| 1 | +--- |
| 2 | +Title: Redis Data Integration release notes 1.12.0 (June 2025) |
| 3 | +alwaysopen: false |
| 4 | +categories: |
| 5 | +- docs |
| 6 | +- operate |
| 7 | +- rs |
| 8 | +description: | |
| 9 | + Enhanced CLI command for HA topology information. |
| 10 | + Automatic DLQ routing for key errors. |
| 11 | + Enhanced transformation job validation in the PATCH and POST /api/v1/pipelines endpoints. |
| 12 | + Added `xml_to_dict` transformation function. |
| 13 | +linkTitle: 1.12.0 (June 2025) |
| 14 | +toc: 'true' |
| 15 | +weight: 982 |
| 16 | +--- |
| 17 | + |
| 18 | +{{< note >}}This minor release replaces the 1.10.0 release.{{< /note >}} |
| 19 | + |
| 20 | +RDI’s mission is to help Redis customers sync Redis Enterprise with live data from their slow disk-based databases to: |
| 21 | + |
| 22 | +- Meet the required speed and scale of read queries and provide an excellent and predictable user experience. |
| 23 | +- Save resources and time when building pipelines and coding data transformations. |
| 24 | +- Reduce the total cost of ownership by saving money on expensive database read replicas. |
| 25 | + |
| 26 | +RDI keeps the Redis cache up to date with changes in the primary database, using a [_Change Data Capture (CDC)_](https://en.wikipedia.org/wiki/Change_data_capture) mechanism. |
| 27 | +It also lets you _transform_ the data from relational tables into convenient and fast data structures that match your app's requirements. You specify the transformations using a configuration system, so no coding is required. |
| 28 | + |
| 29 | +## Headlines |
| 30 | + |
| 31 | +- Enhanced CLI status command to display RDI High Availability (HA) topology information. |
| 32 | +- Improved error handling with automatic DLQ routing for wrong Redis key errors. |
| 33 | +- Enhanced transformation job validation in the `PATCH` and `POST` `/api/v1/pipelines` |
| 34 | + endpoints with better error reporting. |
| 35 | +- Added `xml_to_dict` transformation function for converting XML strings to JSON objects. |
| 36 | + |
| 37 | +## Detailed changes |
| 38 | + |
| 39 | +**CLI and Monitoring** |
| 40 | + |
| 41 | +- The `redis-di status` command now displays High Availability (HA) information for cluster status visibility. |
| 42 | +- Fixed `rdi_version_info` metric to export periodically instead of only at startup. |
| 43 | +- Status API: Fixed issue - pipeline status not shifting from snapshot to streaming after restart or reset |
| 44 | + |
| 45 | +**Validation and Error Handling** |
| 46 | + |
| 47 | +- Static configuration and job schema validation provides clearer error messages. |
| 48 | +- Pipeline endpoints validate source and job configurations against database metadata, preventing mismatches: |
| 49 | + - Error in table names or table doesn't exist. |
| 50 | + - More than one job per table. |
| 51 | +- Automatic DLQ routing for wrong Redis key errors. |
| 52 | +- Support for secret rotation. Pods are recreated when a secret rotates. |
| 53 | +- RDI validates that its Redis database is not sharded when RDI starts. |
| 54 | + |
| 55 | +**Database Connectivity** |
| 56 | + |
| 57 | +- MySQL connector filters system tables for cleaner metadata. |
| 58 | +- Collector API supports multiple database and schema entries for multi-database scenarios. |
| 59 | +- `/api/v1/pipelines/{source_name}/metadata` endpoint supports table name filtering. |
| 60 | +- `/api/v1/pipelines/{source_name}/tables` endpoint supports table name filtering. |
| 61 | + |
| 62 | +**API and Infrastructure** |
| 63 | + |
| 64 | +- Pipeline endpoints (source, targets, secret-providers) support key deletion via `PATCH` operations. |
| 65 | +- Helm chart supports lists of ingress hosts. |
| 66 | +- Operator handles missing SPCPS CRD gracefully. |
| 67 | + |
| 68 | +## Limitations |
| 69 | + |
| 70 | +RDI can write data to a Redis Active-Active database. However, it doesn't support writing data to two or more Active-Active replicas. Writing data from RDI to several Active-Active replicas could easily harm data integrity as RDI is not synchronous with the source database commits. |
0 commit comments