Skip to content

Commit

Permalink
Merge branch '1.x' into integration/symfony-string-folded
Browse files Browse the repository at this point in the history
  • Loading branch information
f-lapinski authored Feb 6, 2025
2 parents 13d2c65 + efc9369 commit 14b7b31
Show file tree
Hide file tree
Showing 24 changed files with 1,813 additions and 63 deletions.
4 changes: 3 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
## [Unreleased] - 2025-02-05
## [Unreleased] - 2025-02-06

### Added
- [#1447](https://github.com/flow-php/flow/pull/1447) - **Add read support for JSONL files** - [@jmortlock](https://github.com/jmortlock)
- [0d0601](https://github.com/flow-php/flow/commit/0d060180469dbf279df168da7c0f07de92ef3a18) - **permalinks to headlines rendered from markdown** - [@norberttech](https://github.com/norberttech)
- [#1442](https://github.com/flow-php/flow/pull/1442) - **Added support for JSONL - https://github.com/jmortlock/flow/pull/new/add-jsonl-support** - [@jmortlock](https://github.com/jmortlock)
- [#1440](https://github.com/flow-php/flow/pull/1440) - **composer.json file to each example** - [@norberttech](https://github.com/norberttech)
Expand Down Expand Up @@ -141,6 +142,7 @@
- [#1240](https://github.com/flow-php/flow/pull/1240) - **Update Homebrew TAP formula: flow-php to version: 0.10.0** - [@norberttech](https://github.com/norberttech)

### Fixed
- [d82381](https://github.com/flow-php/flow/commit/d823813af9be12d5cc21d4b8e2a01171ce0e0c90) - **failing example test** - [@norberttech](https://github.com/norberttech)
- [#1448](https://github.com/flow-php/flow/pull/1448) - **ParquetOutput didn't implement Output interface** - [@radozato](https://github.com/radozato)
- [#1441](https://github.com/flow-php/flow/pull/1441) - **Added missing lock files to examples** - [@norberttech](https://github.com/norberttech)
- [#1437](https://github.com/flow-php/flow/pull/1437) - **Setting up the offset for reading remote parquet files** - [@norberttech](https://github.com/norberttech)
Expand Down
10 changes: 5 additions & 5 deletions examples/topics/data_reading/elasticsearch/composer.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion examples/topics/data_reading/http_dynamic/output.txt
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
+----------+-----------------------------+---------------------+----------+--------------+-----------+----------------------+
| name | html_url | blog | login | public_repos | followers | created_at |
+----------+-----------------------------+---------------------+----------+--------------+-----------+----------------------+
| Flow PHP | https://github.com/flow-php | http://flow-php.com | flow-php | 38 | 111 | 2020-10-26T18:40:27Z |
| Flow PHP | https://github.com/flow-php | http://flow-php.com | flow-php | 38 | 113 | 2020-10-26T18:40:27Z |
+----------+-----------------------------+---------------------+----------+--------------+-----------+----------------------+
1 rows
8 changes: 4 additions & 4 deletions examples/topics/data_reading/json/composer.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

24 changes: 24 additions & 0 deletions examples/topics/data_reading/jsonl/code.php
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
<?php

declare(strict_types=1);

use function Flow\ETL\Adapter\JSON\from_json_lines;
use function Flow\ETL\DSL\{bool_schema, data_frame, int_schema, schema, str_schema, to_stream};

require __DIR__ . '/vendor/autoload.php';

$schema = schema(
int_schema('id'),
str_schema('name'),
str_schema('email'),
bool_schema('active'),
);

data_frame()
->read(
from_json_lines(__DIR__ . '/input/dataset.jsonl')
->withSchema($schema)
)
->collect()
->write(to_stream(__DIR__ . '/output.txt', truncate: false))
->run();
16 changes: 16 additions & 0 deletions examples/topics/data_reading/jsonl/composer.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
{
"name": "flow-php/examples",
"description": "Flow PHP - Examples",
"license": "MIT",
"type": "library",
"require": {
"flow-php/etl": "1.x-dev",
"flow-php/etl-adapter-json": "1.x-dev"
},
"archive": {
"exclude": [
".env",
"vendor"
]
}
}
Loading

0 comments on commit 14b7b31

Please sign in to comment.