Skip to content

Conversation

@padam-prakash
Copy link
Contributor

improve incremental flow documentation, clarify outputTmp usage, and restructure explanation for readability

sonalgoyal and others added 12 commits October 16, 2025 01:08
* refactoring code

* ambiguous z_zids

* working tests

* fixing join for graph

* working junits

* moving to spark 3.5.5

* pom changes
Added in the description, config and python file
…restructure explanation for readability

improve incremental flow documentation, clarify outputTmp usage, and restructure explanation for readability
incrArgs.setParentArgs(args)
incrPipe = ECsvPipe("testFebrlIncr", "examples/febrl/test-incr.csv", schema)
incrArgs.setIncrementalData(incrPipe)
outputTempPipe = ECsvPipe("outputTemp", "/tmp/zinggOutput_febrl_tmp")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

has to have headers?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not necessarily. Both True and False values for outputTmp header work. If the header is set to True for outputTmp, the final output will include the header.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants