Releases: demisto/demisto-sdk
Releases · demisto/demisto-sdk
v1.19.2
- Added a period at the end of lines produced by the generate-docs command that state the tested version of the product.
- Update
RN112
validation's docs reference link. - Added support to control the maximum file size and log rotation files count in the sdk logger.
- Fixed an issue with where passing the deprecated logging arguments to any command presented an incorrect recommendation for argument substitution.
- Fixed an issue where the documentation of logging arguments was incorrect.
- Fixed an issue in calculating content graph hash when creating or updating it.
- Fixed an issue where the coloring of the logging messages was not working properly when mixing both Console log and Parallel log handlers.
- Calling graph create or graph update now run the commands with default arguments, instead of showing the command help.
- Removed the use of chunks when calculating content relationships.
- Fixed an issue where the url regex in the validate command was wrong.
- Fixed an issue where pre-commit command failed when using global environment.
- Fixed an issue where validate would fail in external repos when trying to ignore
BA102
. - Fixed an issue where error-code failed on some error codes.
- Fixes an issue in format command where the
-i
option included files in.venv
directories. - Updated the comment added to contribution PRs to old packs so it contains a link to the documentation of the GitHub Codespaces in xsoar.pan.dev.
- Updated GitPython version to 3.1.32.
v1.19.1
- Fixed an issue where unify failed on integrations using an API a module, when not called from the content root.
- Improved update-release-notes logs when changes in dependent API modules are detected.
- Reverted changes released in version 1.19.0 in lint, lint will not fail on
demisto.results
,return_outputs
andLOG
. - Updated the generate-docs command to use the content graph instead of the id_set file.
- Added the '--all' input option for the prepare-content command, to support running on all content packs.
- Updated the '-i' input option of the prepare-content command to support multiple inputs as a comma-separated list.
v1.19.0
- Added the graph command group. The create-content-graph and update-content-graph commands were migrated to this command group, and named graph create and graph update respectively.
- Added the graph get-relationships command.
- The graph create command will now use a list of known content items from content-private, to avoid false-positives in validation
GR103
. Additionally,GR103
was added to the ALLOWED_IGNORE_ERRORS list. - The modeling-rules test command will now validate that the modeling rules schema mappings are aligned with the test-data mappings.
- Added the --xsiam flag to the init command in order to create XSIAM content.
- Fixed an issue where the
update-additional-dependencies
pre-commit step failed when not running in a content-like repo. - Removed the format execution step from the
contribution_converter
since it can be executed separately during the contribution process. - Added a new validation (
GR108
) to validate command that assures hidden packs do not have mandatory dependant packs. - Added a validation that check that non ignorable errors are not used.
- Running validate in a GitHub Action will now show errors as annotations, visible in the
Files Changed
tab of the pull request. - lint will now fail on
demisto.results
andreturn_outputs
usage, when a pack isxsoar
orpartner
supported. - lint will now fail on
LOG
usage in python files. - Updated the format command to use the content graph instead of the id_set file.
- Updated format command not to fail on unexpected values that returns from the graph, and just add it to the log.
- Removed a redundant debug log on the
tools.get_file
function.
v1.18.1
- Fixed an issue where the coloring directives where showing in log messages.
- Fixed an issue where create-content-graph was not executed upon changes in the parser infra files.
- Added a parameter
skip-packs-known-words
to the doc-review command, making sure that pack known words will not be added.
v1.18.0
- Fixed an issue where the DEMISTO_SDK_SKIP_VERSION_CHECK was ignored when running on non CI environments.
- Added the ability to ignore any validation in the validate command when running in an external (non-demisto/content) repo, by placing a
.private-repo-settings
file at its root. - Fixed an issue where validate falsely detected backwards-compatibility issues, and prevented adding the
marketplaces
key to content items. - Calling format with the
-d
flag now removes test playbooks testing the deprecated content from conf.json. - Fixed an issue where the SDK would fail pulling docker images.
- Fixed an issue where prepare-content command would add the string
candidate
to scripts and integrations for the nativeimage key. - Fixed an issue where in some cases the split command did not remove pack version note from the script.
- Improved the content graph performance when calculating content relationships.
- Fixed an issue where validate would not properly detect dependencies of core packs.
- Removed usages of Random in unit tests to ensure the tests are deterministic.
- validate will now run on all the pack content items when the pack supported marketplaces are modified.
- Fixed an issue where validate failed on single-select types incident and indicator fields when given empty value as a select value option.
- pre-commit no longer runs when there are no modified files (unless provided with input files).
- Fixed an issue where errors in validate were logged as
info
. - Fixed an issue where validate error messages were not logged when an integration param, or the default argument in reputation commands is not valid.
- Added new validation that XSIAM integrations must have
marketplacev2
as the value of the marketplaces field. - Fixed an issue where the format command would change the value of the
unsearchable
key in fields. - Added an ability to provide list of marketplace names as a credentials-type (type 9) param attribute.
- doc-review will run with the
--use-packs-known-words
default to true. - Fixed an issue where lint command failed to pull docker image in Gitlab environment.
- Added the deprecated field to the pack object for the content-graph metadata.
- Fixed an issue in doc-review command where escape characters within Markdown files were detected as invalid words.
- Calling modeling-rules init-test-data will now return the XDM fields output in alphabetical order.
- Fixed an issue where validate failed on infrastructure test files.
- Added a new validation (
BA125
) to validate that assures internal function names aren't in use in customer-facing docs. - Removed the Pipfile and Pipfile.lock from the templates in demisto-sdk init command.
- Disabled the option to create an integration with Pipfile and Pipfile.lock files.
- Fixed an issue in update-content-graph where the neo4j service was unaccessible for non-root users.
- Added a Sourcery hook to pre-commit.
- Added a working directory to the
contribution_converter
in order to support working on a temporary directory. - Added a waiting period when checking whether the dataset exists in the modeling-rule test command.
v1.17.2
- Fixed an issue where lint and validate commands failed on integrations and scripts that use docker images that are not available in the Docker Hub but exist locally.
- Added documentation for the flag override-existing used in upload.
- Fixed an issue where validate failed on Incident Field items with a
template
value. - Improved memory efficiency in update-content-graph and create-content-graph commands.
- Removed support for the
cve_id
name for the default-argument for cve reputation commands in validate. Now, onlycve
may be used for such commands. - Fixed an issue where zip_packs failed uploading content.
- Added
tenant_timezone
handling to the modeling-rules init command, allowing usage with tenants in various timezones. - Shortened the timeout when checking whether the dataset exists in test-modeling-rule.
- Cleaned up project dependencies.
- Added support for the List content item in Xpanse marketplace.
- Fixed an issue in run-unit-tests command when running Powershell tests.
- Fixed an issue where lint failed running when a docker container would not init properly.
- Fixed an issue where the upload command would upload a pack metadata with wrong display names.
- Performance enhancements when reading yaml files.
- Removed redundant errors and fields from
errors.py
. - Updated update-release-notes to use graph instead of id_set.
v1.17.1
- Added the
aliasTo
key to the Incident Field schema. - Modified validate to not require fields whose value is always
False
. - Modified validate to use the graph instead of id_set on changed APIModules.
- Fixed an issue where
register_module_line()
was not removed from python scripts when the script had no trailing newline. - Fixed an issue where an integration containing a command without a description would fail to upload while using the upload command.
- Fixed an issue where attempting to individually upload
Preprocess Rule
files raised an unclear error message. Note: preprocess rules can not be individually uploaded, but only as part of a pack. - Fixed an issue where the upload command would fail on Indicator Types.
- Fixed an issue where the upload command would return the wrong error message when connection credentials are invalid.
- Fixed an issue where the upload command would fail parsing input paths.
- added support for the
isfetcheventsandassets
flag in content graph.
v1.17.0
- validate will only fail on docker related errors if the pack is supported by xsoar.
- Added a validation that assures filename, id, and name have a correct suffix for modeling/parsing rules files.
- Added new validate checks, preventing unwanted changes of the marketplaces (BC108,BC109), toversion (BC107) and fromversion (BC106) fields.
- Removed the
timezone_offset
argument in the modeling-rules test command. - Fixed an issue where lint failed when importing functions from CommonServerUserPython.
- The format command now will sync hidden parameters with master branch.
- Fixed an issue where lock integration failed on FileNotFound.(PANW-internal only).
- Fixed an issue where lint falsely warned of using
demisto.results
. - Fixed an issue where validate always returned XSIAM Dashboards and Correlation Rules files as valid.
- Added
GR107
validation to validate using the graph validations to check that no deprecated items are used by non-deprecated content. - Fixed an issue where the modeling-rules test command failed to get the existence of dataset in cases where the dataset takes more than 1 minute to get indexed.
- Fixed an issue in lint where the container used for linting had dependency conflicts with the image used by content, and caused inconsistent results.
- Fixed an issue where the download command failed when the playbook has different
name
andid
. - Moved the pre-commmit command template to the
demisto/content
repository, where it's easier to maintain. - Fixed an issue where an internal method caused warning messages when reading md files.
- Added support for Pre Process Rules in the upload command.
- Fixed an issue where upload would not upload items whose
maketplaces
value was an empty list. - Added a prettyName key to the incident field schema.
- Fixed an issue where upload command could not parse content items that are not unicode-encoded.
v1.16.0
- Added a check to is_docker_image_latest_tag to only fail the validation on non-latest image tag when the current tag is older than 3 days.
- Fixed an issue where upload would not properly show the installed version in the UI.
- Fixed an issue where the
contribution_converter
failed replacing generated release notes with the contribution form release notes. - Fixed an issue where an extra levelname was added to a logging message.
- Modified the
mypy
pre-commit hook to run in a virtual environment, rather than the local mypy version. - Added support to run validate with
--git
flag on detached HEAD. - Added a validation that the validate command will fail if the pack name is not prefixed on XSIAM dashboard images.
- Fixed the generate-test-playbook which failed on an unexpected keyword argument - 'console_log_threshold'.
- Fixed an issue where prepare-content would not properly parse the
fromVersion
andtoVersion
attributes of XSIAM-Dashbaord and XSIAM-Report content items. - Fixed an issue where validate command did not fail on non-existent dependency ids of non-mandatory dependant content.
- Fixed pytest async io deprecation warning.
- Added the
--incident-id
argument (optional) to the run command. - Fixed an issue in run-unit-tests and update-content-graph where running commands in a docker container was done with insufficient permissions.
- Added the
_time
field to the output compare table of the modeling-rules test command. - Changed the endpoint download uses to get system content items.
- Fixed an issue where graph-related tasks failed when files were deleted from the repo.
- Added a validate check, and a format auto fix for the
fromversion
field in Correlation Rules and XSIAM Dashboards. - Update the format used for dev-dependencies in pyproject.toml to match modern versions of Poetry.
- Added timestamps to logging messages when running in a CI build.
v1.15.5
- Breaking Change: The default of the upload command
--zip
argument istrue
. To upload packs as custom content items use the--no-zip
argument. - Removed the
no-implicit-optional
hook from pre-commit. - Removed the
markdownlint
hook from pre-commit. - Fixed an issue in run-unit-tests to pass with warnings when no tests are collected.
- Fixed an issue in run-unit-tests with the coverage calculation.
- Fixed a notification about log file location appeared more than once.
- Updated the error message when code coverage is below the threshold in coverage-analyze to be printed in a more noticeable red color.
- Fixed an issue in upload that failed when a comma-separated list of paths is passed to the
--input
argument. - Running validate with the
--graph
flag will now run the graph validations after all other validations. - improved the generated release note for newly added XSIAM entities when running update-release-notes command.
- Fixed an issue where in some cases validation failed when mapping null values.
- Fixed an issue in upload command where the
--keep-zip
argument did not clean the working directory. - Fixed an issue where an extra levelname was added to a logging message.
- Fixed an issue in upload where uploading packs to XSIAM failed due to version mismatch.