Releases: cloudfoundry/cf-acceptance-tests
v16.1.0
Notice
In order to succeed, the readiness healthcheck tests (on by default since CATs v15.1.0) now depend upon CAPI v1.169.0, which was first included in CF-D v36.0.0. This is not considered a breaking change because the readiness healthcheck tests can be turned off by setting "readiness_health_checks_enabled": false
in your CATs configuration.
Features
- Add tests for readiness healthcheck audit events to the
apps
andwindows
test suites by @ameowlia, @geofffranks in #997, #1044, #1038
Fixes
- Set GOVERSION in app manifests to Go 1.21 by @rroberts2222 in #1047
Maintenance
- build(deps): bump code.cloudfoundry.org/go-log-cache/v2 from 2.0.5 to 2.0.6 by @dependabot in #1011
- build(deps): bump org.springframework.boot:spring-boot-starter-parent from 3.2.0 to 3.2.1 in /assets/java-spring by @dependabot in #1008
- build(deps): bump google.golang.org/protobuf from 1.31.0 to 1.32.0 in /assets/grpc by @dependabot in #1007
- build(deps): bump org.springframework.boot from 3.2.0 to 3.2.1 in /assets/credhub-enabled-app by @dependabot in #1009
- build(deps): bump code.cloudfoundry.org/go-loggregator/v9 from 9.0.8 to 9.1.0 by @dependabot in #1012
- build(deps): bump sinatra from 3.1.0 to 3.2.0 in /assets/service_broker by @dependabot in #1016
- build(deps): bump sinatra from 3.1.0 to 3.2.0 in /assets/dora by @dependabot in #1015
- build(deps): bump sinatra from 3.1.0 to 3.2.0 in /assets/ruby_simple by @dependabot in #1014
- build(deps): bump sinatra from 3.1.0 to 3.2.0 in /assets/loggregator-load-generator by @dependabot in #1013
- build(deps): bump golang.org/x/crypto from 0.17.0 to 0.18.0 by @dependabot in #1019
- build(deps): bump golang.org/x/net from 0.19.0 to 0.20.0 in /assets/http2 by @dependabot in #1020
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.13.2 to 2.14.0 in /assets/catnip by @dependabot in #1023
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.13.2 to 2.14.0 by @dependabot in #1022
- build(deps): bump github.com/cloudfoundry/cf-test-helpers/v2 from 2.8.0 to 2.9.0 by @dependabot in #1024
- build(deps): bump github.com/onsi/gomega from 1.30.0 to 1.31.0 in /assets/catnip by @dependabot in #1028
- build(deps): bump github.com/onsi/gomega from 1.30.0 to 1.31.0 by @dependabot in #1026
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.14.0 to 2.15.0 in /assets/catnip by @dependabot in #1027
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.14.0 to 2.15.0 by @dependabot in #1025
- build(deps): bump sinatra from 3.2.0 to 4.0.0 in /assets/dora by @dependabot in #1031
- build(deps): bump sinatra from 3.2.0 to 4.0.0 in /assets/ruby_simple by @dependabot in #1029
- build(deps): bump sinatra from 3.2.0 to 4.0.0 in /assets/service_broker by @dependabot, @ctlong in #1032, #1037
- build(deps): bump github.com/onsi/gomega from 1.31.0 to 1.31.1 by @dependabot in #1036
- build(deps): bump github.com/onsi/gomega from 1.31.0 to 1.31.1 in /assets/catnip by @dependabot in #1035
- build(deps): bump org.springframework.boot from 3.2.1 to 3.2.2 in /assets/credhub-enabled-app by @dependabot in #1034
- build(deps): bump org.springframework.boot:spring-boot-starter-parent from 3.2.1 to 3.2.2 in /assets/java-spring by @dependabot in #1033
- build(deps): bump google.golang.org/grpc from 1.60.1 to 1.61.0 by @dependabot in #1039
- Remove duplicated cf CLI version output by @ctlong in #1041
- build(deps): bump code.cloudfoundry.org/go-loggregator/v9 from 9.1.0 to 9.2.0 by @dependabot in #1043
- build(deps): bump github.com/cloudfoundry/noaa/v2 from 2.3.0 to 2.4.0 by @dependabot in #1042
- build(deps): bump google.golang.org/grpc from 1.60.1 to 1.61.0 in /assets/grpc by @dependabot in #1040
New Contributors
- @rroberts2222 made their first contribution in #1047
Full Changelog: v16.0.0...v16.1.0
v16.0.0
Notice
The recommended minimum version line of Go to use with CATs, and CATs assets that are written in Go, has been bumped from go1.20 to go1.21.
Breaking Changes
Maintenance
- build(deps): bump google.golang.org/protobuf from 1.31.0 to 1.32.0 by @dependabot in #1006
- chore(assets/credhub-service-broker): Bump golang.org/x/crypto to v0.17.0 by @ctlong in #1010
Full Changelog: v15.3.0...v16.0.0
v15.3.0
Fixes
- Check error when we try to open the firehose websocket connection by @jochenehret in #980
Maintenance
- chore(deps): Use v3 archiver by @ctlong in #960
- build(deps): bump google.golang.org/grpc from 1.58.3 to 1.59.0 in /assets/grpc by @dependabot in #962
- build(deps): bump google.golang.org/grpc from 1.58.3 to 1.59.0 by @dependabot in #963
- build(deps): bump org.json:json from 20230618 to 20231013 in /assets/credhub-enabled-app by @dependabot in #961
- build(deps): bump org.springframework.boot:spring-boot-starter-parent from 3.1.4 to 3.1.5 in /assets/java-spring by @dependabot in #964
- build(deps): bump org.springframework.boot from 3.1.4 to 3.1.5 in /assets/credhub-enabled-app by @dependabot in #965
- build(deps): bump github.com/onsi/gomega from 1.28.0 to 1.28.1 by @dependabot in #967
- build(deps): bump github.com/onsi/gomega from 1.28.0 to 1.28.1 in /assets/catnip by @dependabot in #966
- build(deps): bump github.com/cloudfoundry/cf-test-helpers/v2 from 2.7.0 to 2.8.0 by @dependabot in #969
- build(deps): bump code.cloudfoundry.org/go-log-cache/v2 from 2.0.4 to 2.0.5 by @dependabot in #968
- build(deps): bump github.com/onsi/gomega from 1.28.1 to 1.29.0 in /assets/catnip by @dependabot in #971
- build(deps): bump github.com/onsi/gomega from 1.28.1 to 1.29.0 by @dependabot in #970
- Update minimum go version in README to 1.20 by @kei-yamazaki in #972
- build(deps): bump golang.org/x/net from 0.17.0 to 0.18.0 in /assets/http2 by @dependabot in #976
- build(deps): bump golang.org/x/crypto from 0.14.0 to 0.15.0 by @dependabot in #974
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.13.0 to 2.13.1 by @dependabot in #978
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.13.0 to 2.13.1 in /assets/catnip by @dependabot in #977
- build(deps): bump github.com/onsi/gomega from 1.29.0 to 1.30.0 by @dependabot in #975
- build(deps): bump github.com/onsi/gomega from 1.29.0 to 1.30.0 in /assets/catnip by @dependabot in #973
- build(deps): bump io.spring.dependency-management from 1.1.3 to 1.1.4 in /assets/credhub-enabled-app by @dependabot in #979
- build(deps): bump org.springframework.boot from 3.1.5 to 3.2.0 in /assets/credhub-enabled-app by @dependabot in #986
- build(deps): bump org.springframework.boot:spring-boot-starter-parent from 3.1.5 to 3.2.0 in /assets/java-spring by @dependabot in #985
- fix(helpers): Remove unnecessary tools import by @ctlong in #982
- build(deps): bump json from 2.6.3 to 2.7.0 in /assets/service_broker by @dependabot in #992
- build(deps): bump json from 2.6.3 to 2.7.0 in /assets/dora by @dependabot in #991
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.13.1 to 2.13.2 in /assets/catnip by @dependabot in #990
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.13.1 to 2.13.2 by @dependabot in #989
- build(deps): bump json from 2.7.0 to 2.7.1 in /assets/service_broker by @dependabot in #994
- build(deps): bump json from 2.7.0 to 2.7.1 in /assets/dora by @dependabot in #993
- build(deps): bump golang.org/x/net from 0.18.0 to 0.19.0 in /assets/http2 by @dependabot in #988
- build(deps): bump golang.org/x/crypto from 0.15.0 to 0.16.0 by @dependabot in #987
- build(deps): bump google.golang.org/grpc from 1.59.0 to 1.60.0 by @dependabot in #996
- build(deps): bump google.golang.org/grpc from 1.59.0 to 1.60.0 in /assets/grpc by @dependabot in #995
- build(deps): bump google.golang.org/grpc from 1.60.0 to 1.60.1 in /assets/grpc by @dependabot in #1002
- build(deps): bump golang.org/x/crypto from 0.16.0 to 0.17.0 by @dependabot in #1001
- build(deps): bump google.golang.org/grpc from 1.60.0 to 1.60.1 by @dependabot in #1000
- build(deps): bump github.com/go-chi/chi/v5 from 5.0.10 to 5.0.11 in /assets/credhub-service-broker by @dependabot in #1004
- build(deps): bump github.com/go-chi/chi/v5 from 5.0.10 to 5.0.11 in /assets/catnip by @dependabot in #1005
Full Changelog: v15.2.0...v15.3.0
v15.2.0
Fixes
- Use a different 404 expectations that allows for custom router error pages to be set in Cloud Foundry by @ctlong in #930
Maintenance
- Bump org.springframework.boot from 3.1.2 to 3.1.3 in /assets/credhub-enabled-app by @dependabot in #919, #936
- build(deps): bump golang.org/x/net from 0.14.0 to 0.17.0 in /assets/http2 by @dependabot in #925, #945, #949
- build(deps): bump google.golang.org/grpc from 1.57.0 to 1.58.3 in /assets/grpc by @dependabot in #927, #931, #937, #950
- build(deps): bump golang.org/x/crypto from 0.12.0 to 0.14.0 by @dependabot in #924, #944
- build(deps): bump google.golang.org/grpc from 1.57.0 to 1.58.3 by @dependabot in #926, #932, #938, #948
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.12.0 to 2.13.0 in /assets/catnip by @dependabot in #934, #946
- build(deps): bump github.com/onsi/ginkgo/v2 from 2.12.0 to 2.13.0 by @dependabot in #933, #947
- build(deps): bump org.springframework.boot:spring-boot-starter-parent from 3.1.3 to 3.1.4 in /assets/java-spring by @dependabot in #935
- build(deps): bump code.cloudfoundry.org/go-loggregator/v9 from 9.0.7 to 9.0.8 by @dependabot in #941
- build(deps): bump code.cloudfoundry.org/go-log-cache/v2 from 2.0.3 to 2.0.4 by @dependabot in #940
- chore(bin): update test defaults by @ctlong in #939
- build(deps): bump github.com/onsi/gomega from 1.27.10 to 1.28.0 in /assets/catnip by @dependabot in #943
- build(deps): bump github.com/onsi/gomega from 1.27.10 to 1.28.0 by @dependabot in #942
- build(deps): bump golang.org/x/net from 0.14.0 to 0.17.0 in /assets/catnip by @dependabot in #951
- build(deps): bump golang.org/x/net from 0.9.0 to 0.17.0 in /assets/grpc by @dependabot in #954
- build(deps): bump golang.org/x/net from 0.8.0 to 0.17.0 in /assets/credhub-service-broker by @dependabot in #953
- build(deps): bump golang.org/x/net from 0.14.0 to 0.17.0 by @dependabot in #952
Full Changelog: v15.1.0...v15.2.0
v15.1.0
Notice
In order to succeed, the readiness healthcheck tests depend upon garden v1.37.0, diego v2.81.0, capi v1.158.0. All of which were first included together in CF-D v32.2.0.
The new readiness healthcheck tests are on by default, but are not considered a breaking change because they can be turned off by setting "readiness_health_checks_enabled": false
in your configuration.
Features
- Add tests for the new readiness healthcheck feature to the
apps
andwindows
test suites by @ameowlia in #915 & #923
Maintenance
- Bump github.com/onsi/ginkgo/v2 from 2.11.0 to 2.12.0 in /assets/catnip by @dependabot in #921
- Bump github.com/onsi/ginkgo/v2 from 2.11.0 to 2.12.0 by @dependabot in #918
- Bump org.springframework.boot:spring-boot-starter-parent from 3.1.2 to 3.1.3 in /assets/java-spring by @dependabot in #920
Full Changelog: v15.0.0...v15.1.0
v15.0.0
Breaking Changes
Features
Fixes
Maintenance
- Bump github.com/go-chi/chi/v5 from 5.0.8 to 5.0.10 in /assets/credhub-service-broker by @dependabot in #886
- Bump github.com/go-chi/chi/v5 from 5.0.8 to 5.0.10 in /assets/catnip by @dependabot in #885
- Bump code.cloudfoundry.org/go-loggregator/v9 from 9.0.6 to 9.0.7 by @dependabot in #888
- Bump code.cloudfoundry.org/go-log-cache/v2 from 2.0.2 to 2.0.3 by @dependabot in #887
- Bump github.com/onsi/gomega from 1.27.8 to 1.27.9 in /assets/catnip by @dependabot in #895
- Bump github.com/onsi/gomega from 1.27.8 to 1.27.9 by @dependabot in #894
- Bump github.com/onsi/gomega from 1.27.8 to 1.27.10 by @dependabot in #896
- Bump github.com/onsi/gomega from 1.27.9 to 1.27.10 in /assets/catnip by @dependabot in #897
- Bump google.golang.org/grpc from 1.56.2 to 1.57.0 by @dependabot in #899
- Bump google.golang.org/grpc from 1.56.2 to 1.57.0 in /assets/grpc by @dependabot in #898
- Bump rack from 2.2.7 to 2.2.8 in /assets/hello-world by @dependabot in #903
- Bump rack from 2.2.7 to 2.2.8 in /assets/hello-routing by @dependabot in #901
- Rework cats pipeline by @jochenehret in #902
- Bump golang.org/x/net from 0.12.0 to 0.13.0 in /assets/http2 by @dependabot in #904
- Bump github.com/cloudfoundry/noaa/v2 from 2.2.0 to 2.3.0 by @dependabot in #905
- Bump credhub enabled app to spring boot 3 by @moleske in #893
- Bump golang.org/x/net from 0.13.0 to 0.14.0 in /assets/http2 by @dependabot in #909
- Bump golang.org/x/crypto from 0.11.0 to 0.12.0 by @dependabot in #910
- Bump sinatra from 3.0.6 to 3.1.0 in /assets/loggregator-load-generator by @dependabot in #911
- Bump sinatra from 3.0.6 to 3.1.0 in /assets/service_broker by @dependabot in #908
- Bump sinatra from 3.0.6 to 3.1.0 in /assets/dora by @dependabot in #907
- Bump sinatra from 3.0.6 to 3.1.0 in /assets/ruby_simple by @dependabot in #906
- Bump spring-boot-starter-parent from 2.7.7 to 3.1.2 in /assets/java-spring by @dependabot in #890
- Bump github.com/cloudfoundry/cf-test-helpers/v2 from 2.5.0 to 2.6.0 by @dependabot in #913
- Bump io.spring.dependency-management from 1.1.2 to 1.1.3 in /assets/credhub-enabled-app by @dependabot in #916
- Bump github.com/cloudfoundry/cf-test-helpers/v2 from 2.6.0 to 2.7.0 by @dependabot in #917
Full Changelog: v14.0.0...v15.0.0
v14.0.0
Breaking Changes
- Remove cflinuxfs3 support from CATs by @jochenehret in #881
Fixes
- Fix test flakiness resulting from credhub-service-broker asset's improper error handling by @ctlong in #863
Maintenance
- Bump github.com/onsi/ginkgo/v2 from 2.9.5 to 2.9.7 in /assets/catnip by @dependabot in #855
- Bump github.com/onsi/ginkgo/v2 from 2.9.5 to 2.9.7 by @dependabot in #854
- Bump github.com/onsi/ginkgo/v2 from 2.9.7 to 2.10.0 in /assets/catnip by @dependabot in #859
- Bump github.com/onsi/gomega from 1.27.7 to 1.27.8 by @dependabot in #857
- Bump github.com/onsi/ginkgo/v2 from 2.9.7 to 2.10.0 by @dependabot in #856
- Bump github.com/onsi/gomega from 1.27.7 to 1.27.8 in /assets/catnip by @dependabot in #858
- CI: Update Dependabot configuration by @ctlong in #861
- Bump golang.org/x/crypto from 0.9.0 to 0.10.0 by @dependabot in #864
- Bump golang.org/x/net from 0.10.0 to 0.11.0 in /assets/http2 by @dependabot in #865
- Bump google.golang.org/grpc from 1.55.0 to 1.56.0 in /assets/grpc by @dependabot in #867
- Bump google.golang.org/grpc from 1.55.0 to 1.56.0 by @dependabot in #866
- Bump github.com/onsi/ginkgo/v2 from 2.10.0 to 2.11.0 in /assets/catnip by @dependabot in #871
- Bump code.cloudfoundry.org/go-loggregator/v9 from 9.0.5 to 9.0.6 by @dependabot in #870
- Bump code.cloudfoundry.org/go-log-cache/v2 from 2.0.1 to 2.0.2 by @dependabot in #869
- Bump google.golang.org/grpc from 1.56.0 to 1.56.1 in /assets/grpc by @dependabot in #873
- Bump google.golang.org/grpc from 1.56.0 to 1.56.1 by @dependabot in #872
- Bump google.golang.org/protobuf from 1.30.0 to 1.31.0 by @dependabot in #875
- Bump google.golang.org/protobuf from 1.30.0 to 1.31.0 in /assets/grpc by @dependabot in #874
- Bump golang.org/x/net from 0.11.0 to 0.12.0 in /assets/http2 by @dependabot in #878
- Bump golang.org/x/crypto from 0.10.0 to 0.11.0 by @dependabot in #877
- Bump google.golang.org/grpc from 1.56.1 to 1.56.2 in /assets/grpc by @dependabot in #880
- Bump google.golang.org/grpc from 1.56.1 to 1.56.2 by @dependabot in #879
- Improvement: Combine worker assets by @ctlong in #876
Full Changelog: v13.1.0...v14.0.0
v13.1.0
Fixes
- Remove apps/buildpack_cache test hardcoded timeout by @ctlong in #837
- Update Dynamic ASG tests timeouts to reduce flakiness by @ebroberson in #833
- Use CfPushTimeotDuration where appropriate in the v3 suite by @dsabeti in #838
- Replace deprecated gorilla/mux package in credhub-service-broker with go-chi/chi by @ctlong in #839
Maintenance
- Bump github.com/onsi/ginkgo/v2 from 2.9.2 to 2.9.5 in /assets/catnip by @dependabot
- Bump github.com/onsi/ginkgo/v2 from 2.9.2 to 2.9.5 by @dependabot
- Bump golang.org/x/net from 0.9.0 to 0.10.0 in /assets/http2 by @dependabot in #847
- Bump golang.org/x/crypto from 0.8.0 to 0.9.0 by @dependabot in #846
- Bump google.golang.org/grpc from 1.54.0 to 1.55.0 in /assets/grpc by @dependabot in #845
- Bump google.golang.org/grpc from 1.54.0 to 1.55.0 by @dependabot in #844
- Bump code.cloudfoundry.org/go-log-cache/v2 from 2.0.0 to 2.0.1 by @dependabot in #849
- Bump code.cloudfoundry.org/go-loggregator/v9 from 9.0.4 to 9.0.5 by @dependabot in #848
- Bump github.com/onsi/gomega from 1.27.6 to 1.27.7 in /assets/catnip by @dependabot in #853
- Bump github.com/onsi/gomega from 1.27.6 to 1.27.7 by @dependabot in #852
New Contributors
- @ebroberson made their first contribution in #833
Full Changelog: v13.0.0...v13.1.0
v13.0.0
Breaking Changes
The default stack was changed to cflinuxfs4 in #834, which is available in cf-deployment by default as of v28.0.0.
Fixes
- Replace
assets/binary
with a go binary that doesn't attempt to use theruby
executable by @jochenehret in #818 - Check for the existence of
apt
rather thanruby
in app_staging test @arjun024 in #819 - Hardcode
cf push
timeout to 120 seconds in buildpack_cache test by @iaftab-alam in #832 - Check process start command rather than endpoint response in buildpack_cache test by @sethboyles in #823
Maintenance
- Bump github.com/onsi/gomega from 1.27.5 to 1.27.6 in /assets/catnip by @dependabot in #821
- Bump github.com/onsi/gomega from 1.27.5 to 1.27.6 by @dependabot in #820
- Fix: remove validationerrors package in favor of go1.20 wrapped errors by @ctlong in #752
- Fix: credhub service broker asset by @ctlong in #814
- Bump thin from 1.8.1 to 1.8.2 in /assets/hello-routing by @dependabot in #822
- Bump golang.org/x/net from 0.8.0 to 0.9.0 in /assets/http2 by @dependabot in #825
- Bump golang.org/x/crypto from 0.7.0 to 0.8.0 by @dependabot in #824
- Bump code.cloudfoundry.org/clock from 1.0.1-0.20220601152104-3983b71fbf93 to 1.1.0 in /assets/catnip by @dependabot in #826
- Bump sinatra from 3.0.5 to 3.0.6 in /assets/dora by @dependabot in #830
- Bump sinatra from 3.0.5 to 3.0.6 in /assets/service_broker by @dependabot in #828
- Bump sinatra from 3.0.5 to 3.0.6 in /assets/loggregator-load-generator by @dependabot in #829
- Bump sinatra from 3.0.5 to 3.0.6 in /assets/ruby_simple by @dependabot in #827
- Bump rack from 2.2.6.4 to 2.2.7 in /assets/hello-routing by @dependabot in #836
- Bump rack from 2.2.6.4 to 2.2.7 in /assets/hello-world by @dependabot in #835
New Contributors
- @iaftab-alam made their first contribution in #831
Full Changelog: v12.1.0...v13.0.0
v12.1.0
Fixes
- Match on curl error code in tasks suite's ASG test so that it works in cflinuxfs4 by @staylor14 in #817
Maintenance
- Bump google.golang.org/protobuf from 1.29.1 to 1.30.0 in /assets/grpc by @dependabot in #805
- Bump google.golang.org/protobuf from 1.29.1 to 1.30.0 by @dependabot in #804
- Fix: Bump go-log-cache to v2 by @ctlong in #806
- Bump google.golang.org/grpc from 1.53.0 to 1.54.0 in /assets/grpc by @dependabot in #808
- Bump google.golang.org/grpc from 1.53.0 to 1.54.0 by @dependabot in #807
- Bump rack from 2.2.6.3 to 2.2.6.4 in /assets/ruby_simple by @dependabot in #803
- Bump rack from 2.2.6.3 to 2.2.6.4 in /assets/loggregator-load-generator by @dependabot in #802
- Bump github.com/onsi/gomega from 1.27.4 to 1.27.5 in /assets/catnip by @dependabot in #813
- Bump github.com/onsi/gomega from 1.27.4 to 1.27.5 by @dependabot in #811
- Use ARD WG Git Bot by @jochenehret in #816
- Fix: bump cf test helpers by @ctlong in #815
New Contributors
- @staylor14 made their first contribution in #817
Full Changelog: v12.0.0...v12.1.0