Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix bad request handling #179

Merged
merged 20 commits into from
Oct 25, 2024
Merged
Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 3 additions & 7 deletions .github/workflows/release.yml
Original file line number Diff line number Diff line change
@@ -1,11 +1,8 @@
name: Release to Maven Central

on:
workflow_dispatch:
inputs:
branch:
description: "The branch to use to release from."
required: true
default: "main"

jobs:
release:
name: Release to Maven Central
Expand All @@ -16,8 +13,7 @@ jobs:
uses: actions/checkout@v2
with:
fetch-depth: 0
ref: ${{ github.event.inputs.branch }}
# We need a personal access token to be able to push to a protected branch
ref: main # Hardcoded to main branch
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Prior it was possible to push to maven central from any branch which can lead to accidental pushes to maven central

token: ${{ secrets.GH_PERSONAL_ACCESS_TOKEN }}

- name: Set up JDK
Expand Down
6 changes: 6 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,12 @@ All notable changes to this project will be documented in this file.
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [3.5.7] - 2024-10-23
### Changed
- Added error handling for bad requests with incorrect sort parameters.
- Added automatic pagination handling in the `/unreferenced-paths` endpoint for improved Swagger documentation.
- Updated the Maven Central release workflow to run exclusively from the main branch.

## [3.5.6] - 2024-06-14
### Fixed
- Added aws-sts-jdk dependency in `beekeeper-metadata-cleanup`, `beekeeper-path-cleanup`, `beekeeper-scheduler-apiary` to solve IRSA unable to assume role issue.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,8 @@
@ComponentScan(basePackages = {
"com.expediagroup.beekeeper.api.conf",
"com.expediagroup.beekeeper.api.controller",
"com.expediagroup.beekeeper.api.service" })
"com.expediagroup.beekeeper.api.service",
"com.expediagroup.beekeeper.api.error" })
public class BeekeeperApiApplication {
public static void main(String[] args) {
new SpringApplicationBuilder(BeekeeperApiApplication.class)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -106,7 +106,7 @@ public ResponseEntity<Page<HousekeepingPathResponse>> getAllPaths(
@Spec(path = "cleanupTimestamp", params = "deleted_after", spec = GreaterThan.class),
@Spec(path = "creationTimestamp", params = "registered_before", spec = LessThan.class),
@Spec(path = "creationTimestamp", params = "registered_after", spec = GreaterThan.class) }) Specification<HousekeepingPath> spec,
Pageable pageable) {
@ParameterObject Pageable pageable) {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added @ParameterObject to the Pageable parameter, this allows Swagger to automatically generate and display pagination parameters (page, size, sort) for /unreferenced-paths. This will make it consistent with /metadata and reduces manual parameter definitions.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

isn't this for requests params e.g. url/bla?myRequestParam=foo
I thought the Pageable is part of the request body in this API?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Pageable parameter is populated from url query params. The GET request won't have a request body but the json format in swagger is misleading . .

The @ParameterObject will ensure swagger generates better documentation for the query params, we now have separate fields for Page, Size & Sort. It also resolves the Sort filter issue by making it clearer and ensuring it's optional by default, which wasn’t the case in the JSON format.

We already have this in the /metadata endpoint so not sure why it wasn't done for this one, you can see how the layout differs between endpoints in swagger.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cool thanks for explaning!

return ResponseEntity.ok(housekeepingEntityService.getAllPaths(spec, pageable));
}

Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
/**
* Copyright (C) 2019-2024 Expedia, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/

package com.expediagroup.beekeeper.api.error;

import javax.servlet.http.HttpServletRequest;

import org.springframework.data.mapping.PropertyReferenceException;
import org.springframework.http.HttpStatus;
import org.springframework.http.ResponseEntity;
import org.springframework.web.bind.annotation.ExceptionHandler;
import org.springframework.web.bind.annotation.RestControllerAdvice;

import java.time.LocalDateTime;

@RestControllerAdvice
public class BeekeeperExceptionHandler {

/**
* Handles invalid sort parameters.
*
* @param ex the exception thrown when an invalid property is referenced
* @param request the HTTP request
* @return a ResponseEntity containing the error response
*/

@ExceptionHandler(PropertyReferenceException.class)
public ResponseEntity<ErrorResponse> handlePropertyReferenceException(
PropertyReferenceException ex, HttpServletRequest request) {

ErrorResponse errorResponse = new ErrorResponse();
errorResponse.setTimestamp(LocalDateTime.now().toString());
errorResponse.setStatus(HttpStatus.BAD_REQUEST.value());
errorResponse.setError(HttpStatus.BAD_REQUEST.getReasonPhrase());
errorResponse.setMessage("Invalid sort parameter: " + ex.getMessage());
errorResponse.setPath(request.getRequestURI());

return new ResponseEntity<>(errorResponse, HttpStatus.BAD_REQUEST);
}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Handles PropertyReferenceException (e.g., invalid sort parameters) globally and returns a custom BAD_REQUEST error response with details.


}
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
/**
* Copyright (C) 2019-2024 Expedia, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/

package com.expediagroup.beekeeper.api.error;

import lombok.Getter;
import lombok.Setter;

@Setter
@Getter
public class ErrorResponse {
private String timestamp;
private int status;
private String error;
private String message;
private String path;
}
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,7 @@
import org.springframework.boot.SpringApplication;
import org.springframework.context.ConfigurableApplicationContext;
import org.springframework.data.domain.Page;
import org.springframework.http.HttpStatus;
import org.springframework.util.SocketUtils;

import com.fasterxml.jackson.core.type.TypeReference;
Expand All @@ -51,6 +52,7 @@
import com.fasterxml.jackson.module.paramnames.ParameterNamesModule;

import com.expediagroup.beekeeper.api.BeekeeperApiApplication;
import com.expediagroup.beekeeper.api.error.ErrorResponse;
import com.expediagroup.beekeeper.api.response.HousekeepingMetadataResponse;
import com.expediagroup.beekeeper.api.response.HousekeepingPathResponse;
import com.expediagroup.beekeeper.core.model.HousekeepingMetadata;
Expand Down Expand Up @@ -111,7 +113,7 @@ public final void afterEach() {

@Test
public void testGetMetadataWhenTableNotFoundReturnsEmptyList()
throws SQLException, InterruptedException, IOException {
throws SQLException, InterruptedException, IOException {

for (HousekeepingMetadata testMetadata : Arrays.asList(testMetadataB, testMetadataC)) {
insertExpiredMetadata(testMetadata);
Expand Down Expand Up @@ -302,4 +304,23 @@ private HousekeepingPath createHousekeepingPath(
.build();
}

}
@Test
public void testInvalidSortParameter() throws SQLException, IOException, InterruptedException {
insertExpiredMetadata(testMetadataA);

String filters = "?sort=nonExistentProperty,asc";
HttpResponse<String> response = testClient.getMetadata(someDatabase, someTable, filters);

assertThat(response.statusCode()).isEqualTo(HttpStatus.BAD_REQUEST.value());

String body = response.body();
ErrorResponse errorResponse = mapper.readValue(body, ErrorResponse.class);

assertThat(errorResponse.getStatus()).isEqualTo(HttpStatus.BAD_REQUEST.value());
assertThat(errorResponse.getMessage()).contains("Invalid sort parameter");
assertThat(errorResponse.getError()).isEqualTo("Bad Request");
assertThat(errorResponse.getPath()).contains("/api/v1/database/some_database/table/some_table/metadata");
assertThat(errorResponse.getTimestamp()).isNotNull();
}

}
Loading