Conflict when switching ALB from HTTP to HTTPS

[chrisshiplet]

│ Error: error creating ELBv2 Listener: DuplicateListener: A listener already exists on this port for this load balancer 
│       status code: 400, request id:
│ 
│   with module.load_balancer.aws_lb_listener.https_redirect[0],
│   on .terraform/modules/load_balancer/main.tf line 39, in resource "aws_lb_listener" "https_redirect":
│   39: resource "aws_lb_listener" "https_redirect" {
│ 

When I add a certificate_arn to an ALB that didn't have one before, I get this error because it tries to create the new listener before removing the old one