Code

Add media download service (part 1)#104

Code

Merged

philmcmahon merged 14 commits intomainguardian/transcription-service:mainfrom pm-add-local-media-downloadguardian/transcription-service:pm-add-local-media-downloadCopy head branch name to clipboardOct 9, 2024

+3,542-11,592

Commits

Commits on Oct 9, 2024

• Introduce media download service (and associated types) - which fetched a job from sqs, uses yt-dlp to download and uploads the result to s3

  philmcmahon

  committed
  34117b9

  Copy full SHA for 34117b9

• Add new sqs queue for media download service

  philmcmahon

  committed
  a524c85

  Copy full SHA for a524c85

• Add media download api endpoint

  philmcmahon

  committed
  53c0794

  Copy full SHA for 53c0794

• Simplify transcript sqs logic for translations

  philmcmahon

  committed
  c20592b

  Copy full SHA for c20592b

• After uploading the file to s3, send an SQS message requesting a transcription

  philmcmahon

  committed
  1331600

  Copy full SHA for 1331600

• media-download not media-downloader

  philmcmahon

  committed
  c663acf

  Copy full SHA for c663acf

• Use a separate dead letter queue for the media download queue

  philmcmahon

  committed
  99fc2db

  Copy full SHA for 99fc2db

• Remove phantomjs/ffmpeg dependencies

  philmcmahon

  committed
  3d39603

  Copy full SHA for 3d39603

• Log an error when failing to send sqs message.

  philmcmahon

  committed
  1a8ecf4

  Copy full SHA for 1a8ecf4

• Use runSpawnCommand rather than zx for media download service

  philmcmahon

  committed
  322acaf

  Copy full SHA for 322acaf

• Bump gu cdk and aws cdk versions

  philmcmahon

  committed
  86ac652

  Copy full SHA for 86ac652

• Only hide stdout sometimes

  philmcmahon

  committed
  ecff3ce

  Copy full SHA for ecff3ce

• Update package-lock

  philmcmahon

  committed
  a7f1e8e

  Copy full SHA for a7f1e8e

• Explicitly depend on @guardian/eslint-config

  philmcmahon

  committed
  cc1248d

  Copy full SHA for cc1248d