Skip to content

Latest commit

 

History

History
1024 lines (547 loc) · 27.9 KB

CHANGELOG.md

File metadata and controls

1024 lines (547 loc) · 27.9 KB

CHANGELOG

v1.41.7 (2025-01-28)

Bug Fixes

  • Bump pandas to 2.2.2 to fix broken pytest (32dc477)

Build System

  • Added missing pandas requirement (2105643)

  • Renamed package to mbari-aidata (218fe75)

v1.41.6 (2025-01-28)

Bug Fixes

  • Removed unnecessary release step and minor changes to README.md to reflect correct package name (11f6558)

v1.41.5 (2025-01-28)

Bug Fixes

  • Added missing upload to semantic release and poetry build command (e258cd3)

v1.41.4 (2025-01-28)

Bug Fixes

  • Triggering release to test pypi (329bc28)

Build System

  • Clear names for dependency install and do release upload (fa2b024)

  • Replace pytest with poetry enabled (9c45a21)

  • Switching to poetry build (419ca7d)

v1.41.3 (2025-01-25)

Bug Fixes

  • Correct concurrent task array init (163eb25)

v1.41.2 (2025-01-24)

Performance Improvements

v1.41.1 (2025-01-24)

Bug Fixes

  • Correct option named not-verified to unverified (e97c2e2)

v1.41.0 (2025-01-23)

Features

  • Added flag to download all unverified data, e.g. --unverified python aidata download dataset --voc --token --config /tmp/uav/config.yml --base-path /mnt/ML_SCRATCH/uav --min-score 0.5 --crop-roi --resize 224 --labels "all" --unverified (4dfa7da)

v1.40.1 (2025-01-22)

Bug Fixes

  • Handle missing score and cluster attributes when combining versions (604c911)

v1.40.0 (2025-01-22)

Features

  • Download all versions by default and combine via NMS; this is potentially a breaking change for downstream that relies on the Baseline naming convention. Remove Baseline from the root directory name on datasets (7c8c1dd)

v1.39.0 (2025-01-16)

Features

  • Add database id and box coordinates to the localizations.csv output (9d948db)

v1.38.0 (2025-01-14)

Features

  • Handle missing secondary labels/scores during download (e1cec96)

v1.37.0 (2025-01-14)

Documentation

  • Added descriptions for just recipes (b187851)

Features

  • Added export of csv with media,cluster,label,score,label_s,score_s for downstream analysis (f2fe1fe)

v1.36.2 (2025-01-10)

Bug Fixes

  • Larger batch size for ffmpeg roi crop (c3325b8)

v1.36.1 (2025-01-10)

Bug Fixes

  • Correct depth query (85c125c)

  • Handle crops from images with whitespaces (57d1abf)

v1.36.0 (2025-01-06)

Bug Fixes

  • Correct related attribute query (cef33e8)

Documentation

  • Minor reorg and update docker info (c3915e4)

Features

  • Added support for minimum score in load boxes command and truncate exactly min boxes (3ed40b8)

v1.35.7 (2025-01-01)

Bug Fixes

  • Remove any unused media attributes (0dee5d6)

v1.35.6 (2024-12-31)

Bug Fixes

  • Add missing arg for ffmpeg image crop that was munged during refactor (7e9cb34)

  • Rename plugins that load media; image_path should be media_path to support both image/video loads (1d547e8)

v1.35.5 (2024-12-27)

Performance Improvements

  • 2x speed-up for ROI crop (6d405c7)

v1.35.4 (2024-12-21)

Bug Fixes

  • Correct query format for video name (d60ed95)

  • Handle white space in video path (723651a)

v1.35.3 (2024-12-21)

v1.35.2 (2024-12-21)

Bug Fixes

  • Minor fix to assign mime first choice (593f339)

  • Minor fix to report correct name when video already loaded (fbab8ee)

  • cfe: Index video correctly for cfe isiis (fae5709)

v1.35.1 (2024-12-21)

Bug Fixes

  • Correct indexing for cfe media load (4a821af)

Build System

  • Add moviepy==2.1.1 to support video metadata extraction (e2382f8)

Documentation

  • Minor update in load help for clarity (0691b85)

v1.35.0 (2024-12-20)

Documentation

Features

v1.34.2 (2024-12-19)

v1.34.1 (2024-12-19)

Bug Fixes

Performance Improvements

  • Reduce delay for redis load and more robust handling of different label payload (4abd444)

v1.34.0 (2024-12-12)

Features

  • Handle 2015-03-07T20:53:01.065Z media timestamp and different cases of label in redis load (e46a739)

v1.33.0 (2024-12-06)

Features

  • Separate crops by label and output stats.json to compatible format as voc-cropper (0c95b7e)

v1.32.0 (2024-12-03)

Features

  • Added support to download ROIs in optimized formats for training from either video or images with python aidata download dataset --crop-roi --resize 224 etc. (a60c466)

v1.31.1 (2024-11-21)

Bug Fixes

  • For coco/voc only download images and no video (2beb2e6)

v1.31.0 (2024-11-17)

Features

  • Remove any duplicate localizations on redis load (d6cd406)

v1.30.3 (2024-11-08)

Bug Fixes

  • Correct handling of related attribute depth (190b3dc)

v1.30.2 (2024-10-29)

Bug Fixes

  • Correct handling of related media attributes, e.g. --depth 1000 or --section 1000m during download (ff12787)

v1.30.1 (2024-10-28)

Bug Fixes

  • Correct handling of related media attributes, e.g. --depth 1000 or --section 1000m during download (27d0ace)

v1.30.0 (2024-10-25)

Features

  • Exclude more than one label, e.g. --exclude Unknown --exclude Batray in load boxes (6f1fb51)

v1.29.1 (2024-10-21)

v1.29.0 (2024-10-21)

Bug Fixes

Features

  • cfe: Support loading individual cfe images (d0fea5d)

v1.28.0 (2024-10-18)

Features

  • Support any named exemplar (f097d7a)

v1.27.0 (2024-10-16)

Features

  • Added --max-saliency option to download (592439f)

v1.26.2 (2024-10-12)

Bug Fixes

  • Handle missing float/int attributes (8c68ef9)

v1.26.1 (2024-10-09)

Bug Fixes

  • Correctly load single voc/sdcat file (4e10f4b)

v1.26.0 (2024-10-09)

Documentation

  • Minor update to command help to include voc (a61d50d)

  • Minor update to command help to include voc (45177b8)

Features

  • Added support for collapsing to a single class during download with --single-class (72b2aa1)

Performance Improvements

  • Handle missing video frame rate/codec, more performant queue based loads and handle different timecode payloads (876036a)

v1.25.0 (2024-10-08)

Documentation

  • Added update to README.md (7330522)

Features

  • Added support to load from voc (3b653ec)

v1.24.0 (2024-10-07)

Documentation

Features

  • Support exclusion of single label, e.g. Unknown with load boxes (3be99be)

v1.23.2 (2024-10-04)

Bug Fixes

  • Support redis port/host/password (3a25060)

v1.23.1 (2024-10-01)

Bug Fixes

  • uav: Correct media date (76bf902)

v1.23.0 (2024-09-29)

Features

  • Add support for --min-score in download dataset (915aa1f)

v1.22.0 (2024-09-22)

Bug Fixes

  • Albumentations dependency break (b483324)

Features

  • Add support for --min-saliency in download dataset (014f5af)

v1.21.1 (2024-09-20)

Performance Improvements

  • Slimmer memory footprint for downloads. working for 360k download and export for CFE ROIs (4f035ac)

v1.21.0 (2024-09-19)

Features

  • Added support for --section in download (a89e695)

v1.20.0 (2024-09-19)

Documentation

  • Add missing images (4a2171e)

  • Correct link to docs (2c7a544)

  • Just some refactoring of setup docs (6531f40)

Features

Adds the option --resize to the transform to transform with a resize. Useful for training models with scales of the same image. For tiny boxes that may result in downsizing, the option --min-dim supports removal at them; this defaults to 10 pixels in any dimension

v1.19.0 (2024-09-16)

Features

  • feat: added test and config for loading planktivore

  • docs: more detail on test/dev setup and added in redis to test

  • test: correct tests conf that aligns to doc

  • docs: correct link to database

  • chore: added in more just recipes for testing

v1.18.0 (2024-09-05)

Features

  • Add support to different models (13fb78e)

v1.17.1 (2024-09-04)

Performance Improvements

  • Bump to better indexing (5405abe)

v1.17.0 (2024-09-03)

Features

  • Replace underscore with colon in redis hash store of exemplars (d7a07bc)

v1.16.0 (2024-09-01)

Features

  • Added redis document id fetch (3ab3b72)

v1.15.0 (2024-09-01)

Features

  • Replace index id with database id for exemplars (64f6dde)

v1.14.0 (2024-08-30)

Features

  • Disable flagging exexmplars (fa74c55)

v1.13.0 (2024-08-29)

Documentation

  • Updated docs and and config with better test setup (f45e94f)

  • Updated docs and and config with better test setup (7210a84)

Features

  • Added support for depth parsing (9449cde)

v1.12.2 (2024-08-26)

Bug Fixes

  • Handle empty query operators (b957f7a)

v1.12.1 (2024-08-22)

Bug Fixes

  • Trigger release to update init.py (d278ce3)

Documentation

  • Minor correction to reflect correct path to docs (13c24b5)

v1.12.0 (2024-08-16)

Bug Fixes

  • Correct handling of label map (7827810)

  • Handle conversion errors outside of normalized 0-1 coordinates (e410cd4)

Build System

  • Added missing albumentations library (623df2f)

Documentation

  • Added detail on .env file (66b83a0)

  • Correct link to internal docs (c0e4f87)

  • Moved CHANGELOG (f3df55c)

  • Removed docs which are now in another repo and added commands for ref in README.md (bdd122a)

  • Resolve conflict (783fa25)

  • Updated with correct link to docs (1577fa3)

Features

  • Addded voc_to_yolo (cb4e798)

  • Added transform for voc only (ade3713)

  • Added transform for voc only (9147c28)

v1.11.0 (2024-08-08)

Features

  • Added label counts to /labels/{project_name} (d6e5cce)

v1.10.0 (2024-08-05)

Documentation

  • Added project image (6798ca7)

  • Fixed links and added clickable link to mantis (eef0f32)

Features

  • Added verified --verified to download (bb2b274)

v1.9.0 (2024-08-05)

Features

  • Added database reset and cleane up docs (572bdd5)

v1.8.0 (2024-07-26)

Features

  • Add load to exemplar bool which is helpful for visualization (5d1feb2)

v1.7.4 (2024-07-26)

Bug Fixes

  • Correct default for max-images to load all (9f284ab)

v1.7.3 (2024-07-24)

Bug Fixes

  • Correct parsing of class names and cuda device enable (58b0dea)

v1.7.2 (2024-07-23)

Bug Fixes

  • Correct handling of exemplars (accbb9e)

Build System

  • Correct docker build path (4406a96)

  • Exclude py12 which is problematic with transformers library (2116ad3)

  • Remove legacy "ENV key value" in Dockerfile.cuda (84fa73c)

v1.7.1 (2024-07-23)

Bug Fixes

  • Correct handling of version arg (8eb99b5)

v1.7.0 (2024-07-23)

Features

  • Added password pass through to redis (900bbef)

v1.6.4 (2024-07-23)

Performance Improvements

  • Move model to gpu and some minor refactoring for clarity (a9d2f59)

v1.6.3 (2024-07-22)

Bug Fixes

  • Minor fix in exemplar args and more logging (f34e643)

v1.6.2 (2024-07-19)

Bug Fixes

  • Handled empty labels, bad media, and more reporting of progress (e31b691)

v1.6.1 (2024-07-18)

Bug Fixes

Build System

  • Removed unused imports and bump torch to python3.11 compatible and (c9afcbb)

v1.6.0 (2024-07-05)

Bug Fixes

  • Remove whitespace and move exemplar to load (a7d8607)

Features

  • Added sdcat exemplar load (46ea57e)

v1.5.0 (2024-06-25)

Documentation

Features

  • Pass through the id to the voc output (e28a211)

v1.4.7 (2024-06-24)

Bug Fixes

  • Handle fewer records correctly (a3528de)

v1.4.6 (2024-05-22)

v1.4.5 (2024-05-22)

Bug Fixes

  • Correct load_bulk_boxes args and attribute mapping for redis load (09241be)

  • Revert to original pass through of datetime object (5af3119)

Performance Improvements

  • Handle variable case attribues (2538007)

  • Remove audio and reduce frame rate to 24 for .git (604a463)

  • Remove palette gen for speed-up of video gif creation (5ce9a12)

v1.4.4 (2024-05-21)

Performance Improvements

v1.4.3 (2024-05-21)

Bug Fixes

  • Correct key for datetime attribute format (f1bcad7)

Documentation

  • Added in load/download docs and adding in CHANGELOG.md (f3ac92c)

v1.4.2 (2024-05-16)

Bug Fixes

v1.4.1 (2024-05-16)

Bug Fixes

v1.4.0 (2024-05-10)

Documentation

  • Minor fix to checkout and more explicit naming of path (7be3aa3)

  • Minor update to add token to examples (7c499a5)

Features

  • Some refactoring but mostly addition of support for versioning (cfe9ba1)

v1.3.0 (2024-05-02)

Bug Fixes

  • Adjustments to match Fernandas generated test images (1ef27b7)

Features

  • Added support to pass in max-images which is useful with --dry-run (fe8d2de)

v1.2.3 (2024-05-01)

Bug Fixes

  • Remove return to load all (460b449)

v1.2.2 (2024-04-29)

Bug Fixes

  • Skip over images with no metadata and minor logging fix (c926ca8)

v1.2.1 (2024-04-29)

Bug Fixes

  • Correct path for loading SONY images (42048fb)

  • Return dataframe and process in sorted order for convenience (52025fb)

Build System

  • Added missing dependency (3f1a267)

Documentation

  • Added hint for dry-run and hostname (f314d4e)

v1.2.0 (2024-04-29)

Bug Fixes

Features

  • Support both png and jpg SONY images (75adcca)

  • Support both png and jpg uppercase SONY images (343651b)

v1.1.0 (2024-04-29)

Features

  • Added support for extracing sony mdata for UAV (6cd2faa)

v1.0.3 (2024-03-26)

Bug Fixes

  • Correct path to data in test database (fa9f7dc)

v1.0.2 (2024-03-26)

Bug Fixes

  • Correct formatting for the cluster string (41678b3)

v1.0.1 (2024-03-25)

Bug Fixes

  • Fix bug that downloads everything (685c72a)

Documentation

v1.0.0 (2024-03-16)

Features