v0.1.1 - 2025-03-23
๐ Features
- (callbacks) Added training callbacks.
- (watch) Added method to watch trained agents (notebooks).
- (record) Added
RecordVideos
callback with minor optimizations
- (train) Enhanced agent training loop and metric storage.
- (metrics) Moved
TrainMetrics
intoTrainState
for callbacks.
- (gradients) Added method to compute gradients of NCP networks.
- (analytics) Added
CometAnalytics
callback for cloud tracking.
- (version) Made
velora
compatible with Python 3.11
.
๐ Bug Fixes
- (buffer) Reorganized buffer items to fix circular imports.
- (config) Fixed config copy bug.
- (imports) Fixed import circulation errors.
- (buffer) Fixed actions for multi-dimensional spaces.
- (ddpg) Fixed DDPG learning bug.
- (wiring) Fixed number of neuron connections bug.
- (metrics) Fixed metrics
std()
call bug when window_size=1
.
๐ Refactor
- (callbacks) Moved callbacks location for clarity.
- (save) Enhanced saved method to include
config.json
.
- (buffer) Added
warm
method to ReplayBuffer
for simplicity.
- (config) Simplified config creation in
LiquidDDPG
.
- (watch) Removed
watch_notebook
method - redundant.
- (callbacks) Simplified callback handling in
train
method.
- (old) Removed old redundant code.
- (config) Simplified agent
config
creation.
- (callback) Refactored
SaveCheckpoints
to simplify init.
- (metrics) Simplified and enhanced metric implementation.
- (metrics) Added attributes for stored metrics.
- (callbacks) Modified
RecordVideo
env wrapper logic.
- (metrics) Minor updates + custom gradient removal.
- (callbacks) Simplified
RecordVideos
callback parameters.
- (metrics) Updated metric tracking to use SQLite database.
- (record) Added
root_path
to record_last_episode
method.
- (checkpoints) Updated checkpoint target condition to simplify.
- (lnn) Updated LNN architecture for accuracy.
- (lnn) QoL additions and improvements.
- (ncp) Simplified and improved architecture.
- (tweaks) Minor changes to DDPG and buffer methods.
- (ncp) Added
NCPModule
base class to simplify Actor-Critics.
- (train) Improved console training output.
- (sparse) Removed
SparseParameter
(deprecated).
- (output) Added running step count to training output.
- (save) Updated saving and loading to
safetensors
.
๐ Documentation
- (callbacks) Added and updated documentation for better flow.
- (config) Added
config
API reference and updated save
docs.
- (install) Updated install docs for GPU and CPU versions.
- (callbacks) Added docs for
RecordVideos
& updated existing ones.
- (metrics) Added docs for training metrics.
- (roadmap) Added content to roadmap.
- (additions) Updated and added docs for Comet & new metric system.
- (docstrings) Updated codebase docstrings for clarity.
- (lnn) Updated customization docs for clarity.
- (updates) Updated
Buffer
and Metrics
docs with new changes.
- (save): Added API references for saving and loading models.
- (buffer) Reduced total training time by 63%.
- (metrics) Reduced total training time by a further 40%.
- (ncp) Reduced training time with NCP compiling.
- (compile) Simplified compilation to agent level.
๐จ Styling
- (output) Updated format for training output.
- (train) Improved training output details.
๐งช Testing
- (buffer) Fixed failed tests.
- (callbacks) Added unit tests for new feature coverage.
- (save) Added and fixed broken tests for saving and loading.
- (cov) Added tests for coverage.
- (fix) Updated test container packages & removed redundant tests.
- (fix) Fixed broken tests for new training logic.
- (fix) Fixed broken test cases for
TrainState.metrics
refactor.
- (fix) Added tests and fixed broken ones.
- (fix) Fixed broken DDPG test.
- (fix) Fixed unit tests.
- (stopping) Fixed
EarlyStopping
tests.
- (fix) Fixed broken tests with recent code changes.
- (all) Updated and added tests cases for coverage.
- (fix) Removed pre-release code to fix test cases.
- (fix) Updated tests to accommodate recent changes.
โ๏ธ Miscellaneous Tasks
- (build) Added
matplotlib
package as main dependency.
- (build) Removed redundant packages and updated existing ones.
- (packages) Refactored packages to fix
torch
install bug.
- (torch) Moved
torch
dependencies to group.