Slot: learning_rate_warmup

Linear warmup of learning rate from 0 to learning_rate over n_iterations. eta_effective = eta * (i+1) / n_iterations

URI: tvbo:slot/learning_rate_warmup Alias: learning_rate_warmup

Applicable Classes

Name Description Modifies Slot
Algorithm A complete specification of an iterative parameter tuning algorithm no

Properties

Identifier and Mapping Information

Schema Source

  • from schema: https://w3id.org/tvbo

Mappings

Mapping Type Mapped Value
self tvbo:learning_rate_warmup
native tvbo:learning_rate_warmup

LinkML Source

name: learning_rate_warmup
description: Linear warmup of learning rate from 0 to learning_rate over n_iterations.
  eta_effective = eta * (i+1) / n_iterations
from_schema: https://w3id.org/tvbo
rank: 1000
ifabsent: boolean(false)
alias: learning_rate_warmup
owner: Algorithm
domain_of:
- Algorithm
range: boolean