Search
English

Posts from qlabs.sh

  1. How to Pretrain Transformers Without Backpropagation Using Token-wise Activation Noise(qlabs.sh)

    SummaryDust is a new algorithm that applies random perturbations to the neural activation values of each token and estimates gradients by measuring and averaging how much these perturbations reduce loss on…

    startupxo SummaryDiscuss

Keyboard shortcuts

Choose a post with J and K or the arrow keys, then press Enter.

K ↑ / J ↓
Previous post / next post
Enter C
Open summary and comments for the selected post
O
Open the original link of the selected post
/
Search
?
Show this help
Tab
Move to the submit or comment button, then press Enter

Type normally in text fields. Tab and Enter are always available.