StartupXO
Search
English
Submit

Posts from qlabs.sh

  1. Find XO: How to Pretrain Transformers Without Backpropagation Using Token-wise Activation Noise (qlabs.sh)

    SummaryDust is a new algorithm that applies random perturbations to each token's neural activation values and estimates gradients by measuring and averaging how much these perturbations reduce the loss for…

    No votes yet startupxo Summary 1 comment

Keyboard shortcuts

Choose a post with the up and down arrows, then press Enter.

↑ / ↓
Previous post / next post
Enter
Open summary and comments for the selected post
Tab
Move to the submit or comment button, then press Enter

Type normally in text fields. Tab and Enter are always available.