NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
▲Reactive Optimizers: rewrite the optimizer's source code during training (xingjianbai.com)
rurban 8 hours ago [-]
I do that constantly in a lot of apps. Mostly I write a include file of a param table and retest under new conditions. It's called calibration, just that I compile the values in, and recompile.
rao-v 2 days ago [-]
This is really interesting and fun!

Reactive optimizers could actually be helpful if you used them to dynamically tweak training data mix and use them to make choices about RL environments (if you recall from the Mimo training dashboards, it’s quite tricky to figure out how to value and chose RL traces during post training)

coef2 1 days ago [-]
It looks interesting. The same concept could be applied to different parts of the training process.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 14:47:29 GMT+0000 (UTC) with Wasmer Edge.