Nerd Stuff: Remarkably Stable Performance with High Learning Rates with Custom Activation Function

Nerd Stuff: Remarkably Stable Performance with High Learning Rates with Custom Activation Function

+2

Submitted by dwalters on Aug. 24, 2025, 8:43 p.m. to 🤖 | 122 views

Nerd Stuff: Remarkably Stable Performance with High Learning Rates with Custom Activation Function uploaded image

In the The Macroeconomics of Individual Action, a book I wrote in 2013, I introduced a function to model human economic decision-making. I have implemented that function experimentally and am currently exploring training criteria against the MNIST handwritten digit data with excellent results. See Claude's output above.

If you want to see this research continue, donations are welcome. Click the heart button on the navigation menu. Godspeed.

Comments

NOTICE: Content on Silverpaul.com represents the opinions of the authors and does not necessarily reflect the opinions of Silverpaul LLC personnel. Thank you for your kindness. Silverpaul.com uses affiliate links to help keep the lights on.