Commit Graph

6 Commits

Author SHA1 Message Date
rockerBOO
c2f75f43a4 Do not convert to float 2025-04-15 04:41:59 -04:00
rockerBOO
4d005cdf3d Remove old code 2025-04-14 15:52:25 -04:00
rockerBOO
9bc392001c Simplify AID implementation. AID(B*A) instead of AID(B)*A. 2025-04-14 15:50:54 -04:00
rockerBOO
584ea4ee34 Improve performance. Add curve for AID probabilities 2025-04-14 01:56:37 -04:00
rockerBOO
61af45ef3c Add AID_GELU. Add dropout curve for AID 2025-04-13 21:30:35 -04:00
rockerBOO
dfae3a486c Add AID activation interval-wise dropout 2025-04-13 13:57:52 -04:00