cavis/libnd4j/include/ops/declarable
Oleh 69c92ca5ae
Learning updaters for gradient (#335)
* libnd4j raw implementation of sgd upader

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections and simple test added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections after discussion

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j integrate applyScalar

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j raw implementation of rmsPropUpdater on cpu

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fix operations declaration

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j rmsPropUpdater added, test cases for sgd, etc

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed several typos

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some fixes and improvements for rmsPropUpdater based on Java tests

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed cuda implementation, update tests and corrected behavior according java tests

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j adaGrad updater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j one minor fix for ada grad

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several more fixes for ada_grad

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j nesterovs updater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed nesterovs updater behavior, several typos and rename file

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j one minor typo

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j ada max updater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed several typos in adaMax updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed several typos in adaMaxUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several fixes for adaMax, added Adam Updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j adaDeltaUpdater added, minor fixes for adamUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several fixes for adaDeltaUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j nadamUpdater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j one more correction for nadam updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several fixes for nadam updater and added amsGradUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several typos fixed in amsGradUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections and added f order support rmsProp updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j added support of f order for all updaters and modify tests for testing in place

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed issues for updates when not in place mode used, added tests for f order

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j added input shape checks

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections for different cases handling

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some code clean up and optimize per request

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j updaters refactoring after review

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* SgdUpdater wrapper

Signed-off-by: raver119 <raver119@gmail.com>

* first test

Signed-off-by: raver119 <raver119@gmail.com>

* RmsPropUpdater added

Signed-off-by: raver119 <raver119@gmail.com>

* NadamUpdater + NesterovsUpdater

Signed-off-by: raver119 <raver119@gmail.com>

* AmsGradUpdater

Signed-off-by: raver119 <raver119@gmail.com>

* AdamUpdater added

Signed-off-by: raver119 <raver119@gmail.com>

* AdaGradUpdater + AdaDeltaUpdater + AdaMaxUpdater

Signed-off-by: raver119 <raver119@gmail.com>

* AdaGradUpdater test added

Signed-off-by: raver119 <raver119@gmail.com>

* libnd4j remove input parameters parsing through NDArray, split implementation of helpers to separate files, added some rename, etc

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j next step to split operations implementation into separate files

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j merge master and minor corrections

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j revert some changes of split implementation

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j forgot to add header file

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* public default constructors

Signed-off-by: raver119 <raver119@gmail.com>

* ImportClassMapping updated

Signed-off-by: raver119 <raver119@gmail.com>

Co-authored-by: raver119 <raver119@gmail.com>
2020-03-23 07:28:31 +03:00
..
generic Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
headers Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
helpers Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
impl Nullify (#304) 2020-03-20 08:49:28 +03:00
platform Shyrma weights format (#329) 2020-03-20 12:11:27 +03:00
BooleanOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
BroadcastableOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
CustomOperations.h Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
DeclarableCustomOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
DeclarableListOp.h Improve ResultSet usage in libnd4j (#281) 2020-03-10 07:42:50 +03:00
DeclarableOp.h Nullify (#304) 2020-03-20 08:49:28 +03:00
DeclarableReductionOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
EmptyHandling.h Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
LegacyBroadcastBoolOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyBroadcastOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyIndexReduceOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyPairwiseTransformBoolOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyPairwiseTransformOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyRandomOp.h benchmarks fixes (#321) 2020-03-16 10:31:06 +03:00
LegacyReduce3Op.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyReduceBoolOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyReduceFloatOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyReduceLongOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyReduceOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyReduceSameOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyScalarBoolOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyScalarOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyStatsOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyTransformAnyOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyTransformBoolOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyTransformFloatOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyTransformOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyTransformSameOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LegacyTransformStrictOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
LogicOp.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
OpDescriptor.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
OpRegistrator.h Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
OpTuple.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
PlatformHelper.h Nullify (#304) 2020-03-20 08:49:28 +03:00