cavis/libnd4j/include/ops/declarable/helpers
Oleh 69c92ca5ae
Learning updaters for gradient (#335)
* libnd4j raw implementation of sgd upader

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections and simple test added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections after discussion

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j integrate applyScalar

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j raw implementation of rmsPropUpdater on cpu

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fix operations declaration

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j rmsPropUpdater added, test cases for sgd, etc

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed several typos

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some fixes and improvements for rmsPropUpdater based on Java tests

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed cuda implementation, update tests and corrected behavior according java tests

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j adaGrad updater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j one minor fix for ada grad

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several more fixes for ada_grad

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j nesterovs updater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed nesterovs updater behavior, several typos and rename file

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j one minor typo

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j ada max updater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed several typos in adaMax updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed several typos in adaMaxUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several fixes for adaMax, added Adam Updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j adaDeltaUpdater added, minor fixes for adamUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several fixes for adaDeltaUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j nadamUpdater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j one more correction for nadam updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several fixes for nadam updater and added amsGradUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several typos fixed in amsGradUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections and added f order support rmsProp updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j added support of f order for all updaters and modify tests for testing in place

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed issues for updates when not in place mode used, added tests for f order

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j added input shape checks

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections for different cases handling

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some code clean up and optimize per request

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j updaters refactoring after review

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* SgdUpdater wrapper

Signed-off-by: raver119 <raver119@gmail.com>

* first test

Signed-off-by: raver119 <raver119@gmail.com>

* RmsPropUpdater added

Signed-off-by: raver119 <raver119@gmail.com>

* NadamUpdater + NesterovsUpdater

Signed-off-by: raver119 <raver119@gmail.com>

* AmsGradUpdater

Signed-off-by: raver119 <raver119@gmail.com>

* AdamUpdater added

Signed-off-by: raver119 <raver119@gmail.com>

* AdaGradUpdater + AdaDeltaUpdater + AdaMaxUpdater

Signed-off-by: raver119 <raver119@gmail.com>

* AdaGradUpdater test added

Signed-off-by: raver119 <raver119@gmail.com>

* libnd4j remove input parameters parsing through NDArray, split implementation of helpers to separate files, added some rename, etc

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j next step to split operations implementation into separate files

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j merge master and minor corrections

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j revert some changes of split implementation

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j forgot to add header file

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* public default constructors

Signed-off-by: raver119 <raver119@gmail.com>

* ImportClassMapping updated

Signed-off-by: raver119 <raver119@gmail.com>

Co-authored-by: raver119 <raver119@gmail.com>
2020-03-23 07:28:31 +03:00
..
cpu Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
cuda Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
impl [WIP] Shyrma coords (#305) 2020-03-11 16:21:59 +03:00
BarnesHutTsne.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
activations.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
addBias.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
adjust_hue.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
adjust_saturation.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
axis.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
batched_gemm.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
batchnorm.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
betaInc.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
choose.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
col2im.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
compare_elem.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
confusion.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
convolutions.h Shyrma weights format (#329) 2020-03-20 12:11:27 +03:00
crop_and_resize.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
cross.h Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
d_t_s.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
diag.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
dilation2d.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
dropout.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
dynamic.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
extract_patches.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
fake_quantization.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
flatten.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
gammaMathFunc.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
gather.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
gradient.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
gru.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
hamming.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
hashcode.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
helpers.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
histogram.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
histogramFixedWidth.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
im2col.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
image_draw_bounding_boxes.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
image_resize.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
image_suppression.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
imagesHelpers.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
ismax.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
knn.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
legacy_helpers.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lgamma.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
listdiff.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lrn.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lstm.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lstmBlock.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lstmLayer.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lstsq.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lup.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
matmul.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
matrixSetDiag.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
matrix_band.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
matrix_diag_part.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
max_pooling.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
meshgrid.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
minimax.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
multiUnique.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
nth_element.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
one_hot.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
percentile.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
prefix.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
print_variable.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
qr.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
random.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
random_crop.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
range.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
reverse.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
rnn.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
roll.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
s_t_b.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
s_t_d.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
scatter.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
segment.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
segment_common.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
sequence_mask.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
sg_cb.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
shift.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
solve.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
sparse_to_dense.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
sru.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
stack.h profiling of stack and unstack ops (#261) 2020-03-03 07:32:37 +03:00
svd.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
toggle_bits.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
top_k.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
transforms.h profiling of stack and unstack ops (#261) 2020-03-03 07:32:37 +03:00
triangular_solve.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
unique.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
updatersHelpers.h Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
weights.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
where.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
zeta.h libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00