cavis/libnd4j/include/ops/declarable/helpers/cpu
Oleh 69c92ca5ae
Learning updaters for gradient (#335)
* libnd4j raw implementation of sgd upader

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections and simple test added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections after discussion

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j integrate applyScalar

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j raw implementation of rmsPropUpdater on cpu

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fix operations declaration

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j rmsPropUpdater added, test cases for sgd, etc

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed several typos

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some fixes and improvements for rmsPropUpdater based on Java tests

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed cuda implementation, update tests and corrected behavior according java tests

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j adaGrad updater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j one minor fix for ada grad

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several more fixes for ada_grad

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j nesterovs updater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed nesterovs updater behavior, several typos and rename file

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j one minor typo

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j ada max updater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed several typos in adaMax updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed several typos in adaMaxUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several fixes for adaMax, added Adam Updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j adaDeltaUpdater added, minor fixes for adamUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several fixes for adaDeltaUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j nadamUpdater added

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j one more correction for nadam updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several fixes for nadam updater and added amsGradUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j several typos fixed in amsGradUpdater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections and added f order support rmsProp updater

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j added support of f order for all updaters and modify tests for testing in place

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j fixed issues for updates when not in place mode used, added tests for f order

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j added input shape checks

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some corrections for different cases handling

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j some code clean up and optimize per request

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j updaters refactoring after review

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* SgdUpdater wrapper

Signed-off-by: raver119 <raver119@gmail.com>

* first test

Signed-off-by: raver119 <raver119@gmail.com>

* RmsPropUpdater added

Signed-off-by: raver119 <raver119@gmail.com>

* NadamUpdater + NesterovsUpdater

Signed-off-by: raver119 <raver119@gmail.com>

* AmsGradUpdater

Signed-off-by: raver119 <raver119@gmail.com>

* AdamUpdater added

Signed-off-by: raver119 <raver119@gmail.com>

* AdaGradUpdater + AdaDeltaUpdater + AdaMaxUpdater

Signed-off-by: raver119 <raver119@gmail.com>

* AdaGradUpdater test added

Signed-off-by: raver119 <raver119@gmail.com>

* libnd4j remove input parameters parsing through NDArray, split implementation of helpers to separate files, added some rename, etc

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j next step to split operations implementation into separate files

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j merge master and minor corrections

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j revert some changes of split implementation

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* libnd4j forgot to add header file

Signed-off-by: Oleg <oleg.semeniv@gmail.com>

* public default constructors

Signed-off-by: raver119 <raver119@gmail.com>

* ImportClassMapping updated

Signed-off-by: raver119 <raver119@gmail.com>

Co-authored-by: raver119 <raver119@gmail.com>
2020-03-23 07:28:31 +03:00
..
compilation_units libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
BarnesHutTsne.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
README.md Merge master to upstream (#7945) 2019-06-27 18:37:04 +03:00
activations.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
addBias.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
adjust_hue.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
adjust_saturation.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
axis.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
batched_gemm.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
batchnorm.cpp [WIP] Shyrma coords (#305) 2020-03-11 16:21:59 +03:00
betaInc.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
col2im.cpp Nullify (#304) 2020-03-20 08:49:28 +03:00
compare_elem.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
concat.cpp profiling of stack and unstack ops (#261) 2020-03-03 07:32:37 +03:00
confusion.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
convolutions.cpp Shyrma weights format (#329) 2020-03-20 12:11:27 +03:00
crop_and_resize.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
crop_and_resize.hpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
cross.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
d_t_s.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
diGamma.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
diag.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
dilation2d.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
dropout.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
dynamic.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
extract_patches.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
fake_quantization.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
flatten.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
gather.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
gradient.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
gru.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
hamming.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
hashcode.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
histogram.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
histogramFixedWidth.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
im2col.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
image_draw_bounding_boxes.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
image_resize.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
image_suppression.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
imagesHelpers.cpp [WIP] Shyrma coords (#305) 2020-03-11 16:21:59 +03:00
ismax.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
legacy_helper.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lgamma.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lrn.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
lstm.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
lstsq.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
lup.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
matrixSetDiag.cpp [WIP] Shyrma coords (#305) 2020-03-11 16:21:59 +03:00
matrix_band.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
matrix_diag_part.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
max_pooling.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
meshgrid.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
minimax.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
nth_element.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
one_hot.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
percentile.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
polyGamma.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
prefix.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
print_variable.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
qr.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
random.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
random_crop.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
range.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
reverse.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
roll.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
s_t_b.cpp [WIP] Shyrma coords (#305) 2020-03-11 16:21:59 +03:00
s_t_d.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
scatter.cpp [WIP] Shyrma coords (#305) 2020-03-11 16:21:59 +03:00
segment.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
sequence_mask.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
sg_cb.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
shift.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
softmax.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
solve.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
split.cpp [WIP] Shyrma coords (#305) 2020-03-11 16:21:59 +03:00
sru.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
stack.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
svd.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
toggle_bits.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
top_k.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
transforms.cpp [WIP] Shyrma coords (#305) 2020-03-11 16:21:59 +03:00
triangular_solve.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00
updaterAdaDelta.cpp Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
updaterAdaGrad.cpp Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
updaterAdaMax.cpp Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
updaterAdam.cpp Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
updaterAmsGrad.cpp Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
updaterNadam.cpp Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
updaterNesterovs.cpp Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
updaterRmsProp.cpp Learning updaters for gradient (#335) 2020-03-23 07:28:31 +03:00
weights.cpp libnd4j polishing (#273) 2020-03-02 12:49:41 +03:00
zeta.cpp Revert "OpenMP Threads execution (#297)" (#299) 2020-03-09 08:22:49 +03:00

README.md

This folder contains OpenMP implementations for operations helpers. Basically suited for homogenous x86-like platforms.