cavis

Commit Graph

Author	SHA1	Message	Date
raver119	ce2ef20f96	additional reverse signatures Signed-off-by: raver119 <raver119@gmail.com>	2019-11-19 13:54:07 +03:00
raver119	db7ca956c5	[WIP] Mish (#55 ) * Mish activation function and its derivative Signed-off-by: raver119 <raver119@gmail.com> * signature fix Signed-off-by: raver119 <raver119@gmail.com> * mish as activation for dl4j Signed-off-by: raver119 <raver119@gmail.com> * javadoc Signed-off-by: raver119 <raver119@gmail.com> * minor optimization Signed-off-by: raver119 <raver119@gmail.com>	2019-11-18 13:21:26 +03:00
Alex Black	09a827fb6d	Fixes and pre-release QA (#51 ) * #8395 Keras import - support scaled identity weight init Signed-off-by: AlexDBlack <blacka101@gmail.com> * More Keras scaled weight init fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8352 Deprecate duplicate SamplingDataSetIterator class Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove /O2 optimization for faster CUDA build Signed-off-by: AlexDBlack <blacka101@gmail.com> * Tweak regression test precision for CUDA Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix edge cases for buffer creation Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update MKLDNN validation tests to new helper enable/disable settings Signed-off-by: AlexDBlack <blacka101@gmail.com> * Delete debugging class Signed-off-by: AlexDBlack <blacka101@gmail.com> * MKLDNN test - add proper skip for CUDA backend Signed-off-by: AlexDBlack <blacka101@gmail.com> * Align WeightInitUtil with weight init classes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix for SameDiff test layers weight init when using IWeightInit classes Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-16 17:04:29 +11:00
raver119	1780dcc883	[WIP] Small fixes here and there (#50 ) * one range test Signed-off-by: raver119 <raver119@gmail.com> * few Context convenience singatures Signed-off-by: raver119 <raver119@gmail.com> * one more range test Signed-off-by: raver119 <raver119@gmail.com> * "range" "fix" Signed-off-by: raver119 <raver119@gmail.com> * adjuct_contrast_v2 now allows scale factor to be provided via input_variable Signed-off-by: raver119 <raver119@gmail.com> * adjust_contrast now allows scale factor as variable too Signed-off-by: raver119 <raver119@gmail.com> * bitcast shape tests Signed-off-by: raver119 <raver119@gmail.com> * BitCast import dtype added Signed-off-by: raver119 <raver119@gmail.com> * few more BitCast signatures Signed-off-by: raver119 <raver119@gmail.com>	2019-11-15 17:04:29 +03:00
raver119	1eb3de90d7	[WIP] Platform helpers switches (#44 ) * - platform helpers can be disabled on per-op basis now via Context::allowHelpers - java has access to it as well Signed-off-by: raver119 <raver119@gmail.com> * global platform-helpers trigger Signed-off-by: raver119 <raver119@gmail.com> * few signatures renamed Signed-off-by: raver119 <raver119@gmail.com> * - few new env variables to follow - maxThreads/masterThreads differentiation Signed-off-by: raver119 <raver119@gmail.com> * Javadoc update Signed-off-by: raver119 <raver119@gmail.com>	2019-11-14 14:35:02 +03:00
Alex Black	47d19908f4	Various fixes (#43 ) * #8172 Enable DL4J MKLDNN batch norm backward pass Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8382 INDArray.toString() rank 1 brackets / ambiguity fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8308 Fix handful of broken links (inc. some in errors) Signed-off-by: AlexDBlack <blacka101@gmail.com> * Unused dependencies, round 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Unused dependencies, round 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Unused dependencies, round 3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Uniform distribution TF import fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-14 19:38:20 +11:00
raver119	48df1acdfb	[WIP] ThreadPool (#8 ) This PR removes OpenMP use in 95% of cases	2019-11-13 17:04:59 +03:00
Alex Black	1d96bb9e6e	SameDiff op runtime benchmarking listener (#42 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-12 22:51:09 +11:00
Alex Black	18c01f5bdc	Add SameDiff memory reuse memory manager (array cache) (#39 ) * Attention op comments Signed-off-by: AlexDBlack <blacka101@gmail.com> * ArrayCacheMemoryMgr - first pass Signed-off-by: AlexDBlack <blacka101@gmail.com> * Tweak array cache for use with SameDiff identity arrays Signed-off-by: AlexDBlack <blacka101@gmail.com> * ArrayCacheMemoryMgr javadoc and properly get max memory Signed-off-by: AlexDBlack <blacka101@gmail.com> * LRU cache policy + add tests Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Resize arrays internally if required for ArrayCacheMemoryMgr Signed-off-by: AlexDBlack <blacka101@gmail.com> * Test improvement Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small polish Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-12 21:15:44 +11:00
Alex Black	2f84ea666d	Uniform distribution op tweaks + 'specified output dtype' constructor (#38 ) * Uniform distribution op tweaks + 'specified output dtype' constructor Signed-off-by: AlexDBlack <blacka101@gmail.com> * Validation tweak Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-08 18:08:25 +11:00
Alex Black	24980efde3	Fix LogSumExp along dimension (#35 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-07 23:36:15 +11:00
Alex Black	df8b4e607a	SameDiff: make use of DeviceLocal configurable (#32 ) * #8340 make DeviceLocal configurable Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J SameDiff layers: use SingleThreadArrayHolder to avoid assigns + DeviceLocalNDArray overhead Signed-off-by: AlexDBlack <blacka101@gmail.com> * Javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-06 18:52:41 +11:00
AlexDBlack	7583ccfa15	Merge Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-06 13:28:03 +11:00
Alex Black	948ebef41c	Op Fixes (#28 ) * #8280 biasadd_bp nchw arg fixes (java side) + test Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8285 Concat op Java side fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Concat op cpp fix - allow dynamic axis to be negative, same as static axis Signed-off-by: AlexDBlack <blacka101@gmail.com> * ignores for deconv3d import tests until deconv3d_tf op is implemented Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-05 00:05:04 +11:00
Alex Black	4763547c9e	Add Deconv3DTF (#25 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-04 12:42:11 +11:00
Alex Black	5e312374d0	TF deconv3d import (#8341 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-02 22:57:24 +11:00
Alex Black	9efd811508	Use DL4J workspaces for SameDiff layers in MLN/CG (#23 ) * #8329 DL4J workspace integration for SameDiff layers Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix bug for Nd4j.createUninitializedDetached for scalars (length 0 shape array) Signed-off-by: AlexDBlack <blacka101@gmail.com> * SameDiff output layer, graph vertex, various fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-02 17:42:01 +11:00
Alex Black	d82877b18b	Various SameDiff fixes (#21 ) * MKLDNN LSTM forward implementation (disabled pending #8331) Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8318 add SameDiff.calculateGradientsAndOutputs Signed-off-by: AlexDBlack <blacka101@gmail.com> * Disable mkldnn backprop for now - pending fix, issue #8335 Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8337 Fix CudaExecutioner unnecessary result array allocation/replacement Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small FlatBuffers serde fix, UInt8 Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8135 ImagePreProcessingScaler - add segmentation support Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8319 Ensure listeners are called when they are supposed to be called Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8214 UNet (non-pretrained) last conv layer kernal size fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-02 11:25:53 +11:00
Alexander Stoyakin	45a40c8a89	DL4J/ND4J: Do pass on integer casts (#15 ) * Int cast fixes. * Revert "Int cast fixes." This reverts commit aa36e8ca * Int casts * Int cast * Int casts * Get rid of int casts. Dropping deprecated aggregate ops. * java scatterUpdate changes Signed-off-by: raver119 <raver119@gmail.com> * c++ scatterUpdate changes Signed-off-by: raver119 <raver119@gmail.com> * Remove aggregated ops. * Restored test * Tests restored. * Minor fixes	2019-10-31 11:23:09 +02:00
raver119	5a4d2e8b31	[WIP] SVD (#16 ) * - new SVD constructor - OrthogonalDistribution now uses SVD custom op Signed-off-by: raver119 <raver119@gmail.com> * shapes fixed Signed-off-by: raver119 <raver119@gmail.com>	2019-10-28 12:31:01 +03:00
Yurii Shyrma	029a69a835	Shyrma bn mkl bp (#14 ) * - write code for new batchnorm backprop Signed-off-by: Yurii <iuriish@yahoo.com> * - testing batchnorm backprop Signed-off-by: Yurii <iuriish@yahoo.com> * - write code for batchnorm backprop based on mkl dnn api Signed-off-by: Yurii <iuriish@yahoo.com> * - testing and fixing bugs in batchnorm_bp mkl dnn Signed-off-by: Yurii <iuriish@yahoo.com> * - made corrections required by reviewer Signed-off-by: Yurii <iuriish@yahoo.com> * - change name in java wrapper for batchnorm op Signed-off-by: Yurii <iuriish@yahoo.com>	2019-10-26 14:14:21 +03:00
Alex Black	d333d29099	SameDiff cleanup and fixes (#12 ) * #8160 Remove resolvePrepertiesFromSameDiffBeforeExecution Signed-off-by: AlexDBlack <blacka101@gmail.com> * SameDiff API cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * More SameDiff cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8248 Switch SameDiff variable init from lazy to creation time for more predictable behaviour Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8252 TanhDerivative javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8225 Deconvolution2D input validation Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8265 Switch SameDiff.outputs() to user settable, instead of unreliable 'best guess' Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8224 SameDiff.zero and .one create constants, not variables Signed-off-by: AlexDBlack <blacka101@gmail.com> * More cleanup and fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J SameDiff fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Re-add hack for Deconvolution2DLayer until #8315 is resolved Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8270 Move CUDA device/version logging to Java; can be disabled via existing org.nd4j.log.initialization system property Signed-off-by: AlexDBlack <blacka101@gmail.com> * All ND4J init logging checks system property Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small tweak Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove redundant device logging Signed-off-by: AlexDBlack <blacka101@gmail.com> * One more fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * UX improvements Signed-off-by: AlexDBlack <blacka101@gmail.com> * Deconv fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add deconv tests Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove debug code Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-10-26 12:38:08 +11:00
Alex Black	730442ae21	Remove bad import (#13 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-10-24 20:51:15 +11:00
Alex Black	3f0b4a2d4c	SameDiff execution, TF and memory management overhaul (#10 ) * SameDiff execution memory management improvements, round 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Round 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Round 3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Clear node outputs closed array references; Slight change to OpValidation internals to not rely on cached op outputs Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next step Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * More polish Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add WeakIdentityHashmap Signed-off-by: AlexDBlack <blacka101@gmail.com> * Session fixes for control ops and next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * First steps for training session + in-line updating Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix losses and history during training Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * BiasAdd and other fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Don't use SDVariable.getArr() in TFGraphTestAllHelper (import tests) Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * First steps for new dependency tracking approach Signed-off-by: AlexDBlack <blacka101@gmail.com> * Start integrating dependency tracking for memory management Signed-off-by: AlexDBlack <blacka101@gmail.com> * Non-control op dependency tracking works/passes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Switch/merge Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup and next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix issue dependency tracking for initial variables/constants Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add check for aliases when determining if safe to close array Signed-off-by: AlexDBlack <blacka101@gmail.com> * First pass on new TF graph import class Signed-off-by: AlexDBlack <blacka101@gmail.com> * Import fixes, op fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup and fixes for new TF import mapper Signed-off-by: AlexDBlack <blacka101@gmail.com> * More cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Partial implementation of new dependency tracker Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * AbstractDependencyTracker for shared code Signed-off-by: AlexDBlack <blacka101@gmail.com> * Overhaul SameDiff graph execution (dependency tracking) Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes, cleanup, next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Ad no-op memory manager, cleanup, fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix switch dependency tracking Signed-off-by: AlexDBlack <blacka101@gmail.com> * INDArray.toString: no exception on closed arrays, just note closed Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix enter and exit dependency tracking Signed-off-by: AlexDBlack <blacka101@gmail.com> * TensorArray memory management fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add unique ID for INDArray instances Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix memory management for NextIteration outputs in multi-iteration loops Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove (now unnecessary) special case handling for nested enters Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Handle control dependencies during execution; javadoc for memory managers Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup, polish, code comments, javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup and more javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add memory validation for all TF import tests - ensure all arrays (except outputs) are released Signed-off-by: AlexDBlack <blacka101@gmail.com> * Clean up arrays waiting on unexecuted ops at the end of execution Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fixes for enter op memory managent in the context of multiple non-nested loops/frames Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix order of operation issues for dependency tracker Signed-off-by: AlexDBlack <blacka101@gmail.com> * Always clear op fields after execution to avoid leaks or unintended array reuse Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Re-implement dtype conversion Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix for control dependencies execution (dependency tracking) Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix TF import overrides and filtering Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix for constant enter array dependency tracking Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J Fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * More DL4J fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup and polish Signed-off-by: AlexDBlack <blacka101@gmail.com> * More polish and javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * More logging level tweaks, small DL4J fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix to DL4J SameDiffLayer Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix empty array deserialization, add extra deserialization checks Signed-off-by: AlexDBlack <blacka101@gmail.com> * FlatBuffers control dep serialization fixes; test serialization as part of all TF import tests Signed-off-by: AlexDBlack <blacka101@gmail.com> * Variable control dependencies serialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix issue with removing inputs for ops Signed-off-by: AlexDBlack <blacka101@gmail.com> * FlatBuffers NDArray deserialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * FlatBuffers NDArray deserialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Final cleanup/polish Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-10-23 21:19:50 +11:00
Alexander Stoyakin	f31661e13b	Merge pull request #7 from KonduitAI/asto_nd4s_10172019 KDTree optimization	2019-10-23 12:11:25 +03:00
Alexander Stoyakin	9e5799847a	TF names fixed.	2019-10-16 19:50:18 +03:00
Alexander Stoyakin	502bedf5d5	Register ops for TF import.	2019-10-16 19:39:04 +03:00
Alexander Stoyakin	ec722b20ee	TF names added	2019-10-16 19:29:19 +03:00
Alexander Stoyakin	99d77e1384	Ops exported for sameDiff	2019-10-16 19:16:47 +03:00
Alexander Stoyakin	d5002b14c7	New ops wrappers	2019-10-16 12:59:08 +03:00
Robert Altena	50b13fadc8	nd4j-api cleanup. (#8273 ) * nd4j-api cleanup. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * restore deleted schemes. Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-10-08 21:48:22 +11:00
Robert Altena	1f4ad08305	refactoring activations. (#8261 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-10-03 20:35:27 +10:00
Alex Black	f98f8be7b6	SameDiff ops (#8247 ) * update javadocs and a few method signatures Signed-off-by: Ryan Nett <rnett@skymind.io> * add PRelu op Signed-off-by: Ryan Nett <rnett@skymind.io> * test and fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * add PRelu op Signed-off-by: Ryan Nett <rnett@skymind.io> * test and fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * slightly better test Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-19 11:52:20 +10:00
Steven Lang	d58a4b45b1	Fix Nadam updater clone missing schedule (#8243 ) Signed-off-by: Steven Lang <steven.lang.mz@gmail.com>	2019-09-17 22:56:49 +03:00
Robert Altena	83d958d536	Sparse matrix refactoring. (#8238 ) * remove sparse method from INDArray. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove gemm Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove useage of n4j.sparseFactory Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Nd4j.sparseFactory removed. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * sparseNDArray deleted. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * iremove more sparse calls and constants. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove SparseBlasWrapper. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * delete BaseSparseBlaswrapper. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove 3 sparse factory classes. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * delete SparseCPULevel. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * deletes JcusparseLevel, CUDASparselevel. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * delete nativeCPU sparse classes. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * removes sparse methods from NDArrayFactory. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * more deletes. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * delete (ignored) tests. BaseSparseNDArray. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * deletes ISparseNDArray. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove sparse methods from indArray. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * deletes sparse classes. Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-17 22:56:29 +03:00
raver119	979ef13c0b	fix build issues Signed-off-by: raver119 <raver119@gmail.com>	2019-09-13 11:55:13 +03:00
raver119	2bd69c004c	[WIP] Fixed signatures. SameDiff tests (#258 ) (#8233 ) * Fixed signatures. SameDiff tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Small fix Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Fixed test Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com>	2019-09-12 19:25:03 +03:00
Alex Black	3e73e9b56e	Fixes, cleanup, enable now fixed tests, etc (#254 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-11 23:37:24 +10:00
Ryan Nett	8a05ec2a97	Fix a couple SameDiff training issues (#253 ) * fix execBackwards training issue Signed-off-by: Ryan Nett <rnett@skymind.io> * fix validation not specifying outputs Signed-off-by: Ryan Nett <rnett@skymind.io> * another fix for validation listeners and history Signed-off-by: Ryan Nett <rnett@skymind.io> * tests Signed-off-by: Ryan Nett <rnett@skymind.io> * add single batch dataset output methods Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-10 20:38:23 -07:00
Alex Black	f91970734b	Another small fix (#251 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-10 13:14:29 +10:00
Alex Black	3fb9aecb59	Fix for null shape in SameDiff.var validation (#250 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-10 12:22:10 +10:00
Alex Black	b582e69e3b	Small ND4J/SameDiff fixes (#248 ) * #8218 Fix Nd4j.hstack rank 1 case Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8209 SameDiff: don't allow empty arrays (with 0s in shape) for variables Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-09 22:54:07 +10:00
Robert Altena	c99f980513	INDArray javadoc (#246 ) * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * review fixes. Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-09 13:09:31 +10:00
Alex Black	52d2795193	Another round of small fixes (#241 ) * Small base spark test fix; ROC toString for empty ROC Signed-off-by: Alex Black <blacka101@gmail.com> * More fixes Signed-off-by: Alex Black <blacka101@gmail.com>	2019-09-05 17:01:47 +10:00
Ryan Nett	79867f5c5a	cleanup SDRNN and rnn ops (#238 ) Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-05 12:25:03 +10:00
Alex Black	7d85775934	Arbiter generic JSON ser/de fixes (#237 ) * Arbiter generic JSON ser/de fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Javadoc fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-05 11:51:11 +10:00
Robert Altena	f25e3e71e5	remove lengthLong (#236 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-05 11:19:38 +10:00
Alex Black	03c52ef9dd	Add SameDiff.bitwise namespace (#232 ) * #8196 add SameDiff.bitwise namespace Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add BitsHammingDistance, add remaining bitwise ops to bitwise namespace Signed-off-by: AlexDBlack <blacka101@gmail.com> * fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-04 22:34:31 +10:00
raver119	a90c7dd995	[WIP] Last set of changes (#234 ) * mmul op instead of cublasSgemm Signed-off-by: raver119 <raver119@gmail.com> * transB Signed-off-by: raver119 <raver119@gmail.com> * jcpp handles Signed-off-by: raver119 <raver119@gmail.com> * bitwise and/or/xor Signed-off-by: raver119 <raver119@gmail.com> * bitwise and/or/xor mapping Signed-off-by: raver119 <raver119@gmail.com> * cuda/cublas version check Signed-off-by: raver119 <raver119@gmail.com> * add expected version Signed-off-by: raver119 <raver119@gmail.com> * cuda/cublas version check in java Signed-off-by: raver119 <raver119@gmail.com> * one more error check Signed-off-by: raver119 <raver119@gmail.com> * build fix Signed-off-by: raver119 <raver119@gmail.com> * build fix Signed-off-by: raver119 <raver119@gmail.com> * build fix Signed-off-by: raver119 <raver119@gmail.com> * one more fix Signed-off-by: raver119 <raver119@gmail.com> * skip CUDA version check for now Signed-off-by: raver119 <raver119@gmail.com> * better wording Signed-off-by: raver119 <raver119@gmail.com> * few more tweaks Signed-off-by: raver119 <raver119@gmail.com> * few more tweaks Signed-off-by: raver119 <raver119@gmail.com>	2019-09-04 14:41:08 +03:00
Ryan Nett	e9454b8882	SDCNN cleanup pass (#230 ) * SDCNN cleanup Signed-off-by: Ryan Nett <rnett@skymind.io> * NonNull annotations Signed-off-by: Ryan Nett <rnett@skymind.io> * better javadoc, NonNull fix for sconv Signed-off-by: Ryan Nett <rnett@skymind.io> * update builders to fix names Signed-off-by: Ryan Nett <rnett@skymind.io> * fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * even more fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * fix for null bias Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-04 00:44:01 -07:00
Alex Black	6cc887bee9	Rename flatbuffers DataType to DType (#228 ) * Rename flatbuffers DataType enum to DType Signed-off-by: Alex Black <blacka101@gmail.com> * Rename flatbuffers DataType enum to DType Signed-off-by: Alex Black <blacka101@gmail.com> * Updates for flatbuffers datatype enum renaming Signed-off-by: Alex Black <blacka101@gmail.com>	2019-09-04 16:36:11 +10:00
Robert Altena	25b01f7850	javadoc and remove deprecated methods. (#231 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-04 13:29:02 +10:00
Robert Altena	c64b340975	javadoc (#225 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-03 14:06:42 +10:00
Alex Black	364a6e1a2a	ELU DL4J fixes (#224 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-03 13:35:02 +10:00
Alex Black	82c9dc5743	ELU fix (#219 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-02 18:37:05 +10:00
Alex Black	65c9f2a888	ELU fix (#217 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-02 17:42:12 +10:00
Ryan Nett	b3a134b608	New Nd4j backprop ops for activations (#211 ) * new (for java at least) backprop ops Signed-off-by: Ryan Nett <rnett@skymind.io> * update activation functions Signed-off-by: Ryan Nett <rnett@skymind.io> * add differential functions for SameDiff Signed-off-by: Ryan Nett <rnett@skymind.io> * deprecate old ops Signed-off-by: Ryan Nett <rnett@skymind.io> * update correct old ops Signed-off-by: Ryan Nett <rnett@skymind.io> * update ops backprop to use new ops Signed-off-by: Ryan Nett <rnett@skymind.io> * misc updates for deprecated functions (mostly Nd4j.rand w/ vararg shape) Signed-off-by: Ryan Nett <rnett@skymind.io> * remove old imports Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-02 16:15:23 +10:00
Robert Altena	6d04d30c94	INDArray.java javadoc (#215 ) * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-02 16:06:20 +10:00
Alex Black	6efffb727f	Import fix (#208 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-30 23:40:52 +10:00
Alex Black	a7dca9fc87	Add java op class for relu derivative, and use in Activation ReLU (#207 ) * Add java op class for relu derivative, and use in ACtivation ReLU Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-30 23:36:00 +10:00
raver119	70a9ae5068	[WIP] few tweaks (#206 ) * scatter empty check Signed-off-by: raver119 <raver119@gmail.com> * scatter empty test Signed-off-by: raver119 <raver119@gmail.com> * one more test Signed-off-by: raver119 <raver119@gmail.com> * two tweaks Signed-off-by: raver119 <raver119@gmail.com> * dup tweak Signed-off-by: raver119 <raver119@gmail.com> * - put empty checking of indices array immediately prior helper run Signed-off-by: Yurii <yurii@skymind.io> * minor tests fix Signed-off-by: raver119 <raver119@gmail.com> * minor tests fix Signed-off-by: raver119 <raver119@gmail.com>	2019-08-30 16:32:01 +03:00
Robert Altena	54e320a255	javadoc (#201 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-08-30 22:40:27 +10:00
Alex Black	62e96c9724	Guava Function -> nd4j-common Function (#203 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-30 20:39:43 +10:00
raver119	1003428a18	[WIP] Int broadcastables (#195 ) * Removed invalid resource and fixed tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * legacy scalar/pairwise/broadcast int ops Signed-off-by: raver119 <raver119@gmail.com> * NDArray int broadcastables Signed-off-by: raver119 <raver119@gmail.com> * few more bitwise tests Signed-off-by: raver119 <raver119@gmail.com> * java side update Signed-off-by: raver119 <raver119@gmail.com> * Argument type changed for shift ops Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * legacy scalar/pairwise/broadcast int ops Signed-off-by: raver119 <raver119@gmail.com> * NDArray int broadcastables Signed-off-by: raver119 <raver119@gmail.com> * few more bitwise tests Signed-off-by: raver119 <raver119@gmail.com> * java side update Signed-off-by: raver119 <raver119@gmail.com> * Argument type changed for shift ops Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com>	2019-08-30 10:12:40 +03:00
Alex Black	dcc2baa676	Version upgrades (#199 ) * DataVec fixes for Jackson version upgrade Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J jackson updates + databind version 2.9.9.3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Shade snakeyaml along with jackson Signed-off-by: AlexDBlack <blacka101@gmail.com> * Version fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Switch DataVec legacy JSON format handling to mixins Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next set of fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup for legacy JSON mapping Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade commons compress to 1.18; small test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * New Jackson backward compatibility for DL4J - Round 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * New Jackson backward compatibility for DL4J - Round 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes, all but legacy custom passing Signed-off-by: AlexDBlack <blacka101@gmail.com> * Provide an upgrade path for custom layers for models in pre-1.0.0-beta JSON format Signed-off-by: AlexDBlack <blacka101@gmail.com> * Legacy deserialization cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small amount of polish - legacy JSON Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade guava version Signed-off-by: AlexDBlack <blacka101@gmail.com> * IEvaluation legacy format deserialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade play version to 2.7.3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update nd4j-parameter-server-status to new Play API Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update DL4J UI for new play version Signed-off-by: AlexDBlack <blacka101@gmail.com> * More play framework updates Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove Spark 1/2 adapter code from DataVec Signed-off-by: AlexDBlack <blacka101@gmail.com> * datavec-spark dependency cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 4 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Another fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Breeze upgrade, dependency cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add Scala 2.12 version to pom.xml Signed-off-by: AlexDBlack <blacka101@gmail.com> * change-scala-versions.sh - add scala 2.12, remove 2.10 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Move Spark version properties to parent pom (now that only one spark version is supported) Signed-off-by: AlexDBlack <blacka101@gmail.com> * DataVec Play fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * datavec play dependency fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Clean up old spark/jackson stuff Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup jackson unused dependencies Signed-off-by: AlexDBlack <blacka101@gmail.com> * Dropping redundant dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Removed scalaxy dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * DataVec fixes for Jackson version upgrade Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J jackson updates + databind version 2.9.9.3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Shade snakeyaml along with jackson Signed-off-by: AlexDBlack <blacka101@gmail.com> * Version fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Switch DataVec legacy JSON format handling to mixins Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next set of fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup for legacy JSON mapping Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade commons compress to 1.18; small test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * New Jackson backward compatibility for DL4J - Round 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * New Jackson backward compatibility for DL4J - Round 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes, all but legacy custom passing Signed-off-by: AlexDBlack <blacka101@gmail.com> * Provide an upgrade path for custom layers for models in pre-1.0.0-beta JSON format Signed-off-by: AlexDBlack <blacka101@gmail.com> * Legacy deserialization cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small amount of polish - legacy JSON Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade guava version Signed-off-by: AlexDBlack <blacka101@gmail.com> * IEvaluation legacy format deserialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade play version to 2.7.3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update nd4j-parameter-server-status to new Play API Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update DL4J UI for new play version Signed-off-by: AlexDBlack <blacka101@gmail.com> * More play framework updates Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove Spark 1/2 adapter code from DataVec Signed-off-by: AlexDBlack <blacka101@gmail.com> * datavec-spark dependency cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 4 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Another fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Breeze upgrade, dependency cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add Scala 2.12 version to pom.xml Signed-off-by: AlexDBlack <blacka101@gmail.com> * change-scala-versions.sh - add scala 2.12, remove 2.10 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Move Spark version properties to parent pom (now that only one spark version is supported) Signed-off-by: AlexDBlack <blacka101@gmail.com> * DataVec Play fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * datavec play dependency fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Clean up old spark/jackson stuff Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup jackson unused dependencies Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add shaded guava Signed-off-by: AlexDBlack <blacka101@gmail.com> * Dropping redundant dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Removed scalaxy dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Ensure not possible to import pre-shaded classes, and remove direct guava dependencies in favor of shaded Signed-off-by: AlexDBlack <blacka101@gmail.com> * ND4J Shaded guava import fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * DataVec and DL4J guava shading Signed-off-by: AlexDBlack <blacka101@gmail.com> * Arbiter, RL4J fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Build fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Fix dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Fix bad merge Signed-off-by: AlexDBlack <blacka101@gmail.com> * Jackson shading fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Set play secret, datavec-spark-inference-server Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix for datavec-spark-inference-server Signed-off-by: AlexDBlack <blacka101@gmail.com> * Arbiter fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Arbiter fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small test fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-30 14:35:27 +10:00
Yurii Shyrma	70af8c2afc	Shyrma svd (#191 ) * - add one additional test for svd * - provide float argument in eye op to be a type of output array Signed-off-by: Yurii <yurii@skymind.io> * - add cuda capability check to mmulHelper Signed-off-by: Yurii <yurii@skymind.io> * - make use another method for divice id evaluation Signed-off-by: Yurii <yurii@skymind.io> * Eye data type as T argument Signed-off-by: raver119 <raver119@gmail.com>	2019-08-28 18:27:08 +03:00
Ryan Nett	2a1431264f	Remove calculate output shape from java side (#151 ) * remove some unneeded java-side output shape calculations Signed-off-by: Ryan Nett <rnett@skymind.io> * delete Broadcast Signed-off-by: Ryan Nett <rnett@skymind.io> * delete Linear and Module, Signed-off-by: Ryan Nett <rnett@skymind.io> * update Identity, HashCode, and NoOp Signed-off-by: Ryan Nett <rnett@skymind.io> * removed Cast java-side shape function, added tests and SDVariable.isEmpty Signed-off-by: Ryan Nett <rnett@skymind.io> * ignoring test w/ issues on master Signed-off-by: Ryan Nett <rnett@skymind.io> * noop needs more work, fixed BaseArithmeticBackprop and BaseDynamicTransform ops merge in master for c++ build fix Signed-off-by: Ryan Nett <rnett@skymind.io> * fix EqualTo Signed-off-by: Ryan Nett <rnett@skymind.io> * fix other cond ops Signed-off-by: Ryan Nett <rnett@skymind.io> * "fake" ops calculateOutputShape() throws exception Signed-off-by: Ryan Nett <rnett@skymind.io> * use c++ shape calc for Linspace Signed-off-by: Ryan Nett <rnett@skymind.io> * fix exception message, move most to BaseCompatOp Signed-off-by: Ryan Nett <rnett@skymind.io> * remove SDVariable.isEmpty Signed-off-by: Ryan Nett <rnett@skymind.io> * remove commented out code Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-08-27 20:39:32 -07:00
Alex Black	b46f9827b8	Layer norm test updates (#187 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-28 13:27:00 +10:00
Robert Altena	59a6e4e3ae	INDArray refactoring (#170 ) * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove javaTensorAlongDimension Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com> * javadoc	2019-08-28 12:03:23 +09:00
Ryan Nett	d31197db5f	Remove resolvePropertiesFromSameDiffBeforeExecution() (#172 ) * remove unneeded resolveProperties methods Signed-off-by: Ryan Nett <rnett@skymind.io> * final fixes, make final to prevent more from being added Signed-off-by: Ryan Nett <rnett@skymind.io> * gather fix Signed-off-by: Ryan Nett <rnett@skymind.io> * deprecate DifferentialFunction resolveProps Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-08-28 11:02:41 +10:00
Alex Black	9d325ad070	Small optimization to Nd4j.readNumpy (#183 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-27 23:27:41 +10:00
Alex Black	fd22a8ecc7	Small build fix, after last PR (#177 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-27 19:46:26 +10:00
Alex Black	5cfbeb64ac	Another small fix (#175 ) * Layer norm 4d case fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-27 19:10:31 +10:00
Alex Black	dce4751fc1	Layer norm 4d case fixes (#174 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-27 18:34:53 +10:00
Robert Altena	9a513a9aa6	INDArray javadocs (#166 ) * small fix of compiler warnings in nd4j. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * indarray javadoc start. Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-08-26 16:01:20 +09:00
Alex Black	a9b08cc163	Upgrade protobuf version (#162 ) * First steps for protobuf version upgrade Signed-off-by: AlexDBlack <blacka101@gmail.com> * Phase 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update imports to shaded protobuf Signed-off-by: AlexDBlack <blacka101@gmail.com> * Version fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Switch to single execution for protobuf codegen to work around plugin bug Signed-off-by: AlexDBlack <blacka101@gmail.com> * Automatically delete old PB generated files after name change Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-24 19:22:36 +10:00
raver119	99cdf6d42b	- cpu isMax fix for multidim case + test - INDArray.wasClosed() fix for empty array edge case Signed-off-by: raver119 <raver119@gmail.com>	2019-08-23 18:44:37 +03:00
Alex Black	70ee8ba91d	Optimization / fix for DL4J SameDiff layers (#156 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-23 20:54:24 +10:00
raver119	dbea687903	better handling of INDArray.close() (#154 ) Signed-off-by: raver119 <raver119@gmail.com>	2019-08-23 10:24:56 +03:00
Alex Black	80d35377d4	SameDiff cleanup and fixes (#150 ) * Cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * SDVariable no longer extends DifferentialFunction Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8123 Remove cloning library to avoid 'illegal reflective access' warnings Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8095 Make Pooling3D abstract, fix flatbuffers serialization issue Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8117 WordVectorSerializer deprecated method javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Final fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * One more Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-23 15:09:53 +10:00
raver119	930b49e87f	[WIP] DeviceLocalNDArray updates (#149 ) * ContextBuffers are released upon device change Signed-off-by: raver119 <raver119@gmail.com> * DeviceLocalNDArray updates + tests Signed-off-by: raver119 <raver119@gmail.com> * special array for delayed mode Signed-off-by: raver119 <raver119@gmail.com> * additional detach() Signed-off-by: raver119 <raver119@gmail.com>	2019-08-22 20:01:29 +03:00
Robert Altena	c523aa792f	removr trueVector. (#146 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-08-22 19:27:43 +09:00
Alex Black	9c2bfc9863	Various fixes (DL4J, ND4J) (#147 ) * Import fixes, IsMax dtype calc, small test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * SubsamplingLayer fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J - SpaceToBatch layer updates Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-22 16:16:03 +10:00
Robert Altena	ca7e5593ec	ND4J: Remove Nd4j.trueScalar/trueVector (#145 ) * merge conflict. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove/replace trueVector Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-08-22 10:49:30 +09:00
Ryan Nett	2b0d7b3b52	[WIP] Various fixes, mostly SameDiff/Nd4j (#110 ) * Nd4j pad update Signed-off-by: Ryan Nett <rnett@skymind.io> * switched from guava Immutables to Collections.unmodifiableList/Map Signed-off-by: Ryan Nett <rnett@skymind.io> * javadoc Signed-off-by: Ryan Nett <rnett@skymind.io> * use new pad Signed-off-by: Ryan Nett <rnett@skymind.io> * conv tests use OpValidation Signed-off-by: Ryan Nett <rnett@skymind.io> * deconv3d overrides Signed-off-by: Ryan Nett <rnett@skymind.io> * test fix for the new pad method Signed-off-by: Ryan Nett <rnett@skymind.io> * more test fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * more test fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * rename SameDiff function methods to op (except for the actual SameDiff function ones) Signed-off-by: Ryan Nett <rnett@skymind.io> * more pad overloads, test fix Signed-off-by: Ryan Nett <rnett@skymind.io> * test updates Signed-off-by: Ryan Nett <rnett@skymind.io> * conv1d test Signed-off-by: Ryan Nett <rnett@skymind.io> * remove Conv1D tf import (there isn't a TF conv1d op) Signed-off-by: Ryan Nett <rnett@skymind.io> * remove numThreads from Nd4j Signed-off-by: Ryan Nett <rnett@skymind.io> * replace Old ops with their newer versions, deprecate ones that haven't already been deprecated Signed-off-by: Ryan Nett <rnett@skymind.io> * remove use of setNumThreads Signed-off-by: Ryan Nett <rnett@skymind.io> * fix for Reverse and ATan2 Signed-off-by: Ryan Nett <rnett@skymind.io> * fix test for wrong equals type Signed-off-by: Ryan Nett <rnett@skymind.io> * well it works now Signed-off-by: Ryan Nett <rnett@skymind.io> * better javadocs Signed-off-by: Ryan Nett <rnett@skymind.io> * NonNulls Signed-off-by: Ryan Nett <rnett@skymind.io> * better array literal Signed-off-by: Ryan Nett <rnett@skymind.io> * re-add tf import stuff (will remove later) Signed-off-by: Ryan Nett <rnett@skymind.io> * conv1d config load fix Signed-off-by: Ryan Nett <rnett@skymind.io> * partial config usage changes Signed-off-by: Ryan Nett <rnett@skymind.io> * remove Old op classes Signed-off-by: Ryan Nett <rnett@skymind.io> * config property fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * removed one too many ops Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-08-21 16:40:32 -07:00
raver119	d9ab299759	[WIP] Minor fixes (#140 ) * - Tile java shape fn removed - Tile 0 validation added - scatter_upd test Signed-off-by: raver119 <raver119@gmail.com> * additional tile validation Signed-off-by: raver119 <raver119@gmail.com> * - provide vector case in cuda scatter op Signed-off-by: Yurii <yurii@skymind.io> * cpu ismax view fix Signed-off-by: raver119 <raver119@gmail.com> * exp Signed-off-by: raver119 <raver119@gmail.com> * cuda ismax fix Signed-off-by: raver119 <raver119@gmail.com>	2019-08-21 15:05:47 +03:00
raver119	4211f3b4ce	one more scalar constructor fix Signed-off-by: raver119 <raver119@gmail.com>	2019-08-21 08:53:36 +03:00
raver119	3f4379927a	scalar constructor fix Signed-off-by: raver119 <raver119@gmail.com>	2019-08-21 08:50:59 +03:00
Robert Altena	38310777ee	fix for eclipse#8087 (#129 ) * fix for #8087 Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove commented code. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * removing trueScalar. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove tueScalar. Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-08-20 15:20:40 +09:00
Alexander Stoyakin	10d676e0b8	[WIP] nd4s - Scala operators for SameDiff (#113 ) * Jar packaging for maven Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Typo fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * minimal viable prototype for SD Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests corrected Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * few fixes for bfloat16 in java and cpp (#114) Signed-off-by: raver119 <raver119@gmail.com> * Nd4j refactoring (#112) * refactoring Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip * fix: make test public. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * make test public. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * fixes read refactoring. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Enabled test Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test copied from nd4j Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * [WIP] bitwise ops (#115) * - cyclic_shift_bits + test - shift_bits + test Signed-off-by: raver119 <raver119@gmail.com> * OMP_IF replacement Signed-off-by: raver119 <raver119@gmail.com> * Thin wrapper added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Cleanup Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Shugeo cuda tests (#116) * Added tests for get_seed/set_seed ops. * Added missed tests for scatter_sub/mul/div ops. * Added tests for hardsigmoid and hardsigmoid_bp. * Added tests for hardtanh and hardtanh_bp ops. * Added test for histogram op. * Added tests for identity op. * Refactored mergemaxindex op. Added tests for log1p,mergemaxindex, mod and mod_bp ops. * Fixed tests for FloorDiv. * Added test for rank op. * Added tests for rationaltanh/rationaltanh_bp ops. * Added tests for realdiv/realdiv_bp. * Added tests for rectifiedtanh/_bp ops. * Added tests for shapes_of op. * Added tests for shapes_of op. * Added tests for size op. * Added tests for softplus/_bp ops. * Added tests for softsign/_bp ops. * Added tests for toggle_bits op. Fixed processing of OP_IMPL and so on defititions. * Added test for truncatediv op. * Added another test for truncatediv op. * Added another test for histogram. * Added tests for unstack_list op. * Refactored to_int32/uint32/float16/float32/double/int64/uint64 ops and tests. * Refactored mergemaxindex op helper for cuda platform and tests. * Fixed cuda kernel for histogram op helper. * Refactor skipgram to avoid early buffers shift. * Fixed check up with non_max_suppression op cuda helper. Added cuda kernel implementation for skipgram op helpers. * Added implementation of skipgram op helper for cuda platform. Working revision * Fixed mergeMaxIndex kernel and move it to separate source file. * Adding arithmetic Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Eliminated memory leaks and dropped waste prints with tests. (#117) * Added tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * fix test Signed-off-by: raver119 <raver119@gmail.com> * no openmp for ClipByGlobalNorm Signed-off-by: raver119 <raver119@gmail.com> * Stubs for ops Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * [WIP] right shift ops (#118) * right shift ops Signed-off-by: raver119 <raver119@gmail.com> * typo Signed-off-by: raver119 <raver119@gmail.com> * rotr test Signed-off-by: raver119 <raver119@gmail.com> * fix: IOException no longer thrown by read(). (#120) Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Small fix in TensorflowConversion class (#121) Signed-off-by: Alex Black <blacka101@gmail.com> * Shyrma concat2 (#119) * - rewrite/improve concat Signed-off-by: Yurii <yurii@skymind.io> * - ged rid of unnecessary argument in concat kernel Signed-off-by: Yurii <yurii@skymind.io> * InferenceSession additional validation for shape calc (#122) Signed-off-by: Alex Black <blacka101@gmail.com> * [WIP] build fix (#124) * AffinityManager changes Signed-off-by: raver119 <raver119@gmail.com> * build fixes Signed-off-by: raver119 <raver119@gmail.com> * OP/CONFIGURABLE_OP shapefn fix (#125) Signed-off-by: raver119 <raver119@gmail.com> * Some ops added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Nd4j refactoring (last one!) (#123) * fix: IOException no longer thrown by read(). Signed-off-by: Robert Altena <Rob@Ra-ai.com> * refactoring * last refactorings Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Advanced tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * [WIP] Java wrappers (#126) * shift/rshift/rotl/rotr java/sd wrappers Signed-off-by: raver119 <raver119@gmail.com> * few additional wrappers Signed-off-by: raver119 <raver119@gmail.com> * minor naming tweak Signed-off-by: raver119 <raver119@gmail.com> * Test added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * one more build fix Signed-off-by: raver119 <raver119@gmail.com> * Jar packaging for maven Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Typo fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * minimal viable prototype for SD Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests corrected Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Enabled test Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test copied from nd4j Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Thin wrapper added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Cleanup Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Adding arithmetic Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Added tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Stubs for ops Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Some ops added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Advanced tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Ops added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Small build fixes (#127) * Small build fixes Signed-off-by: Alex Black <blacka101@gmail.com> * Fix RL4J Signed-off-by: Alex Black <blacka101@gmail.com> * Test fixes Signed-off-by: Alex Black <blacka101@gmail.com> * Another fix Signed-off-by: Alex Black <blacka101@gmail.com> * parent module name fix Signed-off-by: raver119 <raver119@gmail.com> * [WIP] Roll rewritten (#128) * Process correct input vector. * Added tests for roll. * Refactored roll to conform with TF. Eliminated memory leaks with Roll op tests. * no thread_local for cpu Signed-off-by: raver119 <raver119@gmail.com> * Jar packaging for maven Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Typo fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * minimal viable prototype for SD Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests corrected Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Enabled test Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test copied from nd4j Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Thin wrapper added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Cleanup Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Adding arithmetic Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Added tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Stubs for ops Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Some ops added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Advanced tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Ops added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Boolen logic ops Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Shift operations Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com>	2019-08-19 16:25:13 +03:00
raver119	b8ab1a00b0	- 2 mod tests - ModOp mapping added Signed-off-by: raver119 <raver119@gmail.com>	2019-08-19 12:57:24 +03:00
raver119	aceb915557	[WIP] tests fixes (#130 ) * no openmp for ClipByGlobalNorm Signed-off-by: raver119 <raver119@gmail.com> * one more bfloat16 rng test Signed-off-by: raver119 <raver119@gmail.com> * assertion fix Signed-off-by: raver119 <raver119@gmail.com> * - legacy IsMax gone - linear IsMax gets shapeInfo argument Signed-off-by: raver119 <raver119@gmail.com> * get rid of legacy IsMax tests Signed-off-by: raver119 <raver119@gmail.com> * IsMax is custom op now Signed-off-by: raver119 <raver119@gmail.com> * more blocks for ismax Signed-off-by: raver119 <raver119@gmail.com> * one more test Signed-off-by: raver119 <raver119@gmail.com> * - sqrt test - some legacy code removed from CudaExecutioner - Transforms.asin tweaks Signed-off-by: raver119 <raver119@gmail.com> * - TransformFloat fix Signed-off-by: raver119 <raver119@gmail.com> * - ismax fix - SpaceToBatchND/BatchToSpaceND wrappers - couple of legacy tests removed Signed-off-by: raver119 <raver119@gmail.com>	2019-08-19 11:33:15 +03:00
raver119	3ba616a161	[WIP] Java wrappers (#126 ) * shift/rshift/rotl/rotr java/sd wrappers Signed-off-by: raver119 <raver119@gmail.com> * few additional wrappers Signed-off-by: raver119 <raver119@gmail.com> * minor naming tweak Signed-off-by: raver119 <raver119@gmail.com>	2019-08-16 13:14:26 +03:00
Robert Altena	7fbc4b0933	Nd4j refactoring (last one!) (#123 ) * fix: IOException no longer thrown by read(). Signed-off-by: Robert Altena <Rob@Ra-ai.com> * refactoring * last refactorings Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-08-16 16:39:11 +10:00
raver119	2f3d7330ce	[WIP] build fix (#124 ) * AffinityManager changes Signed-off-by: raver119 <raver119@gmail.com> * build fixes Signed-off-by: raver119 <raver119@gmail.com>	2019-08-16 08:14:18 +03:00
Alex Black	65ff18383a	InferenceSession additional validation for shape calc (#122 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-16 14:19:06 +10:00
raver119	935cbf5df3	fix test Signed-off-by: raver119 <raver119@gmail.com>	2019-08-15 18:19:24 +03:00
Robert Altena	59cba587f4	Nd4j refactoring (#112 ) * refactoring Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip * fix: make test public. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * make test public. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * fixes read refactoring. Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-08-15 13:50:52 +09:00
raver119	53ca9a76e8	[WIP] multi-device support (#80 ) * fix pad javadoc and @see links. (#72) Signed-off-by: Robert Altena <Rob@Ra-ai.com> * [WIP] More fixes (#73) * special tests for ConstantTadHelper/ConstantShapeHelper Signed-off-by: raver119 <raver119@gmail.com> * release methods for data buffers Signed-off-by: raver119 <raver119@gmail.com> * delete temporary buffer Java side Signed-off-by: raver119 <raver119@gmail.com> * delete temporary buffer Java side Signed-off-by: raver119 <raver119@gmail.com> * delete temporary TadPack C++/Java side (#74) Signed-off-by: raver119 <raver119@gmail.com> * Zoo model TF import test updates (#75) * argLine fix, update compression_gru comment * updated comment for xception * undid but commented argLine change * updated xlnet comment * copyright headers * - new NDArray methods like()/ulike() (#77) - fix for depthwise_conv2d_bp + special test Signed-off-by: raver119 <raver119@gmail.com> * upsampling2d fix CUDA Signed-off-by: raver119 <raver119@gmail.com> * DL4J trace logging (#79) * MLN/CG trace logging for debugging Signed-off-by: AlexDBlack <blacka101@gmail.com> * Tiny tweak Signed-off-by: AlexDBlack <blacka101@gmail.com> * strided_slice_bp shape fn leak fix Signed-off-by: raver119 <raver119@gmail.com> * SameDiff fixes and naming (#78) * remove SDVariable inplace methods * import methods * npe fix in OpVal * removed SameDiff inplace ops from tests * Naming updates, moved to centralized methods in SameDiff, should use op_#:# for everything * quick fixes * javadoc * SDVariable eval with placeholders * use regex match * better matching * initial commit Signed-off-by: raver119 <raver119@gmail.com> * initial commit Signed-off-by: raver119 <raver119@gmail.com> * fix javadoc. (#76) * fix javadoc. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * replace most @see with @link s. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * 4 additional tests Signed-off-by: raver119 <raver119@gmail.com> * launch context reorganization Signed-off-by: raver119 <raver119@gmail.com> * LaunchContext reorganization Signed-off-by: raver119 <raver119@gmail.com> * per-device LaunchContext Signed-off-by: raver119 <raver119@gmail.com> * Various DL4J/ND4J fixes (#81) * #7954 Force refresh of UI when switching tabs on overview page Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8017 Concurrent modification exception (synchronize) fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8033 Don't initialize updater in middle of writing memory crash dump Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8208 Fix shape checks for ND4J int[] creator methods Signed-off-by: AlexDBlack <blacka101@gmail.com> * #6385 #7992 Keras import naming fixes + cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8016 Upsampling3D - add NDHWC format support Signed-off-by: AlexDBlack <blacka101@gmail.com> * ContextBuffers as separate entity Signed-off-by: raver119 <raver119@gmail.com> * Refactor NativeOps.h to export C functions * Actually export functions from NativeOps.h * Adapt the Java wrappers in ND4J generated with JavaCPP * Create C wrappers for some of the C++ classes currently used by ND4J * ContextBuffers as separate entity Signed-off-by: raver119 <raver119@gmail.com> * remove duplicate code in createBufferDetached. (#83) Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Keras model import - updater lr fix (#84) * Keras model import - updater lr fix Signed-off-by: eraly <susan.eraly@gmail.com> * Keras model import - updater lr fix, cleanup Signed-off-by: eraly <susan.eraly@gmail.com> * ContextBuffers as separate entity Signed-off-by: raver119 <raver119@gmail.com> * ContextBuffers as separate entity Signed-off-by: raver119 <raver119@gmail.com> * Fix functions of OpaqueVariablesSet * thread-local buffers/affinity Signed-off-by: raver119 <raver119@gmail.com> * thread safety for LaunchContext Signed-off-by: raver119 <raver119@gmail.com> * more of thread safety Signed-off-by: raver119 <raver119@gmail.com> * one more multi threaded test Signed-off-by: raver119 <raver119@gmail.com> * SameDiff Convolution Config validation, better output methods (#82) * Conv Config validation & tests Signed-off-by: Ryan Nett <rnett@skymind.io> * stackOutputs utility method Signed-off-by: Ryan Nett <rnett@skymind.io> * use constructor for validation, support negative kernel sizes (infered from weights) Signed-off-by: Ryan Nett <rnett@skymind.io> * better output methods Signed-off-by: Ryan Nett <rnett@skymind.io> * move output to be with fit and evaluate Signed-off-by: Ryan Nett <rnett@skymind.io> * fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * more fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * refactor duplicate code from pad methods. (#86) * refactor duplicate code from pad methods. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * replace switch with if. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Various ND4J/DL4J fixes and improvements (#87) * Reshape and reallocate - small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Reshape and reallocate - small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * #6488 ElementWiseVertex broadcast support Signed-off-by: AlexDBlack <blacka101@gmail.com> * Constructors and broadcast supported it Transforms.max/min Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8054 ElementWiseVertex now supports broadcast inputs Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8057 Nd4j.create overload dtype fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * #7551 ND4J Shape validation fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * [WIP] Numpy boolean import (#91) * numpy bool type Signed-off-by: raver119 <raver119@gmail.com> * numpy bool java side Signed-off-by: raver119 <raver119@gmail.com> * remove create method with unused parameter. (#89) * remove create method with unused parameter. * removed more unused methods. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * removing more unused code. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * last removal of unused code. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove createSparse methods. (#92) Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Various ND4J/DL4J fixes (#90) * Deprecate OldOp instances Signed-off-by: AlexDBlack <blacka101@gmail.com> #8063 #8054 Broadcast exceptions + cleanup inplace ops Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove bad test condition Signed-off-by: AlexDBlack <blacka101@gmail.com> * #7993 Fix shape function issue in crop_and_resize op Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J SameDiff lambda layer fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8029 Fix for pnorm backprop math Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8038 Fix Op profiler NaN/Inf triggering + add tests (#93) Signed-off-by: AlexDBlack <blacka101@gmail.com> * createUninitializedDetached refactoring. (#94) * wip * update interface, add null implementations. * Breaking one test in a weird way. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * createUninitializedDetached refactored. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * cuda build fix for issues introduced by recent refactoring Signed-off-by: raver119 <raver119@gmail.com> * [WIP] More of CUDA (#95) * initial commit Signed-off-by: raver119 <raver119@gmail.com> * Implementation of hashcode cuda helper. Working edition. * Fixed parallel test input arangements. * Fixed tests for hashcode op. * Fixed shape calculation for image:crop_and_resize op and test. * NativeOps tests. Initial test suite. * Added tests for indexReduce methods. * Added test on execBroadcast with NDArray as dimensions. * Added test on execBroadcastBool with NDArray as dimensions. * Added tests on execPairwiseTransform and execPairwiseTransofrmBool. * Added tests for execReduce with scalar results. * Added reduce tests for non-empty dims array. * Added tests for reduce3. * Added tests for execScalar. * Added tests for execSummaryStats. * - provide cpu/cuda code for batch_to_space - testing it Signed-off-by: Yurii <yurii@skymind.io> * - remove old test for batch_to_space (had wrong format and numbers were not checked) Signed-off-by: Yurii <yurii@skymind.io> * Fixed complilation errors with test. * Added test for execTransformFloat. * Added test for execTransformSame. * Added test for execTransformBool. * Added test for execTransformStrict. * Added tests for execScalar/execScalarBool with TADs. * Added test for flatten. * - provide cpu/cuda code for space_to_Batch operaion Signed-off-by: Yurii <yurii@skymind.io> * Added test for concat. * comment unnecessary stuff in s_t_b Signed-off-by: Yurii <yurii@skymind.io> * Added test for specialConcat. * Added tests for memcpy/set routines. * Fixed pullRow cuda test. * Added pullRow test. * Added average test. * - correct typo in NDArray::applyPairwiseTransform(nd4j::pairwise::BoolOps op...) Signed-off-by: Yurii <yurii@skymind.io> * - debugging and fixing cuda tests in JavaInteropTests file Signed-off-by: Yurii <yurii@skymind.io> * - correct some tests Signed-off-by: Yurii <yurii@skymind.io> * Added test for shuffle. * Fixed ops declarations. * Restored omp and added shuffle test. * Added convertTypes test. * Added tests for execRandom. Eliminated usage of RandomBuffer with NativeOps. * Added sort tests. * Added tests for execCustomOp. * - further debuging and fixing tests terminated with crash Signed-off-by: Yurii <yurii@skymind.io> * Added tests for calculateOutputShapes. * Addded Benchmarks test. * Commented benchmark tests. * change assertion Signed-off-by: raver119 <raver119@gmail.com> * Added tests for apply_sgd op. Added cpu helper for that op. * Implement cuda helper for aplly_sgd op. Fixed tests for NativeOps. * Added test for assign broadcastable. * Added tests for assign_bp op. * Added tests for axpy op. * - assign/execScalar/execTransformAny signature change - minor test fix Signed-off-by: raver119 <raver119@gmail.com> * Fixed axpy op. * meh Signed-off-by: raver119 <raver119@gmail.com> * - fix tests for nativeOps::concat Signed-off-by: Yurii <yurii@skymind.io> * sequential transform/scalar Signed-off-by: raver119 <raver119@gmail.com> * allow nested parallelism Signed-off-by: raver119 <raver119@gmail.com> * assign_bp leak fix Signed-off-by: raver119 <raver119@gmail.com> * block setRNG fix Signed-off-by: raver119 <raver119@gmail.com> * enable parallelism by default Signed-off-by: raver119 <raver119@gmail.com> * enable nested parallelism by default Signed-off-by: raver119 <raver119@gmail.com> * Added cuda implementation for row_count helper. * Added implementation for tnse gains op helper. * - take into account possible situations when input arrays are empty in reduce_ cuda stuff Signed-off-by: Yurii <yurii@skymind.io> * Implemented tsne/edge_forces op cuda-based helper. Parallelized cpu-based helper for edge_forces. * Added kernel for tsne/symmetrized op heleper. * Implementation of tsne/symmetrized op cuda helper. Working edition. * Eliminated waste printfs. * Added test for broadcastgradientargs op. * host-only fallback for empty reduce float Signed-off-by: raver119 <raver119@gmail.com> * - some tests fixes Signed-off-by: Yurii <yurii@skymind.io> * - correct the rest of reduce_ stuff Signed-off-by: Yurii <yurii@skymind.io> * - further correction of reduce_ stuff Signed-off-by: Yurii <yurii@skymind.io> * Added test for Cbow op. Also added cuda implementation for cbow helpers. * - improve code of stack operation for scalar case Signed-off-by: Yurii <yurii@skymind.io> * - provide cuda kernel for gatherND operation Signed-off-by: Yurii <yurii@skymind.io> * Implementation of cbow helpers with cuda kernels. * minor tests tweaks Signed-off-by: raver119 <raver119@gmail.com> * minor tests tweaks Signed-off-by: raver119 <raver119@gmail.com> * - further correction of cuda stuff Signed-off-by: Yurii <yurii@skymind.io> * Implementatation of cbow op helper with cuda kernels. Working edition. * Skip random testing for cudablas case. * lstmBlockCell context fix Signed-off-by: raver119 <raver119@gmail.com> * Added tests for ELU and ELU_BP ops. * Added tests for eq_scalar, gt_scalar, gte_scalar and lte_scalar ops. * Added tests for neq_scalar. * Added test for noop. * - further work on clipbynorm_bp Signed-off-by: Yurii <yurii@skymind.io> * - get rid of concat op call, use instead direct concat helper call Signed-off-by: Yurii <yurii@skymind.io> * lstmBlockCell context fix Signed-off-by: raver119 <raver119@gmail.com> * Added tests for lrelu and lrelu_bp. * Added tests for selu and selu_bp. * Fixed lrelu derivative helpers. * - some corrections in lstm Signed-off-by: Yurii <yurii@skymind.io> * operator * result shape fix Signed-off-by: raver119 <raver119@gmail.com> * - correct typo in lstmCell Signed-off-by: Yurii <yurii@skymind.io> * few tests fixed Signed-off-by: raver119 <raver119@gmail.com> * CUDA inverse broadcast bool fix Signed-off-by: raver119 <raver119@gmail.com> * disable MMAP test for CUDA Signed-off-by: raver119 <raver119@gmail.com> * BooleanOp syncToDevice Signed-off-by: raver119 <raver119@gmail.com> * meh Signed-off-by: raver119 <raver119@gmail.com> * additional data types for im2col/col2im Signed-off-by: raver119 <raver119@gmail.com> * Added test for firas_sparse op. * one more RandomBuffer test excluded Signed-off-by: raver119 <raver119@gmail.com> * Added tests for flatten op. * Added test for Floor op. * bunch of tests fixed Signed-off-by: raver119 <raver119@gmail.com> * mmulDot tests fixed Signed-off-by: raver119 <raver119@gmail.com> * more tests fixed Signed-off-by: raver119 <raver119@gmail.com> * Implemented floordiv_bp op and tests. * Fixed scalar case with cuda implementation for bds. * - work on cuda kernel for clip_by_norm backprop op is completed Signed-off-by: Yurii <yurii@skymind.io> * Eliminate cbow crach. * more tests fixed Signed-off-by: raver119 <raver119@gmail.com> * more tests fixed Signed-off-by: raver119 <raver119@gmail.com> * Eliminated abortion with batched nlp test. * more tests fixed Signed-off-by: raver119 <raver119@gmail.com> * Fixed shared flag initializing. * disabled bunch of cpu workspaces tests Signed-off-by: raver119 <raver119@gmail.com> * scalar operators fix: missing registerSpecialUse call Signed-off-by: raver119 <raver119@gmail.com> * Fixed logdet for cuda and tests. * - correct clipBynorm_bp Signed-off-by: Yurii <yurii@skymind.io> * Fixed crop_and_resize shape datatype. * - correct some mmul tests Signed-off-by: Yurii <yurii@skymind.io> * build fix Signed-off-by: raver119 <raver119@gmail.com> * exclude two methods for JNI Signed-off-by: raver119 <raver119@gmail.com> * exclude two methods for JNI Signed-off-by: raver119 <raver119@gmail.com> * exclude two methods for JNI (#97) Signed-off-by: raver119 <raver119@gmail.com> * temporary stack fix Signed-off-by: raver119 <raver119@gmail.com> * round robin affinity test Signed-off-by: raver119 <raver119@gmail.com> * get rid of legacy CudaContext methods Signed-off-by: raver119 <raver119@gmail.com> * get rid of legacy ContextPool classes/methods Signed-off-by: raver119 <raver119@gmail.com> * one legacy test removed Signed-off-by: raver119 <raver119@gmail.com> * few more fields rearranged Signed-off-by: raver119 <raver119@gmail.com> * OpaqueLaunchContext Signed-off-by: raver119 <raver119@gmail.com> * OpaqueLaunchContext++ Signed-off-by: raver119 <raver119@gmail.com> * more of OpaqueLaunchContext methods Signed-off-by: raver119 <raver119@gmail.com> * LaunchContext -> CudaContext Signed-off-by: raver119 <raver119@gmail.com> * AffinityManger changes Signed-off-by: raver119 <raver119@gmail.com> * AffinityManger changes Signed-off-by: raver119 <raver119@gmail.com> * cusolver handles Signed-off-by: raver119 <raver119@gmail.com> * typo Signed-off-by: raver119 <raver119@gmail.com> * cusolver method Signed-off-by: raver119 <raver119@gmail.com> * cusolver handle propagated Signed-off-by: raver119 <raver119@gmail.com> * blas/solver handles Signed-off-by: raver119 <raver119@gmail.com> * one more test Signed-off-by: raver119 <raver119@gmail.com> * legacy concat implementations replaced with new CustomOp Signed-off-by: raver119 <raver119@gmail.com> * one more test Signed-off-by: raver119 <raver119@gmail.com> * concat now uses way more blocks Signed-off-by: raver119 <raver119@gmail.com> * print Signed-off-by: raver119 <raver119@gmail.com> * no more triple template mmul Signed-off-by: raver119 <raver119@gmail.com> * bunch of kernels have dtypes reconsidered Signed-off-by: raver119 <raver119@gmail.com> * bunch of kernels have dtypes reconsidered Signed-off-by: raver119 <raver119@gmail.com> * bitonic sort reorganized Signed-off-by: raver119 <raver119@gmail.com> * bunch of cpu stuff removed from cuda scope Signed-off-by: raver119 <raver119@gmail.com> * bunch of cpu stuff removed from cuda scope Signed-off-by: raver119 <raver119@gmail.com> * type conversions moved to generic impl Signed-off-by: raver119 <raver119@gmail.com> * cpu data types pass Signed-off-by: raver119 <raver119@gmail.com> * non_max_suppression Signed-off-by: raver119 <raver119@gmail.com> * sortByValue fix Signed-off-by: raver119 <raver119@gmail.com> * ignore all mixed datatype tests for mmul Signed-off-by: raver119 <raver119@gmail.com> * special handling of OpProfiler exceptions Signed-off-by: raver119 <raver119@gmail.com> * - one failing concat test in cpp - Nd4j.tile now uses op internally Signed-off-by: raver119 <raver119@gmail.com> * get back dtype exception for legacy arrays deserialization Signed-off-by: raver119 <raver119@gmail.com>	2019-08-14 16:52:34 +03:00
raver119	ec847e034b	[WIP] Remote inference (#96 ) * fix pad javadoc and @see links. (#72) Signed-off-by: Robert Altena <Rob@Ra-ai.com> * [WIP] More fixes (#73) * special tests for ConstantTadHelper/ConstantShapeHelper Signed-off-by: raver119 <raver119@gmail.com> * release methods for data buffers Signed-off-by: raver119 <raver119@gmail.com> * delete temporary buffer Java side Signed-off-by: raver119 <raver119@gmail.com> * delete temporary buffer Java side Signed-off-by: raver119 <raver119@gmail.com> * delete temporary TadPack C++/Java side (#74) Signed-off-by: raver119 <raver119@gmail.com> * Zoo model TF import test updates (#75) * argLine fix, update compression_gru comment * updated comment for xception * undid but commented argLine change * updated xlnet comment * copyright headers * - new NDArray methods like()/ulike() (#77) - fix for depthwise_conv2d_bp + special test Signed-off-by: raver119 <raver119@gmail.com> * upsampling2d fix CUDA Signed-off-by: raver119 <raver119@gmail.com> * DL4J trace logging (#79) * MLN/CG trace logging for debugging Signed-off-by: AlexDBlack <blacka101@gmail.com> * Tiny tweak Signed-off-by: AlexDBlack <blacka101@gmail.com> * strided_slice_bp shape fn leak fix Signed-off-by: raver119 <raver119@gmail.com> * SameDiff fixes and naming (#78) * remove SDVariable inplace methods * import methods * npe fix in OpVal * removed SameDiff inplace ops from tests * Naming updates, moved to centralized methods in SameDiff, should use op_#:# for everything * quick fixes * javadoc * SDVariable eval with placeholders * use regex match * better matching * fix javadoc. (#76) * fix javadoc. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * replace most @see with @link s. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * 4 additional tests Signed-off-by: raver119 <raver119@gmail.com> * Various DL4J/ND4J fixes (#81) * #7954 Force refresh of UI when switching tabs on overview page Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8017 Concurrent modification exception (synchronize) fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8033 Don't initialize updater in middle of writing memory crash dump Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8208 Fix shape checks for ND4J int[] creator methods Signed-off-by: AlexDBlack <blacka101@gmail.com> * #6385 #7992 Keras import naming fixes + cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8016 Upsampling3D - add NDHWC format support Signed-off-by: AlexDBlack <blacka101@gmail.com> * Refactor NativeOps.h to export C functions * Actually export functions from NativeOps.h * Adapt the Java wrappers in ND4J generated with JavaCPP * Create C wrappers for some of the C++ classes currently used by ND4J * remove duplicate code in createBufferDetached. (#83) Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Keras model import - updater lr fix (#84) * Keras model import - updater lr fix Signed-off-by: eraly <susan.eraly@gmail.com> * Keras model import - updater lr fix, cleanup Signed-off-by: eraly <susan.eraly@gmail.com> * Fix functions of OpaqueVariablesSet * SameDiff Convolution Config validation, better output methods (#82) * Conv Config validation & tests Signed-off-by: Ryan Nett <rnett@skymind.io> * stackOutputs utility method Signed-off-by: Ryan Nett <rnett@skymind.io> * use constructor for validation, support negative kernel sizes (infered from weights) Signed-off-by: Ryan Nett <rnett@skymind.io> * better output methods Signed-off-by: Ryan Nett <rnett@skymind.io> * move output to be with fit and evaluate Signed-off-by: Ryan Nett <rnett@skymind.io> * fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * more fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * refactor duplicate code from pad methods. (#86) * refactor duplicate code from pad methods. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * replace switch with if. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Various ND4J/DL4J fixes and improvements (#87) * Reshape and reallocate - small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Reshape and reallocate - small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * #6488 ElementWiseVertex broadcast support Signed-off-by: AlexDBlack <blacka101@gmail.com> * Constructors and broadcast supported it Transforms.max/min Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8054 ElementWiseVertex now supports broadcast inputs Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8057 Nd4j.create overload dtype fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * #7551 ND4J Shape validation fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * [WIP] Numpy boolean import (#91) * numpy bool type Signed-off-by: raver119 <raver119@gmail.com> * numpy bool java side Signed-off-by: raver119 <raver119@gmail.com> * remove create method with unused parameter. (#89) * remove create method with unused parameter. * removed more unused methods. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * removing more unused code. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * last removal of unused code. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove createSparse methods. (#92) Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Various ND4J/DL4J fixes (#90) * Deprecate OldOp instances Signed-off-by: AlexDBlack <blacka101@gmail.com> #8063 #8054 Broadcast exceptions + cleanup inplace ops Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove bad test condition Signed-off-by: AlexDBlack <blacka101@gmail.com> * #7993 Fix shape function issue in crop_and_resize op Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J SameDiff lambda layer fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8029 Fix for pnorm backprop math Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8038 Fix Op profiler NaN/Inf triggering + add tests (#93) Signed-off-by: AlexDBlack <blacka101@gmail.com> * createUninitializedDetached refactoring. (#94) * wip * update interface, add null implementations. * Breaking one test in a weird way. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * createUninitializedDetached refactored. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * cuda build fix for issues introduced by recent refactoring Signed-off-by: raver119 <raver119@gmail.com> * initial commit Signed-off-by: raver119 <raver119@gmail.com> * deps tweaks Signed-off-by: raver119 <raver119@gmail.com> * initial prototype Signed-off-by: raver119 <raver119@gmail.com> * modules reorganized Signed-off-by: raver119 <raver119@gmail.com> * gprc module moved to nd4j-remote as well Signed-off-by: raver119 <raver119@gmail.com> * gprc module moved to nd4j-remote as well Signed-off-by: raver119 <raver119@gmail.com> * serving prototype Signed-off-by: raver119 <raver119@gmail.com> * serving prototype Signed-off-by: raver119 <raver119@gmail.com> * serving prototype Signed-off-by: raver119 <raver119@gmail.com> * serving prototype Signed-off-by: raver119 <raver119@gmail.com> * [WIP] More of CUDA (#95) * initial commit Signed-off-by: raver119 <raver119@gmail.com> * Implementation of hashcode cuda helper. Working edition. * Fixed parallel test input arangements. * Fixed tests for hashcode op. * Fixed shape calculation for image:crop_and_resize op and test. * NativeOps tests. Initial test suite. * Added tests for indexReduce methods. * Added test on execBroadcast with NDArray as dimensions. * Added test on execBroadcastBool with NDArray as dimensions. * Added tests on execPairwiseTransform and execPairwiseTransofrmBool. * Added tests for execReduce with scalar results. * Added reduce tests for non-empty dims array. * Added tests for reduce3. * Added tests for execScalar. * Added tests for execSummaryStats. * - provide cpu/cuda code for batch_to_space - testing it Signed-off-by: Yurii <yurii@skymind.io> * - remove old test for batch_to_space (had wrong format and numbers were not checked) Signed-off-by: Yurii <yurii@skymind.io> * Fixed complilation errors with test. * Added test for execTransformFloat. * Added test for execTransformSame. * Added test for execTransformBool. * Added test for execTransformStrict. * Added tests for execScalar/execScalarBool with TADs. * Added test for flatten. * - provide cpu/cuda code for space_to_Batch operaion Signed-off-by: Yurii <yurii@skymind.io> * Added test for concat. * comment unnecessary stuff in s_t_b Signed-off-by: Yurii <yurii@skymind.io> * Added test for specialConcat. * Added tests for memcpy/set routines. * Fixed pullRow cuda test. * Added pullRow test. * Added average test. * - correct typo in NDArray::applyPairwiseTransform(nd4j::pairwise::BoolOps op...) Signed-off-by: Yurii <yurii@skymind.io> * - debugging and fixing cuda tests in JavaInteropTests file Signed-off-by: Yurii <yurii@skymind.io> * - correct some tests Signed-off-by: Yurii <yurii@skymind.io> * Added test for shuffle. * Fixed ops declarations. * Restored omp and added shuffle test. * Added convertTypes test. * Added tests for execRandom. Eliminated usage of RandomBuffer with NativeOps. * Added sort tests. * Added tests for execCustomOp. * - further debuging and fixing tests terminated with crash Signed-off-by: Yurii <yurii@skymind.io> * Added tests for calculateOutputShapes. * Addded Benchmarks test. * Commented benchmark tests. * change assertion Signed-off-by: raver119 <raver119@gmail.com> * Added tests for apply_sgd op. Added cpu helper for that op. * Implement cuda helper for aplly_sgd op. Fixed tests for NativeOps. * Added test for assign broadcastable. * Added tests for assign_bp op. * Added tests for axpy op. * - assign/execScalar/execTransformAny signature change - minor test fix Signed-off-by: raver119 <raver119@gmail.com> * Fixed axpy op. * meh Signed-off-by: raver119 <raver119@gmail.com> * - fix tests for nativeOps::concat Signed-off-by: Yurii <yurii@skymind.io> * sequential transform/scalar Signed-off-by: raver119 <raver119@gmail.com> * allow nested parallelism Signed-off-by: raver119 <raver119@gmail.com> * assign_bp leak fix Signed-off-by: raver119 <raver119@gmail.com> * block setRNG fix Signed-off-by: raver119 <raver119@gmail.com> * enable parallelism by default Signed-off-by: raver119 <raver119@gmail.com> * enable nested parallelism by default Signed-off-by: raver119 <raver119@gmail.com> * Added cuda implementation for row_count helper. * Added implementation for tnse gains op helper. * - take into account possible situations when input arrays are empty in reduce_ cuda stuff Signed-off-by: Yurii <yurii@skymind.io> * Implemented tsne/edge_forces op cuda-based helper. Parallelized cpu-based helper for edge_forces. * Added kernel for tsne/symmetrized op heleper. * Implementation of tsne/symmetrized op cuda helper. Working edition. * Eliminated waste printfs. * Added test for broadcastgradientargs op. * host-only fallback for empty reduce float Signed-off-by: raver119 <raver119@gmail.com> * - some tests fixes Signed-off-by: Yurii <yurii@skymind.io> * - correct the rest of reduce_ stuff Signed-off-by: Yurii <yurii@skymind.io> * - further correction of reduce_ stuff Signed-off-by: Yurii <yurii@skymind.io> * Added test for Cbow op. Also added cuda implementation for cbow helpers. * - improve code of stack operation for scalar case Signed-off-by: Yurii <yurii@skymind.io> * - provide cuda kernel for gatherND operation Signed-off-by: Yurii <yurii@skymind.io> * Implementation of cbow helpers with cuda kernels. * minor tests tweaks Signed-off-by: raver119 <raver119@gmail.com> * minor tests tweaks Signed-off-by: raver119 <raver119@gmail.com> * - further correction of cuda stuff Signed-off-by: Yurii <yurii@skymind.io> * Implementatation of cbow op helper with cuda kernels. Working edition. * Skip random testing for cudablas case. * lstmBlockCell context fix Signed-off-by: raver119 <raver119@gmail.com> * Added tests for ELU and ELU_BP ops. * Added tests for eq_scalar, gt_scalar, gte_scalar and lte_scalar ops. * Added tests for neq_scalar. * Added test for noop. * - further work on clipbynorm_bp Signed-off-by: Yurii <yurii@skymind.io> * - get rid of concat op call, use instead direct concat helper call Signed-off-by: Yurii <yurii@skymind.io> * lstmBlockCell context fix Signed-off-by: raver119 <raver119@gmail.com> * Added tests for lrelu and lrelu_bp. * Added tests for selu and selu_bp. * Fixed lrelu derivative helpers. * - some corrections in lstm Signed-off-by: Yurii <yurii@skymind.io> * operator * result shape fix Signed-off-by: raver119 <raver119@gmail.com> * - correct typo in lstmCell Signed-off-by: Yurii <yurii@skymind.io> * few tests fixed Signed-off-by: raver119 <raver119@gmail.com> * CUDA inverse broadcast bool fix Signed-off-by: raver119 <raver119@gmail.com> * disable MMAP test for CUDA Signed-off-by: raver119 <raver119@gmail.com> * BooleanOp syncToDevice Signed-off-by: raver119 <raver119@gmail.com> * meh Signed-off-by: raver119 <raver119@gmail.com> * additional data types for im2col/col2im Signed-off-by: raver119 <raver119@gmail.com> * Added test for firas_sparse op. * one more RandomBuffer test excluded Signed-off-by: raver119 <raver119@gmail.com> * Added tests for flatten op. * Added test for Floor op. * bunch of tests fixed Signed-off-by: raver119 <raver119@gmail.com> * mmulDot tests fixed Signed-off-by: raver119 <raver119@gmail.com> * more tests fixed Signed-off-by: raver119 <raver119@gmail.com> * Implemented floordiv_bp op and tests. * Fixed scalar case with cuda implementation for bds. * - work on cuda kernel for clip_by_norm backprop op is completed Signed-off-by: Yurii <yurii@skymind.io> * Eliminate cbow crach. * more tests fixed Signed-off-by: raver119 <raver119@gmail.com> * more tests fixed Signed-off-by: raver119 <raver119@gmail.com> * Eliminated abortion with batched nlp test. * more tests fixed Signed-off-by: raver119 <raver119@gmail.com> * Fixed shared flag initializing. * disabled bunch of cpu workspaces tests Signed-off-by: raver119 <raver119@gmail.com> * scalar operators fix: missing registerSpecialUse call Signed-off-by: raver119 <raver119@gmail.com> * Fixed logdet for cuda and tests. * - correct clipBynorm_bp Signed-off-by: Yurii <yurii@skymind.io> * Fixed crop_and_resize shape datatype. * - correct some mmul tests Signed-off-by: Yurii <yurii@skymind.io> * build fix Signed-off-by: raver119 <raver119@gmail.com> * exclude two methods for JNI Signed-off-by: raver119 <raver119@gmail.com> * exclude two methods for JNI Signed-off-by: raver119 <raver119@gmail.com> * exclude two methods for JNI (#97) Signed-off-by: raver119 <raver119@gmail.com> * temporary stack fix Signed-off-by: raver119 <raver119@gmail.com> * downgrade jetty to latest stable version Signed-off-by: raver119 <raver119@gmail.com> * test and profiles Signed-off-by: raver119 <raver119@gmail.com> * Servlet skeleton * one test case Signed-off-by: raver119 <raver119@gmail.com> * one test case Signed-off-by: raver119 <raver119@gmail.com> * compilation fix Signed-off-by: raver119 <raver119@gmail.com> * draft improvements Signed-off-by: raver119 <raver119@gmail.com> * draft improvements Signed-off-by: raver119 <raver119@gmail.com> * proof of concept works Signed-off-by: raver119 <raver119@gmail.com> * proof of concept works Signed-off-by: raver119 <raver119@gmail.com> * Servlet Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * logging + simple timing Signed-off-by: raver119 <raver119@gmail.com> * Content type fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Profile required Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Servlet tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Post test Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests added: Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Minor tweaks Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Constants used Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Check content type Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Some tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Errors checking Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Constraints and tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Minor tweaks Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Dl4j servlet skeleton Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Moving class to dl4j Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Builder extended Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * initial dl4j commit Signed-off-by: raver119 <raver119@gmail.com> * unirest version change Signed-off-by: raver119 <raver119@gmail.com> * temp fallback Signed-off-by: raver119 <raver119@gmail.com> * Reverted unirest version Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Reverted unirest version Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * revert back unirest version change Signed-off-by: raver119 <raver119@gmail.com> * revert unirest change Signed-off-by: raver119 <raver119@gmail.com> * some additional checks in builder Signed-off-by: raver119 <raver119@gmail.com> * few more fields Signed-off-by: raver119 <raver119@gmail.com> * Test added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * lombok Signed-off-by: raver119 <raver119@gmail.com> * Tests added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * deps Signed-off-by: raver119 <raver119@gmail.com> * profiles re-introduced Signed-off-by: raver119 <raver119@gmail.com> * Added tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Model servlet Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * builders Signed-off-by: raver119 <raver119@gmail.com> * builders Signed-off-by: raver119 <raver119@gmail.com> * Servlet skeleton Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Servlet tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * builders Signed-off-by: raver119 <raver119@gmail.com> * get rid of old class Signed-off-by: raver119 <raver119@gmail.com> * use PI for inference Signed-off-by: raver119 <raver119@gmail.com> * superbuilder Signed-off-by: raver119 <raver119@gmail.com> * get back builder Signed-off-by: raver119 <raver119@gmail.com> * Servlet builder Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * PI setup Signed-off-by: raver119 <raver119@gmail.com> * get rid of superbuilder Signed-off-by: raver119 <raver119@gmail.com> * SameDiffServlet inheritance constructor Signed-off-by: raver119 <raver119@gmail.com> * dl4jservlet attached to samediffservlet Signed-off-by: raver119 <raver119@gmail.com> * builder types fix Signed-off-by: raver119 <raver119@gmail.com> * dummy model Signed-off-by: raver119 <raver119@gmail.com> * single out Signed-off-by: raver119 <raver119@gmail.com> * loss Signed-off-by: raver119 <raver119@gmail.com> * Tests added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * missed builder type Signed-off-by: raver119 <raver119@gmail.com> * working serving example Signed-off-by: raver119 <raver119@gmail.com> * sd model fix Signed-off-by: raver119 <raver119@gmail.com> * fix unirest version Signed-off-by: raver119 <raver119@gmail.com> * More tests Signed-off-by: AlexDBlack <blacka101@gmail.com> * Tests added: Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Minor tests fixes Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Build fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Ser/deser added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * one more unirest fix Signed-off-by: raver119 <raver119@gmail.com> * Custom serializers Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests disabled Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * revert back unirest version change Signed-off-by: raver119 <raver119@gmail.com> * update Signed-off-by: raver119 <raver119@gmail.com> * some default fields values Signed-off-by: raver119 <raver119@gmail.com> * some comments/javadoc Signed-off-by: raver119 <raver119@gmail.com> * - move serde impls to client module - get rid of INDArray serde for now Signed-off-by: raver119 <raver119@gmail.com> * jackson-based serde for float[], double[] and String Signed-off-by: raver119 <raver119@gmail.com> * more of basic ser/de + tests Signed-off-by: raver119 <raver119@gmail.com> * minor api changes Signed-off-by: raver119 <raver119@gmail.com> * change imports/signatures Signed-off-by: raver119 <raver119@gmail.com> * Optional parralel inference Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Insert pause between tests as workaround for unavailable port issue Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * few unused imports removed Signed-off-by: raver119 <raver119@gmail.com> * Models usage Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Models usage Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * - InputAdapter + OutputAdapter = InferenceAdapter - JsonModelServer now allows separate configuration of InputAdapter and OutputAdapter Signed-off-by: raver119 <raver119@gmail.com> * unused import Signed-off-by: raver119 <raver119@gmail.com> * input adapter.. Signed-off-by: raver119 <raver119@gmail.com> * minor signature change Signed-off-by: raver119 <raver119@gmail.com> * few more signatures updated Signed-off-by: raver119 <raver119@gmail.com> * input/output adapter Signed-off-by: raver119 <raver119@gmail.com> * Tests added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * javadocs added Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * minor polishing Signed-off-by: raver119 <raver119@gmail.com> * more of javadoc Signed-off-by: raver119 <raver119@gmail.com> * signature change Signed-off-by: raver119 <raver119@gmail.com>	2019-08-14 12:11:09 +03:00

1 2 3 4 5

205 Commits (ddf70ac450cb4a108fa7a0889d710ac743487d7a)