cavis

Commit Graph

Author	SHA1	Message	Date
Alex Black	da1944e8e1	SameDiff TF import (#49 ) * Added implementation files for image_resize and resize_bicubic ops. * Image resize and image.resize_bicubic ops implementation. Initial revision. * Minor fix * Some TF imports disabled. * Finished with infrastructure development for image.resize_bilinear op and image_resizo op implementation. * Refactored resize methods. * Added processing for Mitchelcubic algorithm. * adjust_contrast * Small fix for TF import expected value loading when variable name starts with the test name Signed-off-by: AlexDBlack <blacka101@gmail.com> * Tests * Tests added. * Removed tf names absent in mapping. * Some fixes. * Small fixes * Minor change * Some failing tests. * Disable failed test * Ignore some tests * Fix import class mapping Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix float property mapping (flatbuffers) Signed-off-by: AlexDBlack <blacka101@gmail.com> * Override equality function for model 'dropout' Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fail tests * Failed tests ignored temporarily. * Minor fixes * Small fix * Conflict resolved * Default implementations of tensorflowName and onnxName	2019-11-19 22:44:29 +11:00
raver119	ce2ef20f96	additional reverse signatures Signed-off-by: raver119 <raver119@gmail.com>	2019-11-19 13:54:07 +03:00
raver119	db7ca956c5	[WIP] Mish (#55 ) * Mish activation function and its derivative Signed-off-by: raver119 <raver119@gmail.com> * signature fix Signed-off-by: raver119 <raver119@gmail.com> * mish as activation for dl4j Signed-off-by: raver119 <raver119@gmail.com> * javadoc Signed-off-by: raver119 <raver119@gmail.com> * minor optimization Signed-off-by: raver119 <raver119@gmail.com>	2019-11-18 13:21:26 +03:00
raver119	c5cbdcd8f4	[WIP] clang for jcpp (#53 ) * clang as compiler for jcpp Signed-off-by: raver119@gmail.com <raver119@gmail.com> * we don't need macos profile Signed-off-by: raver119 <raver119@gmail.com>	2019-11-17 09:45:30 +03:00
Alex Black	09a827fb6d	Fixes and pre-release QA (#51 ) * #8395 Keras import - support scaled identity weight init Signed-off-by: AlexDBlack <blacka101@gmail.com> * More Keras scaled weight init fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8352 Deprecate duplicate SamplingDataSetIterator class Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove /O2 optimization for faster CUDA build Signed-off-by: AlexDBlack <blacka101@gmail.com> * Tweak regression test precision for CUDA Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix edge cases for buffer creation Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update MKLDNN validation tests to new helper enable/disable settings Signed-off-by: AlexDBlack <blacka101@gmail.com> * Delete debugging class Signed-off-by: AlexDBlack <blacka101@gmail.com> * MKLDNN test - add proper skip for CUDA backend Signed-off-by: AlexDBlack <blacka101@gmail.com> * Align WeightInitUtil with weight init classes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix for SameDiff test layers weight init when using IWeightInit classes Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-16 17:04:29 +11:00
raver119	1780dcc883	[WIP] Small fixes here and there (#50 ) * one range test Signed-off-by: raver119 <raver119@gmail.com> * few Context convenience singatures Signed-off-by: raver119 <raver119@gmail.com> * one more range test Signed-off-by: raver119 <raver119@gmail.com> * "range" "fix" Signed-off-by: raver119 <raver119@gmail.com> * adjuct_contrast_v2 now allows scale factor to be provided via input_variable Signed-off-by: raver119 <raver119@gmail.com> * adjust_contrast now allows scale factor as variable too Signed-off-by: raver119 <raver119@gmail.com> * bitcast shape tests Signed-off-by: raver119 <raver119@gmail.com> * BitCast import dtype added Signed-off-by: raver119 <raver119@gmail.com> * few more BitCast signatures Signed-off-by: raver119 <raver119@gmail.com>	2019-11-15 17:04:29 +03:00
raver119	c5b912bddf	few changes for openblas and jcpp preloads (on macos) (#46 ) Signed-off-by: raver119 <raver119@gmail.com>	2019-11-14 19:50:24 +03:00
raver119	1eb3de90d7	[WIP] Platform helpers switches (#44 ) * - platform helpers can be disabled on per-op basis now via Context::allowHelpers - java has access to it as well Signed-off-by: raver119 <raver119@gmail.com> * global platform-helpers trigger Signed-off-by: raver119 <raver119@gmail.com> * few signatures renamed Signed-off-by: raver119 <raver119@gmail.com> * - few new env variables to follow - maxThreads/masterThreads differentiation Signed-off-by: raver119 <raver119@gmail.com> * Javadoc update Signed-off-by: raver119 <raver119@gmail.com>	2019-11-14 14:35:02 +03:00
Alex Black	47d19908f4	Various fixes (#43 ) * #8172 Enable DL4J MKLDNN batch norm backward pass Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8382 INDArray.toString() rank 1 brackets / ambiguity fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8308 Fix handful of broken links (inc. some in errors) Signed-off-by: AlexDBlack <blacka101@gmail.com> * Unused dependencies, round 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Unused dependencies, round 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Unused dependencies, round 3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Uniform distribution TF import fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-14 19:38:20 +11:00
raver119	48df1acdfb	[WIP] ThreadPool (#8 ) This PR removes OpenMP use in 95% of cases	2019-11-13 17:04:59 +03:00
Alex Black	1d96bb9e6e	SameDiff op runtime benchmarking listener (#42 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-12 22:51:09 +11:00
Alex Black	18c01f5bdc	Add SameDiff memory reuse memory manager (array cache) (#39 ) * Attention op comments Signed-off-by: AlexDBlack <blacka101@gmail.com> * ArrayCacheMemoryMgr - first pass Signed-off-by: AlexDBlack <blacka101@gmail.com> * Tweak array cache for use with SameDiff identity arrays Signed-off-by: AlexDBlack <blacka101@gmail.com> * ArrayCacheMemoryMgr javadoc and properly get max memory Signed-off-by: AlexDBlack <blacka101@gmail.com> * LRU cache policy + add tests Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Resize arrays internally if required for ArrayCacheMemoryMgr Signed-off-by: AlexDBlack <blacka101@gmail.com> * Test improvement Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small polish Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-12 21:15:44 +11:00
AlexDBlack	0107fb10ab	Merge remote-tracking branch 'konduit/master'	2019-11-08 18:11:45 +11:00
Alex Black	2f84ea666d	Uniform distribution op tweaks + 'specified output dtype' constructor (#38 ) * Uniform distribution op tweaks + 'specified output dtype' constructor Signed-off-by: AlexDBlack <blacka101@gmail.com> * Validation tweak Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-08 18:08:25 +11:00
Alex Black	24980efde3	Fix LogSumExp along dimension (#35 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-07 23:36:15 +11:00
Samuel Audet	73b5a508fc	Update dependencies to just released JavaCPP and JavaCV 1.5.2 Signed-off-by: Samuel Audet <samuel.audet@gmail.com>	2019-11-07 17:57:34 +09:00
longzhendong	52c9918c6f	Testing slice and concat (#8362 )	2019-11-07 14:47:37 +11:00
Alex Black	df8b4e607a	SameDiff: make use of DeviceLocal configurable (#32 ) * #8340 make DeviceLocal configurable Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J SameDiff layers: use SingleThreadArrayHolder to avoid assigns + DeviceLocalNDArray overhead Signed-off-by: AlexDBlack <blacka101@gmail.com> * Javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-06 18:52:41 +11:00
AlexDBlack	7583ccfa15	Merge Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-06 13:28:03 +11:00
Alex Black	948ebef41c	Op Fixes (#28 ) * #8280 biasadd_bp nchw arg fixes (java side) + test Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8285 Concat op Java side fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Concat op cpp fix - allow dynamic axis to be negative, same as static axis Signed-off-by: AlexDBlack <blacka101@gmail.com> * ignores for deconv3d import tests until deconv3d_tf op is implemented Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-05 00:05:04 +11:00
Alex Black	4763547c9e	Add Deconv3DTF (#25 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-04 12:42:11 +11:00
Alex Black	5e312374d0	TF deconv3d import (#8341 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-02 22:57:24 +11:00
AlexDBlack	2844f8b69a	Merge remote-tracking branch 'konduit/master'	2019-11-02 19:00:47 +11:00
Alex Black	9efd811508	Use DL4J workspaces for SameDiff layers in MLN/CG (#23 ) * #8329 DL4J workspace integration for SameDiff layers Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix bug for Nd4j.createUninitializedDetached for scalars (length 0 shape array) Signed-off-by: AlexDBlack <blacka101@gmail.com> * SameDiff output layer, graph vertex, various fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-02 17:42:01 +11:00
Alex Black	d82877b18b	Various SameDiff fixes (#21 ) * MKLDNN LSTM forward implementation (disabled pending #8331) Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8318 add SameDiff.calculateGradientsAndOutputs Signed-off-by: AlexDBlack <blacka101@gmail.com> * Disable mkldnn backprop for now - pending fix, issue #8335 Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8337 Fix CudaExecutioner unnecessary result array allocation/replacement Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small FlatBuffers serde fix, UInt8 Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8135 ImagePreProcessingScaler - add segmentation support Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8319 Ensure listeners are called when they are supposed to be called Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8214 UNet (non-pretrained) last conv layer kernal size fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-11-02 11:25:53 +11:00
Alexander Stoyakin	b816845797	Fixing nd4j-cuda build (#20 ) * Roll back recent fix to restore build. * Fix compilation. * presets updated Signed-off-by: raver119 <raver119@gmail.com>	2019-11-01 15:59:29 +02:00
Alexander Stoyakin	45a40c8a89	DL4J/ND4J: Do pass on integer casts (#15 ) * Int cast fixes. * Revert "Int cast fixes." This reverts commit aa36e8ca * Int casts * Int cast * Int casts * Get rid of int casts. Dropping deprecated aggregate ops. * java scatterUpdate changes Signed-off-by: raver119 <raver119@gmail.com> * c++ scatterUpdate changes Signed-off-by: raver119 <raver119@gmail.com> * Remove aggregated ops. * Restored test * Tests restored. * Minor fixes	2019-10-31 11:23:09 +02:00
raver119	5a4d2e8b31	[WIP] SVD (#16 ) * - new SVD constructor - OrthogonalDistribution now uses SVD custom op Signed-off-by: raver119 <raver119@gmail.com> * shapes fixed Signed-off-by: raver119 <raver119@gmail.com>	2019-10-28 12:31:01 +03:00
Yurii Shyrma	029a69a835	Shyrma bn mkl bp (#14 ) * - write code for new batchnorm backprop Signed-off-by: Yurii <iuriish@yahoo.com> * - testing batchnorm backprop Signed-off-by: Yurii <iuriish@yahoo.com> * - write code for batchnorm backprop based on mkl dnn api Signed-off-by: Yurii <iuriish@yahoo.com> * - testing and fixing bugs in batchnorm_bp mkl dnn Signed-off-by: Yurii <iuriish@yahoo.com> * - made corrections required by reviewer Signed-off-by: Yurii <iuriish@yahoo.com> * - change name in java wrapper for batchnorm op Signed-off-by: Yurii <iuriish@yahoo.com>	2019-10-26 14:14:21 +03:00
Alex Black	d333d29099	SameDiff cleanup and fixes (#12 ) * #8160 Remove resolvePrepertiesFromSameDiffBeforeExecution Signed-off-by: AlexDBlack <blacka101@gmail.com> * SameDiff API cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * More SameDiff cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8248 Switch SameDiff variable init from lazy to creation time for more predictable behaviour Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8252 TanhDerivative javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8225 Deconvolution2D input validation Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8265 Switch SameDiff.outputs() to user settable, instead of unreliable 'best guess' Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8224 SameDiff.zero and .one create constants, not variables Signed-off-by: AlexDBlack <blacka101@gmail.com> * More cleanup and fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J SameDiff fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Re-add hack for Deconvolution2DLayer until #8315 is resolved Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8270 Move CUDA device/version logging to Java; can be disabled via existing org.nd4j.log.initialization system property Signed-off-by: AlexDBlack <blacka101@gmail.com> * All ND4J init logging checks system property Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small tweak Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove redundant device logging Signed-off-by: AlexDBlack <blacka101@gmail.com> * One more fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * UX improvements Signed-off-by: AlexDBlack <blacka101@gmail.com> * Deconv fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add deconv tests Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove debug code Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-10-26 12:38:08 +11:00
Alex Black	730442ae21	Remove bad import (#13 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-10-24 20:51:15 +11:00
Alex Black	3f0b4a2d4c	SameDiff execution, TF and memory management overhaul (#10 ) * SameDiff execution memory management improvements, round 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Round 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Round 3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Clear node outputs closed array references; Slight change to OpValidation internals to not rely on cached op outputs Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next step Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * More polish Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add WeakIdentityHashmap Signed-off-by: AlexDBlack <blacka101@gmail.com> * Session fixes for control ops and next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * First steps for training session + in-line updating Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix losses and history during training Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * BiasAdd and other fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Don't use SDVariable.getArr() in TFGraphTestAllHelper (import tests) Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * First steps for new dependency tracking approach Signed-off-by: AlexDBlack <blacka101@gmail.com> * Start integrating dependency tracking for memory management Signed-off-by: AlexDBlack <blacka101@gmail.com> * Non-control op dependency tracking works/passes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Switch/merge Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup and next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix issue dependency tracking for initial variables/constants Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add check for aliases when determining if safe to close array Signed-off-by: AlexDBlack <blacka101@gmail.com> * First pass on new TF graph import class Signed-off-by: AlexDBlack <blacka101@gmail.com> * Import fixes, op fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup and fixes for new TF import mapper Signed-off-by: AlexDBlack <blacka101@gmail.com> * More cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Partial implementation of new dependency tracker Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * AbstractDependencyTracker for shared code Signed-off-by: AlexDBlack <blacka101@gmail.com> * Overhaul SameDiff graph execution (dependency tracking) Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes, cleanup, next steps Signed-off-by: AlexDBlack <blacka101@gmail.com> * Ad no-op memory manager, cleanup, fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix switch dependency tracking Signed-off-by: AlexDBlack <blacka101@gmail.com> * INDArray.toString: no exception on closed arrays, just note closed Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix enter and exit dependency tracking Signed-off-by: AlexDBlack <blacka101@gmail.com> * TensorArray memory management fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add unique ID for INDArray instances Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix memory management for NextIteration outputs in multi-iteration loops Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove (now unnecessary) special case handling for nested enters Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Handle control dependencies during execution; javadoc for memory managers Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup, polish, code comments, javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup and more javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add memory validation for all TF import tests - ensure all arrays (except outputs) are released Signed-off-by: AlexDBlack <blacka101@gmail.com> * Clean up arrays waiting on unexecuted ops at the end of execution Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fixes for enter op memory managent in the context of multiple non-nested loops/frames Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix order of operation issues for dependency tracker Signed-off-by: AlexDBlack <blacka101@gmail.com> * Always clear op fields after execution to avoid leaks or unintended array reuse Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Re-implement dtype conversion Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix for control dependencies execution (dependency tracking) Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix TF import overrides and filtering Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix for constant enter array dependency tracking Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J Fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * More DL4J fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup and polish Signed-off-by: AlexDBlack <blacka101@gmail.com> * More polish and javadoc Signed-off-by: AlexDBlack <blacka101@gmail.com> * More logging level tweaks, small DL4J fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix to DL4J SameDiffLayer Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix empty array deserialization, add extra deserialization checks Signed-off-by: AlexDBlack <blacka101@gmail.com> * FlatBuffers control dep serialization fixes; test serialization as part of all TF import tests Signed-off-by: AlexDBlack <blacka101@gmail.com> * Variable control dependencies serialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix issue with removing inputs for ops Signed-off-by: AlexDBlack <blacka101@gmail.com> * FlatBuffers NDArray deserialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * FlatBuffers NDArray deserialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Final cleanup/polish Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-10-23 21:19:50 +11:00
Alexander Stoyakin	f31661e13b	Merge pull request #7 from KonduitAI/asto_nd4s_10172019 KDTree optimization	2019-10-23 12:11:25 +03:00
Alexander Stoyakin	9e5799847a	TF names fixed.	2019-10-16 19:50:18 +03:00
Alexander Stoyakin	502bedf5d5	Register ops for TF import.	2019-10-16 19:39:04 +03:00
Alexander Stoyakin	ec722b20ee	TF names added	2019-10-16 19:29:19 +03:00
Alexander Stoyakin	99d77e1384	Ops exported for sameDiff	2019-10-16 19:16:47 +03:00
Alexander Stoyakin	d5002b14c7	New ops wrappers	2019-10-16 12:59:08 +03:00
Alex Black	b9a4b0f25f	Update links (#8292 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-10-16 12:59:52 +11:00
Robert Altena	50b13fadc8	nd4j-api cleanup. (#8273 ) * nd4j-api cleanup. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * restore deleted schemes. Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-10-08 21:48:22 +11:00
Robert Altena	1f4ad08305	refactoring activations. (#8261 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-10-03 20:35:27 +10:00
Alex Black	f98f8be7b6	SameDiff ops (#8247 ) * update javadocs and a few method signatures Signed-off-by: Ryan Nett <rnett@skymind.io> * add PRelu op Signed-off-by: Ryan Nett <rnett@skymind.io> * test and fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * add PRelu op Signed-off-by: Ryan Nett <rnett@skymind.io> * test and fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * slightly better test Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-19 11:52:20 +10:00
Steven Lang	d58a4b45b1	Fix Nadam updater clone missing schedule (#8243 ) Signed-off-by: Steven Lang <steven.lang.mz@gmail.com>	2019-09-17 22:56:49 +03:00
Robert Altena	83d958d536	Sparse matrix refactoring. (#8238 ) * remove sparse method from INDArray. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove gemm Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove useage of n4j.sparseFactory Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Nd4j.sparseFactory removed. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * sparseNDArray deleted. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * iremove more sparse calls and constants. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove SparseBlasWrapper. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * delete BaseSparseBlaswrapper. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove 3 sparse factory classes. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * delete SparseCPULevel. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * deletes JcusparseLevel, CUDASparselevel. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * delete nativeCPU sparse classes. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * removes sparse methods from NDArrayFactory. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * more deletes. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * delete (ignored) tests. BaseSparseNDArray. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * deletes ISparseNDArray. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove sparse methods from indArray. Signed-off-by: Robert Altena <Rob@Ra-ai.com> * deletes sparse classes. Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-17 22:56:29 +03:00
raver119	979ef13c0b	fix build issues Signed-off-by: raver119 <raver119@gmail.com>	2019-09-13 11:55:13 +03:00
raver119	2bd69c004c	[WIP] Fixed signatures. SameDiff tests (#258 ) (#8233 ) * Fixed signatures. SameDiff tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Tests fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Test fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Small fix Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Fixed test Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com>	2019-09-12 19:25:03 +03:00
AlexDBlack	a66e03355e	Merge remote-tracking branch 'fork/master'	2019-09-12 12:20:57 +10:00
raver119	07901ceb69	few more mkldnn dependencies removed Signed-off-by: raver119 <raver119@gmail.com>	2019-09-12 04:55:59 +03:00
raver119	98e2814879	Platform helpers (#8216 ) * platform helpers draft Signed-off-by: raver119 <raver119@gmail.com> * typo Signed-off-by: raver119 <raver119@gmail.com> * disable platform cmake Signed-off-by: raver119 <raver119@gmail.com> * another draft Signed-off-by: raver119 <raver119@gmail.com> * mkldnn convolution refactored Signed-off-by: raver119 <raver119@gmail.com> * minor tweaks Signed-off-by: raver119 <raver119@gmail.com> * one more safety check Signed-off-by: raver119 <raver119@gmail.com> * prototype works Signed-off-by: raver119 <raver119@gmail.com> * meh Signed-off-by: raver119 <raver119@gmail.com> * force static library mode for mkldnn Signed-off-by: raver119 <raver119@gmail.com> * - ismax fix - experimental arg fix - don't enforce openblas on Apple hardware Signed-off-by: raver119 <raver119@gmail.com> * bunch of small fixes Signed-off-by: raver119@gmail.com <raver119@gmail.com> * declare concurrent Signed-off-by: raver119@gmail.com <raver119@gmail.com> * - MKLDNN version upgrade to 1.0.2 - avgpool2d/maxpool2d APIs update Signed-off-by: raver119 <raver119@gmail.com> * - avgpool2d_bp/maxpool2d_bp APIs update Signed-off-by: raver119 <raver119@gmail.com> * - conv2d/batchnorm APIs update Signed-off-by: raver119 <raver119@gmail.com> * - lrn/conv2d_bp/conv3d/conv3d_bp APIs update Signed-off-by: raver119 <raver119@gmail.com> * all ops converted to MKLDNN 1.x Signed-off-by: raver119 <raver119@gmail.com> * bunch of tweaks Signed-off-by: raver119 <raver119@gmail.com> * namespace for platform helpers Signed-off-by: raver119 <raver119@gmail.com> * make sure platform helpers aren't opimized out Signed-off-by: raver119 <raver119@gmail.com> * build cpu_features on x86 systems Signed-off-by: raver119 <raver119@gmail.com> * build cpu_features on x86 systems Signed-off-by: raver119 <raver119@gmail.com> * more of cpu_features Signed-off-by: raver119 <raver119@gmail.com> * - mkldnn removed from java - cpu_features checks in CpuNDArrayFactory Signed-off-by: raver119 <raver119@gmail.com> * F16C definition renamed Signed-off-by: raver119 <raver119@gmail.com> * some mkldnn rearrangements Signed-off-by: raver119 <raver119@gmail.com> * check supported instructions before doing anything Signed-off-by: raver119 <raver119@gmail.com> * typo Signed-off-by: raver119 <raver119@gmail.com> * missied impl Signed-off-by: raver119 <raver119@gmail.com> * BUILD_PIC option Signed-off-by: raver119 <raver119@gmail.com> * conv2d fix Signed-off-by: raver119 <raver119@gmail.com> * avgpool3d fix Signed-off-by: raver119 <raver119@gmail.com> * avgpool3d_bp fix Signed-off-by: raver119 <raver119@gmail.com> * avgpool2d_bp leak fix Signed-off-by: raver119 <raver119@gmail.com> * avgpool3d_bp leak fix Signed-off-by: raver119 <raver119@gmail.com> * maxpool bp leaks fixed Signed-off-by: raver119 <raver119@gmail.com> * printf removed Signed-off-by: raver119 <raver119@gmail.com> * batchnorm fix Signed-off-by: raver119 <raver119@gmail.com> * AVX warning/error polishing Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * More polish Signed-off-by: AlexDBlack <blacka101@gmail.com> * Polish Signed-off-by: AlexDBlack <blacka101@gmail.com> * remove previous MKL-DNN support layer Signed-off-by: raver119 <raver119@gmail.com> * avx2 tweak Signed-off-by: raver119 <raver119@gmail.com> * allow static for apple Signed-off-by: raver119@gmail.com <raver119@gmail.com> * exclude mkldnn in one more place Signed-off-by: raver119 <raver119@gmail.com> * exclude mkldnn in one more place Signed-off-by: raver119 <raver119@gmail.com> * restore OPENBLAS_PATH use Signed-off-by: raver119 <raver119@gmail.com> * add runtime check for avx/avx2 support Signed-off-by: raver119 <raver119@gmail.com> * convolution_auto Signed-off-by: raver119 <raver119@gmail.com> * Add logic for helper argument * minor test fix Signed-off-by: raver119 <raver119@gmail.com> * few tweaks Signed-off-by: raver119 <raver119@gmail.com> * few tweaks Signed-off-by: raver119 <raver119@gmail.com> * skip OpTracker props for non-x86 builds Signed-off-by: raver119 <raver119@gmail.com> * linux arm isn't x86 :) Signed-off-by: raver119 <raver119@gmail.com> * avx-512 Signed-off-by: raver119 <raver119@gmail.com> * CUDA presets fix Signed-off-by: raver119 <raver119@gmail.com> * BUILD_PIC Signed-off-by: raver119 <raver119@gmail.com> * prefetchw for avx2 Signed-off-by: raver119 <raver119@gmail.com> * BUILD_PIC again Signed-off-by: raver119 <raver119@gmail.com>	2019-09-11 21:50:28 +03:00
Alex Black	3e73e9b56e	Fixes, cleanup, enable now fixed tests, etc (#254 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-11 23:37:24 +10:00
Ryan Nett	8a05ec2a97	Fix a couple SameDiff training issues (#253 ) * fix execBackwards training issue Signed-off-by: Ryan Nett <rnett@skymind.io> * fix validation not specifying outputs Signed-off-by: Ryan Nett <rnett@skymind.io> * another fix for validation listeners and history Signed-off-by: Ryan Nett <rnett@skymind.io> * tests Signed-off-by: Ryan Nett <rnett@skymind.io> * add single batch dataset output methods Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-10 20:38:23 -07:00
Alex Black	f91970734b	Another small fix (#251 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-10 13:14:29 +10:00
Alex Black	3fb9aecb59	Fix for null shape in SameDiff.var validation (#250 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-10 12:22:10 +10:00
Alex Black	b582e69e3b	Small ND4J/SameDiff fixes (#248 ) * #8218 Fix Nd4j.hstack rank 1 case Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8209 SameDiff: don't allow empty arrays (with 0s in shape) for variables Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-09 22:54:07 +10:00
Robert Altena	c99f980513	INDArray javadoc (#246 ) * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * review fixes. Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-09 13:09:31 +10:00
AlexDBlack	a76a44e198	Merge remote-tracking branch 'fork/master'	2019-09-05 22:04:25 +10:00
Alex Black	52d2795193	Another round of small fixes (#241 ) * Small base spark test fix; ROC toString for empty ROC Signed-off-by: Alex Black <blacka101@gmail.com> * More fixes Signed-off-by: Alex Black <blacka101@gmail.com>	2019-09-05 17:01:47 +10:00
Alex Black	87d873929f	Small LapackTest fix (#240 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-05 14:25:20 +10:00
Ryan Nett	79867f5c5a	cleanup SDRNN and rnn ops (#238 ) Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-05 12:25:03 +10:00
Alex Black	7d85775934	Arbiter generic JSON ser/de fixes (#237 ) * Arbiter generic JSON ser/de fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Javadoc fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-05 11:51:11 +10:00
Robert Altena	f25e3e71e5	remove lengthLong (#236 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-05 11:19:38 +10:00
AlexDBlack	b7226bdd7a	Merge Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-05 00:54:11 +10:00
Alex Black	03c52ef9dd	Add SameDiff.bitwise namespace (#232 ) * #8196 add SameDiff.bitwise namespace Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add BitsHammingDistance, add remaining bitwise ops to bitwise namespace Signed-off-by: AlexDBlack <blacka101@gmail.com> * fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-04 22:34:31 +10:00
raver119	a90c7dd995	[WIP] Last set of changes (#234 ) * mmul op instead of cublasSgemm Signed-off-by: raver119 <raver119@gmail.com> * transB Signed-off-by: raver119 <raver119@gmail.com> * jcpp handles Signed-off-by: raver119 <raver119@gmail.com> * bitwise and/or/xor Signed-off-by: raver119 <raver119@gmail.com> * bitwise and/or/xor mapping Signed-off-by: raver119 <raver119@gmail.com> * cuda/cublas version check Signed-off-by: raver119 <raver119@gmail.com> * add expected version Signed-off-by: raver119 <raver119@gmail.com> * cuda/cublas version check in java Signed-off-by: raver119 <raver119@gmail.com> * one more error check Signed-off-by: raver119 <raver119@gmail.com> * build fix Signed-off-by: raver119 <raver119@gmail.com> * build fix Signed-off-by: raver119 <raver119@gmail.com> * build fix Signed-off-by: raver119 <raver119@gmail.com> * one more fix Signed-off-by: raver119 <raver119@gmail.com> * skip CUDA version check for now Signed-off-by: raver119 <raver119@gmail.com> * better wording Signed-off-by: raver119 <raver119@gmail.com> * few more tweaks Signed-off-by: raver119 <raver119@gmail.com> * few more tweaks Signed-off-by: raver119 <raver119@gmail.com>	2019-09-04 14:41:08 +03:00
Ryan Nett	e9454b8882	SDCNN cleanup pass (#230 ) * SDCNN cleanup Signed-off-by: Ryan Nett <rnett@skymind.io> * NonNull annotations Signed-off-by: Ryan Nett <rnett@skymind.io> * better javadoc, NonNull fix for sconv Signed-off-by: Ryan Nett <rnett@skymind.io> * update builders to fix names Signed-off-by: Ryan Nett <rnett@skymind.io> * fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * even more fixes Signed-off-by: Ryan Nett <rnett@skymind.io> * fix for null bias Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-04 00:44:01 -07:00
Alex Black	6cc887bee9	Rename flatbuffers DataType to DType (#228 ) * Rename flatbuffers DataType enum to DType Signed-off-by: Alex Black <blacka101@gmail.com> * Rename flatbuffers DataType enum to DType Signed-off-by: Alex Black <blacka101@gmail.com> * Updates for flatbuffers datatype enum renaming Signed-off-by: Alex Black <blacka101@gmail.com>	2019-09-04 16:36:11 +10:00
Robert Altena	25b01f7850	javadoc and remove deprecated methods. (#231 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-04 13:29:02 +10:00
raver119	7abc574eeb	Snapshot update (#8194 ) * fix double consumption of rng on cpu Signed-off-by: raver119 <raver119@gmail.com> * Shyrma docs (#222) * - documenting and profiling matrix_set_diag cuda kernel Signed-off-by: Yurii <yurii@skymind.io> * - correct formula of pnorm pooling in cuda 2d/3d kernels - remove helper matrix_diag which duplicates work of helper matrix_set_diag Signed-off-by: Yurii <yurii@skymind.io> * cublasHandle sharing + lock Signed-off-by: raver119 <raver119@gmail.com> * cublasHandle sharing + lock Signed-off-by: raver119 <raver119@gmail.com> * Documentation from serialization/deserialization in NLP (#221) * refactoring Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Javadocs Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Javadoc fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Cleanup Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * dedicated lock for getCudaCublasHandle Signed-off-by: raver119 <raver119@gmail.com> * Small fixes (#223) Signed-off-by: AlexDBlack <blacka101@gmail.com> * ELU DL4J fixes (#224) Signed-off-by: AlexDBlack <blacka101@gmail.com> * javadoc (#225) Signed-off-by: Robert Altena <Rob@Ra-ai.com> * Small test compilation fix (#226) Signed-off-by: AlexDBlack <blacka101@gmail.com> * #8182 remove spark version suffix (#227) Signed-off-by: AlexDBlack <blacka101@gmail.com> * [WIP] Thread safety (#229) * sync after cublasgemm Signed-off-by: raver119 <raver119@gmail.com> mutex for CublasHelper Signed-off-by: raver119 <raver119@gmail.com> * don't store cublasHandle in LaunchContext, it's per-device anyway Signed-off-by: raver119 <raver119@gmail.com> * some printout Signed-off-by: raver119 <raver119@gmail.com> * check for field instead Signed-off-by: raver119 <raver119@gmail.com> * pew-pew Signed-off-by: raver119 <raver119@gmail.com> * don't release ContextBuffers until device changed Signed-off-by: raver119 <raver119@gmail.com> * small tweak Signed-off-by: raver119 <raver119@gmail.com> * some logging in sgemm Signed-off-by: raver119 <raver119@gmail.com> * stream sync Signed-off-by: raver119 <raver119@gmail.com> * some more logging Signed-off-by: raver119 <raver119@gmail.com> * some more error checks Signed-off-by: raver119 <raver119@gmail.com> * one fancy test Signed-off-by: raver119 <raver119@gmail.com> * one fancy test Signed-off-by: raver119 <raver119@gmail.com> * minor AffinityManager fix Signed-off-by: raver119 <raver119@gmail.com> * cudaEvent error logging improvement Signed-off-by: raver119 <raver119@gmail.com> * ConstantHelper thread safety Signed-off-by: raver119 <raver119@gmail.com> * - minor corrections in ConstantTadHelper Signed-off-by: Yurii <yurii@skymind.io> * ConstantShapeHelper thread safety Signed-off-by: raver119 <raver119@gmail.com> * ConstantTadHelper.cu updated Signed-off-by: raver119 <raver119@gmail.com> * logging off Signed-off-by: raver119 <raver119@gmail.com> * logging off Signed-off-by: raver119 <raver119@gmail.com>	2019-09-03 22:02:02 +03:00
raver119	dddc8a1143	[WIP] Thread safety (#229 ) * sync after cublasgemm Signed-off-by: raver119 <raver119@gmail.com> mutex for CublasHelper Signed-off-by: raver119 <raver119@gmail.com> * don't store cublasHandle in LaunchContext, it's per-device anyway Signed-off-by: raver119 <raver119@gmail.com> * some printout Signed-off-by: raver119 <raver119@gmail.com> * check for field instead Signed-off-by: raver119 <raver119@gmail.com> * pew-pew Signed-off-by: raver119 <raver119@gmail.com> * don't release ContextBuffers until device changed Signed-off-by: raver119 <raver119@gmail.com> * small tweak Signed-off-by: raver119 <raver119@gmail.com> * some logging in sgemm Signed-off-by: raver119 <raver119@gmail.com> * stream sync Signed-off-by: raver119 <raver119@gmail.com> * some more logging Signed-off-by: raver119 <raver119@gmail.com> * some more error checks Signed-off-by: raver119 <raver119@gmail.com> * one fancy test Signed-off-by: raver119 <raver119@gmail.com> * one fancy test Signed-off-by: raver119 <raver119@gmail.com> * minor AffinityManager fix Signed-off-by: raver119 <raver119@gmail.com> * cudaEvent error logging improvement Signed-off-by: raver119 <raver119@gmail.com> * ConstantHelper thread safety Signed-off-by: raver119 <raver119@gmail.com> * - minor corrections in ConstantTadHelper Signed-off-by: Yurii <yurii@skymind.io> * ConstantShapeHelper thread safety Signed-off-by: raver119 <raver119@gmail.com> * ConstantTadHelper.cu updated Signed-off-by: raver119 <raver119@gmail.com> * logging off Signed-off-by: raver119 <raver119@gmail.com> * logging off Signed-off-by: raver119 <raver119@gmail.com>	2019-09-03 22:00:38 +03:00
Robert Altena	c64b340975	javadoc (#225 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-03 14:06:42 +10:00
Alex Black	364a6e1a2a	ELU DL4J fixes (#224 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-03 13:35:02 +10:00
raver119	d3253aff3f	dedicated lock for getCudaCublasHandle Signed-off-by: raver119 <raver119@gmail.com>	2019-09-02 20:01:13 +03:00
raver119	2129d5bcac	cublasHandle sharing + lock Signed-off-by: raver119 <raver119@gmail.com>	2019-09-02 16:52:28 +03:00
raver119	18828f9725	cublasHandle sharing + lock Signed-off-by: raver119 <raver119@gmail.com>	2019-09-02 16:52:10 +03:00
AlexDBlack	7ded4416cb	Merge remote-tracking branch 'fork/master'	2019-09-02 18:52:12 +10:00
Alex Black	82c9dc5743	ELU fix (#219 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-02 18:37:05 +10:00
Alex Black	65c9f2a888	ELU fix (#217 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-09-02 17:42:12 +10:00
Ryan Nett	b3a134b608	New Nd4j backprop ops for activations (#211 ) * new (for java at least) backprop ops Signed-off-by: Ryan Nett <rnett@skymind.io> * update activation functions Signed-off-by: Ryan Nett <rnett@skymind.io> * add differential functions for SameDiff Signed-off-by: Ryan Nett <rnett@skymind.io> * deprecate old ops Signed-off-by: Ryan Nett <rnett@skymind.io> * update correct old ops Signed-off-by: Ryan Nett <rnett@skymind.io> * update ops backprop to use new ops Signed-off-by: Ryan Nett <rnett@skymind.io> * misc updates for deprecated functions (mostly Nd4j.rand w/ vararg shape) Signed-off-by: Ryan Nett <rnett@skymind.io> * remove old imports Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-09-02 16:15:23 +10:00
Robert Altena	6d04d30c94	INDArray.java javadoc (#215 ) * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-02 16:06:20 +10:00
Robert Altena	ef1de6a4aa	rcorbish #8617 (#8188 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-09-01 07:17:36 +03:00
raver119	b71c993ded	[WIP] maxpool_bp cuda fix (#212 ) * one test for alex Signed-off-by: raver119 <raver119@gmail.com> * fix Signed-off-by: raver119 <raver119@gmail.com> * get rid of safety offset in cpp Signed-off-by: raver119 <raver119@gmail.com> * bfloat16 Signed-off-by: raver119 <raver119@gmail.com> * minor test rearrangement to fastpath launch Signed-off-by: raver119 <raver119@gmail.com> * - atomicAdd/Mul/Div fix for float16/bfloat16 misalignment - one special test for maxpoolbp java - safety offset of 8 bytes is back to libnd4j legacy Signed-off-by: raver119 <raver119@gmail.com>	2019-08-31 20:57:05 +03:00
Alex Black	6efffb727f	Import fix (#208 ) Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-30 23:40:52 +10:00
Alex Black	a7dca9fc87	Add java op class for relu derivative, and use in Activation ReLU (#207 ) * Add java op class for relu derivative, and use in ACtivation ReLU Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-30 23:36:00 +10:00
raver119	70a9ae5068	[WIP] few tweaks (#206 ) * scatter empty check Signed-off-by: raver119 <raver119@gmail.com> * scatter empty test Signed-off-by: raver119 <raver119@gmail.com> * one more test Signed-off-by: raver119 <raver119@gmail.com> * two tweaks Signed-off-by: raver119 <raver119@gmail.com> * dup tweak Signed-off-by: raver119 <raver119@gmail.com> * - put empty checking of indices array immediately prior helper run Signed-off-by: Yurii <yurii@skymind.io> * minor tests fix Signed-off-by: raver119 <raver119@gmail.com> * minor tests fix Signed-off-by: raver119 <raver119@gmail.com>	2019-08-30 16:32:01 +03:00
Robert Altena	54e320a255	javadoc (#201 ) Signed-off-by: Robert Altena <Rob@Ra-ai.com>	2019-08-30 22:40:27 +10:00
Alex Black	62e96c9724	Guava Function -> nd4j-common Function (#203 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-30 20:39:43 +10:00
raver119	1003428a18	[WIP] Int broadcastables (#195 ) * Removed invalid resource and fixed tests Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * legacy scalar/pairwise/broadcast int ops Signed-off-by: raver119 <raver119@gmail.com> * NDArray int broadcastables Signed-off-by: raver119 <raver119@gmail.com> * few more bitwise tests Signed-off-by: raver119 <raver119@gmail.com> * java side update Signed-off-by: raver119 <raver119@gmail.com> * Argument type changed for shift ops Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * legacy scalar/pairwise/broadcast int ops Signed-off-by: raver119 <raver119@gmail.com> * NDArray int broadcastables Signed-off-by: raver119 <raver119@gmail.com> * few more bitwise tests Signed-off-by: raver119 <raver119@gmail.com> * java side update Signed-off-by: raver119 <raver119@gmail.com> * Argument type changed for shift ops Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com>	2019-08-30 10:12:40 +03:00
Alex Black	dcc2baa676	Version upgrades (#199 ) * DataVec fixes for Jackson version upgrade Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J jackson updates + databind version 2.9.9.3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Shade snakeyaml along with jackson Signed-off-by: AlexDBlack <blacka101@gmail.com> * Version fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Switch DataVec legacy JSON format handling to mixins Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next set of fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup for legacy JSON mapping Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade commons compress to 1.18; small test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * New Jackson backward compatibility for DL4J - Round 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * New Jackson backward compatibility for DL4J - Round 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes, all but legacy custom passing Signed-off-by: AlexDBlack <blacka101@gmail.com> * Provide an upgrade path for custom layers for models in pre-1.0.0-beta JSON format Signed-off-by: AlexDBlack <blacka101@gmail.com> * Legacy deserialization cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small amount of polish - legacy JSON Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade guava version Signed-off-by: AlexDBlack <blacka101@gmail.com> * IEvaluation legacy format deserialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade play version to 2.7.3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update nd4j-parameter-server-status to new Play API Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update DL4J UI for new play version Signed-off-by: AlexDBlack <blacka101@gmail.com> * More play framework updates Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove Spark 1/2 adapter code from DataVec Signed-off-by: AlexDBlack <blacka101@gmail.com> * datavec-spark dependency cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 4 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Another fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Breeze upgrade, dependency cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add Scala 2.12 version to pom.xml Signed-off-by: AlexDBlack <blacka101@gmail.com> * change-scala-versions.sh - add scala 2.12, remove 2.10 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Move Spark version properties to parent pom (now that only one spark version is supported) Signed-off-by: AlexDBlack <blacka101@gmail.com> * DataVec Play fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * datavec play dependency fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Clean up old spark/jackson stuff Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup jackson unused dependencies Signed-off-by: AlexDBlack <blacka101@gmail.com> * Dropping redundant dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Removed scalaxy dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * DataVec fixes for Jackson version upgrade Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J jackson updates + databind version 2.9.9.3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Shade snakeyaml along with jackson Signed-off-by: AlexDBlack <blacka101@gmail.com> * Version fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Switch DataVec legacy JSON format handling to mixins Signed-off-by: AlexDBlack <blacka101@gmail.com> * Next set of fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup for legacy JSON mapping Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade commons compress to 1.18; small test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * New Jackson backward compatibility for DL4J - Round 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * New Jackson backward compatibility for DL4J - Round 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * More fixes, all but legacy custom passing Signed-off-by: AlexDBlack <blacka101@gmail.com> * Provide an upgrade path for custom layers for models in pre-1.0.0-beta JSON format Signed-off-by: AlexDBlack <blacka101@gmail.com> * Legacy deserialization cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small amount of polish - legacy JSON Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade guava version Signed-off-by: AlexDBlack <blacka101@gmail.com> * IEvaluation legacy format deserialization fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Upgrade play version to 2.7.3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update nd4j-parameter-server-status to new Play API Signed-off-by: AlexDBlack <blacka101@gmail.com> * Update DL4J UI for new play version Signed-off-by: AlexDBlack <blacka101@gmail.com> * More play framework updates Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Remove Spark 1/2 adapter code from DataVec Signed-off-by: AlexDBlack <blacka101@gmail.com> * datavec-spark dependency cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 1 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 2 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 3 Signed-off-by: AlexDBlack <blacka101@gmail.com> * DL4J spark updates, pt 4 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Test fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Another fix Signed-off-by: AlexDBlack <blacka101@gmail.com> * Breeze upgrade, dependency cleanup Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add Scala 2.12 version to pom.xml Signed-off-by: AlexDBlack <blacka101@gmail.com> * change-scala-versions.sh - add scala 2.12, remove 2.10 Signed-off-by: AlexDBlack <blacka101@gmail.com> * Move Spark version properties to parent pom (now that only one spark version is supported) Signed-off-by: AlexDBlack <blacka101@gmail.com> * DataVec Play fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * datavec play dependency fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Clean up old spark/jackson stuff Signed-off-by: AlexDBlack <blacka101@gmail.com> * Cleanup jackson unused dependencies Signed-off-by: AlexDBlack <blacka101@gmail.com> * Add shaded guava Signed-off-by: AlexDBlack <blacka101@gmail.com> * Dropping redundant dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Removed scalaxy dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Ensure not possible to import pre-shaded classes, and remove direct guava dependencies in favor of shaded Signed-off-by: AlexDBlack <blacka101@gmail.com> * ND4J Shaded guava import fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * DataVec and DL4J guava shading Signed-off-by: AlexDBlack <blacka101@gmail.com> * Arbiter, RL4J fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Build fixed Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Fix dependency Signed-off-by: Alexander Stoyakin <alexander.stoyakin@gmail.com> * Fix bad merge Signed-off-by: AlexDBlack <blacka101@gmail.com> * Jackson shading fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Set play secret, datavec-spark-inference-server Signed-off-by: AlexDBlack <blacka101@gmail.com> * Fix for datavec-spark-inference-server Signed-off-by: AlexDBlack <blacka101@gmail.com> * Arbiter fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Arbiter fixes Signed-off-by: AlexDBlack <blacka101@gmail.com> * Small test fix Signed-off-by: AlexDBlack <blacka101@gmail.com>	2019-08-30 14:35:27 +10:00
Serhii Shepel	0463ee4eba	Fix backend dependencies for tests (#189 )	2019-08-29 12:54:48 +09:00
Yurii Shyrma	70af8c2afc	Shyrma svd (#191 ) * - add one additional test for svd * - provide float argument in eye op to be a type of output array Signed-off-by: Yurii <yurii@skymind.io> * - add cuda capability check to mmulHelper Signed-off-by: Yurii <yurii@skymind.io> * - make use another method for divice id evaluation Signed-off-by: Yurii <yurii@skymind.io> * Eye data type as T argument Signed-off-by: raver119 <raver119@gmail.com>	2019-08-28 18:27:08 +03:00
raver119	f4860574d7	[WIP] More fixes (#190 ) * Refactored kernels for segment_max/min/sum ops. * Refactored segment_prod kernels. * Refactored segment_prod kernels. * DynamicPartition test Signed-off-by: raver119 <raver119@gmail.com> * Addede linear test for dynamic_partition op. * Refactored test with int datatype. * some logging Signed-off-by: raver119 <raver119@gmail.com> * some logging Signed-off-by: raver119 <raver119@gmail.com> * some logging Signed-off-by: raver119 <raver119@gmail.com> * dynamicPartition fix Signed-off-by: raver119 <raver119@gmail.com> * get rid of some logging Signed-off-by: raver119 <raver119@gmail.com> * one more test for dynamic_stitch Signed-off-by: raver119 <raver119@gmail.com> * one more test for dynamic_stitch Signed-off-by: raver119 <raver119@gmail.com> * empty check for stitch Signed-off-by: raver119 <raver119@gmail.com> * minor print changes Signed-off-by: raver119 <raver119@gmail.com>	2019-08-28 15:38:57 +03:00
Ryan Nett	2a1431264f	Remove calculate output shape from java side (#151 ) * remove some unneeded java-side output shape calculations Signed-off-by: Ryan Nett <rnett@skymind.io> * delete Broadcast Signed-off-by: Ryan Nett <rnett@skymind.io> * delete Linear and Module, Signed-off-by: Ryan Nett <rnett@skymind.io> * update Identity, HashCode, and NoOp Signed-off-by: Ryan Nett <rnett@skymind.io> * removed Cast java-side shape function, added tests and SDVariable.isEmpty Signed-off-by: Ryan Nett <rnett@skymind.io> * ignoring test w/ issues on master Signed-off-by: Ryan Nett <rnett@skymind.io> * noop needs more work, fixed BaseArithmeticBackprop and BaseDynamicTransform ops merge in master for c++ build fix Signed-off-by: Ryan Nett <rnett@skymind.io> * fix EqualTo Signed-off-by: Ryan Nett <rnett@skymind.io> * fix other cond ops Signed-off-by: Ryan Nett <rnett@skymind.io> * "fake" ops calculateOutputShape() throws exception Signed-off-by: Ryan Nett <rnett@skymind.io> * use c++ shape calc for Linspace Signed-off-by: Ryan Nett <rnett@skymind.io> * fix exception message, move most to BaseCompatOp Signed-off-by: Ryan Nett <rnett@skymind.io> * remove SDVariable.isEmpty Signed-off-by: Ryan Nett <rnett@skymind.io> * remove commented out code Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-08-27 20:39:32 -07:00
Alex Black	b46f9827b8	Layer norm test updates (#187 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-28 13:27:00 +10:00
Robert Altena	59a6e4e3ae	INDArray refactoring (#170 ) * javadoc Signed-off-by: Robert Altena <Rob@Ra-ai.com> * remove javaTensorAlongDimension Signed-off-by: Robert Altena <Rob@Ra-ai.com> * wip Signed-off-by: Robert Altena <Rob@Ra-ai.com> * javadoc	2019-08-28 12:03:23 +09:00
Ryan Nett	d31197db5f	Remove resolvePropertiesFromSameDiffBeforeExecution() (#172 ) * remove unneeded resolveProperties methods Signed-off-by: Ryan Nett <rnett@skymind.io> * final fixes, make final to prevent more from being added Signed-off-by: Ryan Nett <rnett@skymind.io> * gather fix Signed-off-by: Ryan Nett <rnett@skymind.io> * deprecate DifferentialFunction resolveProps Signed-off-by: Ryan Nett <rnett@skymind.io>	2019-08-28 11:02:41 +10:00
raver119	b472d7d8c8	[WIP] few more fixes (#182 ) * one noop test Signed-off-by: raver119 <raver119@gmail.com> * skip input validation for no-input ops Signed-off-by: raver119 <raver119@gmail.com> * - one more noop empty test - one more validation before sync Signed-off-by: raver119 <raver119@gmail.com> * typo Signed-off-by: raver119 <raver119@gmail.com> * one more validation fix Signed-off-by: raver119 <raver119@gmail.com> * CUDA empty reductions java side Signed-off-by: raver119 <raver119@gmail.com> * one svd test Signed-off-by: raver119 <raver119@gmail.com> * Corrected segment_mean helpers and added another test. * Refactored segment_mean kernels to avoid race_condition.	2019-08-27 21:00:38 +03:00
Alex Black	9d325ad070	Small optimization to Nd4j.readNumpy (#183 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-27 23:27:41 +10:00
Alex Black	dff599aa8f	Test fix (#179 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-27 20:43:36 +10:00
raver119	a49f7c908b	[WIP] More fixes (#178 ) * skip string arrays for device validation Signed-off-by: raver119 <raver119@gmail.com> * histogram_fixed_width now really supports indexing types Signed-off-by: raver119 <raver119@gmail.com>	2019-08-27 13:21:01 +03:00
Alex Black	fd22a8ecc7	Small build fix, after last PR (#177 ) Signed-off-by: Alex Black <blacka101@gmail.com>	2019-08-27 19:46:26 +10:00

1 2 3 4 5 ...

268 Commits (a25bb6a11c6dda17464542df39ff62b8e92588a1)