raver119 5d69069177
[WIP] Memory limits (#167)
* initial commit

Signed-off-by: raver119 <raver119@gmail.com>

* one more initial commit

Signed-off-by: raver119 <raver119@gmail.com>

* additional initial commit

Signed-off-by: raver119 <raver119@gmail.com>

* subsequent initial commit

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit testing

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit per device

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit per group

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit for cuda

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit for cuda + few missed lines

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit for cuda + missed includes

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit for cuda + one more missed include

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit shouldn't count host mem as dev0 in cuda

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit that tracks HOST group limits for CUDA

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit with some Environment changes

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit with more Environment changes

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit with maxMasterThreads fix

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit with maxMasterThreads fix

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit without maxMasterThreads exception

Signed-off-by: raver119 <raver119@gmail.com>

* initial commit without Nd4jULong in Environment

Signed-off-by: raver119 <raver119@gmail.com>

* add sleep and more iterations for OOM cases

Signed-off-by: raver119 <raver119@gmail.com>

* limits propagation from java side

Signed-off-by: raver119 <raver119@gmail.com>

* - consume ErrorCode every time
- one test for memory limits

Signed-off-by: raver119 <raver119@gmail.com>

* unordered_map

Signed-off-by: raver119 <raver119@gmail.com>

* unordered_map

Signed-off-by: raver119 <raver119@gmail.com>

* unordered_map

Signed-off-by: raver119 <raver119@gmail.com>

* RSub op mapping fixed

Signed-off-by: raver119 <raver119@gmail.com>

* typo fixed

Signed-off-by: raver119 <raver119@gmail.com>

* one bad test fixed

Signed-off-by: raver119 <raver119@gmail.com>
2020-01-24 10:11:09 +03:00

107 lines
2.9 KiB
C++

/*******************************************************************************
* Copyright (c) 2015-2018 Skymind, Inc.
*
* This program and the accompanying materials are made available under the
* terms of the Apache License, Version 2.0 which is available at
* https://www.apache.org/licenses/LICENSE-2.0.
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations
* under the License.
*
* SPDX-License-Identifier: Apache-2.0
******************************************************************************/
//
// Created by raver119 on 14.10.2017.
//
#ifndef LIBND4J_SCOPE_H
#define LIBND4J_SCOPE_H
#include <string>
#include <unordered_map>
#include <graph/Node.h>
namespace nd4j {
namespace graph {
/**
* Scope holds sequential list of operations, and made suitable for continuous
* re-execution of multiple operations.
*
* @tparam T
*/
class ND4J_EXPORT Scope {
protected:
// Graph-unique IDs for Scope instances
int _id;
std::string _name;
// list of nodes to run, always sequential
// Graph takes care of topo sort
std::vector<Node*> _nodes;
public:
// attach GiG here, with shared namespace?
// or just rebuilt graph leaf?
// ¯\_(ツ)_/¯
// default consructor
explicit Scope(int id, const char* name = nullptr);
// default destructor
~Scope();
/**
* this method adds op node to the scope
*
* PLEASE NOTE: We assume that ops are being added ORDERED
*/
void push_back(Node* node);
/**
* This method returns list of ops stored earlier, ready for execution
*
* PLEASE NOTE: If the scope is conditional - last op in list should be BooleanOp
* @return
*/
std::vector<Node*> * nodes();
/**
* This function returns number of nodes in this scope
*
* @return
*/
int size();
/**
* Returns ID of this scope
* @return
*/
int id();
/**
* Returns name of this scope
*
* @return
*/
std::string* name();
/**
* This method returns clone of this Scope
*/
Scope* clone();
/**
* This method removes all Nodes from this scope
*/
void forgetNodes();
};
}
}
#endif //LIBND4J_SCOPE_H