File: doc_oar-whyusing.rst

package info (click to toggle)
oar 2.5.4-2
  • links: PTS
  • area: main
  • in suites: jessie-kfreebsd
  • size: 11,064 kB
  • sloc: perl: 28,891; ruby: 5,813; sh: 5,208; ml: 3,408; sql: 3,255; cpp: 2,277; ansic: 702; makefile: 389; php: 99; exp: 23
file content (106 lines) | stat: -rw-r--r-- 4,065 bytes parent folder | download | duplicates (2)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
Why using OAR
=============

OAR advantages
--------------

We present below some points that explain benefits of the new version of OAR.

A better resource management
~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Using Linux kernel new feature called cpuset, OAR allows a more reliable 
management of the resources:

  * No unattended processes should remain from previous jobs.
  * Access to the resources is now restricted to the owner of the resources.

Beside, features like job dependency and check-pointing are now available, 
allowing a better resources use.

A cpuset is attached to every process, and allows:

  * to specify which resource processor/memory can be used by a process, e.g. 
    resources allocated to the job in OAR 2 context.
  * to group and identify processes that share the same cpuset, e.g. the 
    processes of a job in OAR 2 context, so that actions like clean-up can be 
    efficiently performed. (here, cpusets provide a replacement for the 
    group/session of processes concept that is not efficient in Linux). 

Multi-cluster
~~~~~~~~~~~~~

OAR can manage complex hierarchies of resources. For example:
   1. clusters
   2. switchs
   3. nodes
   4. cpus
   5. cores 

A modern cluster management system
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

By providing a mechanism to isolate the jobs at the core level, OAR is one of 
the most modern cluster management systems. Users developing cluster or grid 
algorithms and programs will then work in a today's up-to-date environment 
similar to the ones they will meet with other recent cluster management systems 
on production platforms for instance.

Optimization of the resources usage
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Now a day, machines with more than 10 cores become common. Thus, it is then very 
important to be able to handle cores efficiently. By providing resources 
selection and processes isolation at the core level, OAR allows users running 
experiments that do not require the exclusivity of a node (at least during a 
preparation phase) to have access to many nodes on one core only, but leave the 
remaining cores free for other users. This can allow to optimize the number of 
available resources.

Beside, OAR also provide a time-sharing feature which will allow to share a 
same set of resources among users.

Easier access to the resources
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Using OAR OARSH connector to access the job resources, basic usages will not 
anymore require the user to configure his SSH environment as everything is 
handled internally (known host keys management, etc). Beside, users that would 
actually prefer not using OARSH can still use SSH with just the cost of some 
options to set (one of the features of the OARSH wrapper is to actually hide 
these options).

Grid resources interconnection
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

As access to one cluster resources is restricted to an attached job, one may 
wonder if connections from job to job, from cluster to cluster, from site to 
site would still be possible. OAR provides a mechanism called job-key than 
allows inter job communication, even on several sites managed by several OAR 
servers (this mechanism is indeed used by OARGrid2 for instance).

Management of abstract resources
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

OAR features a mechanism to manage resources like software licenses or other 
non-material resources the same way it manages classical resources.

OAR Uses and Users
------------------

At the present time, OAR is used in several countries (France, Slovakia, Brazil)
by several types of users.
These users are not only programmers and computer specialists but also simple
scientists, novices at programming. Thus the spread of users type is wide.

They are mainly:

- physicists 
- biologists that work on medical imaging, radioactivity study...
- weathermen
- chemical engineers
- computer sciences engineers and researchers that work on many subjects as 
  cryptography, data mining, HPC...
- stargazers that work on subjetcs like trajectory computation and data analysis
  from probes