File: tools.rst

package info (click to toggle)
migraphx 7.1.1-4
  • links: PTS, VCS
  • area: main
  • in suites: sid
  • size: 32,108 kB
  • sloc: cpp: 212,477; python: 26,075; sh: 307; xml: 199; makefile: 61; ansic: 16
file content (74 lines) | stat: -rw-r--r-- 2,262 bytes parent folder | download | duplicates (2)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
.. meta::
  :description: MIGraphX tools
  :keywords: MIGraphX, code base, contribution, developing, tooks, knobs

.. _tools:

Tools
=====

roctx.py
--------
You can use the :ref:`roctx` command with :doc:`rocprof <rocprofiler:rocprofv1>` binary to get marker timing information for each MIGraphX operator.  
To process timing information, use ``roctx.py`` helper script.

::

    Usage: roctx.py [-h] [--json-path json_path] [--out out]
    [--study-name study-name] [--repeat repeat] [--parse]
    [--run run] [--debug]

The ``roctx.py`` helper script provides two main functionalities: ``run`` and ``parse``.

.. option::  --run

Runs ``migraphx-driver roctx`` command with the given ``migraphx-driver`` knobs followed by the parsing of the result which provides GPU kernel timing information.
You can pass the MIGraphX knobs via a string to `--run` knob. See the :ref:`_roctx-examples` for usage.

.. option::  --parse

Parses JSON file in the given ``--json-path`` and provides GPU kernel timing information.

.. option::  --out

Output folder

.. option::  --study-name

Optional. Allows user to name a study for easy interpretation. Defaults to timestamp.

.. option::  --repeat

Number of iterations. Sets to **2** by default.

.. option::  --debug

Provides additional debug information related to data. Use for debugging purposes only.

.. _roctx-examples:

**Examples:**

**Running inference with rocTX for a given ONNX file:**
::
    python roctx.py --run '--onnx --gpu fcn-resnet50-11.onnx' --out output_folder --repeat 5

Example output:

.. image:: ../data/roctx1.jpg

Hotspot kerel timing information:

.. image:: ../data/roctx2.jpg

The output provides ``SUM``, ``MIN``, ``MAX`` and ``COUNT`` information for each kernel executed for a given model. It also
provides the average total time. The following three files are provided for reference:

-   OUTPUT CSV FILE: Provides a summary of the run which includes utilized MIGraphX knobs and related kernel timing information.
-   KERNEL TIMING DETAILS: Provides the hotspot kernel timing information.
-   ALL DATA FROM ALL RUNS: Provides all output data related to all iterations executed during a run.

**Parsing an existing JSON file:**
::

    python roctx.py --parse --json-path ../trace.json