Extended Darshan (Based on 2.3.0 release)
Darshan is developed at Argonne National Laboratory. We extend it to recording file I/O operation history.
Just Try it
The example directory is located under the directory of this file.
For the K computer users, type the following commands to see how the darshan works:
$ cd example
$ pjsub run-k.sh
$ cd darshan/2015/*/*
$ ls -l
$ darshan-parser --history a03228_simple_id29390_2-24-29839-4689494154855117309_1.darshan.gz
How to Use Darshan for MPI applications
The darshan hooks system calls to record file I/O operations. If your binary program has been created with the dynamically linked option (in default), you do not need anything for the binary.
- Create a directory for log files
In this darshan binary distribution for Co-design of Post K, the log directory is “../darshan/” in the working directory. The darshan will create a log file under the “../darshan/MM/DD/” directory where MM and DD are month and day, respectively. Before executing an application, the directory must be created. For example, if an application runs on 17th of April, 2015, the following directory must exist.../darshan/2015/4/17# in KHere is an example to create such a directory.
./darshan/2015/4/17 # in x86 Linux
$ mkdir -p ../darshan/`date +%Y/%m/%d | sed -e "s/\/0/\//g"`
- You must specify the darshan library as a dynamic link library. In
order to enable recording history of read and write operations, the
environment variable DARSHAN_HISTORY_RW must be specified. Here is an
example where the dynamic link library is located in the current
$ ( export LD_PRELOAD=./libdarshan.so; export DARSHAN_HISTORY_RW="rw"; your binary )
- After the execution, a log file appears under the directory created
in step 1). Here is an example:
- There are several utilities provided by darshan. The
darshan-parser is the basic utility to extract information of a log
file. To extract read and write operation histories, the –history
option is introduced. e.g.,
The darshan-parser is included in the K distribution.
$ darshan-parser --history ishikawa_simple_id8732_4-16-40056-6523797983477487085_1.darshan.gz
How to Use Darshan for Non MPI applications
The darshan is extended to non MPI applications. For logging file I/O
operations, the darshan-single.so shared library is preloaded.
$ ( export LD_PRELOAD=./libdarshan-single.so; \ export DARSHAN_HISTORY_RW="rw"; \ gcc -O2 test.c )
The format of log file name is
How to see the log
- darshan-job-summary.pl is used to look an overall log.
A pdf file is generated by the tool.
$ darshan-job-summary.pl log file
- To look file I/O operations, darshan-history.pl is used
The history_rank.png file is generated by the tool.
$ darshan-history.pl log file
Environment Variables extended by RIKEN AICS
Enables recording read or/and write operations. No recording in default.
export DARSHAN_HISTORY_RW="rw" # for read write
export DARSHAN_HISTORY_RW="r" # for read only
export DARSHAN_HISTORY_RW="w" # for write only
Specifies the size of working memory area to record I/O operations.
1MB (87,380 records) is in default.
export DARSHAN_HISTORY_MEMSIZE=10485760 # 10MB
export DARSHAN_HISTORY_MEMSIZE=104857600 # 100MB
- The last 15 bytes of a file name is only saved. This is a darshan feature.
- We will follow the latest distribuion, 2.3.1, soon.
- First Release
- timestamps of open/close/read/write system calls are relative to timestamp of MPI_Init.
- libdarshan-single.so is availale for non MPI applications.timestamps of syste calls are related to timestamp of the first open system call.
- Fujitsu provides the darshan-history.pl tool which shows file I/O history.