Andreas just added a DTrace script to the V60s2_BRANCH release of the Grid Engine CVS codebase.
This means one can conduct performance tuning and troubleshooting of the qmaster/scheduler of a production SGE cluster, without compiling a special version of the binaries, and without restarting daemons!
Currently, Solaris 10 is the only OS with DTrace support (MacOSX and FreeBSD developers are porting DTrace to their platforms). Thus qmaster needs to be running on a Solaris 10 machine (SPARC, AMD64, or x86).
A wrapper shell script (monitor.sh) is also included to invoke the DTrace script from the command line with all the parameters needed.
% monitor.sh -help monitor.sh [options] options: -cell
|use $SGE_CELL other than "default" -interval|
See Andreas’ post for more.