cvcov(1)
cvcov - The WorkShop Test Coverage Tool
Showing IRIX 6.5.30 (default release). Unchanged since IRIX 6.5.
NAME cvcov - The WorkShop Test Coverage Tool SYNOPSIS cvcov -ver | subcommand ... DESCRIPTION cvcov invokes the command line version of the WorkShop Tester dynamic test coverage tool. cvxcov invokes the GUI version of the same tool. All functionality is available from either program. Some of the graphical representations of the data will be available only from cvxcov. For more information on using cvcov please refer to the "CASEVision/WorkShop Tester User's Guide." For installation of cvcov please refer to the "WorkShop Tester Release Notes." OPTIONS -ver Print the program version to stdout. addtest test_name test_set_name|test_group_name Add the test or test set to the specified test set. test_name Name of test or testset to add. test_set_name|test_group_name Name of testset or test group which is modified. cattest [ -r ] test_name Describe the test details for test_name. -r Recursively print out details of subtests of this test. This is useful if the test is a test set. test_name Name of test to describe. deltest test_name test_set_name|test_group_name Delete the test or test set from the specified test set. test_name Name of test or testset to remove. test_set_name|test_group_name Name of testset or test group which is modified. diff [ -arg ] [ -exe exe_name ] [ -functions ] [ -pretty ] [ -sort function|diff ] experiment1 experiment2 List the differences in two test experiments. -arg Show arguments for functions. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. -functions Show differences for functions along with summary. -pretty Column aligned output. -sort function|diff function sorts alphabetically by function name. diff sorts by differences in the counting information for all types of coverage (TBD). experiment1 and experiment2 Specify the two test experiment directories to make the comparison. help [ command_name ] Print help on the specified command. If the optional command name is not specified, it prints help for all the commands. command_name Name of command which requires help. lsarc [ -arg ] [ -callee callee_pattern ] [ -caller caller_pattern ] [ -contrib ] [ -exe exe_name ] [ -pretty ] [ -sort caller|callee|count ] experiment|test_name List function arcs coverage. Arcs are calls from one function to another. -arg Show arguments for functions. -callee callee_pattern Show the arcs with callee_pattern as callee. Note, function patterns are of the form: [dso|executable]:{function|*}. For example, "/usr/lib/libc.so.1:*" refers to all functions in the dynamically shared object for the C library. -caller caller_pattern Show the arcs with caller_pattern as caller. See the previous discussion of function patterns. -contrib Show the list of tests that contributed to coverage for each arc. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. -pretty Column aligned output. -sort caller|callee|count Sort the output on caller, callee or arc count. experiment|test_name Specify the test experiment directory or test directory. If test_name is specified, the latest (newest) test experiment in the test directory will be used. lsblock [ -addr ] [ -arg ] [ -contrib ] [ -exe exe_name ] [ -pat func_pattern ] [ -pretty ] [ -sort function|count|file ] experiment|test_name List basic block count information in the function. Blocks are shown as line number sequences. -addr Show basic block by PC range instead of source line number range. -arg Show arguments for functions. -contrib Show the list of tests that contributed to coverage for each block. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. -pat func_pattern Specify function name for coverage. See the previous discussion of function patterns. -pretty Column aligned output. -sort function|count|file Sort the output on function name, count or file name. experiment|test_name Specify the test experiment directory or test directory. If test_name is specified, the latest (newest) test experiment in the test directory will be used. lsbranch [ -addr ] [ -arg ] [ -exe exe_name ] [ -pat func_pattern ] [ -pretty ] [ -sort function|file ] experiment|test_name List count information for assembly language branch instructions. -addr Show branch by PC instead of source line number. -arg Show arguments for functions. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. -pat func_pattern Specify function name for coverage. See the previous discussion of function patterns. -pretty Column aligned output. -sort function|file Sort the output on function name or file name. experiment|test_name Specify the test experiment directory or test directory. If test_name is specified, the latest (newest) test experiment in the test directory will be used. lscall [ -arg ] [ -exe exe_name ] [ -node func_name ] [ -pretty ] [ -r ] experiment|test_name List function call graph. -arg Show arguments for functions. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. -node func_name Show the call graph starting from func_name subnode recursively. -pretty Column aligned output. -r Show all the subnodes of the call graph recursively. experiment|test_name Specify the test experiment directory or test directory. If test_name is specified, the latest (newest) test experiment in the test directory will be used. lsfun [ -arg ] [ -bf filter_type block_filter_value ] [ -blocks ] [ -branches ] [ -contrib ] [ -exe exe_name ] [ -ff filter_type func_filter_value ] [ -pat pattern ] [ -pretty ] [ -rf filter_type branch_filter_value ] [ -sort function|count|file ] experiment|test_name List function coverage. -arg Show arguments for functions. -bf filter_type block_filter_value Filter for block where block_filter_value ranges between 0 and 1. Filter type is same as function filter_type. For example, list the functions whose block coverage is less than 25 percent: cvcov lsfun -bf "<" .25 test_name -blocks Show block coverage for each function. -branches Show branch coverage for each function. -contrib Show the list of tests that contributed to coverage for each function. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. -ff filter_type func_filter_value Filter for function, where filter type is one of the following "<","=", ">", "!=", "<=" and ">=". func_filter_value is the threshold value. For example, list only the functions whose count = 0 and sort the output on function name: cvcov lsfun -ff "=" 0 -sort function test_name -pat pattern Specify individual functions by pattern. See the previous discussion of function patterns. -pretty Column aligned output. -rf filter_type branch_filter_value Filter for branch coverage where branch_filter_value ranges between 0 and 1. Filter type is same as function filter_type. For example, list the functions whose branch coverage is greater than 75 percent. cvcov lsfun -rf ">" .75 test_name -sort function|count|file List the functions sorted on function name, count or file name. experiment|test_name Specify the test experiment directory or test directory. If test_name is specified, the latest (newest) test experiment in the test directory will be used. lsinstr [ -exe exe_name ] [ -functions ] [ -v versionnumber ] test_name Display the instrumentation information for a particular test. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. -functions Show the functions that are included in the coverage experiment. -v versionnumber Specify the version of the program that was instrumented. test_name Specify the test directory. lsline [ -arg ] [ -exe exe_name ] [ -pat func_pattern ] [ -pretty ] [ -sort function|file ] experiment|test_name List the coverage for native source lines. -arg Show arguments for functions. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. -pat func_pattern Specify function name for coverage. See the previous discussion of function patterns. -pretty Column aligned output. -sort function|file Sort the output on either function or file name. experiment|test_name Specify the test experiment directory or test directory. If test_name is specified, the latest (newest) test experiment in the test directory will be used. lssource [ -asm ] [ -exe exe_name ] function experiment|test_name Display source for function with line count (block count) information. 0 counted lines are highlighted. -asm Show assembly level source code. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. function Specify the function name to be displayed. experiment|test_name Specify the test experiment directory or test directory. If test_name is specified, the latest (newest) test experiment in the test directory will be used. lssum [ -exe exe_name ] [ -weight func_factor:line_factor:branch_factor:arc_factor:block_factor ] experiment|test_name List the summary of overall coverage for this run. Also list the function, line, arc, branch, and block coverage. -weight func_factor:line_factor:branch_factor:arc_factor:block_factor Specify the weight factors for calculating overall coverage based on individual coverages for function, line, branch, arc, and block. The weights should add up to 1. experiment|test_name Specify the test experiment directory or test directory. If test_name is specified, the latest (newest) test experiment in the test directory will be used. lstest [ -r ] [test_name ...] List the coverage tests. -r Recursively walk the directory and list all coverage tests. test_name ... If testname or pattern is specified, list all tests which match. If no testname is specified, list all tests in the current working directory. lstrace [ -exe exe_name ] [ -pat func_name ] [ -pretty ] [ -sort function|type ] experiment|test_name Trace function argument coverage. -exe exe_name Specify which executable is targeted for query. If no executable is specified, the main program is the default. -pat func_name Function name for argument tracing. See the previous discussion of function patterns. -pretty Column aligned output. -sort function|type Sort the output on either function name or argument type. experiment|test_name Specify the test directory or test directory. If test_name is specified, the latest (newest) test experiment in the test directory will be used. mktest -cmd 'cmd_line' [ -des 'description' ] [ -instr_dir instr_dir ] [ -testname test ] [ exe1 exe2 ... ] Create a test directory which contains a Test Description File. -cmd 'cmd_line' Specify the program and command line options for the program to be tested. This includes any redirection for stdin, stderr, or stdout as run from the Bourne shell. The "cmd_line" is mandatory, even if it only includes the program name. -des 'description' Specify the test description in single quotes. -instr_dir instr_dir Specify the instrumentation directory. If not specified, mktest looks for the instrumentation directory in the current working directory. -testname test Specify the testname. If not specified, mktest creates a unique name as well as the test directory. exe1 exe2 ... Specify the executables to be covered for this test. This handles programs that cause other programs to be run (e.g., fork/exec). If no executable is specified, the main program is the default. mktgroup [ -des 'description' ] [ -list list_file ] [ -testname test ] target1 target2 ... Create a test group which can contain other tests or test groups. A test group is a collection of programs which share some libraries or dynamically shared objects in common. The coverage is targeted for the shared libraries. -des 'description' Specify the test set description in single quotes. -list list_file Specify the file containing a list of test names to be made part of the test set. If no -list option is specified an empty test set will be created. -testname test Specify the test set name. If not specified, mktset creates a unique name as well as the test directory. target1 target2 ... Specify the target libraries or dynamically shared objects. mktset [ -des 'description' ] [ -list list_file ] [ -testname test ] Create a test set which can contain other tests or test sets as subtests. Specify the test set name, otherwise command will automatically assign a test name for the test set. -des 'description' Specify the test set description in single quotes. -list list_file Specify the file containing a list of test names to be made part of the test set. If no -list option is specified an empty test set will be created. -testname test Specify the test set name. If not specified, mktset creates a unique name as well as the test directory. optimize [ -blocks ] [ -branches ] [ -cbb filter_type bb_filter_value ] [ -cbr filter_type br_filter_value ] [ -exe exe_name ] [ -pat func_pattern ] [ -pretty ] [ -stat ] experiment ...|test_name ... Choose the minimum set of tests that give the same coverage or meet the given coverage criteria -blocks Show block coverage for all the selected tests -branches Show branch coverage for all the selected tests -cbb filter_type bb_filter_value Give the basic-block coverage criteria for test selection. The rules are the same as the option -bf of lsfun command. -cbr filter_type br_filter_value Give the branch coverage criteria for test selection. The rules are the same as the option -rf of lsfun command. -exe exe_name Specify which executable is targeted for test optimization. If no executable is specified, the main program is the default. -pat pattern Specify DSO patterns for calculation of coverage on test selection. See the previous discussion of function patterns. -pretty Column aligned output. -stat Print out block and branch coverage for all the selected tests. Without this option, cumulative coverages for block and branch are given. experiment ...|test_name ... names of experiments or tests to optimize rmtest [ -r ] test_name Remove the test with the test_name specified. -r Recursively remove all the subtests of the test testname. This is useful for removing all the subtests of a test set. test_name Name of test to remove. runinstr [ -instr_dir instr_dir ] [ -instr_file instr_file ] [ -v versionnumber ] executable Instrument the user <executable> based on the user selectable criteria. The instrument file is an ASCII description of the instrumentation criteria for the experiment. A complete description of the instrument file can be found in the "WorkShop/Tester User's Guide". -instr_dir instr_dir Specify the instrumentation directory. -instr_file instr_file Specify the instrument file to be used to instrument <executable>. -v versionnumber Specify the version of the program to be instrumented. executable Name of program that is being instrumented. runtest [ -bitcount ] [ -compress ] [ -force ] [ -keep ] [ -noarc ] [ -rmsub ] [ -sum ] [ -v versionnumber ] test_name Run a test or a test set. -bitcount Compress count data file to be 1-bit-per-count. This option will decrease the data base size up to 32 times, but branch count information will be lost. -compress Compress experiment database using standard utility compress. -force Force the test to be run again even if a test experiment is present. -keep Retain all performance data collected in the experiment. By default, the performance data is not retained, because it is not required by the coverage tool. -noarc Do not capture arc information in the runtest experiment. The arc data can potentially use of large amounts of disk space. -rmsub Remove results for individual subtests if this is a test set or test group. The overall test set or test group data is retained. -sum Accumulate (sum over) the coverage data into the existing experiment results. This allows users to run and re-run the same test and accumulate the results in one place. -v versionnumber Specify the version of the program to be run. If not specified, runtest assumes the latest version of the program. test_name Name of test to run. FILES /usr/lib/X11/app-defaults/Cvxcov Application defaults for GUI program, cvxcov. /usr/Tester/default_instr_file Default instrument file. SEE ALSO cvxcov(1), cvd(1), cvinstr(1), cvperf(1), cvxhang(1)