QUICK LINKS
	ITEE Public Web
	Student IT Help
	ITEE Internal Web
	Staff IT Help

	State-of-Practice Questionnaire: V&V in Concurrency

Questionnaire on the
State-of-Practice of
Verification &Validation in Concurrency

This questionnaire is designed to discover the state-of-practice for verification and validation (V&V) for concurrent programs. The results of the survey will be used in my PhD project to help the design and evaluation of V&V for concurrent programs. All the information you provide will be kept confidential.

This questionnaire is being done as part of the TestCon research group (for more information, please visit: www.itee.uq.edu.au/~testcon). My PhD focuses on the evaluation of V&V technologies for concurrent components, therefore it is of great interest to me to learn what V&V is currently being performed and the context of performing V&V on concurrent components, as well as the sources of information that are used to make V&V technology choices. I would greatly appreciate it if you could share your input by filling in the questionnaire. I will be collecting data from the online form until the 31st of March. If you are interested in the results of the survey, please leave your details in the survey or e-mail me.

The questionnaire is available via the web site: <www.itee.uq.edu.au/~wojcicki/practitioner_survey/VVquest.html>

Margaret Wojcicki
E-mail: wojcicki 'at' itee.uq.edu.au
Web page: <www.itee.uq.edu.au/~wojcicki>

Context of V&V Technology

1. What is your role in your organization? (please mark all roles that you think are applicable)
Software tester
Quality Assurance
Verification and Validation
Software Developer
Project Manager
Researcher
Academic
Other:

2. How many years of experience do you have with V&V?
Less than one year 1-2 years 3-5 years 6 years or more

3. What is the scope of the V&V that you perform? (please mark all that are applicable)
Unit
Integration
System
Acceptance
Other:

4. What programming languages do you use? Please specify years of experience in the space provided and the version of the programming language used in the space provided.

Programming Language	Years of Experience	Current Version
Java
C++
Ada

Other programming languages used, years of experience and current version:

5. What concurrency defects are (or have been) an issue in your work?
Deadlock
Interference
Starvation
Other:

6.      a) What V&V technologies do you use? (please mark all technologies that you use)
        Code inspection/code walkthrough
        Pair programming
        Automated static analysis tools (examples: Lint, Jlint, FindBugs)
        Coverage
        Capture/Playback
        Model-checker
        Unit/Development testing tools (JUnit)
        Other:

         b) If you marked code inspection/code walkthrough, please choose the style you most often apply:
        individual - systematic
        individual - ad hoc
        group - systematic
        group - ad hoc

7. a) Are any of the V&V technologies you use open source? Yes No

b) If yes, then please list the open source tools you use:

Decision Process for V&V Use

8. For each of the following sources of information, indicate your level of agreement with the statement that the particular source of information is an important factor for you in determining which V&V technologies to use.
(SA - strongly agree, A - agree, N - neutral, D - disagree, SA - strongly disagree)

Source of Information	SA	A	N	D	SD
History of use in other companies
History of use in your company
Marketing information
Search Engine results on the V&V technology
Newsgroups/Forums
Research Literature

Information from Case Studies

9. If you consider case studies or experience reports in your decisions to apply certain V&V technologies, indicate your level of agreement with the statement that the particular aspect of a case study is an important factor in determining what V&V technology to use.
(SA - strongly agree, A - agree, N - neutral, D - disagree, SD - strongly disagree, NA - not applicable)

Aspect of case study	SA	A	N	D	SD	NA
The empirical study took place in industry.
There was a large number of participants in the study.
The study involved participants that applied the V&V technology (i.e. the evaluation was not automated).
The defects in the study were real, as opposed to artificially seeded.
The case study was in a similar application domain to yours.

Other aspects of case studies that you consider important:

Cost-Effectiveness

10. Rate the following aspects of cost-effectiveness of V&V technology in terms of their relative importance. (1-highest importance, 2-middle importance, 3-lowest importance).

	Rating
The V&V tool finds all faults of a certain type.
The V&V tool does not report any false positives (i.e. warnings that turn out not to be errors).
The cost of using the V&V tool relative to the number of errors detected.

Other aspects of cost-effectiveness of V&V technology that you consider important:

General comments

Any other comments you have about this questionnaire:

Contact Information

Please provide your contact details if you are interested in receiving a summary of the results of this survey:

privacy | feedback