NDLI logo
  • Content
  • Similar Resources
  • Metadata
  • Cite This
  • Log-in
  • Fullscreen
Log-in
Do not have an account? Register Now
Forgot your password? Account recovery
  1. IEEE/ACM International Workshop on Complex Faults and Failures in Large Software Systems (COUFLESS).
  2. 2015 IEEE/ACM 1st International Workshop on Complex Faults and Failures in Large Software Systems (COUFLESS)
  3. Evaluating Bug Finders -- Test and Measurement of Static Code Analyzers
Loading...

Please wait, while we are loading the content...

2015 IEEE/ACM 1st International Workshop on Complex Faults and Failures in Large Software Systems (COUFLESS)
Title Page iii
Copyright Page
Table of Contents
Message from the Chairs
Committees
Sponsors and Supporters
FLAVS: A Fault Localization Add-In for Visual Studio
The Importance of Being Positive in Causal Statistical Fault Localization: Important Properties of Baah et al.'s CSFL Regression Model
Evaluating Bug Finders -- Test and Measurement of Static Code Analyzers
Cross-Technology, Cross-Layer Defect Detection in IT Systems -- Challenges and Achievements
The Role of Environmental Assumptions in Failures of DNA Nanosystems
Emulating Environment-Dependent Software Faults
Towards Classification of Concurrency Bugs Based on Observable Properties
Modeling and Verification of Zone Controller: The SCADE Experience in China's Railway Systems
Defect Analysis over Multiple Release Versions of a Semiconductor Software System
Crying Wolf and Meaning It: Reducing False Alarms in Monitoring of Sporadic Operations through POD-Monitor
Author Index
Publisher's Information

Similar Documents

...
Evaluating bug finders: test and measurement of static code analyzers

Article

...
Using Static Analysis to Find Bugs

Article

...
Evaluating static analysis defect warnings on production software

Article

...
Comparison of Static Analysis Tools for Finding Concurrency Bugs

Article

...
Assessing the precision of FindBugs by mining Java projects developed at a university

Article

...
Static Analyzers: Seat Belts for Your Code

Article

...
CARAMEL: Detecting and Fixing Performance Problems That Have Non-Intrusive Fixes

Article

...
Making findbugs more powerful

Article

...
Method-level bug prediction

Article

Evaluating Bug Finders -- Test and Measurement of Static Code Analyzers

Content Provider IEEE Xplore Digital Library
Author Delaitre, A. Stivalet, B. Fong, E. Okun, V.
Copyright Year 2015
Description Author affiliation: Dept. of Comput. Sci. & Electr. Eng., West Virginia Univ., Morgantown, WV, USA (Delaitre, A.) || Software & Syst. Div., Nat. Inst. of Stand. & Technol., Gaithersburg, MD, USA (Stivalet, B.; Fong, E.; Okun, V.)
Abstract Software static analysis is one of many options for finding bugs in software. Like compilers, static analyzers take a program as input. This paper covers tools that examine source code - without executing it - and output bug reports. Static analysis is a complex and generally undecidable problem. Most tools resort to approximation to overcome these obstacles and it sometimes leads to incorrect results. Therefore, tool effectiveness needs to be evaluated. Several characteristics of the tools should be examined. First, what types of bugs can they find? Second, what proportion of bugs do they report? Third, what percentage of findings is correct? These questions can be answered by one or more metrics. But to calculate these, we need test cases having certain characteristics: statistical significance, ground truth, and relevance. Test cases with all three attributes are out of reach, but we can use combinations of only two to calculate the metrics. The results in this paper were collected during Static Analysis Tool Exposition (SATE) V, where participants ran 14 static analyzers on the test sets we provided and submitted their reports to us for analysis. Tools had considerably different support for most bug classes. Some tools discovered significantly more bugs than others or generated mostly accurate warnings, while others reported wrong findings more frequently. Using the metrics, an evaluator can compare candidates and select the tool that aligns best with his or her objectives. In addition, our results confirm that the bugs most commonly found by tools are among the most common and important bugs in software. We also observed that code complexity is a major hindrance for static analyzers and detailed which code constructs tools handle well and which impede their analysis.
Starting Page 14
Ending Page 20
File Size 478151
Page Count 7
File Format PDF
ISBN 9781467370349
DOI 10.1109/COUFLESS.2015.10
Language English
Publisher Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date 2015-05-23
Publisher Place Italy
Access Restriction Subscribed
Rights Holder Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword Measurement Java Software vulnerability Computer bugs Production NIST Software assurance Software Complexity theory Software faults Static analysis tools
Content Type Text
Resource Type Article
  • About
  • Disclaimer
  • Feedback
  • Sponsor
  • Contact
About National Digital Library of India (NDLI)
NDLI logo

National Digital Library of India (NDLI) is a virtual repository of learning resources which is not just a repository with search/browse facilities but provides a host of services for the learner community. It is sponsored and mentored by Ministry of Education, Government of India, through its National Mission on Education through Information and Communication Technology (NMEICT). Filtered and federated searching is employed to facilitate focused searching so that learners can find the right resource with least effort and in minimum time. NDLI provides user group-specific services such as Examination Preparatory for School and College students and job aspirants. Services for Researchers and general learners are also provided. NDLI is designed to hold content of any language and provides interface support for 10 most widely used Indian languages. It is built to provide support for all academic levels including researchers and life-long learners, all disciplines, all popular forms of access devices and differently-abled learners. It is designed to enable people to learn and prepare from best practices from all over the world and to facilitate researchers to perform inter-linked exploration from multiple sources. It is developed, operated and maintained from Indian Institute of Technology Kharagpur.

Learn more about this project from here.

Disclaimer

NDLI is a conglomeration of freely available or institutionally contributed or donated or publisher managed contents. Almost all these contents are hosted and accessed from respective sources. The responsibility for authenticity, relevance, completeness, accuracy, reliability and suitability of these contents rests with the respective organization and NDLI has no responsibility or liability for these. Every effort is made to keep the NDLI portal up and running smoothly unless there are some unavoidable technical issues.

Feedback

Sponsor

Ministry of Education, through its National Mission on Education through Information and Communication Technology (NMEICT), has sponsored and funded the National Digital Library of India (NDLI) project.

Contact National Digital Library of India
Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302
See location in the Map
03222 282435
Mail: support@ndl.gov.in
Sl. Authority Responsibilities Communication Details
1 Ministry of Education (GoI),
Department of Higher Education
Sanctioning Authority https://www.education.gov.in/ict-initiatives
2 Indian Institute of Technology Kharagpur Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project https://www.iitkgp.ac.in
3 National Digital Library of India Office, Indian Institute of Technology Kharagpur The administrative and infrastructural headquarters of the project Dr. B. Sutradhar  bsutra@ndl.gov.in
4 Project PI / Joint PI Principal Investigator and Joint Principal Investigators of the project Dr. B. Sutradhar  bsutra@ndl.gov.in
Prof. Saswat Chakrabarti  will be added soon
5 Website/Portal (Helpdesk) Queries regarding NDLI and its services support@ndl.gov.in
6 Contents and Copyright Issues Queries related to content curation and copyright issues content@ndl.gov.in
7 National Digital Libarray of India Club (NDLI Club) Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach clubsupport@ndl.gov.in
8 Digital Preservation Centre (DPC) Assistance with digitizing and archiving copyright-free printed books dpc@ndl.gov.in
9 IDR Setup or Support Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops idr@ndl.gov.in
Cite this Content
Loading...