Analyzing and Testing Non-functional Software Properties
Seminar - Winter Semester 2015/2016

Lehrstuhl für Softwaretechnik (Prof. Zeller)
Universität des Saarlandes – Informatik
Informatik Campus des Saarlandes
Campus E9 1 (CISPA)
66123 Saarbrücken
E-mail: zeller @ cs.uni-saarland.de
Telefon: +49 681 302-70970

Deutschsprachige Startseite Page d'acceuil en français English home page
   Have you ever wondered
  • Why is my program slow?

  • Why does this app in mobile drains out the battery?

  • Can timing and power behaviour of software leak secret information?

If answer to any of the above questions is yes, you might consider attending the seminar.

In this seminar, we will be investigating the aforementioned questions. In particular, this seminar will explore topics related to the analysis, testing and improvement of non-functional software properties, such as performance, energy and robustness, among others.

We will have weekly meetings. Each week we will discuss one research paper.

The kickoff-meeting will be on Friday, 30.10.2015, from 10.00 till 11.00 in room E1 1 1.06

Meetings will be on Fridays from 10.00 till 11.00 in room E9 1 (CISPA), 2.22 room E1 1 1.0 6

News

  • 13.02.2016 - Final presentation schedule and some guidelines are posted here.
  • 18.01.2016 - Final presentation is scheduled on 5th March, 2016, please reserve the entire day.
  • 12.01.2016 - Starting 15th January, 2016, you need to come prepared reading two papers (as per the schedule), but you can still submit (at least) one summary. However, ensure that you submit all your summaries by 14th February, 2016.
  • 12.01.2016 - Starting 15th January, 2016, we will be discussing two papers each week. This means the seminar will take place between 10:00 and 12:00. Please take a note.
  • 12.01.2016 - The seminar on 5th February, 2016 has been cancelled and the seminar structure is rescheduled. Please take a note.
  • 08.12.2015 - The seminar on 11th Dec, 2015 will take place as scheduled, but in E1 3, room 107. Please take a note.
  • 08.12.2015 - Seminars from 18th Dec, 2015 will take place in the new CISPA building (E9 1).
  • 09.11.2015 - A tentative schedule for the agenda has been posted. Please take a note and check the schedule.
  • 09.11.2015 - Paper assignment posted. We are going to discuss "Efficient Path Profiling" on 13th Nov, 2015 .
  • 30.10.2015 - Kick-off slides posted here. Remember to send your preference by 4th Nov, 2015 .
  • 19.10.2015 - Venue and dates of the seminar are confirmed. See you in the kickoff-meeting on 30/10.
  • 12.10.2015 - Due to the absence of Sudipta, there will be no meeting on 6th Nov, 2015.
  • 29.09.2015 - Seminar webpage is alive.

Paper Discussion Schedule (Final)

  • 13.11.2015
    • Efficient Path Profiling (Julian)
  • 20.11.2015
    • Where is the energy spent inside my app? (Christopher)
  • 27.11.2015
    • Understanding and detecting real-world performance bugs (Alex Grethen)
  • 04.12.2015
    • WISE: Automated test generation for worst-case complexity (Ezekiel)
  • 11.12.2015
    • Algorithmic Profiling (Duc Cuong Nguyen)
  • 18.12.2015
    • Detecting energy bugs and hotspots in mobile apps (Sandra)
  • 08.01.2016
    • SEEDS: a software engineer's energy-optimization decision support framework (Christian Degott)
  • 15.01.2016
    • Estimating mobile application energy consumption using program analysis (Frederic Burgard)
    • Symbolic Robustness Analysis (Björn Mathis)
  • 22.01.2016
    • Toddler: Detecting Performance Problems via Similar Memory-Access Patterns (Marvin)
    • MDP-Based Reliability Analysis of an Ambient Assisted Living System (Emamurho)
  • 29.01.2016
    • Static detection of asymptotic performance bugs in collection traversals (Nicolas Brauner)
    • Differential Power Analysis (Lucas Biehl)
  • 12.02.2016
    • CacheAudit: A Tool for the Static Analysis of Cache Side Channels (Lukas Bard)
    • Memento: Learning Secrets from Process Footprints (Alexander Mohr)

List of papers (Final)

  1. Profiling
    • Efficient Path Profiling (MICRO 1996) --- Julian Sahner [13.11]
    • Algorithmic Profiling (PLDI 2012) --- Duc Cuong Nguyen
    • Input-Sensitive Profiling (PLDI 2012)
    • Where is the energy spent inside my app?: fine grained energy accounting on smartphones with Eprof (EUROSYS 2012) --- Christopher [20.11]
  2. Performance Analysis and Testing
    • WISE: Automated test generation for worst-case complexity (ICSE 2009) --- Ezekiel
    • Finding latent performance bugs in systems implementations (FSE 2010)
    • SimLatte: A Framework to Support Testing for Worst-Case Interrupt Latencies in Embedded Software (ICST 2014)
    • Understanding and detecting real-world performance bugs (PLDI 2012) --- Alex Grethen
    • Toddler: Detecting Performance Problems via Similar Memory-Access Patterns (ICSE 2013) --- Marvin
    • Static detection of asymptotic performance bugs in collection traversals (PLDI 2015) --- Nicolas Brauner
  3. Energy Consumption Analysis and Testing
    • Estimating mobile application energy consumption using program analysis (ICSE 2013) --- Frederic Burgard
    • SEEDS: a software engineer's energy-optimization decision support framework (ICSE 2014) --- Christian Degott
    • Detecting energy bugs and hotspots in mobile apps (FSE 2014) --- Sandra Unterdörfer
  4. Reliability Analysis
    • MDP-Based Reliability Analysis of an Ambient Assisted Living System (FM 2014) --- Emamurho
  5. Robustness Analysis and Testing
    • Symbolic Robustness Analysis (RTSS 2009) --- Björn Mathis
    • Proving Programs Robust (FSE 2011)
  6. Side Channels
    • Differential Power Analysis (CRYPTO 1999) --- Lucas Biehl
    • CacheAudit: A Tool for the Static Analysis of Cache Side Channels (USENIX Security 2013) --- Lukas Bard
    • Memento: Learning Secrets from Process Footprints (IEEE Symposium on Security and Privacy 2012) --- Alexander Mohr
    • SMT-Based Verification of Software Countermeasures against Side-Channel Attacks (TACAS 2014)

Registration

We have reached the maximum number of participants for the seminar, and we do not accept any other. The registration is closed.

Passing Requirement

What should you do in order to gain credit points for this course?

  • Submit all Summary on time
  • Attend the weekly meetings. Please inform us if you have a valid reason to miss the discussion
  • Present one of the papers at the end of semester for 20-25 minutes
  • Submit annotated slides of your talk post presentation

Grading Scheme

  • Summary: 40%
  • Presentation + Peer review: 30%
  • Annotated slides: 20%
  • Participation in the discussion: 10%
  • Bonus points for active discussion management

Summaries

Each summary should be sent to the mailing address sudiptac AT st.cs.uni-saarland.de by Wednesday 11:59pm. This deadline is non-negotiable.

You can find a sample summary here, together with some suggestions on how to write a summary.

Feedback

At the end of each discussion session we will provide feedback on your summaries and suggestions on how to improve. On top of that, we will also provide a mini grade which will either be a
  • + Very well done summary, and interesting questions
  • 0 Good summary. Fulfills all the requirements
  • - Summary is lacking important aspects. Should be improved
Students are encouraged to volunteer to summarize and present a 5 minutes talk on a paper to get feedback on their presentation style. Please inform us at least one day before the meeting if you decide to do so.

Final Exam

Final exam will be held on 5th March, 2016 (Saturday) . The final exam contains two parts:
  • a formal presentation for (maximum) 25 minutes + 5-10 minutes Q/A (presentation timing is strictly enforced)
  • Peer reviews of two presentations

Formal Presentation

For the formal presentation, each student should choose a topic related to the paper assigned to him/her. Such a topic should be broader than the specific problem solved in the respective paper, however, it must not be too broad to be covered in 25 minutes. The choice of the topic is part of the examination and students are encouraged to think about it as soon as possible. Before the exam, all students must individually discuss their topic with the instructor. Please prepare a super-short teaser (e.g. 2 slides) for such discussion.

Peer Review

For peer reviews, students are asked to form a group of three. There are 15 students, which leads to 5 groups. Each group member will peer review the presentation of other two group members. In particular, a peer review will be a (maximum) one-page report. The report should clearly clarify the potential strengths and weaknesses of two presentations reviewed by the respective student. The review report must be submitted by 7th March, 2016.

Note

Both final presentation and the review report are mandatory components of the final exam. The evaluation will be deemed incomplete in the absence of presentation and/or review.

Contacts

Impressum Datenschutzerklärung

<webmaster@st.cs.uni-saarland.de> · http://www.st.cs.uni-saarland.de/edu/nfswprop/2015/ · Stand: 2018-04-05 13:40