Awards

TIOBE rewards the best TICS projects with the quarterly TIOBE Software Quality Award. There are more than 900 software projects of various multinationals world-wide that qualify divided into 3 categories:

  • large-sized projects (more than 500K lines of code)
  • mid-sized projects (more than 100K lines of code)
  • small-sized projects (less than 100K lines of code)

TIOBE Software Quality Award Q2 2016

The winner of the most ambitious award, the large-sized projects, for the second quarter of 2016 is …

Eleva System Control of Philips (Hamburg - Germany)

The complete top 5 of large-sized projects is listed below (out of 310 projects):

Q2 2016 Q1 2016 Project Company TQI Score TQI Level
1. (1) Eleva System Control Philips Healthcare Hamburg D 87.65%
2. (2) OTAS ASML Eindhoven NL 84.45%
3. (3) LIS ASML Eindhoven NL 82.55%
4. (5) NavKit NDS TomTom Amsterdam NL 82.38%
5. (-) FSC7.2 Controller Vanderlande Veghel NL 81.77%
The winning Eleva System Control team
elevasystemcontrol


The winners of the mid-sized projects are (out of 319 projects):

Q2 2016 Project Company TQI Score TQI Level
1. IMS Philips Digital Pathology Best NL 93.25%
2. TEM TAD FEI Company Acht NL 90.92%
3. Deauville TomTom Eindhoven NL 90.20%
The winning IMS team
IMS


The winner of the small-sized projects is (out of 965 projects):

Q2 2016 Project Company TQI Score TQI Level
1. QA Graph Client TomTom Amsterdam NL 99.97%


award
The plexiglass TIOBE QA Award

The Winning Eleva System Control Team

The Eleva System Control team runs TICS for its C and C++ code to check all 8 TQI metrics. The Eleva System Control drives several geometry components like tables, wall stands, ceiling suspended tubes, bucky units or collimators but also x-ray generators and non-graphical user interfaces. Its internal component based architecture provides flexibility to configure well defined building blocks, HW and belonging SW driver, which can be composed and reused in many different systems. This platform approach is helpful with respect to short development cycles but also to ease the maintenance, content and quality management. A picture of a system using the Eleva System Control software is shown below.

elevasystemcontroldevice


The Eleva System Control won the TIOBE QA Award by thanks to the following:

  • Quality is always a major driver due to the regulated environment and IEC62304
  • There is a long history of quality assurance tools like static code analysis, code review etc
  • Dedicated resources and management support for software quality assurance
  • Introduction of LEAN methodology to software development e.g. visual management and continuous improvement
  • Experienced team with quality mindset knowing the benefits of automated code quality measurements
  • Learning culture that distributes new techniques within the team e.g. unit test techniques

It was certainly not an easy route to achieve this. According to the team architect and software designer of the team this was mainly because the existing code base was already large. It is hard to apply software quality measurements to such a system and find a way to improve gradually while making sure that you are really improving the code instead of focusing on tool satisfaction.

According to the software team, TIOBE’s TICS framework helped to reach these goals in the following ways:

  • Central toolset that helps on visual software code quality assurance
  • Alignment of different tools from different vendors to a central entry point for engineers
  • Allows managers to easily observe improvements in code quality by having an easy quality indicator system
  • Setting the standards for software quality metrics, the TQI helps discovering the improvement points within our code base
  • Opening the field for competition with other software development teams
  • TICS viewer filters can be used to provide the visualization of our current SMART KPIs (LEAN)

Of course there is also room for improvement for the TICS tooling such as better performance, more customizations for code complexity and improved C/C++ code checkers.

To conclude this story we asked the winning team whether there is anything they would like to recommend to other software teams that wish to improve their code quality. Their answer consists of the following 5 key points:

  • Get the team on board, learn the benefits of code quality assurance
  • Set achievable targets and pursue the goals persistently
  • Set priorities for improvements and concentrate on the large benefits first
  • Have the right tools e.g. refactoring tool or unit test frameworks
  • Have dedicated resources to push the software quality assurance

The next award will be announced around the 1st of October 2016. According to the Eleva System Control team it will be hard to keep the high TQI scores due to changes in the code coverage tooling and adding/reviving old code. We will see!

Previous Winners

  • Q2 2014 - Q4 2014 Philips Healthcare Eleva UI Hamburg (D)
  • Q3 2013 - Q1 2014 ASML OTAS Eindhoven (NL)
  • Q1 2010 - Q2 2013 Philips Healthcare Eleva UI Hamburg (D)
  • Q1 2009 - Q4 2009 Océ Technologies VarioPrint Venlo (NL)
  • Q1 2008 - Q4 2008 NXP Semiconductors STB225 Southampton (UK)