GreenSQA SA is a Colombian company, with knowledge and more than 15 years of experience in software testing and implementation of standards, methodologies and models used in the software industry worldwide for Quality Assurance of both, software products and software development process.
Our main goal in GreenSQA is to provide our experience, knowledge and methodology for software development teams or areas of IT for development, maintenance and/or acceptance of their applications to ensure product conformity and integration solutions to its functional purpose, by the use and transfer of proven test methodologies.
Solution and Services Provided
One of our best customers contacted for an important and national context project, we were committed to certify quality of the “Biometric authentication” application, for which we decided to use an ALM – Application Lifecycle Management – quality testing and quality management solution. Biometric authentication software is necessary to assert that the any present person in the voting event is who declared to be. That application was developed to be use during “Colombian Congress elections” that took place on March 9 of 2014.
The Colombian democratic system implicitly demanded a strong and reliable testing process for any software application integrated in the solution in order to assure functionality, reliability and reduce the risk of electoral fraud. For example, the use of ID of dead people or use of non-registered people on the electoral event. To achieve the requirement, GreenSQA testing team with minimal effort of nine days, used Microsoft ALM technologies and VS2013 to manage, develop scripts to automate and execute more than 25.000 functional test cases manipulating the GUI.
The testing process was supported by: Team Foundation Server “Agile Scrum process template” and Visual Studio 2013. It was also necessary adjustments to the SUT (System Under Test) to ensure maximum quality level (none errors in all executed test cases). With that level of demand in terms of quality of the solution, it was necessary to implement a strong and granular testing process that ensure the desired result and avoid any kind of legal sanction for our client as mandatory Article 39 of 2011 Law that says: “National Civil Registry”, will implement, for the next elections, biometric identification of voters”. With an accurate and reliable biometric authentication process, our client brings transparency and security to the national electoral process in our country.
Our Customer had to test and certify in a short time the biometric application before being distributed to 174 cities, due to the amount of acceptance tests and time constraints, customer chose automation testing as the best option.
The challenge of ensure that de application works correctly, was assigned to GreenSQA who must certify the quality of master computers containing the “Biometric Application” to proceed with logistical process for copying and distribution in the Colombian territory, which was to send 8500 clones to 174 cities. All “Clon” computers lacked of any validity without the GreenSQA certification seal. However, the process: certification, cloning and distribution were performed in 9 calendar days remaining until the electoral event (That dead line, could not be postponed).
Due to security and confidentiality reasons, GreenSQA had to develop and refine the test robot in only two days, just before starting the logistics process for cloning and distribution in the Colombian territory. The machines had a reduced hardware and could not install additional software on them, also the execution environment of the test should be defined directly on the master machine, and in a comprehensive manner, ie for 174 cities in all polling stations. Because the number of tests to be executed for all of the 174 cities is so high and corresponds to system test cases, it was impossible to run them manually.
The most efficient way to deliver for the customer that amount of work was using coded UI tests (automated) and taking into account that must be executed in a time window of seven days because we already had wasted two days in the development of tests robots.
Using the following tools: VS2013, C # language, plus “GreenSQA INFramework” helper libraries, We created an agile scrum project in Visual Studio Online, and extraordinarily we have developed, administered and implemented as the best style of “Fast and Furious” the record amount of 26.515 test cases. During all those tests executions, the robot detected 3 main critical errors, which after being corrected promptly, prevented our customer of being involved in legal issues as political demands or electoral frauds. The robot is portable, and was packaged in a USB storage from which tests were executed for each master machine (the machine that would be cloned and distributed to one voting station), with that USB Mechanism we will not impact the final execution environment of the machines to be certified.
Solution and Services that were provided
Our key business driver was based in Agility and innovation, performing early and constant deliveries of certified “Biometric Applications” installations and ready to be cloned and distributed to Colombian territory, which gave to our customer a very high ROI (Return of Investment) when we replaced manual tests for automated managed tests within an Agile Scrum Process Template.
The response time, the reliability and the used technology were decisive for our customer, the challenge was big as well as the responsibility of testing. However, we were very responsible because we master the best ALM tool on the market, according to Gartner’s Magic Quadrant Nov 19-2013 (Observe -ADLM GARTNER’S MAGIC QUADRANT- as attached evidence) who said that Microsoft Team Foundation Server is a leading worldwide:
…“Microsoft is a Leader in the ADLM (Application Development Lifecycle Management) market with a strong customer base and partner base, together with a solid stream of innovation. Microsoft offers one of the broadest sets of ADLM functionality available in the market; second only to IBM. Since delivering the Azure-based version of Microsoft TFS, the vendor has moved to a consistent release train, moving new features first to the cloud-based versions and then into on-premises releases”…
Carvajal S.A. (Our customer) was aware that the project is critical and that the time box is very short, so our commercial offering was based on: agility, quality, low cost, reliability and continuous value generation, those features can only be achieved with “Scrum Process Template” and a specialized and committed ALM team like GreenSQA members. With the above, we could define a sprint that was adjusted to the complex conditions of the project.
Initially, the contractual scope of tests was described using the ATDD (Acceptance Test Driven Development) agile technique. That let the customer to understand clearly the tests to be done. In addition, we ensure that the management of the process and bugs would be driven in a robust platform that combined with our experience in the rapid development of robots, would become their business requirements viable to test under current conditions.