Challenges
This specialist in the distribution of sports equipment had for several years an E-Commerce solution deployed in several countries (France, Italy, Spain, Germany, Belgium, Netherlands…).
In 2014, it reorganized all its services, and started its reflection on Omni-Commerce. This consists of merging the web customer experience and the in-store customer experience, including support issues on customer returns.
2014 and 2015 are the first years of reflections on what Omni-Commerce should be, with the Customer User Experience at the heart of the reflections. A “Customer Centric Commerce” program is launched, based on Oracle Commerce software. Agile teams are formed in the second quarter of 2015.
Developments began in mid-2015, with a very quick desire to include testing activities within the program, in order to guarantee quality at all levels.
A long-term commitment
Consort has been involved in the testing activities of this client since 2007 (on the historical E-Commerce solution, as well as on the Product Information Management (SPID) and Digital Asset Management (Pixl) solutions), and brings a perfect mastery not only of E-commerce issues but also of the specificities of the client’s environment.
It is naturally that the client called upon the Consort teams to take responsibility for the quality of the application, on this project which was going to include the redesign of the commercial websites. Concretely, we accompanied them in :
The various test phases
- The implementation of a transversal test strategy for all the Agile teams, the latter being divided by functional domain (Product referencing, Customer data management, Supply Chain, Store applications…).
- The design of transverse test scenarios for the functionalities developed by all the teams.
- The implementation of an industrialized testing process, through a DevOps toolchain supporting CI (Continuous Integration including unit tests), but also CD (Continuous Delivery, including automated integration tests with Postman / Newman and automated GUI tests using Java / Maven / Cucumber / Selenium Webdriver projects)
The project management
- Recruitment and management of technical and functional QA, dedicated to operational testing activities.
- The management of the tests carried out by the countries at each release (with a GO Prod common to all countries) with UAT Leads in each country.
- Methodological support (Animation of the “3 amigos”, daily cross-functional meetings that precede the dailys of each team, participation in the implementation of a tool to facilitate the analysis of failed automated tests, animation of weekly QA synchro points, etc.)
Our knowledge of the client and the ability of our community of experts to understand the functional and technical specificities are essential assets.
David NOWAK | Practice Leader Test - Consort France
A wide range of services
The testing activities in such a context are numerous, due to the multiplicity of addressed teams, by DevOps, and by the international stakes.
In addition, the time-to-market and high availability elements of digital commerce are preponderant, leaving no room for non-quality.
The subjects of test management, understanding of functional and technical needs, design of manual tests, writing of automated back and front test scripts, as well as facilitating the analysis of failed test results, the quality of our recruitment and the support of new arrivals were at the heart of our support.
Transversal topics for the teams
- Test strategy across the program
- Animation (Kanban) of the first Daily Meeting, addressing operational needs
- Synchronization points of the Agile teams’ QAs
- Transversal issues (performance tests, management of the transverse software factory, management of Out-of-Production environments, management of user feedback during UAT, management of Prod feedback)
Integration testing
- Development of more than 500 automated API tests in Postman
- Advanced use of the tool (automated assertions via the “Tests” tab, use of the “Pre-Request Script” tab)
- Automated executions three times a day via Jenkins / Newman on environments dedicated to automated tests
- Daily analysis of failed test executions via the ARA tool
Automated HMI tests
- Development of more than 300 automated GUI tests using Java / Maven / Cucumber / Selenium Webdriver
- Automated executions three times a day, via Jenkins on dedicated automated test environments
- Daily analysis of failed test executions via the ARA tool
QAs' mentoring
- Definition of the workflow for issues raised by users in the different countries, on each application release (every 6 weeks)
- Animation of the progress of user tests in each country, via a UAT Lead in each country
- Management of the GO/NOGO in common with all the countries. A maximum of 2 versions of the application are supported, for all countries
Test tools
- Manual tests (>4000) written in RTC / RQM
- Integration tests: Postman / Newman
- GUI tests: Java / Maven / Cucumber / Selenium Webdriver
- Analysis of failed tests: ARA
- Performance tests: JMeter
25000
bugs identified before production release
0.05%
of anomalies seen in production
15
QAs on the program
You may also be interested in
Digital Inclusion - Did you know ?
Talking about inclusion means talking about our actions, our results, the way we approach our jobs and digital technology in general as levers for equal opportunities.
Bank - Development and implementation of KPIs using Tableau Software
Produce dashboards that provide a quick overview of user support activities.
Bank - Standardization of Basel regulatory models
Supporting the modelling of Basel parameters (PD, EAD, LGD) and model validation.