summaryrefslogtreecommitdiff
path: root/plans
AgeCommit message (Collapse)Author
2017-11-30plans: erp: add test plan overlaysChase Qi
Add test plan overlay for each board to customize test plan. Change-Id: Ib650dd1d5cb8f2ed60dc60b5440a038aac54437b Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-11-28Merge "test-runner: add support for test plan overlay"Dan Rue
2017-11-28test-runner: add support for test plan overlayChase Qi
On ERP testing, we need to skip disk partitioning test on boards that don't have the second hard drive installed. We may also need to amend test parameters or add new tests in the future. This patch add support for test plan overlay to: * skip tests. * amend test parameters. * add new tests. Change-Id: I9143b313b32f0c541fb08bacce80f371b1cf15e6 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-11-27plans: introduce linaro test plan v2Chase Qi
* Simplify test plan format. * Update test-runner for the change in test plan. * Update existing test plans to v2. Change-Id: Ic10e6eb3d17cbf54140831d0e030dcbbb95c75db Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-10-25plans/qcomlt/smoke.yaml: Add WLAN and HCI smoke testsAníbal Limón
Recently added and tested by Nicolas Dechesne [1]. [1] https://staging.validation.linaro.org/results/194938 Change-Id: Iea28180352678322bfac7382fa03bca3f17107da Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-10-25plans/qcomlt: Fix dragonboard410c device nameAníbal Limón
Change-Id: Ifca5c7ecaf82106980a9058f157fbf00a7da6c39 Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-10-20plan: erp: remove sysbench percpu subtestChase Qi
percpu run sysbench cpu test for each processor, it is mainly designed for big-little arch, which isn't the case on ERP platforms. Change-Id: I2a4e916aa200129a49d73cad860320cf2043855e Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-10-20plans: update erp test planChase Qi
* Use erp as test plan name instead of rpb_ee. * Removed release version from test plan name so that we don't have to update it for each release. * Added iozone and sysbench tests. Change-Id: Iaed1aa4e11eda45d06cb7510ae4c5da2b9b6011f Signed-off-by: Chase Qi <chase.qi@linaro.org> (cherry picked from commit e110ddba92baac35877e17ac285089b40f3fd559)
2017-10-11plans/qcomlt: Add test plansAníbal Limón
This test plans are divded into benchmark, somke and stress testing. The device is set to dragonboard-410c instead of apq8016-sbc because this test plans are aimed to run when main LAVA instance [1] upgrade to v2 version like LKFT [2]. [1] https://validation.linaro.org/scheduler/device_type/apq8016-sbc [2] https://lkft.validation.linaro.org/scheduler/device_type/dragonboard-410c Change-Id: Ic4742181335c36211173f74054dfb57fb6d047ef Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-06-27Add unixbench to rpb_ee_performance planDan Rue
Change-Id: I1b934127870b12dae97fddc70a81f562f14d854c Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-06-16linux: ltp: skip oom01 on RPKChase Qi
oom01 tries to kill bash and python which are needed by our test script. Prevent it from doing so causes 'Kernel panic - not syncing: Out of memory and no killable processes...' The issue needs to be fixed from ltp. Refer to https://projects.linaro.org/browse/QA-1662 Change-Id: I16ab3ffc6aa7a9e356464c9f6be8ad633a344c8b Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-05-15plans: Added lapack tests to rpb_ee_perfomance test planNaresh Kamboju
The LAPACK project supports the package in the sense that reports of errors or poor performance will gain immediate attention from the developers. Change-Id: I8cdfb072da3ce285fc1a02b4b2c53253af614d1b Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-04-19Rename test directory for disk partitioning testChase Qi
Change-Id: Idcd83a16e0f2f938f31eb312eccaa344b634512c Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-01-23automated: plans: fix indentation in linux-exampleNicolas Dechesne
when trying the current test plan , it failed with: Traceback (most recent call last): File "/work/linaro/test-definitions/automated/bin/test-runner", line 592, in <module> main() File "/work/linaro/test-definitions/automated/bin/test-runner", line 559, in main test_list = test_plan.test_list(args.kind) File "/work/linaro/test-definitions/automated/bin/test-runner", line 59, in test_list if 'tests' in requirement.keys(): AttributeError: 'str' object has no attribute 'keys' The YAML file is not properly written, so fix it. Change-Id: I7b3173f775f5a0bc479c2ecfa8943ef87da8c06a Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2016-12-08plans: added support for generatig CSV from test plansMilosz Wasilewski
Change-Id: If3066f32d52e6c6e253832faa3911629ccaa54c7 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-12-07plans: rpb_ee: fixed test plan namesMilosz Wasilewski
Test plan names were colliding. Changed the names to be different. Change-Id: I78951c635f8ffce8fbf5bf6cb80c322e3cd36915 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-12-02plans: added RPB EE test planMilosz Wasilewski
Reference Platform EE test plan is based on not yet approved requirements. This version will be used for testing 16.12 release Change-Id: I5160aeeabacda0bfea0b7fbfdfe8b0b8b13f743b Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-11-01plans: added test plan rendering scriptMilosz Wasilewski
Change-Id: I3765f688be40dc6fe0a91a9ed6ed72cc3dfd88db Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-08-30v2: linux: add dd write/read speed testChase Qi
- Added Linux dd write/read speed test - Optimized sh-test-lib Change-Id: I3bccfda212535e9a36b8e231b69c0dd2367a88f6 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-08-25v2: initial commitChase Qi
- Added utils, bin, and lib folders and related tools - Added Linux smoke test case as an example - Added test plan example that used to test test-runner Change-Id: I73693108db219cb67afc99525d80cab93f1eb9ea Signed-off-by: Chase Qi <chase.qi@linaro.org>