Angus Gratton
c671a0c3eb
build system: Initial cmake support, work in progress
2018-04-30 09:59:20 +10:00
He Yin Ling
7cfd08deca
test: fix join AP fail during AP power on
2018-04-16 09:27:46 +08:00
huchaoru
f409a33653
test: update ci test case
2018-04-10 14:08:10 +00:00
Ivan Grokhotkov
595ddfd825
Merge branch 'feature/build_ssc_in_multiple_ci_jobs' into 'master'
...
CI: support build SSC in multiple jobs
See merge request idf/esp-idf!1622
2018-04-03 18:20:38 +08:00
He Yin Ling
3b3ad875c4
test: use SSC_BLE_WIFI to test NVS cases
2018-04-02 18:13:52 +08:00
He Yin Ling
48e3e3efca
test: change SSC binary path
2018-03-29 19:40:07 +08:00
Michael (Xiao Xufeng)
15be0829fa
test(spi_master): test spi master speed performance by median value.
...
also increase the boundary of SPI limit by a little.
2018-03-16 16:37:19 +08:00
Ivan Grokhotkov
62f924544d
Merge branch 'test/spi_performance' into 'master'
...
test(spi_master): add performance display for spi master.
See merge request idf/esp-idf!1923
2018-02-08 22:59:40 +08:00
Michael (Xiao Xufeng)
a151767426
test(spi_master): add performance display for spi master.
2018-02-07 17:50:13 +08:00
Jeroen Domburg
70ab924dbb
Especially when internal memory fills up, some FreeRTOS structures (queues etc) get allocated in psram. These structures also contain a spinlock, which needs an atomic-compare-swap operation to work. The psram hardware, however, does not support this operation. As a workaround, this patch detects these spinlocks and will, instead of S32C1I, use equivalent C-code to simulate the behaviour, with an (internal) mux for atomicity.
2018-02-02 17:11:06 +08:00
He Yin Ling
63a401057c
test: enlarge https bin size threshold:
...
use performance matrix to tracking bin size is not convenient. bin size
do change for a lot reasons.
we'll implement a new method to track it. before that, set a large
enough threshold, so we can still keep tracking it.
2018-02-01 09:57:00 +08:00
chensheng
c9607e9753
test: fix BLE update conn param test case errors
2018-01-16 13:39:12 +08:00
Ivan Grokhotkov
6e1453e864
Merge branch 'feature/bot' into 'master'
...
CI: support customize test with @bot
See merge request !1502
2017-11-21 18:43:56 +08:00
He Yin Ling
81f806e676
test: change initial condition of unit test:
...
now UT App will not print test menu by default. it will print a prompt
to indicate it's ready. we can check this prompt instead of delay.
2017-11-20 17:51:27 +08:00
He Yin Ling
9395a702ef
test: check and collect performance via CI
2017-11-16 17:48:30 +08:00
houchenyao
f80824a2d8
test: support test for UT cases expect to reset
2017-11-07 12:19:39 +08:00
He Yin Ling
363a20abec
test: udpate new BLE known issues:
...
1. some cases caused by GATTC can't get correct attribute handle
2. some cases with increased fail ratio
2017-09-22 09:49:18 +08:00
yulong
09a3e4fd58
squesh the commit.
...
component/bt: Change the idf test KnownIssues file.
component/bt: Fixed the bug of gattc mutilple read.
2017-09-14 09:35:36 -04:00
chensheng
ac5e1f65b2
test:update BLE GATT MTU cases
2017-09-07 13:46:13 +08:00
houchenyao
cf64c7e9a6
unit test: add sd env and spi env for sdmmc
2017-08-22 21:01:34 +08:00
He Yin Ling
31f7e8d7e5
CI: add BLE test cases to CI
2017-06-27 10:35:33 +08:00
He Yin Ling
2e7f6a2247
test: add NVS compatible test case and CI job
2017-06-04 10:29:15 +08:00
He Yin Ling
659cd2af43
CI: remove readme content:
...
README will be updated in internal wiki
2017-05-08 11:44:45 +08:00
He Yin Ling
24862b1a6c
CI: remove CI configs and update test case files:
...
we'll auto assign cases to test jobs so we don't need those config
files. cases with different wifi modes will now be generated when
creating test case database, we need to remove them from YAML files.
2017-05-08 11:44:38 +08:00
Ivan Grokhotkov
e9913a11c1
Merge branch 'test/reboot_between_unit_test_cases' into 'release/v2.0'
...
CI: add reset between running each unit test cases
Unit test is designed to detect bug **within** each test case. Therefore we'll reset between each case to provide a clean context. We will later add stress cases to run unit test cases together to detect potential bugs.
See merge request !636
2017-04-10 12:59:49 +08:00
antti
0501507d6b
CI: add script for parsing unit test cases for CI from test files
...
Add python script that parses list of unit test cases for CI from component test folder
Modify .gitlab-ci.yml to run this script as part of build unit tests stage
2017-01-18 17:08:20 +08:00
Yinling
6c41080fd9
CI: update known issues
2017-01-04 19:27:58 +08:00
Yinling
b9a6d276a2
CI: update known issues
2017-01-03 14:06:50 +08:00
Yinling
c47bc43afd
CI: fix bug that restore initial condition fail:
...
in STA+AP mode, when STA is reconnecting to external AP, its AP
interface is not connectable. do disconnect on STA interface first
2017-01-03 14:06:50 +08:00
Ivan Grokhotkov
8f3c74353a
newlib: fix unit test name in test config
2016-12-13 13:24:01 +08:00
Yinling
a283042258
switch socket recv print for stress test
2016-12-09 10:45:10 +08:00
Yinling
5e1cdd3422
fix bug in test case TCPIP_TCP_5101
...
test time is not set in test case and not used to control test time
2016-12-08 16:15:49 +08:00
Yinling
ec40053720
add supported stress test cases to CI
2016-12-06 15:41:02 +08:00
antti
13e7e69239
remove unexisting tests in unit test CIConfig
2016-11-23 16:22:51 +08:00
He Yin Ling
47910466ce
Set result "Succeed" for passed cases
2016-11-02 20:54:22 +08:00
He Yin Ling
e56b745527
incorrect "/", should be "\"
2016-11-02 20:21:46 +08:00
He Yin Ling
c12aeb1127
add case select by name mark " before case name
2016-11-02 20:12:43 +08:00
Yinling
2e319705ec
forget to break when test succeed
2016-11-02 19:41:33 +08:00
Yinling
fdff6b2b01
run unit test case by case name
2016-11-02 19:08:55 +08:00
Yinling
5784586041
integrate unit test to CI
2016-11-01 19:30:42 +08:00
Yinling
3edcf5b096
fix bug for case WIFI_CONN_0102:
...
after set AP, STA will disconnected and do reconnect. scan could fail as reconnect also use scan
2016-10-24 18:59:56 +08:00
Yinling
abd4dc7d43
add know issue ^WIFI_CONN_0601:
...
in STA+AP mode, when STA reconencting to enternal AP, external STA can't connect to AP
2016-10-24 18:42:40 +08:00
Yinling
d3d8c04535
add known issue exception when setting mac address:
...
WIFI_ADDR_0101,^WIFI_ADDR_0101
2016-10-20 16:43:04 +08:00
Yinling
5e8849d032
modify TCPIP_DHCP_0211:
...
delay 30s to make sure STA got enough time to disconnect and reconnect.
2016-10-20 11:28:06 +08:00
Yinling
c350972eac
update following know issues:
...
1. ^WIFI_CONN_0801: auth change event not correct
2. WIFI_SCAN_0303: scan interact with JAP not correct
3. ^WIFI_SCAN_0103,^WIFI_SCAN_0105: no scan done event
4. ^TCPIP_UDP_0304,TCPIP_UDP_0104: UDP poor performance
2016-10-19 20:22:43 +08:00
Yinling
18ebc6411e
fix bug for WIFI_SCAN_0304: need to set AP config first
2016-10-19 18:03:43 +08:00
Yinling
6eaf595a0e
change test WAN server URL:
...
form iot.espressif.cn to factory.espressif.cn
2016-10-19 18:00:27 +08:00
Yinling
0324373cd1
update auto generated CI job config
2016-10-19 15:23:07 +08:00
Yinling
c2b63a614e
sync test env from auto_test_script (add SSC_T5_IOT1)
2016-10-19 15:22:13 +08:00
Yinling
de7b2f5a09
fix following test case bugs:
...
1. (^)TCPIP_DHCP_0101, (^)TCPIP_DHCP_0301: IDF set IP 0.0.0.0 may return error, don't check the result of setting IP to 0.0.0.0;
2. rename (^)TCPIP_DHCP_0102 to (^)TCPIP_DHCP_0212 as it's a DHCP server test case;
3. (^)TCPIP_TCP_0204,(^)TCPIP_TCP_0210,(^)TCPIP_UDP_0201,(^)TCPIP_UDP_0202: recv thread can't be deleted, change case to not create recv thread when create socket ;
4. (^)TCPIP_TCP_0206,(^)TCPIP_TCP_0212: query TCP server status format changed.
5. WIFI_SCAN_0301: check command error and test environment not correct
6. WIFI_SCAN_0302, WIFI_SCAN_0303, WIFI_SCAN_0304: test environment not correct
2016-10-19 15:16:47 +08:00
Yinling
3f521c4afa
update KnowIssues:
...
1. unsupported cases by "phy" command
2. DHCP server behavior different from ESP8266
3. TCP failed cases causes by unstable TCP behavior
4. UDP failed cases by poor UDP performance
2016-10-19 15:11:38 +08:00
Yinling
b72d22041c
rename components/test to idf_test:
...
1. test will be categorized by test level
2. add test level as attribute to test cases
3. will select TestCaseScript by the test cases added to CI (currently no test case uses test case script)
4. adding test level to test jobs
5. update .gitlab-ci.yml, each job need to set its test case file path
6. update .gitlab-ci.yml, test case path for test report is changed to idf_test
2016-10-12 11:17:56 +08:00