Crash_Override/OVMS3-idf
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

CI: do not run cases likely to fail

Browse source
This commit is contained in:
He Yin Ling 2020-07-16 17:18:51 +08:00
parent 50b5b3184e
commit 103503ba56
10 changed files with 17 additions and 98 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

81
components/idf_test/integration_test/KnownIssues
View file

@ -1,88 +1,7 @@
# NOT SUPPORT
# ICMP send Ping not supported
ESP32.TCPIP_ICMP_0101
ESP32.TCPIP_ICMP_0101_01
# Bug or not stable cases
# Wifi scan issue
ESP32.WIFI_SCAN_0303
ESP32.WIFI_SCAN_0303_01
ESP32.WIFI_CONN_0302
ESP32.WIFI_CONN_0302_01
ESP32.WIFI_MODE_0102
ESP32.WIFI_MODE_0103
ESP32.WIFI_ADDR_0102
ESP32.WIFI_ADDR_0102_01
# IGMP
ESP32.TCPIP_IGMP_0201
ESP32.TCPIP_IGMP_0201_01
ESP32.TCPIP_IGMP_0202
ESP32.TCPIP_IGMP_0202_01
ESP32.TCPIP_IGMP_0204
ESP32.TCPIP_IGMP_0204_01
ESP32.TCPIP_IGMP_0301
ESP32.TCPIP_IGMP_0301_01
ESP32.TCPIP_IGMP_0303
ESP32.TCPIP_IGMP_0303_01
ESP32.TCPIP_IGMP_0402
ESP32.TCPIP_IGMP_0402_01
ESP32.TCPIP_IGMP_0406
ESP32.TCPIP_IGMP_0406_01
# TCP
ESP32.TCPIP_TCP_0401_01_02
# UDP
ESP32.TCPIP_UDP_0103
ESP32.TCPIP_UDP_0103_01
ESP32.TCPIP_UDP_0103_02
ESP32.TCPIP_UDP_0103_01_02
# BLE
# BT heap size issue
ESP32.BTSTK_MISC_0301
# SMP
ESP32.BTSTK_SMP_05001
ESP32.BTSTK_SMP_05002
ESP32.BTSTK_SMP_05003
ESP32.BTSTK_SMP_06004
ESP32.BTSTK_SMP_07007
ESP32.BTSTK_SMP_07006
# multi connect
ESP32.BTSTK_GAP_04002
ESP32.BTSTK_GAP_04003
ESP32.BTSTK_GAP_10001
ESP32.BTSTK_GAP_10002
ESP32.BTSTK_GAP_10003
ESP32.BTSTK_GAP_10004
ESP32.BTSTK_GAP_11001
ESP32.BTSTK_GAP_11002
ESP32.BTSTK_GAP_12001
ESP32.BTSTK_GAP_12002
ESP32.BTSTK_GATT_30001
ESP32.BTSTK_GATT_30002
ESP32.BTSTK_GATT_30003
ESP32.BTSTK_GATT_31001
ESP32.BTSTK_GATT_31002
ESP32.BTSTK_GATT_31003
ESP32.BTSTK_GATT_32001
ESP32.BTSTK_GATT_32002
ESP32.BTSTK_GATT_32003
ESP32.BTSTK_GATT_32004
ESP32.BTSTK_GATT_33001
ESP32.BTSTK_GATT_33002
ESP32.BTSTK_GATT_33003
ESP32.BTSTK_GATT_34001
ESP32.BTSTK_GATT_34002
ESP32.BTSTK_GATT_34003
# GATT read multiple
ESP32.BTSTK_GATT_27002
ESP32.BTSTK_GATT_27003

2
components/idf_test/integration_test/TC_IT_BTSTK_SMP.yml
View file

@ -1651,6 +1651,7 @@ test cases:
- *check_connection
- ID: BTSTK_SMP_05003
<<: *SMP_CASE
CI ready: 'No'
test point 2: BLE SMP unsuccessful pair reply test
summary: BLE SMP unsuccessful passkey entry on both side test
steps: |
@ -1766,6 +1767,7 @@ test cases:
- ['P SSC[1-2] C +BLESMP:AuthComplete,Success,0']
- ID: BTSTK_SMP_06004
<<: *SMP_CASE
CI ready: 'No'
test point 2: BLE SMP use API in abnormal state
summary: BLE SMP master disconnect during pairing and repairing
steps: |

2
components/idf_test/integration_test/TC_IT_TCPIP_ICMP.yml
View file

@ -1,5 +1,5 @@
test cases:
- CI ready: 'Yes'
- CI ready: 'No'
ID: TCPIP_ICMP_0101
SDK: |-
8266_NonOS

14
components/idf_test/integration_test/TC_IT_TCPIP_IGMP.yml
View file

@ -545,7 +545,7 @@ test cases:
test point 1: basic function
test point 2: IGMP API parameter check
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: TCPIP_IGMP_0201
SDK: |-
8266_RTOS
@ -593,7 +593,7 @@ test cases:
test point 1: basic function
test point 2: IGMP send/recv test
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: TCPIP_IGMP_0202
SDK: |-
8266_RTOS
@ -703,7 +703,7 @@ test cases:
test point 1: basic function
test point 2: IGMP send/recv test
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: TCPIP_IGMP_0204
SDK: |-
8266_RTOS
@ -759,7 +759,7 @@ test cases:
test point 1: basic function
test point 2: IGMP send/recv test
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: TCPIP_IGMP_0301
SDK: |-
8266_RTOS
@ -845,7 +845,7 @@ test cases:
test point 1: basic function
test point 2: IGMP API parameter check
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: TCPIP_IGMP_0303
SDK: |-
8266_RTOS
@ -1151,7 +1151,7 @@ test cases:
test point 1: basic function
test point 2: IGMP send/recv test
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: TCPIP_IGMP_0402
SDK: |-
8266_RTOS
@ -1377,7 +1377,7 @@ test cases:
test point 1: basic function
test point 2: IGMP send/recv test
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: TCPIP_IGMP_0406
SDK: |-
8266_RTOS

2
components/idf_test/integration_test/TC_IT_TCPIP_TCP.yml
View file

@ -2167,7 +2167,7 @@ test cases:
test point 1: basic function
test point 2: socket option test
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: TCPIP_TCP_0401
SDK: |-
8266_NonOS

2
components/idf_test/integration_test/TC_IT_WIFI_ADDR.yml
View file

@ -43,7 +43,7 @@ test cases:
test point 1: basic function
test point 2: mac address function test
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: WIFI_ADDR_0102
SDK: |-
8266_NonOS

2
components/idf_test/integration_test/TC_IT_WIFI_CONN.yml
View file

@ -418,7 +418,7 @@ test cases:
test point 1: interaction
test point 2: Conn interact with other WiFi operation
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: WIFI_CONN_0302
SDK: |-
ESP32_IDF

4
components/idf_test/integration_test/TC_IT_WIFI_MODE.yml
View file

@ -47,7 +47,7 @@ test cases:
test point 1: basic function
test point 2: wifi mode fucntion
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: WIFI_MODE_0102
SDK: |-
8266_NonOS
@ -88,7 +88,7 @@ test cases:
test point 1: basic function
test point 2: wifi mode fucntion
version: v1 (2016-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: WIFI_MODE_0103
SDK: |-
8266_NonOS

2
components/idf_test/integration_test/TC_IT_WIFI_SCAN.yml
View file

@ -587,7 +587,7 @@ test cases:
test point 1: interaction
test point 2: Scan interact with other WiFi operation
version: v1 (2015-8-15)
- CI ready: 'Yes'
- CI ready: 'No'
ID: WIFI_SCAN_0303
SDK: ESP32_IDF
Test App: SSC

4
tools/ci/config/target-test.yml
View file

@ -548,14 +548,13 @@ IT_004:
IT_005:
extends: .test_template
parallel: 2
tags:
- ESP32_IDF
- SSC_T1_5
IT_006:
extends: .test_template
parallel: 8
parallel: 7
tags:
- ESP32_IDF
- SSC_T1_6
@ -625,7 +624,6 @@ IT_017:
IT_018:
extends: .test_template
parallel: 2
tags:
- ESP32_IDF
- SSC_T1_9