CI: do not run cases likely to fail

This commit is contained in:
He Yin Ling 2020-07-16 17:18:51 +08:00
parent 83895b4e78
commit ce88e9d3fe
10 changed files with 17 additions and 98 deletions

View file

@ -1,88 +1,7 @@
# NOT SUPPORT
# ICMP send Ping not supported
ESP32.TCPIP_ICMP_0101
ESP32.TCPIP_ICMP_0101_01
# Bug or not stable cases
# Wifi scan issue
ESP32.WIFI_SCAN_0303
ESP32.WIFI_SCAN_0303_01
ESP32.WIFI_CONN_0302
ESP32.WIFI_CONN_0302_01
ESP32.WIFI_MODE_0102
ESP32.WIFI_MODE_0103
ESP32.WIFI_ADDR_0102
ESP32.WIFI_ADDR_0102_01
# IGMP
ESP32.TCPIP_IGMP_0201
ESP32.TCPIP_IGMP_0201_01
ESP32.TCPIP_IGMP_0202
ESP32.TCPIP_IGMP_0202_01
ESP32.TCPIP_IGMP_0204
ESP32.TCPIP_IGMP_0204_01
ESP32.TCPIP_IGMP_0301
ESP32.TCPIP_IGMP_0301_01
ESP32.TCPIP_IGMP_0303
ESP32.TCPIP_IGMP_0303_01
ESP32.TCPIP_IGMP_0402
ESP32.TCPIP_IGMP_0402_01
ESP32.TCPIP_IGMP_0406
ESP32.TCPIP_IGMP_0406_01
# TCP
ESP32.TCPIP_TCP_0401_01_02
# UDP
ESP32.TCPIP_UDP_0103
ESP32.TCPIP_UDP_0103_01
ESP32.TCPIP_UDP_0103_02
ESP32.TCPIP_UDP_0103_01_02
# BLE
# BT heap size issue # BT heap size issue
ESP32.BTSTK_MISC_0301 ESP32.BTSTK_MISC_0301
# SMP
ESP32.BTSTK_SMP_05001
ESP32.BTSTK_SMP_05002
ESP32.BTSTK_SMP_05003
ESP32.BTSTK_SMP_06004
ESP32.BTSTK_SMP_07007
ESP32.BTSTK_SMP_07006
# multi connect
ESP32.BTSTK_GAP_04002
ESP32.BTSTK_GAP_04003
ESP32.BTSTK_GAP_10001
ESP32.BTSTK_GAP_10002
ESP32.BTSTK_GAP_10003
ESP32.BTSTK_GAP_10004
ESP32.BTSTK_GAP_11001
ESP32.BTSTK_GAP_11002
ESP32.BTSTK_GAP_12001
ESP32.BTSTK_GAP_12002
ESP32.BTSTK_GATT_30001
ESP32.BTSTK_GATT_30002
ESP32.BTSTK_GATT_30003
ESP32.BTSTK_GATT_31001
ESP32.BTSTK_GATT_31002
ESP32.BTSTK_GATT_31003
ESP32.BTSTK_GATT_32001
ESP32.BTSTK_GATT_32002
ESP32.BTSTK_GATT_32003
ESP32.BTSTK_GATT_32004
ESP32.BTSTK_GATT_33001
ESP32.BTSTK_GATT_33002
ESP32.BTSTK_GATT_33003
ESP32.BTSTK_GATT_34001
ESP32.BTSTK_GATT_34002
ESP32.BTSTK_GATT_34003
# GATT read multiple # GATT read multiple
ESP32.BTSTK_GATT_27002 ESP32.BTSTK_GATT_27002
ESP32.BTSTK_GATT_27003 ESP32.BTSTK_GATT_27003

View file

@ -1651,6 +1651,7 @@ test cases:
- *check_connection - *check_connection
- ID: BTSTK_SMP_05003 - ID: BTSTK_SMP_05003
<<: *SMP_CASE <<: *SMP_CASE
CI ready: 'No'
test point 2: BLE SMP unsuccessful pair reply test test point 2: BLE SMP unsuccessful pair reply test
summary: BLE SMP unsuccessful passkey entry on both side test summary: BLE SMP unsuccessful passkey entry on both side test
steps: | steps: |
@ -1766,6 +1767,7 @@ test cases:
- ['P SSC[1-2] C +BLESMP:AuthComplete,Success,0'] - ['P SSC[1-2] C +BLESMP:AuthComplete,Success,0']
- ID: BTSTK_SMP_06004 - ID: BTSTK_SMP_06004
<<: *SMP_CASE <<: *SMP_CASE
CI ready: 'No'
test point 2: BLE SMP use API in abnormal state test point 2: BLE SMP use API in abnormal state
summary: BLE SMP master disconnect during pairing and repairing summary: BLE SMP master disconnect during pairing and repairing
steps: | steps: |

View file

@ -1,5 +1,5 @@
test cases: test cases:
- CI ready: 'Yes' - CI ready: 'No'
ID: TCPIP_ICMP_0101 ID: TCPIP_ICMP_0101
SDK: |- SDK: |-
8266_NonOS 8266_NonOS

View file

@ -545,7 +545,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: IGMP API parameter check test point 2: IGMP API parameter check
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: TCPIP_IGMP_0201 ID: TCPIP_IGMP_0201
SDK: |- SDK: |-
8266_RTOS 8266_RTOS
@ -593,7 +593,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: IGMP send/recv test test point 2: IGMP send/recv test
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: TCPIP_IGMP_0202 ID: TCPIP_IGMP_0202
SDK: |- SDK: |-
8266_RTOS 8266_RTOS
@ -703,7 +703,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: IGMP send/recv test test point 2: IGMP send/recv test
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: TCPIP_IGMP_0204 ID: TCPIP_IGMP_0204
SDK: |- SDK: |-
8266_RTOS 8266_RTOS
@ -759,7 +759,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: IGMP send/recv test test point 2: IGMP send/recv test
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: TCPIP_IGMP_0301 ID: TCPIP_IGMP_0301
SDK: |- SDK: |-
8266_RTOS 8266_RTOS
@ -845,7 +845,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: IGMP API parameter check test point 2: IGMP API parameter check
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: TCPIP_IGMP_0303 ID: TCPIP_IGMP_0303
SDK: |- SDK: |-
8266_RTOS 8266_RTOS
@ -1151,7 +1151,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: IGMP send/recv test test point 2: IGMP send/recv test
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: TCPIP_IGMP_0402 ID: TCPIP_IGMP_0402
SDK: |- SDK: |-
8266_RTOS 8266_RTOS
@ -1377,7 +1377,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: IGMP send/recv test test point 2: IGMP send/recv test
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: TCPIP_IGMP_0406 ID: TCPIP_IGMP_0406
SDK: |- SDK: |-
8266_RTOS 8266_RTOS

View file

@ -2167,7 +2167,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: socket option test test point 2: socket option test
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: TCPIP_TCP_0401 ID: TCPIP_TCP_0401
SDK: |- SDK: |-
8266_NonOS 8266_NonOS

View file

@ -43,7 +43,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: mac address function test test point 2: mac address function test
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: WIFI_ADDR_0102 ID: WIFI_ADDR_0102
SDK: |- SDK: |-
8266_NonOS 8266_NonOS

View file

@ -418,7 +418,7 @@ test cases:
test point 1: interaction test point 1: interaction
test point 2: Conn interact with other WiFi operation test point 2: Conn interact with other WiFi operation
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: WIFI_CONN_0302 ID: WIFI_CONN_0302
SDK: |- SDK: |-
ESP32_IDF ESP32_IDF

View file

@ -47,7 +47,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: wifi mode fucntion test point 2: wifi mode fucntion
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: WIFI_MODE_0102 ID: WIFI_MODE_0102
SDK: |- SDK: |-
8266_NonOS 8266_NonOS
@ -88,7 +88,7 @@ test cases:
test point 1: basic function test point 1: basic function
test point 2: wifi mode fucntion test point 2: wifi mode fucntion
version: v1 (2016-8-15) version: v1 (2016-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: WIFI_MODE_0103 ID: WIFI_MODE_0103
SDK: |- SDK: |-
8266_NonOS 8266_NonOS

View file

@ -587,7 +587,7 @@ test cases:
test point 1: interaction test point 1: interaction
test point 2: Scan interact with other WiFi operation test point 2: Scan interact with other WiFi operation
version: v1 (2015-8-15) version: v1 (2015-8-15)
- CI ready: 'Yes' - CI ready: 'No'
ID: WIFI_SCAN_0303 ID: WIFI_SCAN_0303
SDK: ESP32_IDF SDK: ESP32_IDF
Test App: SSC Test App: SSC

View file

@ -446,14 +446,13 @@ IT_004:
IT_005: IT_005:
extends: .test_template extends: .test_template
parallel: 2
tags: tags:
- ESP32_IDF - ESP32_IDF
- SSC_T1_5 - SSC_T1_5
IT_006: IT_006:
extends: .test_template extends: .test_template
parallel: 8 parallel: 7
tags: tags:
- ESP32_IDF - ESP32_IDF
- SSC_T1_6 - SSC_T1_6
@ -523,7 +522,6 @@ IT_017:
IT_018: IT_018:
extends: .test_template extends: .test_template
parallel: 2
tags: tags:
- ESP32_IDF - ESP32_IDF
- SSC_T1_9 - SSC_T1_9