python自動化之如何利用allure生成測試報告
Allure測試報告框架幫助你輕松實現(xiàn)”高大上”報告展示。本文通過示例演示如何從0到1集成Allure測試框架。重點展示了如何將Allure集成到已有的自動化測試工程中、以及如何實現(xiàn)報表的優(yōu)化展示。Allure非常強大,支持多種語言多種測試框架,無論是Java/Python還是Junit/TestNG,其他語言或者框架實現(xiàn)的流程和本文一致,具體配置參照各語言框架規(guī)范
安裝安裝allure
Windows用戶:
scoop install allure (需要先下載并安裝Scoop,該方法無需配置環(huán)境變量)MAC用戶:
通過Homebrew進行自動安裝 brew install allure (如果Homebrew版本比較舊,需要先升級Homebrew,否則安裝的allure版本也很老,可能會與Python插件不兼容)手動安裝:
可以從官網(wǎng) https://repo.maven.apache.org/maven2/io/qameta/allure/allure-commandline/ 手動下載目前最新版本為2.13.6下載后解壓并配置環(huán)境變量
安裝allure-pytest插件
pip install allure-pytestallure常用特性
希望在報告中看到測試功能,子功能或場景,測試步驟,包括測試附加信息可以使用@feature,@story,@step,@attach
步驟:
import allure 功能上加@allure.feature('功能名稱') 子功能上加@allure.story('子功能名稱') 步驟上加@allure.step('步驟細節(jié)') @allure.attach('具體文本信息'),需要附加的信息,可以是數(shù)據(jù),文本,圖片,視頻,網(wǎng)頁 如果只測試部分功能運行的時候可以加限制過濾: pytest 文件名 --allure-features '需要運行的功能名稱' allure特性—feature/story@allure.feature與@allure.store的關(guān)系
feature相當于一個功能,一個大的模塊,將case分類到某個feature中,報告中在behaviore中顯示,相當于testsuite story相當于對應這個功能或者模塊下的不同場景,分支功能,屬于feature之下的結(jié)構(gòu),報告在features中顯示,相當于testcase feature與story類似于父與子關(guān)系step特性
測試過程中每個步驟,一般放在具體邏輯方法中 可以放在關(guān)鍵步驟中,在報告中顯示 在app,web自動化測試中,建議每切換到一個新的頁面當做一個step 用法: @allure.step() 只能以裝飾器的形式放在類或方法上面with allure.step(): 可以放在測試用例方法里面,但測試步驟的代碼需要被該語句包含運行:
在測試執(zhí)行期間收集結(jié)果
pytest [測試文件] -s -q --alluredir=./result --clean-alluredir
--alluredir這個選項,用于指定存儲測試結(jié)果的路徑 --clean-alluredir 這個選項用來清除之前生成的結(jié)果查看測試報告:
方法一:測試完成后查看實際報告,在線看報告,會直接打開默認瀏覽器展示當前報告
allure serve ./result
方法二:從結(jié)果生成報告,這是一個啟動tomcat的服務,需要兩個步驟
生成報告:
allure generate ./result -o ./report --clean (注意:--clean用來清除之前已生成的報告)
打開報告:
allure open -h 127.0.0.1 -p 8883 ./report (該方法直接生成一個tomcat服務,可遠程訪問)
舉個例子:
有如下代碼文件
#!/usr/bin/python# -*- coding: UTF-8 -*-'''@author:chenshifeng@file:test_allure.py@time:2020/10/10'''import allureimport [email protected](’登錄模塊’)class TestLogin(): @allure.story(’登錄成功’) @allure.title(’登錄成功標題’) def test_login_sucess(self):with allure.step(’步驟1:打開應用’): print(’應用已打開’)with allure.step(’步驟2:進入登錄頁面’): print(’登錄頁面已打開’)with allure.step(’步驟3:輸入用戶名和密碼’): print(’用戶名和密碼輸入成功’)print(’登錄測試用例:登錄成功’) @allure.story(’登錄成功’) def test_login_sucess2(self):assert ’1’ == 1print(’登錄測試用例:登錄成功’) @allure.story(’登錄失敗’) def test_login_failure_a(self):print(’登錄測試用例:登錄失敗,用戶名缺失’) @allure.story(’登錄失敗’) def test_login_failure_b(self):print(’登錄測試用例:登錄失敗,密碼缺失’) @allure.story(’登錄失敗’) def test_login_failure_c(self):with allure.step(’輸入用戶名’): print(’已輸入用戶名’)with allure.step(’輸入密碼’): print(’已輸入密碼’)with allure.step(’點擊登錄’): print(’已點擊登錄’)print(’登錄測試用例:登錄失敗,密碼錯誤’)@allure.feature(’搜索模塊’)class TestSearch(): def test_search1(self):print(’搜索用例1’) TEST_CASE_LINK = ’https://mirrors.huaweicloud.com/’ @allure.testcase(TEST_CASE_LINK,’測試用例連接’) def test_search2(self):print(’搜索用例2’) @allure.step(’搜索步驟’) def test_search3(self):print(’搜索用例3’)
依次執(zhí)行命令:
pytest test_allure.py --alluredir=./result --clean-alluredir
allure serve ./result
chenshifengdeMacBook-Pro:testcode chenshifeng$ pytest test_allure.py --alluredir=./result --clean-alluredir============================================================================= test session starts =============================================================================platform darwin -- Python 3.9.0, pytest-6.1.1, py-1.9.0, pluggy-0.13.1rootdir: /Users/chenshifeng/MyCode/PythonCode/SFDSZL/test_pytest, configfile: pytest.iniplugins: allure-pytest-2.8.18collected 8 items test_allure.py .F...... [100%]================================================================================== FAILURES ===================================================================================________________________________________________________________________ TestLogin.test_login_sucess2 _________________________________________________________________________self = <test_allure.TestLogin object at 0x7fef3d5cba90> @allure.story(’登錄成功’) def test_login_sucess2(self):> assert ’1’ == 1E AssertionError: assert ’1’ == 1test_allure.py:27: AssertionError=========================================================================== short test summary info ===========================================================================FAILED test_allure.py::TestLogin::test_login_sucess2 - AssertionError: assert ’1’ == 1========================================================================= 1 failed, 7 passed in 0.07s =========================================================================chenshifengdeMacBook-Pro:testcode chenshifeng$ allure serve ./result Generating report to temp directory...Report successfully generated to /var/folders/p0/3_7fwrvx6n3ftpfd4wjb01300000gn/T/7024790777193223986/allure-reportStarting web server...2020-10-13 21:39:56.174:INFO::main: Logging initialized @6818ms to org.eclipse.jetty.util.log.StdErrLogServer started at <http://192.168.12.100:58977/>. Press <Ctrl+C> to exit
生成的報告:
allure特性-testcase
關(guān)聯(lián)測試用例(可以直接給測試用例的地址鏈接)
例子:
TEST_CASE_LINK = ’https://mirrors.huaweicloud.com/’@allure.testcase(TEST_CASE_LINK,’測試用例連接’)def test_search(self): print(’搜索用例’)
通常測試有P0、冒煙測試、驗證上線測試。按重要性級別來執(zhí)行的,比如上線要把主流程和重要模塊都跑一遍,可通過以下方法解決
通過附加@pytest.mark標記
通過allure.feature,allure.story
也可以通過allure.severity來附加標記
級別: trivial:不重要,輕微缺陷(必輸項無提示,或者提示不規(guī)范) minor 不太重要,次要缺陷(界面錯誤與UI需求不符) normal:正常問題,普通缺陷(數(shù)值計算錯誤) critical:嚴重,臨界缺陷(功能點缺失) blocker:阻塞,中斷缺陷(客戶端程序無響應,無法執(zhí)行下一步操作)使用方法:
在方法、函數(shù)和類上面加 @allure.severity(allure.severity_level.TRIVIAL)
執(zhí)行:
pytest -s -v 文件名 --allure-severities normal,critical
舉例說明:
#!/usr/bin/python# -*- coding: UTF-8 -*-'''@author:chenshifeng@file:test_severity.py@time:2020/10/11'''import allureimport pytest# 不加任何標記,默認normaldef test_with_no_severity(): pass# trivial:不重要,輕微缺陷(必輸項無提示,或者提示不規(guī)范)@allure.severity(allure.severity_level.TRIVIAL)def test_with_trivial_severity(): pass# minor 級別 不太重要,次要缺陷(界面錯誤與UI需求不符)@allure.severity(allure.severity_level.MINOR)def test_with_minor_severity(): pass# normal:正常問題,普通缺陷(數(shù)值計算錯誤)@allure.severity(allure.severity_level.NORMAL)def test_with_normal_severity(): pass# critical:嚴重,臨界缺陷(功能點缺失)@allure.severity(allure.severity_level.CRITICAL)def test_with_ritical_severity(): pass# blocker:阻塞,中斷缺陷(客戶端程序無響應,無法執(zhí)行下一步操作)@allure.severity(allure.severity_level.BLOCKER)def test_with_blocker_severity(): [email protected](allure.severity_level.NORMAL)class TestClassWithNormalSeverity(object): # 不加任何標記,默認為同class級別 def test_inside_with_normal_severity(self):pass # 重新設置了critical級別 @allure.severity(allure.severity_level.CRITICAL) def test_inside_with_critical_severity(self):pass
執(zhí)行:
chenshifengdeMacBook-Pro:testcode chenshifeng$ pytest test_severity.py --alluredir=./result --clean-alluredir -vs============================================================================= test session starts =============================================================================platform darwin -- Python 3.9.0, pytest-6.1.1, py-1.9.0, pluggy-0.13.1 -- /usr/local/bin/python3.9cachedir: .pytest_cacherootdir: /Users/chenshifeng/MyCode/PythonCode/SFDSZL/test_pytest, configfile: pytest.iniplugins: allure-pytest-2.8.18collected 8 items test_severity.py::test_with_no_severity PASSEDtest_severity.py::test_with_trivial_severity PASSEDtest_severity.py::test_with_minor_severity PASSEDtest_severity.py::test_with_normal_severity PASSEDtest_severity.py::test_with_ritical_severity PASSEDtest_severity.py::test_with_blocker_severity PASSEDtest_severity.py::TestClassWithNormalSeverity::test_inside_with_normal_severity PASSEDtest_severity.py::TestClassWithNormalSeverity::test_inside_with_critical_severity PASSED============================================================================== 8 passed in 0.03s ==============================================================================chenshifengdeMacBook-Pro:testcode chenshifeng$ allure serve ./result Generating report to temp directory...Report successfully generated to /var/folders/p0/3_7fwrvx6n3ftpfd4wjb01300000gn/T/17788207943997663035/allure-reportStarting web server...2020-10-13 22:27:49.842:INFO::main: Logging initialized @6620ms to org.eclipse.jetty.util.log.StdErrLogServer started at <http://192.168.12.100:59696/>. Press <Ctrl+C> to exit
百度搜索:
#!/usr/bin/python# -*- coding: UTF-8 -*-'''@author:chenshifeng@file:test_baidudemo.py@time:2020/10/13'''import pytestimport allurefrom selenium import webdriverimport [email protected](’https://www.github.com’)@allure.feature('百度搜索')@pytest.mark.parametrize(’test_data1’,[’allure’,’pytest’,’unittest’])def test_steps_demo(test_data1): with allure.step(’打開百度網(wǎng)頁’):driver=webdriver.Chrome()driver.get(’http://www.baidu.com’)driver.maximize_window() with allure.step(f’輸入搜索詞:{test_data1}’):driver.find_element_by_id(’kw’).send_keys(test_data1)time.sleep(2)driver.find_element_by_id(’su’).click()time.sleep(2) with allure.step(’保存圖片’):driver.save_screenshot(’./screenshot/baidu.png’)allure.attach.file(’./screenshot/baidu.png’,attachment_type=allure.attachment_type.PNG) with allure.step(’關(guān)閉瀏覽器’):driver.quit()
執(zhí)行:
chenshifengdeMacBook-Pro:testcode chenshifeng$ pytest test_baidudemo.py --alluredir=./result --clean-alluredir -vs============================================================================= test session starts =============================================================================platform darwin -- Python 3.9.0, pytest-6.1.1, py-1.9.0, pluggy-0.13.1 -- /usr/local/bin/python3.9cachedir: .pytest_cacherootdir: /Users/chenshifeng/MyCode/PythonCode/SFDSZL/test_pytest, configfile: pytest.iniplugins: allure-pytest-2.8.18collected 3 items test_baidudemo.py::test_steps_demo[allure] PASSEDtest_baidudemo.py::test_steps_demo[pytest] PASSEDtest_baidudemo.py::test_steps_demo[unittest] PASSED============================================================================= 3 passed in 24.65s ==============================================================================chenshifengdeMacBook-Pro:testcode chenshifeng$ allure serve ./result Generating report to temp directory...Report successfully generated to /var/folders/p0/3_7fwrvx6n3ftpfd4wjb01300000gn/T/18005664130273264423/allure-reportStarting web server...2020-10-13 23:03:39.221:INFO::main: Logging initialized @7360ms to org.eclipse.jetty.util.log.StdErrLogServer started at <http://192.168.12.100:60775/>. Press <Ctrl+C> to exit
報告:
到此這篇關(guān)于python自動化之如何利用allure生成測試報告的文章就介紹到這了,更多相關(guān)python allure生成測試報告內(nèi)容請搜索好吧啦網(wǎng)以前的文章或繼續(xù)瀏覽下面的相關(guān)文章希望大家以后多多支持好吧啦網(wǎng)!
相關(guān)文章: