automated_testing_framework 5.0.0+14
automated_testing_framework: ^5.0.0+14 copied to clipboard
A testing framework that allows in app tests to be built and executed in an automated way.
5.0.0+14 May 2, 2023 #
- Automated dependency updates
5.0.0+13 April 25, 2023 #
- Automated dependency updates
5.0.0+12 April 18, 2023 #
- Automated dependency updates
5.0.0+11 April 11, 2023 #
- Automated dependency updates
5.0.0+10 April 4, 2023 #
- Automated dependency updates
5.0.0+9 March 28, 2023 #
- Automated dependency updates
5.0.0+8 March 21, 2023 #
- Automated dependency updates
5.0.0+7 March 14, 2023 #
- Automated dependency updates
5.0.0+6 March 7, 2023 #
- Automated dependency updates
5.0.0+5 February 28, 2023 #
- Automated dependency updates
5.0.0+4 February 21, 2023 #
- Automated dependency updates
5.0.0+3 February 14, 2023 #
- Automated dependency updates
5.0.0+2 February 7, 2023 #
- Automated dependency updates
5.0.0+1 January 31, 2023 #
- Automated dependency updates
5.0.0 January 24th, 2023 #
- Flutter 3.7 breaking changes
4.0.7+15 January 24, 2023 #
- Automated dependency updates
4.0.7+14 January 17, 2023 #
- Automated dependency updates
4.0.7+13 January 10, 2023 #
- Automated dependency updates
4.0.7+12 January 3, 2023 #
- Automated dependency updates
4.0.7+11 December 27, 2022 #
- Automated dependency updates
4.0.7+10 December 21, 2022 #
- Automated dependency updates
4.0.7+9 December 13, 2022 #
- Automated dependency updates
4.0.7+8 November 22, 2022 #
- Automated dependency updates
4.0.7+7 November 15, 2022 #
- Automated dependency updates
4.0.7+6 November 12th, 2022 #
- Dependency updates
4.0.7+5 October 18, 2022 #
- Automated dependency updates
4.0.7+4 October 11, 2022 #
- Automated dependency updates
4.0.7+3 September 27, 2022 #
- Automated dependency updates
4.0.7+2 September 20, 2022 #
- Automated dependency updates
4.0.7+1 August 30, 2022 #
- Automated dependency updates
4.0.7 August 24th, 2022 #
- Revert fix for Flutter 3.3 to restore 3.0 compatiblity
4.0.6 August 20th, 2022 #
- Minor changes to a few classes
4.0.5+1 August 16, 2022 #
- Automated dependency updates
4.0.5 August 11th, 2022 #
- Fix for updated
device_info_plus
4.0.4+2 August 9, 2022 #
- Automated dependency updates
4.0.4+1 August 2, 2022 #
- Automated dependency updates
4.0.4 August 1st, 2022 #
- Fix for finding a
Testable
4.0.3 July 28th, 2022 #
- Minor change to how the framework searches for a
Testable
.
4.0.2+1 July 26, 2022 #
- Automated dependency updates
4.0.2 July 14th, 2022 #
- Added more support to
TestDeviceInfoHelper
for not mobile platforms. - Added screenshot support for Web when on CanvasKit
4.0.1+8 July 12, 2022 #
- Automated dependency updates
4.0.1+7 July 5, 2022 #
- Automated dependency updates
4.0.1+6 June 28, 2022 #
- Automated dependency updates
4.0.1+5 June 21, 2022 #
- Automated dependency updates
4.0.1+4 June, 14, 2022 #
- Automated dependency updates
4.0.1+3 June, 7, 2022 #
- Automated dependency updates
4.0.1+2 May, 31, 2022 #
- Automated dependency updates
4.0.1+1 May, 30, 2022 #
- Automated dependency updates
4.0.1 May 18th, 2022 #
- Dependency updates
4.0.0 May 14th, 2022 #
- Flutter 3.0
3.3.1+1 April 16th, 2022 #
- Dependency updates
3.3.1 February 26th, 2022 #
- Fix for screenshot handler
3.3.0+1 February 16th, 2022 #
- Added
gestures
toTestableTextFormField
,TestableFormField
, andTestableDropdownButtonFormField
. - Swapped
device_info
fordevice_info_plus
- Dependency updates to latest
3.2.3 February 6th, 2022 #
- Flutter 2.10
3.2.2 January 17th, 2022 #
- Fixed possible race condition with
ResetNavigationStateMixin
.
3.2.1 January 10th, 2022 #
- Bug fixes
3.2.0 January 9th, 2022 #
- Deprecated
TestController.reset
in favor of a stream approach. - Created
ResetNavigationStateMixin
to simplify listening to reset requests and popping a page off the navigation stack. - Removed deprecated
setVariable
andremoveVariable
functions.
3.1.2 December 28th, 2021 #
- Fixed test imports
3.1.1+2 November 14th, 2021 #
- Removed
uses-material-design
from pubspec
3.1.1+1 September 27th, 2021 #
- Readme updates
3.1.1 September 26th, 2021 #
- Added
IoTestStore
- Fix for adding global variables to the
TestController
via the constructor
3.1.0+4 September 19th, 2021 #
- Dependency updates
3.1.0+3 September 18th, 2021 #
- Dependency updates
3.1.0+2 August 22nd, 2021 #
- Dependency updates
3.1.0 June 21st, 2021 #
- Added variable
disable_screenshot
that can be set on theTestController
to allow for disabling thescreenshot
step when set totrue
. - Updated the
TestController
to isolate variables set in a test vs set globally for the application. - Added
set_global_variable
,remove_global_variable
, andremove_variable
steps. - Added the ability to pin a step so that steps can be added anywhere in an already existing test vs always at the end.
- Fixed an issue where attempting to run a single step from an immediately loaded test would pop too far off the stack.
3.0.8 May 30th, 2021 #
- Added
assert_semantics
step
3.0.7+3 May 21st, 2021 #
- Dependency updates
3.0.7+2 May 17th, 2021 #
- Fix for
drag
step when setting onlydy
. - Updated to ensure
screenshot
always has a stable id from run to run.
3.0.7 May 11th, 2021 #
- Added
drag
step.
3.0.6+3 May 9th, 2021 #
- Added a new
VariableResolver
class to allow applications to pass in custom resolvers. - Added a new view that can render the test in a more Behavior Driven Development view.
3.0.5 April 30th, 2021 #
- Updated to Ack a run test command with the device info and startup status
3.0.4 April 22th, 2021 #
- Fix for
flash
for when the widget is removed before the flash animation is complete.
3.0.3 April 20th, 2021 #
- Minor fix so that when using the matcher a
ValueKey<String>
and aValueKey<String?>
will match correctly.
3.0.2 April 19th, 2021 #
- Added a comment test step
- Switched from using the
identifierForVendor
for iOS as the default device id for use with the test driver toUuid().v4()
to create a unique id in order to comply with: https://developer.apple.com/app-store/review/guidelines/#5.1.2
3.0.1+1 April 13th, 2021 #
- Added a listener to each step to update the status on driven tests.
3.0.1 April 7th, 2021 #
- Adjusted how the driver works to better clean up hanging driver sessions.
3.0.0 March 8th, 2021 #
- Null Safety
2.0.0 Februray 21st, 2021 #
- Added ability to cancel running tests.
- Upgraded to latest models that support more realtime test driving.
- Added test driver implementation that supports driving real timetime tests based off of communication sources.
1.3.4 January 19th, 2021 #
- Fixed deadlock issue with
flash
on theTestable
object when the widget is disposed in the middle of a flash call. - Fixed sort for available tests page.
- Fixed filter for available tests pages when there are more filters than fit vertically.
1.3.3+2 January 17th, 2021 #
- Dependency updates
1.3.3 January 10th, 2021 #
- Swapped old Flat / Raised buttons for new Text / Elevated ones.
1.3.2+1 January 9th, 2021 #
- Dependency updates
1.3.2 December 22nd, 2020 #
- Fix for
set_value
to support non-string variables.
1.3.1+2 December 22nd, 2020 #
- Documentation update only.
1.3.1+1 December 21st, 2020 #
- Fix to put "caseSensitive" in the toJson on
assert_error_step
andassert_value_step
.
1.3.1 December 21st, 2020 #
- Added "caseSensitive" as an option to
assert_error_step
andassert_value_step
.
1.3.0 December 13th, 2020 #
- Updated dependencies
1.2.18+3 November 3rd, 2020 #
- Updated to latest models
1.2.18+2 November 3rd, 2020 #
- Added timestamp to
TestSuiteReportPage
. - Moved common models out to a separate package.
1.2.18+1 October 28th, 2020 #
- Added
appIdentifier
toExternalTestDriver
andGoldenTestImages
id. - Added
TestAppSettings
.
1.2.18 October 28th, 2020 #
- Added
appIdentifier
toDrivableDevice
andTestDeviceInfo
.
1.2.17+5 October 21th, 2020 #
- Update to return the
TestSuiteReport
fromrunTests
andrunPendingTests
.
1.2.17+4 October 21th, 2020 #
- Switch from
autovalidate
toautovalidateMode
to match the direction Flutter is headed.
1.2.17+3 October 20th, 2020 #
- Fix for test controller stating it is running until the
TestSuiteReportPage
is dismissed
1.2.17+2 October 20th, 2020 #
- Minor fix for
Test.copyWith
when passing in a timestamp.
1.2.17+1 October 19th, 2020 #
- Minor fix for
TestDeviceInfo
to work with Windows builds. - Added Windows example.
1.2.17 October 18th, 2020 #
- Added flag so the
TestController.runningTest
will return true when either a single or multiple tests are running.
1.2.16+2 October 15th, 2020 #
- Added equals, hash, and id property to
GoldenTestImages
.
1.2.16+1 October 15th, 2020 #
- Added equals and hash code to
DrivableDevice
andExternalTestDriver
. - Added id generator util functions to
GoldenTestImages
.
1.2.16 October 12th, 2020 #
- Added
_platform
reserved variable. - Added
driverName
toDrivableDevice
.
1.2.15+1 October 11th, 2020 #
- Added the build number to the test suite report page.
1.2.15 October 11th, 2020 #
- Fixed an issue with the screen capture request that could result in the wrong image size.
1.2.14+3 October 11th, 2020 #
- Added
timestamp
toGoldenTestImages
.
1.2.14+2 October 10th, 2020 #
- Fixed a bug with the
TestSuiteReport
andTestReport
when plugins are using the substep feature.
1.2.14+1 October 10th, 2020 #
- Added
timestamp
toTest
.
1.2.14 October 8th, 2020 #
- Improved error message from
assert_value
- Fixed an issue with single variable return from the new variable interpolation code.
1.2.13 October 7th, 2020 #
- Upgraded the variable interpolation to search for variables in substrings rather than requiring them to be the whole string.
1.2.12 October 7th, 2020 #
- Swapped out
crypto
withpointycastle
. - Fixed driver signatures for web apps.
1.2.11+1 October 6th, 2020 #
- Minor update to disable the global overlay while tests are running.
1.2.11 October 5th, 2020 #
- Data model updates to the external test runner framework.
1.2.10 October 3rd, 2020 #
- Added ability to register a custom route to the
TestStepRegistry
and have that route be presented as an option onTestStepsDialog
andTestStepsPage
. - Added variable for
_now
to return the currentDateTime
. - Fixed bug in
TestStepForm
in the dropdown form when values aren't strings. - Beginning of external test driver capabilities
1.2.8+2 September 29th, 2020 #
- Null fix for suite name on test reports
1.2.8+1 September 29th, 2020 #
- UI only tweaks to the test editor and report pages
1.2.8 September 29th, 2020 #
- Minor fix for available tests page when tests in different suites have the same name.
1.2.7 September 28th, 2020 #
- Minor fixes for nulls where the forms from the framework are used outside of a testable application.
1.2.6+3 September 25th, 2020 #
- Fix for monospace fonts to be
monospaced
as opposed to the incorrectmonospace
.
1.2.6+2 September 24th, 2020 #
- Actually checked in the
fromDynamic
on theTestReport
1.2.6+1 September 24th, 2020 #
- Minor fix to pass
ignoreImageData
properly fromTestReport
to theTestImage
list.
1.2.6 September 24th, 2020 #
- Added in
_passing
variable so tests can "sense" when the previous steps are passing. - Updated both
TestReport
andTestImage
to utilizeJsonClass
to be self "json-able". - Added optional
stopOnFirstFail
toTestController
to stop tests on the first failed step.
1.2.5 September 23rd, 2020 #
- Added a flag for
subStep
so plugins can identify steps w/in steps on theTestReport
. - Added optional
screenshotOnFail
flag to theTestController
to automatically take a screenshot when a test step fails.
1.2.4+1 September 23rd, 2020 #
- Fixed
TestStepPicker
on discard changes.
1.2.4 September 23rd, 2020 #
- Fix for reversing height / width in
TestDeviceInfo
.
1.2.3 September 22nd, 2020 #
- Refactored
executeStep
out of theexecute
function in theTestController
so plugins can execute sub-steps while ensuring those steps are part of the final report. - Removed
skipScreenshots
because it was causing more problems than it solved. If screenshots need to be conditionally skipped, the flow control plugin can do that via theconditional
step. - Updated
TestReport
to guarantee steps are kept in order of start rather than end. - Fixed issue in
TestStepPicker
that prevented it from showing the selected step.
1.2.2 September 22nd, 2020 #
- Adding
id
toTestDeviceInfo
.
1.2.1+1 September 21st, 2020 #
- Updated the example to the latest.
1.2.1 September 21st, 2020 #
- Updated the
screenshot
step to support an id and added the id to theTestReport
. - Added "captureImage" capability to the
Testable
to allow capturing images of just that widget. - Added "hide" and "obscure" capability to the
Testable
so it can self-obscure dynamic widgets for golden screenshots. - Added capability for saving and loading golden images.
1.2.0+1 September 19th, 2020 #
- Updated the example to the latest.
1.2.0 September 19th, 2020 #
- Added the concept of test suites to the framework.
1.1.1 September 15th, 2020 #
- Exposed the
TestStepRegistry
to via theTestController
. - Changed from
key
tovariableName
on theset_variable
step, but still acceptkey
for compatibility.
1.1.0 September 14th, 2020 #
- Changed "minified" test steps render on the Current Test Steps page to allow for drag-and-drop too.
- Added variable support to the test steps.
- Added
set_variable
step. - Added ability to attach appplication logs to the
TestReport
. - Swapped attributes on the ios device info to get better data.
1.0.5+1 September 13th, 2020 #
- Updated README with references to the newly available plugins.
1.0.5 September 12th, 2020 #
- Added logging to when a
TestStep
fails. - Added screenshots to the
TestReport
page.
1.0.4 September 11th, 2020 #
- Added example for
linux
.
1.0.3 September 9th, 2020 #
- Updated
TestStep
to be able to copy w/o the image. - Added
AsyncTestLoader
to provide more test loading options. - Updated with device info on the test reports.
- Switched static
AssetTestStore
to an instance to better follow the object model.
1.0.2 September 7th, 2020 #
- Added
exit_app
step - Added image capture support to Desktop. Web is still unsupported.
- Added support for secondary tap / secondary long-press.
- Extracted the core example code to a new package to allow it to be reused across plugins.
1.0.1 September 3rd, 2020 #
- Brought in the minimal amount of
flutter_test
to remove the dependency of the SDK version due to incompatibilities between Flutter 1.20 / 1.21. - Added Web and MacOS to the example app.
- Note: image capture is not supported in Flutter outside of iOS and Android currently.
1.0.0 September 2nd, 2020 #
- Fix for typo in the EnsureExists registry.
- Updated
AssetTestStore
to support an index file or a list of individual files. - Added added ability to pass a
Theme
to theTestRunner
to give the test framework a unique theme vs the rest of the app. - Reformatted the TestReport page to provide more useful information.
- Added a "minify test steps" option to the Test Steps page to make reordering easier.
- Added a
TestSuiteReportPage
to display a summary of all the test results in a test suite run.
0.2.3 September 1st, 2020 #
- Fix to disable Quick Add in the test steps page when a step doesn't support it.
- Fix to not submit a report at the end of an individual step run.
- Fix for when values passed to a
Testable
are types other thanString
. - Fix for running individual steps from the
TestStepPage
that was opened via the dialog. - Accept a null or empty id on
Testable
as a way to disable it.
0.2.2 September 1st, 2020 #
- Added LongPress tests support.
- Implemented
pump
function inoverride_widget_tester.dart
. - Added
widgetLongPressMoveUpdate
testable gesture.
0.2.1 September 1st, 2020 #
- Fix to make the registry optional on
TestController
, as was originally intended.
0.2.0 August 30th, 2020 #
- More documentation updates.
- Removed the
FileTestStore
to preserve web compatibility in the core framework.
0.1.2 August 25th, 2020 #
- More documentation updates.
- Update to auto-run the example tests in
profile
mode. - Updated to a more memory efficient way to load all tests for running.
0.1.1 August 22nd, 2020 #
- Lots of documentation updates; tentatively ready for production use.
0.1.0 August 21st, 2020 #
- First public release; not for production use.