Anu George

1578810666

12 Latest Test Automation Trends To Look For In 2020

#testautomation #testing #softwaretesting #devops #agile

What is GEEK

Buddha Community

12 Latest Test Automation Trends To Look For In 2020
Aurelie  Block

Aurelie Block

1598916060

Top 10 Automation Testing Tools: 2020 Edition

The demand for delivering quality software faster — or “Quality at Speed” — requires organizations to search for solutions in Agile, continuous integration (CI), and DevOps methodologies. Test automation is an essential part of these aspects. The latest World Quality Report 2018–2019 suggests that test automation is the biggest bottleneck to deliver “Quality at Speed,” as it is an enabler of successful Agile and DevOps adoption.

Test automation cannot be realized without good tools; as they determine how automation is performed and whether the benefits of automation can be delivered. Test automation tools is a crucial component in the DevOps toolchain. The current test automation trends have increased in applying artificial intelligence and machine learning (AI/ML) to offer advanced capabilities for test optimization, intelligent test generation, execution, and reporting. It will be worthwhile to understand which tools are best poised to take advantage of these trends.****

#automation-testing #automation-testing-tools #testing #testing-tools #selenium #open-source #test-automation #automated-testing

Mikel  Okuneva

Mikel Okuneva

1596793726

Where To Learn Test Programming — July 2020 Edition

What do you do when you have lots of free time on your hands? Why not learn test programming strategies and approaches?

When you’re looking for places to learn test programming, Test Automation University has you covered. From API testing through visual validation, you can hone your skills and learn new approaches on TAU.

We introduced five new TAU courses from April through June, and each of them can help you expand your knowledge, learn a new approach, and improve your craft as a test automation engineer. They are:

These courses add to the other three courses we introduced in January through March 2020:

  • IntelliJ for Test Automation Engineers (3 hrs 41 min)
  • Cucumber with JavaScript (1 hr 22 min)
  • Python Programming (2 hrs)

Each of these courses can give you a new set of skills.

Let’s look at each in a little detail.

Mobile Automation With Appium in JavaScript

Orane Findley teaches Mobile Automation with Appium in JavaScript. Orane walks through all the basics of Appium, starting with what it is and where it runs.

javascript

“Appium is an open-source tool for automating native, web, and hybrid applications on different platforms.”

In the introduction, Orane describes the course parts:

  • Setup and Dependencies — installing Appium and setting up your first project
  • Working with elements by finding them, sending values, clicking, and submitting
  • Creating sessions, changing screen orientations, and taking screenshots
  • Timing, including TimeOuts and Implicit Waits
  • Collecting attributes and data from an element
  • Selecting and using element states
  • Reviewing everything to make it all make sense

The first chapter, broken into five parts, gets your system ready for the rest of the course. You’ll download and install a Java Developer Kit, a stable version of Node.js, Android Studio and Emulator (for a mobile device emulator), Visual Studio Code for an IDE, Appium Server, and a sample Appium Android Package Kit. If you get into trouble, you can use the Test Automation University Slack channel to get help from Orane. Each subchapter contains the links to get to the proper software. Finally, Orane has you customize your configuration for the course project.

Chapter 2 deals with elements and screen interactions for your app. You can find elements on the page, interact with those elements, and scroll the page to make other elements visible. Orane breaks the chapter into three distinct subchapters so you can become competent with each part of finding, scrolling, and interacting with the app. The quiz comes at the end of the third subchapter.

The remaining chapters each deal with specific bullets listed above: sessions and screen capture, timing, element attributes, and using element states. The final summary chapter ensures you have internalized the key takeaways from the course. Each of these chapters includes its quiz.

When you complete this course successfully, you will have both a certificate of completion and the code infrastructure available on your system to start testing mobile apps using Appium.

Selenium WebDriver With Python

Andrew Knight, who blogs as The Automation Panda, teaches the course on Selenium WebDriver with Python. As Andrew points out, Python has become a popular language for test automation. If you don’t know Python at all, he points you to Jess Ingrassellino’s great course, Python for Test Programming, also on Test Automation University.

Se

In the first chapter, Andrew has you write your first test. Not in Python, but Gherkin. If you have never used Gherkin syntax, it helps you structure your tests in pseudocode that you can translate into any language of your choice. Andrew points out that it’s important to write your test steps before you write test code — and Gherkin makes this process straightforward.

first test case

The second chapter goes through setting up a pytest, the test framework Andrew uses. He assumes you already have Python 3.8 installed. Depending on your machine, you may need to do some work (Macs come with Python 2.7.16 installed, which is old and won’t work. Andrew also goes through the pip package manager to install pipenv. He gives you a GitHub link to his test code for the project. And, finally, he creates a test using the Gherkin codes as comments to show you how a test runs in pytest.

In the third chapter, you set up Selenium Webdriver to work with specific browsers, then create your test fixture in the pytest. Andrew reminds you to download the appropriate browser driver for the browser you want to test — for example, chromedriver to drive Chrome and geckodriver to drive Firefox. Once you use pipenv to install Selenium, you begin your test fixture. One thing to remember is to call an explicit quit for your webdriver after a test.

Chapter 4 goes through page objects, and how you abstract page object details to simplify your test structure. Chapter 5 goes through element locator structures and how to use these in Python. And, in Chapter 6, Andrew goes through some common webdriver calls and how to use them in your tests. These first six chapters cover the basics of testing with Python and Selenium.

Now that you have the basics down, the final three chapters review some advanced ideas: testing with multiple browsers, handling race conditions, and running your tests in parallel. This course gives you specific skills around Python and Selenium on top of what you can get from the Python for Test Programming course.

#tutorial #performance #testing #automation #test automation #automated testing #visual testing #visual testing best practices #testing tutorial

Alayna  Rippin

Alayna Rippin

1597161600

Accelerate Test Execution With Self-Healing Mechanism

In recent years, the testing community has witnessed a steady rise in automation testing. Although it has proved significant advantages compared to manual testing, flakiness in locating objects for WebUI testing is still a constant problem that restrains the transition to automated testing for teams. Testers have to spend unnecessary time and effort to manually update the object locators whenever they make new changes to the application.

The Self-healing mechanism is one of the most promising factors to completely change the automation Web testing. By eliminating unnecessary repetitive tasks in execution, this mechanism creates the foundation for test automation to perform at its full potential.

Object Locator Flakiness — A Constant Challenge in Test Automation

Object locator flakiness comes from the root of automation itself: fragile test scripts. Object locators, most often, can no longer identify the target element after the application under test (AUT) changes. Pre-written scripts then will fail to run the test correctly, which results in a false failed result. The QA team has to detect whether their tests fail because they actually have a problem, or the scripts cannot adapt to new element changes. Web testing, in which UI changes happen over and over, appears to suffer the most from this flakiness.

To maximize the speed advantage of automation testing, automation testers demand a mechanism that can recognize and skip these UI changes to keep the scripts running seamlessly. For automation testers, Self-healing function has turned out to be the optimal solution for this pain point.

What Is Self-Healing Automation? Why Is it Important?

Self-Healing Capability: A Definition

The human body is a perfect example to explain the self-healing mechanism. Whenever a human gets injured, the human self-healing function is triggered to find the wound and heal it without any action needed. For any minor injuries, this mechanism can quickly heal wounds without human intervention.

Back to self-healing automation in software testing, it functions exactly like the way the human body works. Based on the object changes in properties, the self-healing mechanism actively studies the characteristics and properties of all available objects, removing similar objects on the page and comparing their historical data. Then, the test engine will automatically pick up an alternative that best assembles the changed locator to keep the test running.

How Does Self-Healing Capability Benefit Test Automation?

Self-healing has been a desirable solution to solve one major challenge of automation testing: Quality at speed.

By identifying new changes and replacing them with similar objects, the self-healing mechanism reduces downtime and significantly speeds up the deployment process. With this capability, QA teams can release the burden of intense script maintenance, and save time and resources.

Additionally, a well-built self-healing mechanism gives QA teams the ability to create generic test frameworks that can apply to a broad range of software, improving the benefits of automation.

More and more automation tools have developed self-healing as an essential part of the tool in response to this enormous demand. Many experts expect that self-healing will become less of a nice-to-have function but a must-have for all automation tools in the near future.

In their latest update — version 7.6 — Katalon Studio company has introduced the new self-healing mechanism to its users. This function allows users to speed up processes and maximize automation efforts for the whole team.

See what’s new in Katalon Studio.

How Katalon Studio’s Self-Healing Capability Enhances Automation Processes

Before the updated version was released, Katalon Studio users were familiar with its Auto-healing Smart XPath. This plugin assists in recovering broken default locators by trying other available XPath alternatives. However, in case there are no suitable alternatives available, the execution will stop running.

To advance its process and provide users with more efficient test maintenance, Katalon Studio developed the Self-healing mechanism that has been released lately. Following the positive impacts of Smart XPath, the self-healing mechanism is made to be more robust and comprehensive to tackle broken locators during each execution.

Get to Know the Self-Healing Mechanism in Katalon Studio

During the execution, if Katalon Studio fails to identify an object with its default locator, the tool tries other pre-configured locators associated with that object. With 4 selection methods, including XPath, Attributes CSS, and image, users can opt to set the object locating priority to ensure accuracy and continuity of the execution.

If Katalon finds a suitable object within the selectors, the test keeps running to completion. With approval from the tester, the locator that is selected to replace the broken object will then be saved for that particular Test Object in future executions. By doing so, Katalon Studio creates a database to make the self-healing mechanism even more efficient by avoiding analyzing one same broken object repeatedly.

Once the execution is over, Katalon Studio will suggest replacing all broken locators with the locators having found the objects. If Katalon Studio cannot find the target objects, the test will either continue or stop running, depending on how users designed the failure handling option.

How to Execute Tests Using Self-Healing Mechanism in Katalon Studio

Requirements:

  • Katalon Studio version 7.6 onwards
  • An active Katalon Studio Enterprise license

In a Katalon Studio project, you can find a screen in project settings dedicated to Self-healing. You can change the default settings to make the utility better suit your needs.

The self-healing mode is activated by default whenever users run the application. To open the Self-healing window, go to Project/Settings/Self-Healing/Web UI.

Configure Test Design

To start with Katalon Studio’s self-healing, users need to set initial settings to decide the default selection method used during spying and recording. Please note that for Image selection, screenshots for the objects are mandatory.

Go to Project/Settings/Self-healing/Web UI/Test Design to set the default selection method.

test design

Configure Self-Healing Execution

Users can decide which alternative locators to be used in terms of selection methods and their priorities in Project/Settings/Self-Healing/Web UI/ Test Execution.

test execution

This predefined order will be applied when Katalon fails to locate the target objects.

All the replacements are recorded in Self-healing Insights when the execution is over. Katalon Studio allows users to decide which alternative locators to be used in terms of selection methods and their priorities.

To read the full tutorial and sample project using the self-healing mechanism, you can visit Katalon’s Document hub here.

Conclusion

With this upgraded Self-healing mechanism, Web testing is made faster and easier as it reduces human efforts on script maintenance with less interruption. This is a valuable addition for Katalon users to have a more powerful automation experience with consistent results.

To try out this new functionality, sign up on the Katalon website with your business email and get a 30-day free trial with full functions in the latest Katalon Studio!

#devops #software testing #automated testing #automation testing #update #software test automation #xpath #automation tools #software testing 2020 #object locator

Mikel  Okuneva

Mikel Okuneva

1596797400

Measure Your Test Automation Maturity

I’m a Developer Advocate and one of the things I love most about my role is that I travel all of over the world — meeting and consulting with engineering teams, and discussing the challenges that they face.

One thing that I’ve realized about building quality software is…the struggle is real!

Everyone is trying to figure out how to rapidly-produce software that is yet of high quality. So we did some research (shout out to Moshe Milman who helped with this effort) and gathered best practices from some of the top companies in software, financial services, healthcare, gaming, and entertainment verticals and I’ll share with you what these innovative development teams are doing to achieve great levels of success with their test automation initiatives.

As I go through the points of research, feel free to grade your team’s maturity in that respective area. By the end of the article, you’ll have your Test Automation Maturity Level.

Automated Tests

100% of companies researched automate their tests

For starters, 100% of the companies we researched employ automated tests to expedite their release cycles. When the goal is to release software on a continuous cycle, test automation is a must-have. There simply isn’t enough time to manually test every new feature as well as manually execute regression tests to make sure existing functionality isn’t broken. So these teams invest an extensive amount of effort into automating their tests so that they are confident in their product each time they deploy.

Percentages showing who on the team is responsible for writing tests

I know from personal experience how difficult it is for developers to find the time to write tests and also how difficult it is to have test teams write the code to automate tests, so we inquired about this a bit more to determine how are teams overcoming these challenges.

Every single one of these companies has its developers involved in writing tests. Many of them said their developers take care of the unit tests, while the QA team is responsible for writing the integration and end-to-end tests.

A whopping 60% of the teams shared that they no longer have the distinction between development and QA engineers, and instead have hybrid engineers. Their goal here is to have developers own ALL the testing of their code, as well as the triaging and maintenance of those tests.

What they discovered is what I already know — developers aren’t the best at this. There’s not much time, and frankly not much interest from developers to go beyond writing their unit tests. So, many of these teams have had to bring in qualified experts to help out.

I dug a bit more to learn how exactly the Quality Advocates are assisting here. We got a variety of answers but here were some of the common ones:

  • Write test infrastructure
  • Coach developers on how to write better tests
  • Develop a testing strategy

Let’s discuss each of these…

Write Test Infrastructure

The Quality Advocates find the best testing libraries, create the test automation codebase, and all of the utility functionality the developers will need to write their tests. That way it’s not much overhead for the developers. The developers can just focus on cranking their tests out.

Coach Developers

Unfortunately, many of the Computer Science and Bootcamp programs that graduated your developers did not teach them how to test. This is a huge hurdle for developers who may have good intentions and want to test their code. They may not ever share this with you, but a LOT of the developers that I speak with simply don’t know how to test. These quality advocates specialize in this stuff and can help the developers think of scenarios, as well as teach them how to write good tests. If you think this may be a problem for your developers and you don’t have a quality advocate just yet, send them to Test Automation University which is an online learning platform that provides free courses on this very thing.

Develop Testing Strategies

Finally, quality advocates develop testing strategies for the team. They help them assess risk and come up with a plan of attack on what should be tested and how thoroughly.

They also have a big picture view which is greatly needed because your developers are zoned in on their features and their tests. Someone needs to consider how these features interact with one another so that more sophisticated tests can be developed.

Someone also needs to strategize on which tests automatically run given certain pull requests. The advocate can help with that.

The quality advocates also help keep the test suites relevant by pruning out tests that are no longer of high business value.

Criteria: Does Your Team Automate Any Test?

If your team automates _any _tests at all, go ahead and give yourself 10 points!

criteria

Types of Automated Tests

We wanted to make sure that we were talking about more than unit tests here, so we inquired about which tests the companies automated.

  • Every one of these companies automated their unit, web, and API tests.
  • 80% of the companies who develop mobile apps automated their mobile tests.
  • 80% of companies create reusable web design components and automated tests for those.
  • However, there was very little effort by the core development teams to automate non-functional tests. Areas like security, performance, and accessibility testing were mostly handled by separate groups, like the Center of Excellences.

Criteria: Which Type of Tests Do You Automate?

Give yourself 10 points for each of the types you automate: unit, web/mobile, API, security, performance, and accessibility. If your team does not develop mobile apps, just give yourself 10 points so that you don’t have a deficit. The same goes for if your company does not develop web apps or APIs.

criteria and points

Programming Languages

I did some research last year on the top programming languages used in test automation. This included all sorts of companies, not just the mature top dogs. The vast majority of teams are using Java (44%) and while JavaScript was on the rise and came in at #2, it was still only 15%.

This was interesting compared to what the top dogs are using. ALL of them use JavaScript! Some have teams that use other languages in addition to JavaScript for things like native mobile testing and APIs, but for their web apps, it’s JavaScript.

Programming languages used for test automation

I inquired why this is and they explained that their web developers are JavaScript programmers. Some companies even said they had legacy test frameworks built in other languages and their devs wouldn’t touch it! When they switched to JavaScript, the developers became more engaged.

I found this interesting because it aligns with what some thought leaders have been preaching for years. I’ll admit, I’ve been a bit stubborn over my career and I tend to go for the language that the automation will be most comfortable in but it seems perhaps I need to rethink that when I want the developers to contribute.

And to be fair, JavaScript automation tools have gotten much better in recent years…which brings me to the next point of research…

#tutorial #performance #testing #programming #automation #test automation #automated testing #qa #automated testing best practices

Kole  Haag

Kole Haag

1598338800

Review — Automated Visual Testing With WebdriverIO

I took Nyran Moodie’s course on Test Automation UniversityAutomated Visual Testing with WebdriverIO.

If you want the explicit link to the course, here it is https://testautomationu.applitools.com/automated-visual-testing-javascript-webdriverio/index.html.

Course Introduction

If you use WebdriverIO regularly, and you are unfamiliar with the basics of using Applitools for automated visual testing, you will appreciate this course. Nyran focuses you on how to add visual test automation with Applitools to your WebdriverIO tests.

Nyran expects you to know WebdriverIO. If you want to learn WebdriverIO, check out Julia Pottinger’s excellent course — UI Automation with WebdriverIO on Test Automation University.

Nyran uses JavaScript for his examples and Visual Studio Code as his IDE. In case you didn’t know, you can use Applitools with a range of test languages. No matter what your test language of choice or IDE, I think you will find Nyran’s code and coding approach fairly intuitive.

Course Structure

Nyran breaks the course into eight main chapters. He gives this description in the course overview:

  • 1 — I am going to start by giving you an introduction to visual testing.
  • 2 — We are going to look at how we can get our environment set up to start using Applitools eyes.
  • 3 — We are going to create and run our first visual test using Applitools
  • 4 — I want to introduce you to the different match levels that Applitools has and the concept of viewport sizes
  • 5 — I will be talking about checkpoints.
  • 6 — I will be looking at how we can organize our visual tests using batches
  • 7 — We will look at how we can analyze our test results using the Test Manager.
  • 8 — We will be looking at the integration and collaborations that Applitools provides.

Each of these chapters provides a methodical approach to getting going with Applitools. I’ll give a quick overview of each.

If you read this review or take the course, you know why visual testing. Your UI and end-to-end tests result in the rendered output. You can write all the functional tests that grab locators, enter data, effect action, and cause the appropriate output locators to have the appropriate values. But, until you look at the result, you cannot tell if the input and output conform to design and usability expectations.

Nyran did not explain the most frequently-experienced reason for visual testing — unintended consequences of code changes over time. Our experience shows us that most expected application changes get tested, but unintended changes cause problems.

Nyran does a nice job explaining how to get started. You need an Applitools API key, which you can get from the Applitools console. Nyran explains why you set up a local environment variable for your API key (so you do not need to include your API key in your test code directly). He also points to the GitHub repo he uses for all the examples in the course.

Chapter 3 involves the first coding examples for setting up Applitools. With a simple:

npm install @applitools/eyes.webdriverio

You get the the node instructions for installing the Applitools Eyes to your WebdriverIO setup. After this, you can install the Applitools Eyes service to your tests. He shows code examples of what test code looks like when calling Applitools:

appitools

#performance #testing #automation #automated testing #webdriver #visual testing #automated testing best practices #webdriver io #ui automation tools